In our day-to-day life most of the task we carry out involves speaking and hearing. The deaf and dumb people have difficulty in communicating with others who cannot understand sign language and mis interpreters. In this project; we designed a simple embedded system-based device for solving this problem. The main aim of this project is to design and construct a hand talk system which different voices can be announced along with home automation and heartbeat monitoring using five flex sensors, MEMS and heartbeat sensors. The status of the project will display on LCD module. In this project we design a smart glove which is works in two modes like voice and device. We are using ADXL335 MEMS sensor to select the mode either voice or device switching. Glove section: MEMS sensor, five flex sensors, HEARTBEAT sensor, voice module, LCD display and zigbee transmitter is interfaced to the Arduino nano. Device section: Two devices along with relays and zigbee receiver module are interfaced to the PIC Microcontroller. The modules which are connected wirelessly using ZIGBEE wireless communication. Once the glove is placed in the hands, whenever an action for sign language is performed, the bending values are transmits and received by the corresponding action is identified by the microcontroller. It activates the voice chipAPR33A3 and the corresponding voice is spelled in speaker. It will monitor the person’s heartbeat using pulse sensor and display on LCD module. Same operation can be done to the device switching. By using this project we are announcing 8 voices and operate two devices. The main controlling device of the project is Arduino nano and PIC Microcontroller which is loaded program written in embedded C language. This flex sensor is a unique component that changes resistance in proportion to the degree it is bent.  The sensor when lying flat has a nominal resistance. As the flex sensor is bent the resistance increases in proportion. This device is very helpful for paralysis and physically challenged persons.

 

The main objectives of the project are:

• Hand Gestured based device switching and voice announcing using flex sensors.
• MEMS based mode selection.
• Heartbeat monitoring system.
• Wireless communication using ZIGBEE wireless technology.
• Using apr33a3 voice module to request their voices/needs.
• Electromechanical relay-based device switching.
• To achieve this task using Arduino NANO and PIC Microcontroller.

This project provides us with the learning’s on the following aspects:

1. Characteristics of Flex sensor
2. Interfacing of mems sensor with Microcontroller.
3. Appliances interfacing with the microcontroller.
4. Voice module.
5. Pulse sensor working.
6. Relay working.
7. Zigbee wireless communication.
8. Embedded C programming.

The major building blocks of this project are:

• 9v Battery power supply.
• Arduino nano.
• PIC microcontroller.
• Zigbee wireless communication.
• Flex sensors.
• MEMS sensor.
• Voice circuit.
• Relays.
• Devices (light, fan).
• LCD display.

Software’s used:

1. Arduino ide studio dumping code into Microcontroller.
2. Embedded C language.
3. Express SCH for Circuit design.

     

     

Block diagram:    

     

   

   

   

 

video: