ISSN ONLINE(2319-8753)PRINT(2347-6710)

All submissions of the EM system will be redirected to Online Manuscript Submission System. Authors are requested to submit articles directly to Online Manuscript Submission System of respective journal.

Speaking Gloves for Speechless Persons

Abjhijt Auti, V. G. Puranik, Dr. A. K. Kureshi
  1. Dept. of E & TC, Vishwabharti Academy`s College of Engineering, Ahmednagar, Maharastra, India
  2. Dept. of E & TC., Vishwabharti Academy`s College of Engineering, Ahmednagar, Maharastra, India
  3. Dept. of E & TC., Vishwabharti Academy`s College of Engineering, Ahmednagar, Maharastra, India
Related article at Pubmed, Scholar Google

Visit for more related articles at International Journal of Innovative Research in Science, Engineering and Technology

Abstract

The main aim of the paper is to develop Electronic Speaking Glove, designed to facilitate an easy communication through synthesized speech for the benefit of speechless patients. Generally, a speechless person communicates through sign language which is not understood by the majority of people. The proposed system is designed to solve this problem. Gestures of fingers of a user of this glove will be converted into synthesized speech to convey an audible message to others, for example in a critical communication with doctors. The glove is internally equipped with multiple flex sensors that are made up of “bend-sensitive resistance elements”. For each specific gesture, internal flex sensors produce a proportional change in resistance of various elements. The processing of this information sends a unique set of signals to the PIC microcontroller and speaks jet IC which is pre-programmed to speak desired sentences. In recent years, researchers have been focusing on hand gestures detections and been popular for developing applications in the field of robotics and extended in the area of artificial or prosthetic hands that can mimic the behaviour of a natural human hand.

Keywords

Fully embedded, Portable, Less weight, Single Li-ion battery for longer operation, Low power consumption, less hardware, Robust

INTRODUCTION

How frequently do we meet a speechless patient in normal life? How visible are they in offices or behind shop counters? The truth is that there is often little room for these people in the workplaces. In recent years, researchers have been focusing on hand gestures detections and been popular for developing applications in the field of robotics and extended in the area of artificial or prosthetic hands that can mimic the behaviour of a natural human hand. This paper although utilizes a similar approach for the detection of the movement of fingers, however I have tried to extrapolate the idea in a slightly different perspective and have come up with a small yet significant application in the field of bioengineering. This paper is useful for the deaf and dumb, it can also be used for the (speechless) patients with half of their bodies paralysed and who are not able to speak but are able to move their fingers. The aims and objectives of this research work include [1]:
• Basic object of this paper is to design a portable embedded system
Developing an economical and simple solution for the detection of finger gestures
• Cost effective, reliable data acquiring method and signal conditioning

DATA ACQUISITION METHODS

To start with our research, on obtaining a bio-signal from the fingers, which require obtaining a signal proportional to the movement of the fingers? Fingers are able to interpret different hand gestures, research showed that many haptic devices used in prosthesis utilized the conventional method of using EMG signals.
Following is the list of possible methods which could be used to sense the hand's movements [2]: (discussing each one of them in detail will be beyond the scope of this paper)
EMG (Electromyography)
MMG (Mechanomyogram
Load cell
Wearable conductive fiber
Deterioration of fiber optic cable
Sliding fiber optic cable
Strain gauge tactile sensor
Flex Sensor
After analysing all of the above methods for signal acquisition the best solution to use flex sensor in this paper as it is comparatively reliable and a cost effective solution

A. FLEX SENSORS

image
Fig.2.1. Flex Sensors [1]
Flex sensors [3] change in resistance depending upon the amount of bend on the sensor as shown in Fig.2.1 They convert the change in bend to electrical resistance - the more the bend, the more will be the resistance value. They are usually in the form of a thin strip from 1 "-5" long that vary in resistance from approximately 10KΩ to 50KΩ. They are frequently used in gloves to sense finger movement. The flex sensors are used as input and are placed inside the glove that is to be worn. The sensor is so flexible that it bends easily even with a small bend. As it is very thin and light weight so it is also very comfortable.
Inside the flex sensor are carbon resistive elements within a thin flexible substrate. When the substrate is bent the sensor produces a resistance output relative to the bend radius. Pragmatically deflection of 00, 200, 400, 450, 500, 700 and 900 will give 10KΩ, 14.5 KΩ, 18.8 KΩ, 20 KΩ, 21.1 KΩ, 25.5 KΩ and 30 KΩ of resistances respectively. Its relation is shown in Fig. 2.2
image
Fig. 2.2 Relation between Bend and Resistance

SYSTEM MODELLING

A. SYSTEM BLOCK DIAGRAM AND FLOWCHART

image
image

B. SIGNAL CONDITIONING

It has been done by the circuit shown in Fig.3.2.1 Supply voltage is applied on the divider circuit having 51 KΩ resistance in series with flex sensor as load resistance. When it is bent, its resistance increases that causes increase in voltage on it which is an analog voltage change. That is fed to voltage follower; an operational amplifier (LM324, which is recommended by the flex sensor manufacturer) has been used to boost-up the circuit current, which makes it comprehensible for the PIC microcontroller to proceed further.
image
Fig. 3.2.1 Flex Sensor Signal Conditioning Circuit [1]
The corresponding values of graph which is output of Fig. 3.2.2 Calculations are as following: Formula for voltage divider circuit:
image
image
image
Fig. 3.2.2 Signal Conditioning Graph (Deflection vs. Voltage)

C. PIC18F4620

The output of the signal conditioning block is fed to PIC18F4620 (Operating Voltage range 4.2 - 5.5V) on PORTA and PORTE/PORTB that is used as analog input for built-in ADC (Analog to Digital Converter).. It has 10-bit built-in ADC which convert it into digital form i.e. (binary data). Similarly, it takes data from each finger and accumulates all five fingers data in five 8-bit registers, another bit-addressable register is used to store cumulative data in five bits dedicated for five fingers which consequently gives 32 combinations. Every number which is detected by hand gestures that can be seen in Table II has predefined meaning a certain 8-bit code for particular message is sent to aIVR341N block. This block can be seen in Fig. 3.1

D. aIVR341N

Aplus’ aIVR341N is a 8-bit MCU based Voice chip. It is fabricated with Standard CMOS process with embedded voice storage memory. It can store 341sec voice message with 4-bit ADPCM compression at 6KHz sampling rate. 8- bit PCM is also available as user selectable option to improve sound quality. There are up to fifteen programmable I/O pins. Key trigger and Parallel CPU trigger mode can be configured according to different application requirement. User selectable triggering and output signal options provide maximum flexibility to various applications. Built-in resistor controlled oscillator, 9-bit resolution current mode D/A output and PWM direct speaker driving minimize the number of external components. Volume control for both DAC and VOUT output is available.

E. SIGNAL AMPLIFICATION

The recorded voice output from aIVR341N is not much audible to human ears therefore; it is fed to an amplifier (LM386 Y,1/4 W) that enhances its volume. It is configured at the gain of 200 that makes it quite natural to human ears; an 8Ω speaker is used to get the final output.

III. GESTURES AND MESSAGES ACCORDINGLY

image
So far thirty two messages have been programmed for thirty two gestures; maximum 243 messages can be programmed as we have three bends sequence and it can be applied to five fingers but will be difficult for user to use it precisely.

CONCLUSIONS

1. This paper is a useful tool for speech impaired and partially paralysed patients which fill the communication gap between patients, doctors and relatives.
2. This paper will give dumb a voice to speak for their needs and to express their gestures.
3. As it is portable, requires low power operating on a single lithium-ion rechargeable battery and having less weight and robust give patient liberty to carry it anywhere at their will.

ACKNOWLEDGMENT

This investigation was supported by the department of Electronics & Telecommunication Engineering of Vishwabharti Academy`s College Of Engineering, Ahmednagar, University of Pune, India.

References