Arduino-Powered Real-Time Sign Language to Text Converter with Flex Sensors

Abstract

This paper and is aimed at supporting people with hearing and speech limitations. The suggested design uses flex sensors on the glove to record the bending of fingers that are used to represent gestures in sign language. An Arduino microcontroller processes these signals and interprets the gesture and shows the text that corresponds to it on an LCD screen. Moreover, the system offers synthesized speech output with voice module and sends an SMS notification via GSM communication, which improves accessibility and remote communication. The proposed solution does not require lighting or background interference unlike camera-based systems since it works offline. The design of the system is such that it consumes low power, small, and economical; thus, it can be deployed practically. Gesture recognition is accurate and has low latency as shown through experimental evaluation. The proposed work will help in the provision of affordable assistive technology by closing the communication gap between the sign language and non-signers. Index Terms Sign language recognition, wearable technology, flex sensor, arduino, assistive communication, GSM module, speech synthesis.