Sign Speak: Sign Language-To-Speech and Speech-To-Sign Language

Abstract

Exchange of words among the community is one of the essential mediums of survival. Developing a vision-based application that translates sign language into intelligible speech and vice versa is the main goal of our suggested technique [1]. The objective is to establish a link between the hearing and hearing-impaired communities and begin two-way conversation[2].This application presents the Android program that allows blind, deaf, and dumb persons to converse with one another. Utilizing technologies such as TensorFlow Lite for gesture recognition, Flutter for mobile development, and Firebase for backend support, the application guarantees flexibility and inclusivity. CNNs and natural language processing (NLP) improve speech and gesture recognition, and offline functionality fixes connectivity problems.