Gesture Talk

Abstract: Communication is one of the most basic needs for humans, but millions of people who are deaf or hard of hearing struggle to get information and connect with the world around them. The tools available to help them are often limited, providing only pictures that don’t show the full, natural way sign language works. Many platforms also don’t respond quickly or allow people to use their voice, making them hard to use for those with different needs. This paper introduces a web application that helps bridge the communication gap for the deaf and hard-of-hearing community by converting text and speech into real-time, animated Indian Sign Language (ISL). The app lets users type or speak naturally, and then turns that into smooth, animated signs. It uses speech recognition to turn spoken words into text, which is then mapped to an animation system that shows the signs accurately. Instead of using still images, the system creates smooth animations that help people understand better and stay engaged. The web-based design works on any device without needing extra software. By combining speech recognition, language processing, and animation all in one place, the app offers a simple and inclusive way for the deaf community to communicate more easily.

Keywords: Indian Sign Language, speech recognition, real-time conversion, web application, deaf accessibility, animation rendering.