Journal of Advances in Developmental Research

E-ISSN: 0976-4844     Impact Factor: 9.71

A Widely Indexed Open Access Peer Reviewed Multidisciplinary Bi-monthly Scholarly International Journal

Call for Paper Volume 17 Issue 1 January-June 2026 Submit your research before last 3 days of June to publish your research paper in the issue of January-June.

Bidirectional Communication: ISL and Text/speech Converter using 3D Animated Avatar

Author(s) Dr. P. Anbumani, Mrs. Vidhya, Ms. Sandhiya L, Ms. Sona Mithya J S, Ms. Vijayaragavi D, Ms. Ramya Ruba S
Country India
Abstract Communication between people who hear and people with hearing impairment often face major barriers due to a shortage of interpreters and the complexity of sign languages. The rapid advances in deep neural networks and machine translation in technology present a new opportunity for real-time translations between spoken or written words to sign language. This paper describes a framework that utilizes neural networks, computer vision, and natural language processing to translate sign gestures into text or speech, as well as text or voice output into sign gestures. The recognition of gestures is conducted using a convolution neural network while the translation is implemented on a recurrent neural network architecture. The framework also includes avatar-based sign synthesis to improve accessibility and user experience. The objectives of the proposed model are to reduce the communication gap between hearing and deaf individuals and complement the ideas of inclusion and practical utility for both hearing and deaf communities. The paper discusses the findings of experiments from previous research and present projects to highlight challenges and opportunities for future advancements and research projects.
Keywords Sign Language Recognition, Neural Machine Translation, Gesture Recognition, Deep Learning, Computer Vision. Sequence Models, Accessibility, Bidirectional Translation, Human-Computer Interaction, Assistive Technology
Field Engineering
Published In Volume 17, Issue 1, January-June 2026
Published On 2026-02-06
Cite This Bidirectional Communication: ISL and Text/speech Converter using 3D Animated Avatar - Dr. P. Anbumani, Mrs. Vidhya, Ms. Sandhiya L, Ms. Sona Mithya J S, Ms. Vijayaragavi D, Ms. Ramya Ruba S - IJAIDR Volume 17, Issue 1, January-June 2026.

Share this