SIGN LANGUAGE DETECTION AND RECOGNIZATION USING MACHINE LEARNING APPLICATION
Keywords:
Sign Language, Detection, Recognition, Machine Learning, Deep Learning, Convolutional Neural Networks (CNN), Gesture RecognitionAbstract
The primary means by which humans communicate with one another is through voice and language. Our ability to hear allows us to comprehend one another's thoughts. We can still issue commands utilising speech recognition technology today. What happens, though, if a person is completely deaf and mute? Therefore, automatic interpretation of sign language is a vast field of research, as it serves as the primary means of communication for hearing-impaired and silent persons while also ensuring their independence. In the field of image processing and artificial intelligence, numerous methods and algorithms have been created. Each system for recognising sign language is trained to identify the signs and translate them into the necessary pattern.
References
Y. Yu, X. Chen and S. Cao, “Exploration of Chinese Sign Language Recognition Using Wearable Sensors Based on Deep Belief Net,” IEEE journal of biomedical and health informatics, 2019, pp. 2168- 2194.
X. Jiang and Y. Zhang, “Chinese Sign Language Fingerspelling via Six-Layer Convolutional Neural
Network with Leaky Rectified Linear Units for Therapy and Rehabilitation,” Journal of Medical Imaging and Health Informatics, vol. 9, pp. 2031-2090, December.
F. Wang, S. Zhao and X. Zhou, “An Recognition–Verification Mechanism for Real-Time Chinese Sign Language Recognition Based on Multi-Information Fusion,” Sensors, vol. 19, pp. 2495, May 2019.
Q. Xiao, M. Qin and P. Guo, “Multimodal Fusion Based on LSTM and a Couple Conditional Hidden Markov Model for Chinese Sign Language Recognition,” IEEE Access, vol. 4, pp. 112258-112268, June 2019.
S. Huang, C. Mao and J. Tao, “A Novel Chinese Sign Language Recognition Method Based on Keyframe-Centered Clips,” IEEE Signal Processing Letters, vol. 25, pp. 442-446, March 2018.
X. Yang, X. Chen and X. Cao, “Chinese sign language recognition based on an optimized tree-structure framework,” IEEE journal of biomedical and health informatics, vol. 21, pp. 994-1004, May 2016.
