Converter of Indonesian Sign Language into Text and Voice, Text and Voice to Sign Language to build communication between Inclusion Vocational School students and teachers
Andriana, Zulkarnain, Olly Vertus, Sutisna Abdul Rahman, Ida Hamidah, Iwan Setiawan, Mokhammad Syaom Barliana, Tutin Aryanti, Dedi Rohendi, Lala Septem Riza

Universitas Langlang Buana - Bandung Indonesia
Universitas Pendidikan Indonesia - Bandung Indonesia

Abstract

The main objective of this research is to build a sign recognition model that allows processing and classification of the greeting language for Indonesian Sign Language communication and to develop it by designing Machine learning to train the recognition model from input sign language to voice and text or vice versa from voice and text to sign language with the help of the OPT8320 type time of flight camera sensor and infrared sensor. To achieve this goal, benchmark efforts are carried out using machine learning methods and algorithms on video processing techniques based on position, rotation of coordinates and finger conditions for conversion from sign language to text and voice and computational intelligence engineering methods to convert speech and text into sign language. The results of this study become digital learning media that can help communication between inclusive students and teachers in schools. In this research, 5 greeting words were tested in Indonesian. Success with a trial of 5 greetings.

Keywords: Machine learning, Inclusion , Time of Flight Camera, Indonesian language, infrared sensors

Topic: Engineering and Technology