User Interface Design Analysis of Android-Based Sign Language Recognition Learning Media at Special Schools

Faisal *

Department of Vocational and Engineering, Universitas Negeri Makassar, Indonesia.

Yunus Tjandi

Department of Vocational and Engineering, Universitas Negeri Makassar, Indonesia.

Hendra Jaya

Department of Vocational and Engineering, Universitas Negeri Makassar, Indonesia.

*Author to whom correspondence should be addressed.


This research aims to conduct an in-depth analysis of the user interface (UI) design of Android-based sign language recognition learning media used in special schools. In the context of educational inclusion, sign language learning plays an important role in facilitating effective communication for individuals with hearing loss. The use of mobile technology, such as Android applications, has offered an attractive solution to enhance sign language learning by providing flexible and affordable access.

However, the UI design of sign language learning apps does not always adequately consider the special needs of users, especially students with hearing impairment. Therefore, this research aims to analyze the UI design of existing Android-based sign language learning apps, focusing on accessibility, intuitiveness, and effectiveness in delivering learning content.

This research uses the Research and Development (R&D) method with the Waterfall model approach. This research method involves analyzing various aspects of UI design, including layout, navigation, use of symbols, and interactivity. Data was collected through direct observation of student use of the application and interviews with educators in special schools. Data analysis was conducted using qualitative and quantitative approaches to identify strengths and weaknesses in the app's UI design.

The results showed that of the four instruments used in analyzing the UI design of this "AkuBisa" learning media application, using a Likert scale and a Guttman scale, the following results were obtained: needs analysis instrument with an average value of 3.45; media development storyboard instrument with an average value of 3.37; media display design instrument with an average value of 3.31; and Blackbox testing instrument with a percentage level of functionality reaching 100%. The results of testing and assessment of the four instruments show that the user interface design of android-based sign language recognition learning media is declared very valid in fulfilling the elements of accessibility, intuitiveness, and effectiveness as a learning media application and is very feasible to use as an alternative learning media for sign language recognition in special schools.

Keywords: User interface, learning media, sign language, android, hearing impaired students

How to Cite

Faisal, Yunus Tjandi, and Hendra Jaya. 2024. “User Interface Design Analysis of Android-Based Sign Language Recognition Learning Media at Special Schools”. Asian Journal of Education and Social Studies 50 (7):125-35.


Download data is not yet available.


Pressman, Roger S. Software engineering: A practitioner's approach. Prentice Hall, USA; 2011.

Gayatri Solihin I, Zulkipli Lessy. Mufrodat learning for deaf learners using MMR and Android in SLB B Karya Ibu Palembang. Journal on Education. 2023;05(03):10578-10590.

E-ISSN: 2654-5497, P-ISSN: 2655-1365. Available:

Sugiyono. Educational research methods. Publisher: Alfabeta, Bandung; 2021.

Siong TJ, Nasir NRM, Salleh FHM. A mobile learning application for malaysian sign language education. Journal of Physics: Conference Series; 2021. Available:

Rofi'i A, Susilo S. The development of teaching materials based on mobile learning in english learning for elementary schools. AL-ISHLAH: Journal of Education; 2023. Available:

Gayatri J, Rafdhi F. Android-based English education application. Innovative Journal: Information Technology and Informatics Innovation; 2022. Available:

Fatjriyatun D, Joni K, Ubaidillah A, Ulum M, Alfita R. Communication design of indonesian sign language system (SIBI) for deaf/speech children based on speech recognition. Journal Arus Elektro Indonesia. 2021;7(2):35.


Mdikana AA. Nothing about us without us: Assessing the attitudes of deaf learners towards inclusive education. J. Educ. Soc. Behav. Sci. [Internet]. 2021 May 17 [cited 2024 May 30];34(2) :125-31.


Miraji MM, Salim A. Social media platforms usage for learning and library services in selected higher learning institutions in Zanzibar. Asian Res. J. Arts Soc. Sci. [Internet]. 2022 Sep. 1 [cited 2024 May 30];18(3):21-9.


Sibanda P. Analysis of sign language proficiency among teachers of the deaf in primary schools in Bulawayo (Zimbabwe): Implications for learning and inclusion. Scientific Journal of Pure and Applied Sciences. 2015;4(9):157-65.

Alam I, Abdul Hameed, Riaz Ahmad Ziar. Exploring sign language detection on smartphones: A systematic review of machine and deep learning approaches. Hindawi, Advances in Human-Computer Interaction; 2024.


Cangara H. Introduction to communication science. Introduction to Communication Science. 2021;242.

Ridzky, Desanty, Veronikha Effendy, Danang Junaedi. User interface modeling for SIBI (Indonesian Sign Language System) learning application using the user-centered design method. Journal of Physics: Conference Series; 2019. Available:

Efrina EZ, Kusumastuti G. Mobile learning as teaching aid and learning media for special teacher of deaf students. International Journal of Management and Humanities; 2020. Available:https://doi.or g/10.35940/ijmh.k1040.0741120

Haron Hafiza, Hafiza Samad, Fatehah Md Diah, Hafidzan Yusof. E-Learning approach using mobile apps: malaysian sign language for dumb and deaf. International Journal of Advanced Research in Technology and Innovation. 2019;1(1):1-7.

e-ISSN: 2682-8324.

Komala L. Communication science: Perspectives, processes, and contexts. Bandung: Widya Padjadjaran; 2009.

Mais, Asrorul. Learning media for children with special needs. Publisher: CV. Pustaka Abadi, Jember; 2016.

Mohamad Normala, Nor Laily Hashim. UX testing for mobile learning applications of deaf children. International Journal of Advanced Computer Science and Application. 2021;12(11).

Parvez Komal, et al. Measuring effectiveness of mobile application in learning basic mathematical concepts using sign language; 2019., doi:10.3390/su/11113064

Nathan, Shelena Soosay, Azham Hussain, Nor Laily Hashim. Usability evaluation of DEAF mobile application interface: A systematic review. Journal of Engineering and Applied Sciences. 2018;13(2):291-297.

ISSN: 1816-949X