Need Analysis for Developing a Semiotic-Based Augmented Reality Media to Enhance Numeracy Literacy Among Deaf Children
(1) Universitas Muhammadiyah Jember
(2) Universitas Nahdlatul Ulama Surabaya
(3) Universitas Muhammadiyah Jember
(4) Universitas Muhammadiyah Jember
(*) Corresponding Author
Abstract
Abstract
This study aims to analyze the needs for developing a semiotic-based Augmented Reality (AR) learning medium to enhance numeracy literacy among deaf students. A qualitative descriptive method was employed through open-ended questionnaires and interviews involving teachers at Sekolah Luar Biasa Negeri Branjangan, Jember Regency, Indonesia. The findings indicate that although 50% of teachers are familiar with AR technology, all participants expressed a strong need and enthusiasm for its implementation in numeracy instruction. Teachers perceived that the visual, interactive, and semiotic features of AR can transform abstract mathematical concepts into concrete and meaningful learning experiences that align with the visual learning strengths of deaf students. The study also revealed that color, animation, and three-dimensional visualization significantly enhance students’ attention and conceptual understanding. The integration of semiotic principles—icons, indices, and symbols—into AR design enables the representation of mathematical meaning through visual signs that are easily accessible and interpretable. This approach bridges the gap between symbolic understanding and experiential learning in mathematics. The findings highlight the significant potential of AR not only as a technological innovation but also as a semiotic learning environment that supports inclusive education for students with hearing impairments. Moreover, these results provide a theoretical and practical foundation for teacher training programs on the use of AR-based technology in special education contexts.
Keywords: augmented reality, deaf learners, inclusive education, numeracy literacy semiotics.
Abstrak
Penelitian ini bertujuan menganalisis kebutuhan pengembangan media pembelajaran Augmented Reality (AR) berbasis semiotik untuk meningkatkan literasi numerasi di kalangan siswa tuna rungu. Metode deskriptif kualitatif digunakan melalui kuesioner terbuka dan wawancara yang melibatkan guru di Sekolah Luar Biasa Negeri Branjangan, Kabupaten Jember, Indonesia. Temuan penelitian menunjukkan bahwa meskipun 50% guru familiar dengan teknologi AR, semua peserta menyatakan kebutuhan dan antusiasme yang kuat untuk menggunakan AR dalam pembelajaran numerasi. Guru merasa bahwa fitur visual, interaktif, dan semiotik AR dapat mengubah konsep matematika abstrak menjadi pengalaman konkret dan bermakna yang selaras dengan kekuatan pembelajaran visual siswa tuna rungu. Penelitian ini juga menemukan bahwa warna, animasi, dan visualisasi tiga dimensi secara signifikan meningkatkan perhatian dan pemahaman konseptual. Mengintegrasikan prinsip-prinsip semiotik ikon, indeks, dan simbol ke dalam desain AR memungkinkan representasi makna matematika melalui tanda-tanda visual yang mudah diakses dan diinterpretasikan. Pendekatan ini menjembatani kesenjangan antara pemahaman simbolik dan pengalaman dalam matematika. Temuan ini mengindikasikan adanya potensi besar untuk mengembangkan dan mengimplementasikan media AR sebagai inovasi teknologi tetapi sebagai lingkungan belajar semiotik yang mendukung pendidikan inklusif bagi siswa dengan gangguan pendengaran sekaligus menjadi dasar bagi pelatihan guru dalam pemanfaatan teknologi berbasis AR di sekolah luar biasa.
Kata kunci: augmented reality, siswa tuna rungu, pendidikan inklusif, literasi numerasi, semiotik.
Full Text:
PDFReferences
Ahuja, N. J., Dutt, S., Choudhary, S. L., & Kumar, M. (2022). “Intelligent Tutoring System in Education for Disabled Learners using Human–Computer Interaction and Augmented Reality.” International Journal of Human-Computer Interaction, 1–13. https://doi.org/10.1080/10447318.2022.2124359
Aldeeb, F. H., Sallabi, O. M., Elaish, M. M., & Hwang, G. (2024). Enhancing students’ learning achievements, self‐efficacy, and motivation using mobile augmented reality. Journal of Computer Assisted Learning, 40(4), 1823–1837. https://doi.org/10.1111/jcal.12989
Almulla, A. A., Mansour, S. B. M., Afia, A., Aldossary, M., Alshammari, T., Alshammary, R., & Alajmi, E. (2021). The effectiveness of a computerized program in developing visual perception skills among preschool children with specific learning difficulties. Multicultural Education, 7(11), 1-18. https://doi.org/10.5281/zenodo.5640258
Altmeyer, K., Kapp, S., Thees, M., Malone, S., Kuhn, J., & Brünken, R. (2020). The use of augmented reality to foster conceptual knowledge acquisition in STEM laboratory courses—Theoretical background and empirical results. British Journal of Educational Technology, 51(3), 611–628. https://doi.org/10.1111/bjet.12900
Andini, R. A., Nurhidayati, N., & Anjarini, T. (2025). School Literacy Movement On Reading Literacy Skills In Elementary School Students. ejournal.bbg.ac.id. https://doi.org/10.46244/visipena.v16i1.3235
Andriyani, A., & Buliali, J. L. (2021). Pengembangan media pembelajaran lingkaran menggunakan augmented reality berbasis android bagi siswa tunarungu: Math Didactic: Jurnal Pendidikan Matematika, 7(2), Article 2. https://doi.org/10.33654/math.v7i2.1353
Atkin, A. (2023). Peirce’s Theory of Signs. In E. N. Zalta & U. Nodelman (Eds.), The Stanford Encyclopedia of Philosophy (Spring 2023). Metaphysics Research Lab, Stanford University. https://plato.stanford.edu/archives/spr2023/entries/peirce-semiotics
Belda-Medina, J., & Calvo-Ferrer, J. R. (2022). Integrating augmented reality in language learning: pre-service teachers’ digital competence and attitudes through the TPACK framework. Education and Information Technologies, 27(9), 12123–12146. https://doi.org/10.1007/s10639-022-11123-3
Bintoro, T., Fahrurrozi, N., Kusmawati, A. P., & Dewi, R. S. (2023). The teacher strategies in teaching sign language for deaf students in special schools Jakarta. Cogent Education, 10(2). https://doi.org/10.1080/2331186x.2023.2258294
Booyoesen, T. (2023). Exploring the impact of augmented reality on student engagement and learning outcomes in science education. Journal Educational Verkenning, 4(4), 25–32. https://doi.org/10.48173/jev.v4i4.183
Brier, S. (2018). Transdisciplinarity across the Qualitative and Quantitative Science through C.S. Peirce’s Semiotic Concept of Habit. Open Information Science, 2(1), 102–114. https://doi.org/10.1515/opis-2018-0008
Buliali, J. L., Andriyani, A., & Pramudya, Y. (2021). Innovative learning model with augmented reality technology for deaf students. İlköğretim Online, 20(1), 663–673. https://doi.org/10.17051/ilkonline.2021.01.56
Campbell, R., Goodman-Williams, R., Feeney, H., & Fehler-Cabral, G. (2018). Assessing triangulation across methodologies, methods, and stakeholder groups: the joys, woes, and politics of interpreting convergent and divergent data. American Journal of Evaluation, 41(1), 125–144. https://doi.org/10.1177/1098214018804195
Colapietro, V. M. (1988). Peirce’s Approach to the Self: A Semiotic Perspective on Human Subjectivity. State University of New York Press.
Dargan, S., Bansal, S., Kumar, M., Mittal, A., & Kumar, K. (2022). Augmented Reality: A comprehensive review. Archives of Computational Methods in Engineering, 30(2), 1057–1080. https://doi.org/10.1007/s11831-022-09831-7
Du, L., Tang, X., & Wang, J. (2024). Different types of textual cues in educational animations: Effect on science learning outcomes, cognitive load, and self-efficacy among elementary students. Education and Information Technologies. https://doi.org/10.1007/s10639-024-12929-z
Glaser, M., & Schwan, S. (2020). Combining verbal and visual cueing: Fostering learning pictorial content by coordinating verbal explanations with different types of visual cueing. Instructional Science, 48(2), 159–182. https://doi.org/10.1007/s11251-020-09506-5
Gómez‐Rios, M. D., Paredes‐Velasco, M., Hernández‐Beleño, R. D., & Fuentes‐Pinargote, J. A. (2022). Analysis of emotions in the use of augmented reality technologies in education: A systematic review. Computer Applications in Engineering Education, 31(1), 216–234. https://doi.org/10.1002/cae.22593
Hakim, L. (2018). Pengembangan media pembelajaran PAI berbasis Augmented Reality. Lentera Pendidikan : Jurnal Ilmu Tarbiyah dan Keguruan, 21(1), Article 1. https://doi.org/10.24252/lp.2018v21n1i6
Hidayatullah, Z., Wilujeng, I., Nurhasanah, N., Gusemanto, T. G., & Makhrus, M. (2021). Synthesis of the 21st Century Skills (4C) Based Physics Education Research In Indonesia. JIPF (Jurnal Ilmu Pendidikan Fisika), 6(1), 88–97. https://doi.org/10.26737/jipf.v6i1.1889
Humam, M. K., Kahfi, S., Andryansyah, R., Taqiuddin, Z., Bashair, F., & Rida, M. R. (2024). Deaf space concept in designing classroom interior for learning motivation of deaf students in special schools. IOP Conference Series Earth and Environmental Science, 1356(1), 012115. https://doi.org/10.1088/1755-1315/1356/1/012115
Iqbal, M. Z., Mangina, E., & Campbell, A. G. (2022). Current Challenges and Future Research Directions in Augmented Reality for Education. Multimodal Technologies and Interaction, 6(9), 75. https://doi.org/10.3390/mti6090075
Jdaitawi, M., Muhaidat, F., Alsharoa, A., Alshlowi, A., Torki, M., & Abdelmoneim, M. (n.d.). The Effectiveness of augmented Reality in improving Students Motivation: an experimental study. https://eric.ed.gov/?id=EJ1378320
Köroğlu, M. (2024). Pioneering virtual assessments: Augmented reality and virtual reality adoption among teachers. Education and Information Technologies. https://doi.org/10.1007/s10639-024-13159-z
Kurniawati, R., Susiswo, S., & Hadi, S. (n.d.). Composite volume learning media based on augmented reality to enhance students’ Visual-Spatial intelligence. Citeus. https://citeus.um.ac.id/jps/vol12/iss4/2/
Latif, W. B., Yasin, I. M., Rahaman, A., Forid, S., Islam, N., & Hossain, M. Z. (2024). Impact of Augmented Reality (AR) and Virtual Reality (VR) on Interactive Learning Systems. Pac J Adv Eng Innov, 1(1), 23-32. https://scienceget.org/index.php/pjaei
Liono, R. A., Amanda, N., Pratiwi, A., & Gunawan, A. a. S. (2021). A Systematic Literature Review: Learning with Visual by The Help of Augmented Reality Helps Students Learn Better. Procedia Computer Science, 179, 144–152. https://doi.org/10.1016/j.procs.2020.12.019
Marougkas, A., Troussas, C., Krouska, A., & Sgouropoulou, C. (2023). Virtual Reality in Education: A review of learning theories, approaches and methodologies for the last decade. Electronics, 12(13), 2832. https://doi.org/10.3390/electronics12132832
Mu’minah, I. H. (2021). Pemanfaatan media pembelajaran berbasis video sebagai alternatif dalam pembelajaran daring IPA pada masa Pandemi Covid-19. Prosiding Penelitian Pendidikan Dan Pengabdian 2021, 1(1)
Mustaqim, I., & Kurniawan, N. (2017). Pengembangan media belajar berbasis augmented reality. Jurnal Edukasi Elektro, 1(1), Article 1. https://doi.org/10.21831/jee.v1i1.13267
Natasya, D. P., Erika, E., Marsi, M., & Meidawati, S. (2019). Isyarat bagi pembelajaran Matematika siswa Tuna Rungu. Prosiding Seminar Nasional Sains & Entrepreneurship VI, 1(1). https://conference.upgris.ac.id/index.php/snse/article/view/203
Pavithra, M., & Shanthi, R. (2025, July 17). Effectiveness of critical thinking skills for developing arithmetic among children with hearing impairment: a literature review. https://jyanavispmvv.in/index.php/files/article/view/40
Peirce, C.S. (1931). The Collected Papers of Charles Sanders Peirce. Cambridge: Harvard University Press
Paredes-Velasco, M., Velázquez-Iturbide, J. Á., & Gómez-Ríos, M. (2022). Augmented reality with algorithm animation and their effect on students’ emotions. Multimedia Tools and Applications, 82(8), 11819–11845. https://doi.org/10.1007/s11042-022-13679-1
Qasserras, L. (2024). The Role Of Visual Learning Aids Across Diverse Learning Styles In High School Education. European Journal of Applied Linguistics Studies, 7(2). https://doi.org/10.46827/ejals.v7i2.550
Putri, S. S., Supena, A., & Yatimah, D. (2019). Dukungan sosial orangtua anak tunarungu usia 11 tahun di SDN Perwira Kota Bogor. Jurnal EDUCATIO: Jurnal Pendidikan Indonesia, 5(1), 20. https://doi.org/10.29210/120192318
Rajabani, D. N., & Juhana, A. (2025). The role of sign language avatars in enhancing educational access and public services for the deaf community. Rajabani | Titik Imaji. https://doi.org/10.30813/.v8i1.6447
Saglam, Y. (2024). Which Data Gathering Method is Superior: An Open-Ended Questionnaire or a Semi-Structured Interview? International Journal on Studies in Education, 6(3), 375–386. https://doi.org/10.46328/ijonse.220
Setyaningsih, S., Utari, P., & Satyawan, I. A. (2024). Systematic Literature Review: Interpersonal Communication Problems in Hearing Children from Deaf Parents. ETTISAL Journal of Communication, 9(2), 233–246. https://doi.org/10.21111/ejoc.v9i2.12315
Stephan, M., & Akyuz, D. (2021). Semiotics from a Social Constructivist Perspective. International Journal of Science and Mathematics Education, 20(7), 1499–1519. https://doi.org/10.1007/s10763-021-10212-y
Sudiarta, I. G. P., & Sadra, I. W. (2016). Pengaruh model Blended Learning berbantuan video animasi terhadap kemampuan pemecahan masalah dan pemahaman konsep siswa. Jurnal Pendidikan Dan Pengajaran, 49(2), Article 2. https://doi.org/10.23887/jppundiksha.v49i2.9009
Sugiyono. (2019). Metode Penelitian Pendidikan: Kuantitatif, Kualitatif, Kombinasi, R&D, dan Penelitian Pendidikan (3rd ed.). Alfabeta
Supena, A., & Muskania, R. T. (2020). Implementasi pembelajaran di Sekolah Dasar inlusi bagi tunarungu selama Covid-19. AULADUNA: Jurnal Pendidikan Dasar Islam, 7(2), Article 2. https://doi.org/10.24252/10.24252/auladuna.v7i2a9.2020
Suryaningrum, C. W., Purwanto, P., Subanji, S., & Susanto, H. (2020a). Failure of interpretation: Semiotic representations in fractional problem solving. Atlantis Press, 467, 99–103. https://doi.org/10.2991/assehr.k.200827.125
Suryaningrum, C. W., Purwanto, P., Subanji, S., Susanto, H., Ningtyas, Y. D. W. K., & Irfan, M. (2020b). Semiotic reasoning emerges in constructing properties of a rectangle: A study of adversity quotient. Journal on Mathematics Education, 11(1), 95–110. https://doi.org/10.22342/jme.11.1.9766.95-110
Suryaningrum, C. W., Misyana, M., & Jatmikowati, T. E. (2021). Playing mathematics in early childhood based on semiotics. Jurnal Obsesi : Jurnal Pendidikan Anak Usia Dini, 6(2), Article 2. https://doi.org/10.31004/obsesi.v6i2.1341
Suryaningruma, C. W., Munandar, Kukuh., Ah., N. H., Khaulidaa., Y. (2023). The Investigation Of Interpretation Shift Among Elementary Students In Semiotic Reasoning For Constructing A Concept In Math. Kasetsart Journal of Social Sciences. 44 (2023) 1051–1060. https://so04.tci-thaijo.org/index.php/kjss/article/view/268979
Stupiansky, Sandra Waite. (2022). Jean Piaget's Constructivist Theory of Learning. Routledge
Tong, S. C., & Chan, F. F. Y. (2023). Strategies to drive interactivity and digital engagement: a practitioners’ perspective. Journal of Research in Interactive Marketing, 17(6), 901–920. https://doi.org/10.1108/jrim-05-2022-0153
Vu, N. N., Hung, B. P., Van, N. T. T., & Lien, N. T. H. (2021). Theoretical and instructional aspects of using multimedia resources in Language Education: A Cognitive View. In Studies in big data (pp. 165–194). https://doi.org/10.1007/978-981-16-3828-2_9
Wainscott, S. D., & Spurgin, K. (2024). Differentiating Language for students who are deaf or hard of hearing: A Practice-Informed Framework for Auditory and Visual supports. Language Speech and Hearing Services in Schools, 55(2), 473–494. https://doi.org/10.1044/2023_lshss-22-00088
Wangid, M. N., Putra, C. A., & Rudyanto, H. E. (2021). The Science-Math Stories based on digital learning: Digital literacy innovation in increasing ability to solve problems. International Journal of Emerging Technologies in Learning (iJET), 16(09), Article 09. https://doi.org/10.3991/ijet.v16i09.22039
Yanuarto, W. N., & Iqbal, A. M. (2022). Media pembelajaran Augmented Reality untuk meningkatkan kemampuan spasial matematis pada konsep Geometri. Edumatica : Jurnal Pendidikan Matematika, 12(01), Article 01. https://doi.org/10.22437/edumatica.v12i01.17615
Yati, S. E., Rengganis, L. D. A., Suryana, A., Wahyudin, U., & Santoso, B. (2023). The experience of interacting: Learning communication for deaf students. Bricolage Jurnal Magister Ilmu Komunikasi, 9(1), 67. https://doi.org/10.30813/bricolage.v9i1.3890
DOI: 10.24235/al.ibtida.snj.v12i2.14943
Article Metrics
Abstract view : 0 timesPDF - 0 times
Refbacks
- There are currently no refbacks.
Copyright (c) 2025 Al Ibtida: Jurnal Pendidikan Guru MI
This work is licensed under a Creative Commons Attribution 4.0 International License.
Al Ibtida: Jurnal Pendidikan Guru MI Indexed by:
Editorial Office:
FITK Building, 5th Floor, Department of Madrasah Ibtidaiyah Teacher Education, Faculty of Tarbiyah and Teacher Training, UIN Siber Syekh Nurjati Cirebon. Perjuangan Street of Sunyaragi, Cirebon City, West Java, Indonesia 45132. Phone. 0231-481264, Fax. 0231-489926, Email: alibtida@syekhnurjati.ac.id
Al Ibtida: Jurnal Pendidikan Guru MI is licensed under a Creative Commons Attribution 4.0 International License.
