Evaluating the Impact of Computer-Based Testing with Tryout Methodology on Students Numeracy Literacy Development

Saluky Saluky; Hadi Kusmanto; Dzakiyyah Rosyidah S

doi:10.24235/eduma.v14i1.21637

Evaluating the Impact of Computer-Based Testing with Tryout Methodology on Students Numeracy Literacy Development

Saluky Saluky^(1*), Hadi Kusmanto⁽²⁾, Dzakiyyah Rosyidah S⁽³⁾,

(1) Universitas Islam Negeri Siber Syekh Nurjati Cirebon
(2) Universitas Islam Negeri Siber Syekh Nurjati Cirebon
(3) Universitas Islam Negeri Siber Syekh Nurjati Cirebon
(*) Corresponding Author

Abstract

This study investigates the impact of Computer-Based Testing (CBT) with a tryout methodology on students’ numeracy literacy development. The research aims to determine whether repeated exposure to digital tryout-style assessments can significantly improve students’ understanding and application of numeracy concepts. A quasi-experimental design was employed, involving 240 students from several grade levels, who were divided into experimental and control groups. The experimental group engaged in weekly CBT tryouts focused on numeracy problems, while the control group underwent traditional paper-based assessments over a six-week period. Pre- and post-intervention tests were conducted using standardized numeracy instruments to evaluate skills such as number sense, mathematical reasoning, problem-solving, and interpretation of quantitative information. The results showed a statistically significant improvement in the experimental group’s post-test scores compared to the control group (t(238) = 8.91, p < 0.001). The calculated effect size (Cohen’s d = 1.47) indicated a strong impact of the CBT tryout method on numeracy literacy development. Qualitative feedback from students in the experimental group also revealed higher engagement, reduced test anxiety, and increased familiarity with digital testing environments. These findings suggest that integrating CBT with a tryout methodology can serve as an effective instructional and assessment strategy to support numeracy development, particularly in preparing students for computer-based national and standardized tests.

Keywords

Computer-Based Testing; Tryout Methodology; Numeracy Literacy; Digital Assessment; Mathematics Learning.

Full Text:

PDF

References

Ağartıoğlu Kundakçı, G., & Uysal Toraman, A. (2024). Effects of screen-based simulation method on the attitudes and practices of nursing students regarding intimate partner violence: Randomized controlled trial. Clinical Simulation in Nursing, 97, 101646. doi: 10.1016/j.ecns.2024.101646

Azubuike, O. B., Browne, W. J., & Leckie, G. (2024). State and wealth inequalities in foundational literacy and numeracy skills of secondary school-aged children in Nigeria: A multilevel analysis. International Journal of Educational Development, 110, 103112. doi: 10.1016/j.ijedudev.2024.103112

Beattie, L., Robb, F., Spanswick, M., & Gumley, A. (2022). A process evaluation of a digital CBT-I platform in an early intervention in psychosis service. Sleep Medicine, 100, S109. doi: 10.1016/j.sleep.2022.05.302

Beuchert, L., Eriksen, T. L. M., & Krægpøth, M. V. (2020). The impact of standardized test feedback in math: Exploiting a natural experiment in 3rd grade. Economics of Education Review, 77, 102017. doi: 10.1016/j.econedurev.2020.102017

Bitsouni, V., Gialelis, N., & Stratis, I. G. (2022). A quantitative approach on the solvability of evolution problems in open sets of certain geometries. Journal of Mathematical Analysis and Applications, 506(2), 125663. doi: 10.1016/j.jmaa.2021.125663

Chukwuocha, U., Ashinze, O., Iwuoha, G., & Dozie, I. N. (2020). Development and evaluation of a mobile digital quiz game for the promotion of malaria awareness, positive perceptions and appropriate practices. International Journal of Infectious Diseases, 101, 204. doi: 10.1016/j.ijid.2020.09.545

Guapacha Chamorro, M. E. (2022). Cognitive validity evidence of computer- and paper-based writing tests and differences in the impact on EFL test-takers in classroom assessment. Assessing Writing, 51, 100594. doi: 10.1016/j.asw.2021.100594

Hawes, Z., Moss, J., Caswell, B., Seo, J., & Ansari, D. (2019). Relations between numerical, spatial, and executive function skills and mathematics achievement: A latent-variable approach. Cognitive Psychology, 109, 68–90. doi: 10.1016/j.cogpsych.2018.12.002

Lai, L., Li, Y., Zhao, Z., & Ren, Z. (2025). Efficacy of a process-based, Mobile-delivered personalized CBT for anxiety disorders: Study protocol for a randomized controlled trial. Internet Interventions, 39, 100805. doi: 10.1016/j.invent.2025.100805

Liu, J., Ang, M. C., Chaw, J. K., Kor, A.-L., & Ng, K. W. (2023). Emotion assessment and application in human–computer interaction interface based on backpropagation neural network and artificial bee colony algorithm. Expert Systems with Applications, 232, 120857. doi: 10.1016/j.eswa.2023.120857

Megawati, L. A., & Sutarto, H. (2021). Analysis numeracy literacy skills in terms of standardized math problem on a minimum competency assessment. Unnes Journal of Mathematics Education, 10(2), 155–165. doi: 10.15294/ujme.v10i2.49540

Moreno, F. M., de Barros, M. R., Jordão, A., Mathias, M. S., Dottori, M., Reali Costa, A. H., … Tannuri, E. A. (2025). Improving current forecast by Leveraging Measured Data and numerical models via LiESNs. Environmental Modelling & Software, 192, 106556. doi: 10.1016/j.envsoft.2025.106556

Moriña, A., & Perera, V. H. (2025). Promoting inclusive practices with emerging technologies in higher education: Faculty professional development through blended-learning. The Internet and Higher Education, 67, 101019. doi: 10.1016/j.iheduc.2025.101019

OECD. (2024). Adult skills in literacy and numeracy declining or stagnating in most OECD countries. Retrieved from OECD website: https://www.oecd.org/en/about/news/press-releases/2024/12/adult-skills-in-literacy-and-numeracy-declining-or-stagnating-in-most-oecd-countries.html

Pejic, A., Molcer, P. S., & Gulaci, K. (2021). Math proficiency prediction in computer-based international large-scale assessments using a multi-class machine learning model. 2021 IEEE 19th International Symposium on Intelligent Systems and Informatics (SISY), 49–54. IEEE. doi: 10.1109/SISY52375.2021.9582522

Perkins, H. (2024). Beyond techno-solutionism: Towards critical perspectives in environmental education and digital technology. A critical-hermeneutic review. International Journal of Child-Computer Interaction, 42, 100705. doi: 10.1016/j.ijcci.2024.100705

Rehman, N., Huang, X., Mahmood, A., AlGerafi, M. A. M., & Javed, S. (2024). Project-based learning as a catalyst for 21st-Century skills and student engagement in the math classroom. Heliyon, 10(23), e39988. doi: 10.1016/j.heliyon.2024.e39988

Saluky, S., & Marine, Y. (2021). Development of the UTBK Try Out Application with Simulation Methods to Increase Student Scores. ITEJ (Information Technology Engineering Journals), 6(2), 93–99. doi: 10.24235/itej.v6i2.102

Tan, Y., Yang, T., Yang, J., & Li, K. (2025). Mediation of mathematical self-efficacy in the relationship between teacher-student relationships and mathematics achievement by grade and academic level: a multi-group structural equation modeling. Learning and Individual Differences, 120, 102696. doi: 10.1016/j.lindif.2025.102696

Wijaya, T. T., Hidayat, W., Hermita, N., Alim, J. A., & Talib, C. A. (2024). Exploring contributing factors to PISA 2022 mathematics achievement: Insights from Indonesian teachers. Infinity Journal, 13(1), 139–156. doi: 10.22460/infinity.v13i1.p139-156

Zestas, O. N., & Tselikas, N. D. (2024). Realizing computer vision rehabilitation assessment tests & evaluation applications for mobile devices. AEU - International Journal of Electronics and Communications, 186, 155473. doi: 10.1016/j.aeue.2024.155473

Zhang, A. J.-J., Maurer, U., McBride, C., & Inoue, T. (2025). Direct and indirect associations between parents’ and children’s literacy and numeracy skills: A longitudinal study in Hong Kong Chinese families. Cognitive Development, 75, 101605. doi: 10.1016/j.cogdev.2025.101605

DOI: 10.24235/eduma.v14i1.21637

Article Metrics

Abstract view : 0 times
PDF - 0 times

Refbacks

There are currently no refbacks.

algototo

toto

slot