Evaluating the Impact of Computer-Based Testing with Tryout Methodology on Students Numeracy Literacy Development
(1) Universitas Islam Negeri Siber Syekh Nurjati Cirebon
(2) Universitas Islam Negeri Siber Syekh Nurjati Cirebon
(3) Universitas Islam Negeri Siber Syekh Nurjati Cirebon
(*) Corresponding Author
Abstract
This study investigates the impact of Computer-Based Testing (CBT) with a tryout methodology on students’ numeracy literacy development. The research aims to determine whether repeated exposure to digital tryout-style assessments can significantly improve students’ understanding and application of numeracy concepts. A quasi-experimental design was employed, involving 240 students from several grade levels, who were divided into experimental and control groups. The experimental group engaged in weekly CBT tryouts focused on numeracy problems, while the control group underwent traditional paper-based assessments over a six-week period. Pre- and post-intervention tests were conducted using standardized numeracy instruments to evaluate skills such as number sense, mathematical reasoning, problem-solving, and interpretation of quantitative information. The results showed a statistically significant improvement in the experimental group’s post-test scores compared to the control group (t(238) = 8.91, p < 0.001). The calculated effect size (Cohen’s d = 1.47) indicated a strong impact of the CBT tryout method on numeracy literacy development. Qualitative feedback from students in the experimental group also revealed higher engagement, reduced test anxiety, and increased familiarity with digital testing environments. These findings suggest that integrating CBT with a tryout methodology can serve as an effective instructional and assessment strategy to support numeracy development, particularly in preparing students for computer-based national and standardized tests.
Keywords
Full Text:
PDFReferences
Ağartıoğlu Kundakçı, G., & Uysal Toraman, A. (2024). Effects of screen-based simulation method on the attitudes and practices of nursing students regarding intimate partner violence: Randomized controlled trial. Clinical Simulation in Nursing, 97, 101646. doi: 10.1016/j.ecns.2024.101646
Azubuike, O. B., Browne, W. J., & Leckie, G. (2024). State and wealth inequalities in foundational literacy and numeracy skills of secondary school-aged children in Nigeria: A multilevel analysis. International Journal of Educational Development, 110, 103112. doi: 10.1016/j.ijedudev.2024.103112
Beattie, L., Robb, F., Spanswick, M., & Gumley, A. (2022). A process evaluation of a digital CBT-I platform in an early intervention in psychosis service. Sleep Medicine, 100, S109. doi: 10.1016/j.sleep.2022.05.302
Beuchert, L., Eriksen, T. L. M., & Krægpøth, M. V. (2020). The impact of standardized test feedback in math: Exploiting a natural experiment in 3rd grade. Economics of Education Review, 77, 102017. doi: 10.1016/j.econedurev.2020.102017
Bitsouni, V., Gialelis, N., & Stratis, I. G. (2022). A quantitative approach on the solvability of evolution problems in open sets of certain geometries. Journal of Mathematical Analysis and Applications, 506(2), 125663. doi: 10.1016/j.jmaa.2021.125663
Chukwuocha, U., Ashinze, O., Iwuoha, G., & Dozie, I. N. (2020). Development and evaluation of a mobile digital quiz game for the promotion of malaria awareness, positive perceptions and appropriate practices. International Journal of Infectious Diseases, 101, 204. doi: 10.1016/j.ijid.2020.09.545
Guapacha Chamorro, M. E. (2022). Cognitive validity evidence of computer- and paper-based writing tests and differences in the impact on EFL test-takers in classroom assessment. Assessing Writing, 51, 100594. doi: 10.1016/j.asw.2021.100594
Hawes, Z., Moss, J., Caswell, B., Seo, J., & Ansari, D. (2019). Relations between numerical, spatial, and executive function skills and mathematics achievement: A latent-variable approach. Cognitive Psychology, 109, 68–90. doi: 10.1016/j.cogpsych.2018.12.002
Lai, L., Li, Y., Zhao, Z., & Ren, Z. (2025). Efficacy of a process-based, Mobile-delivered personalized CBT for anxiety disorders: Study protocol for a randomized controlled trial. Internet Interventions, 39, 100805. doi: 10.1016/j.invent.2025.100805
Liu, J., Ang, M. C., Chaw, J. K., Kor, A.-L., & Ng, K. W. (2023). Emotion assessment and application in human–computer interaction interface based on backpropagation neural network and artificial bee colony algorithm. Expert Systems with Applications, 232, 120857. doi: 10.1016/j.eswa.2023.120857
Megawati, L. A., & Sutarto, H. (2021). Analysis numeracy literacy skills in terms of standardized math problem on a minimum competency assessment. Unnes Journal of Mathematics Education, 10(2), 155–165. doi: 10.15294/ujme.v10i2.49540
Moreno, F. M., de Barros, M. R., Jordão, A., Mathias, M. S., Dottori, M., Reali Costa, A. H., … Tannuri, E. A. (2025). Improving current forecast by Leveraging Measured Data and numerical models via LiESNs. Environmental Modelling & Software, 192, 106556. doi: 10.1016/j.envsoft.2025.106556
Moriña, A., & Perera, V. H. (2025). Promoting inclusive practices with emerging technologies in higher education: Faculty professional development through blended-learning. The Internet and Higher Education, 67, 101019. doi: 10.1016/j.iheduc.2025.101019
OECD. (2024). Adult skills in literacy and numeracy declining or stagnating in most OECD countries. Retrieved from OECD website: https://www.oecd.org/en/about/news/press-releases/2024/12/adult-skills-in-literacy-and-numeracy-declining-or-stagnating-in-most-oecd-countries.html
Pejic, A., Molcer, P. S., & Gulaci, K. (2021). Math proficiency prediction in computer-based international large-scale assessments using a multi-class machine learning model. 2021 IEEE 19th International Symposium on Intelligent Systems and Informatics (SISY), 49–54. IEEE. doi: 10.1109/SISY52375.2021.9582522
Perkins, H. (2024). Beyond techno-solutionism: Towards critical perspectives in environmental education and digital technology. A critical-hermeneutic review. International Journal of Child-Computer Interaction, 42, 100705. doi: 10.1016/j.ijcci.2024.100705
Rehman, N., Huang, X., Mahmood, A., AlGerafi, M. A. M., & Javed, S. (2024). Project-based learning as a catalyst for 21st-Century skills and student engagement in the math classroom. Heliyon, 10(23), e39988. doi: 10.1016/j.heliyon.2024.e39988
Saluky, S., & Marine, Y. (2021). Development of the UTBK Try Out Application with Simulation Methods to Increase Student Scores. ITEJ (Information Technology Engineering Journals), 6(2), 93–99. doi: 10.24235/itej.v6i2.102
Tan, Y., Yang, T., Yang, J., & Li, K. (2025). Mediation of mathematical self-efficacy in the relationship between teacher-student relationships and mathematics achievement by grade and academic level: a multi-group structural equation modeling. Learning and Individual Differences, 120, 102696. doi: 10.1016/j.lindif.2025.102696
Wijaya, T. T., Hidayat, W., Hermita, N., Alim, J. A., & Talib, C. A. (2024). Exploring contributing factors to PISA 2022 mathematics achievement: Insights from Indonesian teachers. Infinity Journal, 13(1), 139–156. doi: 10.22460/infinity.v13i1.p139-156
Zestas, O. N., & Tselikas, N. D. (2024). Realizing computer vision rehabilitation assessment tests & evaluation applications for mobile devices. AEU - International Journal of Electronics and Communications, 186, 155473. doi: 10.1016/j.aeue.2024.155473
Zhang, A. J.-J., Maurer, U., McBride, C., & Inoue, T. (2025). Direct and indirect associations between parents’ and children’s literacy and numeracy skills: A longitudinal study in Hong Kong Chinese families. Cognitive Development, 75, 101605. doi: 10.1016/j.cogdev.2025.101605
DOI: 10.24235/eduma.v14i1.21637
Article Metrics
Abstract view : 0 timesPDF - 0 times
Refbacks
- There are currently no refbacks.
Copyright (c) 2025 EduMa: Mathematics education learning and teaching

.png)










