Analysis of Students’ Ability and Multiple-Choice Numeracy Test based on Item Difficulty Using Rasch

Churun Lu'lu'il Maknun(1*), Ajeng Wahyuni(2), Irwani Zawawi(3),

(1) Universitas Muhammadiyah Gresik
(2) Institut Agama Islam Negeri Ponorogo
(3) Universitas Muhammadiyah Gresik
(*) Corresponding Author


The purpose of this research is to evaluate learners' numeracy knowledge. This study looked into how university students were taught math skills. The research strategy used in this investigation was quantitative. Rasch Model study was used for the data study. The first research question's goal was to assess the numeracy exams' item difficulty characteristics using the Rasch Measurement Model, and The second research topic's goal was to look into the student's numeracy test performance parameters. According to the study, performing a range of calculations to add, subtract, and multiply as well as calculating and interpreting mean in a variety of contexts were the skills that students found the most difficult to master. The pupils perform exceptionally well when they identify and contrast information and data in tables. The outcome makes it possible to pinpoint each examinee's testing assets and weaknesses; this diagnostic should be applied to raise students' numeracy standards. The level of numeracy can be improved using two important methods. Teaching strategy: Math instructors should adapt their course materials to the students' learning styles


Numeracy, Item Difficulty, Rasch Analysis, Test

Full Text:



Bråting, K., & Kilhamn, C. (2021). Exploring the intersection of algebraic and computational thinking. Mathematical Thinking and Learning, 23(2), 170–185.

Carbonell Carrera, C., & Bermejo Asensio, L. A. (2017). Landscape interpretation with augmented reality and maps to improve spatial orientation skill. Journal of Geography in Higher Education, 41(1), 119–133.

De-Winter, J. C. F., & Dodou, D. (2012). Factor recovery by principal axis factoring and maximum likelihood factor analysis as a function of factor pattern and sample size. Journal of Applied Statistics, 39(4), 695–710.

Erdem, E., & Gürbüz, R. (2014). AN ANALYSIS OF SEVENTH-GRADE STUDENTS’ MATHEMATICAL REASONING. Journal, 44(1), 123–142.

Fagerlin, A., Zikmund-fisher, B. J., Ubel, P. A., Jankovic, A., Derry, H. A., & Smith, D. M. (2007). Measuring Numeracy without a Math Test : Development of the Subjective Numeracy Scale. Medical Decision Making, 672–680.

Gal, I. (2005). Towards “Probability Literacy” for all Citizens: Building Blocks and Instructional Dilemmas. In G. A. Jones (Ed.), Exploring Probability in School: Challenges for Teaching and Learning (pp. 39–63). Boston, MA: Springer US.

Galligan, L. (2013). A systematic approach to embedding academic numeracy at university. Higher Education Research and Development, 32(5), 734–747.

Gregory, L., Villarosa, A. R., Ramjan, L. M., Hughes, M., O’Reilly, R.,

Stunden, A., … Salamonson, Y. (2019). The influence of mathematics self-efficacy on numeracy performance in first-year nursing students: A quasi-experimental study. Journal of Clinical Nursing, 28(19–20), 3651–3659.

Hegarty, M., & Waller, D. (2004). A dissociation between mental rotation and perspective-taking spatial abilities. Intelligence, 32(2), 175–191.

Henson, R. K., Capraro, R. M., & Capraro, M. M. (2004). Reporting practices and use of exploratory factor analyses in educational research journals: Errors and explanation. Research in the Schools, 11(2), 61–72.

Jarvis, C. H. (2011). Spatial Literacy and the Postgraduate GIS Curriculum. Procedia - Social and Behavioral Sciences, 21, 294–299.

Jonas, N. (2018). Numeracy Practices and Numeracy Skills among Adults. OECD Education Working Paper No. 177, (177). Retrieved from

Jordan, N. C., Glutting, J., & Ramineni, C. (2010). The importance of number sense to mathematics achievement in first and third grades. Learning and Individual Differences, 20(2), 82–88.

Kaput, J. (2008). What is algebra? What is algebraic reasoning? In J.

Kaput, D. Carraher, & M. Blanton (Eds.), Algebra in the early grades (pp. 5–18). Lawrence Erlbaum.

Kieffer, K. M. (1999). An introductory primer on the appropriate use of exploratory and confirmatory factor analysis. Research in the Schools, 6(2), 75–92.

Lee, L., & Freiman, V. (2006). Developing Algebraic Thinking through Pattern Exploration. Mathematics Teaching in the Middle School, 11(9), 428–433.

McCowan, R. J., & McCowan, S. C. (1999). Item Analysis for Criterion-Referenced Tests. New York: Center Development of Human Services.

Mohamad, M. M., Lisa, N., Sern, L. C., & Mohd, K. (2015). Measuring the Validity and Reliability of Research Instruments. Procedia - Social and Behavioral Sciences, 204(November 2014), 164–171.

N.A. (2019). Learn About Reliability Analysis and Factor Analysis in SPSS With Online Shopping Data ( 2006 ). SAGE Research Methods Datasets.

Newcombe, N. S., & Shipley, T. F. (2015). Thinking About Spatial Thinking: New Typology, New Assessments BT - Studying Visual and Spatial Reasoning for Design Creativity. In J. S. Gero (Ed.) (pp. 179–192). Dordrecht: Springer Netherlands.

OECD. (2015). Skill Matters: Furthe Results From the Survey of Adults Skills. Jakarta. Retrieved from

OECD. (2016). Skill Matter: Further Results from the Survey of Adult Skills. Paris. Retrieved from

Prince, R., & Frith, V. (2020). An investigation of the relationship between academic numeracy of university students in South Africa and their mathematical and language ability. ZDM, 52, 433–455.

Rothman, R. L., Housam, R., Weiss, H., Davis, D., Gregory, R., Gebretsadik, T., … Elasy, T. A. (2006). Patient Understanding of Food Labels: The Role of Literacy and Numeracy. American Journal of

Preventive Medicine, 31(5), 391–398.

Samuels, P. (2016). Advice on Exploratory Factor Analysis. Centre for Academic Success, Birmingham City University. Retrieved from

Scholz, M. A., Huynh, N. T., Brysch, C. P., & Scholz, R. W. (2014). An Evaluation of University World Geography Textbook Questions for Components of Spatial Thinking. Journal of Geography, 113(5), 208–219.

Seah, R. T. K., & Horne, M. (2020). The influence of spatial reasoning on analysing about measurement situations. Mathematics Education Research Journal, 32(2), 365–386.

Siemon, D., Barkatsas, T., & Seah, R. (2019). Researching and Using Progressions (Trajectories) in Mathematics Education. Leiden, The Netherlands: Brill.

Singh, P., Hoon, T. S., Nasir, N. A. M., Han, C. T., Rasid, N. S. M., & BZH, J. (2020). An Analysis of Students’ Mathematical Reasoning and Mental Computation Proficiencies. Universal Journal of Educational Research, 8(11), 5628–5636.

Sunderaraman, P., Barker, M., Chapman, S., & Cosentino, S. (2022). Assessing numerical reasoning provides insight into financial literacy. Applied Neuropsychology: Adult, 29(4), 710–717.

Vignoles, A. (2016). What is the economic value of literacy and numeracy? IZA World of Labor, (229), 1–10.

Wetzel, A. P. (2011). Factor Analysis Methods And Validity Evidence: A Systematic Review Of Instrument Development Across The Continuum Of Medical Education. Virginia Commonwealth University. Retrieved from

Windisch, H. C. (2015). Adults with low literacy and numeracy skills: A literature review on policy interventions. OECD Education Working Papers No. 123, 12(123), 2–125.

Windisch, H. C. (2016). How to motivate adults with low literacy and numeracy skills to engage and persist in learning: A literature review of policy interventions. International Review of Education, 62(3), 279–297.

DOI: 10.24235/eduma.v12i2.13318

Article Metrics

Abstract view : 0 times
PDF - 0 times


  • There are currently no refbacks.

Copyright (c) 2023

View My Stats