Effectiveness of artificial intelligence tools in developing mathematical skills in secondary school students
DOI:
https://doi.org/10.5281/zenodo.17410207Keywords:
Artificial intelligence, mathematics teaching, secondary educationAbstract
An analysis was conducted on the use of artificial intelligence (AI) tools in mathematics teaching and their relevance in public institutions. To this end, the objective was to explore the evidence on the effectiveness of AI in developing mathematical skills in elementary school students between 2020 and 2025. Regarding the methodology applied, a systematic review of databases such as Web of Science, Scopus, ERIC, and SciELO was used. Subsequently, records were purged in Rayyan and the studies, consisting of 35 articles, were critically read. The results obtained jointly describe intelligent tutoring, conversational assistants with large-scale language models (LLM), and augmented reality and handwriting recognition tools. Other studies demonstrated improvements in learning when supports generated by AI models were included.
Downloads
References
Bolaño García, M., & Duarte Acosta, N. (2024). Una revisión sistemática del uso de la inteligencia artificial en la educación. Revista Colombiana de Cirugía, 39(1), 51-63. https://doi.org/10.30944/20117582.2365
Corica, A., Sureda, P., Parra, V., Schiaffino, S., & Godoy, D. (2025). Educación e inteligencia artificial: desempeño de chatbots y profesores de matemática en la resolución de problemas geométricos. Areté, Revista Digital del Doctorado en Educación, 10(1). https://doi.org/10.55560/arete.2024.ee.10.9
del-Olmo Muñoz, J., González Calero, J., Diago, P., Arnau, D., & Arevalillo Herráez, M. (2023). Intelligent tutoring systems for word problem solving in COVID-19 days: could they have been (part of) the solution? ZDM – Mathematics Education, 55(1), 35-48. https://doi.org/10.1007/s11858-022-01396-w
de-Morais, F., & Jaques, P. (2022). Does handwriting impact learning on math tutoring systems? Informatics in Education, 21(1), 55-90. https://doi.org/10.15388/infedu.2022.03
Drijvers, P., Thurm, D., Vandervieren, E., Klinger, M., Moons, F., van-der-Ree, H., Doorman, M. (2021). Distance mathematics teaching in Flanders, Germany, and the Netherlands during COVID-19 lockdown. Educational Studies in Mathematics, 108(1), 35-64. https://doi.org/10.1007/s10649-021-10094-5
Gbolade Opesemowo, O., & Omoponle Adewuyi, H. (2024). A systematic review of artificial intelligence in mathematics education: The emergence of 4IR. EURASIA Journal of Mathematics, Science and Technology Education, 20(7), 1-11. https://doi.org/10.29333/ejmste/14762
Hermann Spitzer, M., & Moeller, K. (2022). Predicting fraction and algebra achievements online: A large-scale longitudinal study using data from an online learning environment. Journal of Computer Assisted Learning, 38(6), 1797-1806. https://doi.org/10.1111/jcal.12721
Hermann Spitzer, M., & Moeller, K. (2023). Performance increases in mathematics during COVID-19 pandemic distance learning in Austria: Evidence from an intelligent tutoring system for mathematics. Trends Neurosci Educ, 31(100203). https://doi.org/10.1016/j.tine.2023.100203
Hermann Spitzer, M., & Moeller, K. (2024). Performance increases in mathematics within an intelligent tutoring system during COVID-19 related school closures: a large-scale longitudinal evaluation. Computers and Education Open, 6(1). https://doi.org/10.1016/j.caeo.2024.100162
Hermann Spitzer, M., & Musslick, S. (2021). Academic performance of K-12 students in an online-learning environment for mathematics increased during the shutdown of schools in wake of the COVID-19 pandemic. PLOS One, 16(8). https://doi.org/10.1371/journal.pone.0255629
IEA. (2023a). Trends in International Mathematics and Science Study. Asociación Internacional para la Evaluación del Logro Educativo: https://n9.cl/gldhu
IEA. (2023b). South Africa: Highlights Report. Department of Basic Education. https://n9.cl/dwcyi
IMCO. (2023). PISA 2022: Dos de cada tres estudiantes en México no alcanzan el nivel básico de aprendizajes en Matemáticas. Instituto Mexicano para la Competitividad A.C. https://n9.cl/baw3s
INEVAL. (2023). Informe Nacional de Resultados. Ser Estudiante. Subnivel Básica Media. Ministerio de Educación del Ecuador. Instituto Nacional de Evaluación Educativa. https://n9.cl/n3v8hk
Létourneau, A., Deslandes Martineau, M., Charland, P., Alexander Karran, J., Boasen, J., & Majorique Léger, P. (2025). A systematic review of AI-driven intelligent tutoring systems (ITS) in K-12 education. npj Science of Learning, 10(29). https://doi.org/10.1038/s41539-025-00320-7
Levonian, Z., Henkel, O., Li, C., & Postle, M. (2025). Designing Safe and Relevant Generative Chats for Math Learning in Intelligent Tutoring Systems. Journal of Educational Data Mining, 17(1), 66-97. https://doi.org/10.5281/zenodo.14751365
Lim, W., Heffernan, N., & Sales, A. (2025). Evaluating the Effects of Assignment Report Usage on Student Outcomes in an Intelligent Tutoring System: A Randomized-Encouragement Design. Journal of Educational Data Mining, 17(1), 248-275. https://doi.org/10.5281/zenodo.15366697
Lu, Y., Tong, L., & Cheng, Y. (2024). Advanced Knowledge Tracing: Incorporating Process Data and Curricula Information via an Attention-Based Framework for Accuracy and Interpretability. Journal of Educational Data Mining, 16(2), 58-84. https://doi.org/10.5281/zenodo.13712553
Martin, F., Zhuang, M., & Schaefer, D. (2024). Systematic review of research on artificial intelligence in K-12 education (2017–2022). Computers and Education: Artificial Intelligence, 6(1). https://doi.org/10.1016/j.caeai.2023.100195
Matayoshi, J., Cosyn, E., Uzun, H., & Kurd Misto, E. (2025). Using a Randomized Experiment to Compare Mastery Learning Thresholds. Journal of Educational Data Mining, 17(1), 308-336. https://doi.org/10.5281/zenodo.15698758
Mavrikis, M., Rummel, N., Wiedmann, M., Loibl, K., & Holmes, W. (2022). Combining exploratory learning with structured practice educational technologies to foster both conceptual and procedural fractions knowledge. Educational technology research and development, 70(1), 691-412. https://doi.org/10.1007/s11423-022-10104-0
Miao, F., & Holmes, W. (2023). Guidance for generative AI in education and research. UNESCO (United Nations Educational, Scientific and Cultural Organization). https://doi.org/10.54675/EWZM9535
OECD. (2022). Description of the PISA mathematics literacy proficiency levels: 2022. Organization for Economic Cooperation and Development. https://n9.cl/v7qx6
OECD. (2022). Singapore Student performance (PISA). Organización para la Cooperación y el Desarrollo Económicos. https://gpseducation.oecd.org/CountryProfile?primaryCountry=SGP&topic=PI
OECD. (2023). PISA 2022 Results The State of Learning and Equity in Education. Organización para la Cooperación y el Desarrollo Económicos. OECD Publishing. https://doi.org/10.1787/53f23881-en
Pardos, Z., & Bhandari, S. (2024). ChatGPT-generated help produces learning gains equivalent to human tutor-authored help on mathematics skills. PLOS One. https://doi.org/10.1371/journal.pone.0304013
Ponce Vértiz, M., Altabás Kajatt, F., Cuadros Espinoza, M., Ñañez Aldaz, D., & Vera Tudela, D. (2024). El Perú en PISA. Informe nacional de resultados. Ministerio de Educación del Perú. https://n9.cl/r5p5j1
Quintos Almeda, M., & Shaun Baker, R. (2020). Predicting Student Participation in STEM Careers: The Role of Affect and Engagement during Middle School. Journal of Educational Data Mining,, 12(2). https://doi.org/10.5281/zenodo.4008053
Rohani, N., Rohani, B., & Manataki, A. (2024). ClickTree: A Tree-based Method for Predicting Math Students' Performance Based on Clickstream Data. Journal of Educational Data Mining, 16(2), 32-57. https://doi.org/10.5281/zenodo.13627655
Sanabria Medina, G., & Regil Vargas, L. (2024). Inteligencia artificial para la recomendación de recursos en educación en línea. Apertura (Guadalajara, Jal.), 16(2). https://doi.org/10.32870/ap.v16n2.2542
Shih, S., Chang, C., Kuo, B., & Huang, Y. (2023). Mathematics intelligent tutoring system for learning multiplication and division of fractions based on diagnostic teaching. Education and Information Technologies, 28(1), 9189-9210. https://doi.org/10.1007/s10639-022-11553-z
Son, T. (2024). Intelligent Tutoring Systems in Mathematics Education: A Systematic Literature Review Using the Substitution, Augmentation, Modification, Redefinition Model. Computers, 13(10), 270. https://doi.org/10.3390/computers13100270
Spitzer, M., Bardach, L., Strittmatter, Y., Meyer, J., & Moeller, K. (2024). Evaluating the content structure of intelligent tutor systems—A psychological network analysis. Computers and Education Open, 7(1). https://doi.org/10.1016/j.caeo.2024.100198
Sun, S., Else Quest, N., Hodges, L., French, A., & Dowling, R. (2021). The Effects of ALEKS on Mathematics Learning in K-12 and Higher Education: A Meta-Analysis. Investigations in Mathematics Learning, 13(3), 182-191. https://doi.org/10.1080/19477503.2021.1926194
Tomasik, T., Helbling, L., & Moser, U. (2020). Educational gains of in-person vs. distance learning in primary and secondary schools: A natural experiment during the COVID-19 pandemic school closures in Switzerland. International Journal of Psychology, 56(4), 566-576. https://doi.org/10.1002/ijop.12728
UNESCO. (2022). El estudio ERCE 2019 y los niveles de aprendizaje en matemáticas: ¿Qué nos dicen y cómo usarlos para mejorar los aprendizajes de los estudiantes? UNESCO Office Santiago and Regional Bureau for Education in Latin America and the Caribbean. https://n9.cl/qr819
UNESCO. (2023). Tecnología en la educación: ¿Una herramienta en los términos de quien? Organización de las Naciones Unidas para la Educación, la Ciencia y la Cultura. https://doi.org/10.54676/NEDS2300
UNESCO. (2025, Abril 25). “Ser Estudiante” 2023-2024. La evaluación nacional permite fortalecer la calidad educativa en Ecuador. Organización de las Naciones Unidas para la Educación, la Ciencia y la Cultura: https://n9.cl/ngf67b
Uriarte Portillo, A., Zatarain Cabada, R., Barrón Estrada, M., Ibáñez, M., & González Barrón, L. (2023). Intelligent Augmented Reality for Learning Geometry. Information, 14(4), 245. https://doi.org/10.3390/info14040245
Vanacore, K., Gurung, A., Sales, A., & Heffernan, N. (2024). Effect of Gamification on Gamers: Evaluating Interventions for Students Who Game the System. Journal of Educational Data Mining, 16(1). https://doi.org/10.5281/zenodo.11549799
Downloads
Published
Issue
Section
License
Copyright (c) 2025 Marlon Andrés Suscal-Orellana, Jorge Luis Armijos-Carrión (Autor/a)
This work is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License.
Los autores/as que publiquen en esta revista aceptan las siguientes condiciones:
- Los contenidos de la revista se distribuyen bajo una licencia Attribution-NonCommercial-ShareAlike 4.0 International (CC BY-NC-SA 4.0). Esto significa que los usuarios pueden leer, descargar, copiar, distribuir, imprimir, buscar o vincular los textos completos de los artículos, o usarlos para cualquier otro propósito legal, sin solicitar permiso previo del editor o del autor.
- Los autores/as pueden realizar otros acuerdos contractuales independientes y adicionales para la distribución del artículo publicado en esta revista (p. ej., incluirlo en un repositorio institucional o publicarlo en un libro) siempre y cuando indiquen claramente que el trabajo se publicó por primera vez en GEDI-PRAXIS. En caso de reproducción deberá constar una nota similar a la siguiente: Este texto se publicó originalmente en GEDI-PRAXIS. Revisita de Gestión, Educación y Ciencias Sociales, organizada y distribuida por la RED-GEDI, Año ----, Vol ----- N° ----, Páginas ---.
- Se recomienda a los autores/as publicar su trabajo en Internet (por ejemplo en páginas institucionales o personales) en la versión final publicada por RED-GEDI, ya que puede conducir a una mayor y más rápida difusión del trabajo publicado (vea The Effect of Open Access).
