A Systematic Literature Review of Empirical Studies on Learning Analytics in Educational Games

• Ahmed Tlili ^[7] ; Maiga Chang ^[1] ; Jewoong Moon ^[2] ; Zhichun Liu ^[3] ; Daniel Burgos ^[4] ; Nian-Shing Chen ^[5] ; Kinshuk ^[6]
  1. [1] Athabasca University

     Athabasca University

     Canadá

     
  2. [2] Florida State University

     Florida State University

     Estados Unidos

     
  3. [3] University of Massachusetts Dartmouth

     University of Massachusetts Dartmouth

     City of New Bedford, Estados Unidos

     
  4. [4] Universidad Internacional de La Rioja

     Universidad Internacional de La Rioja

     Logroño, España

     
  5. [5] National Yunlin University of Science and Technology

     National Yunlin University of Science and Technology

     Douliu City, Taiwán

     
  6. [6] University of North Texas

     University of North Texas

     Estados Unidos

     
  7. [7] Smart Learning Institute of Beijing Normal University, Beijing (China)

  Mostrar afiliaciones +
• Localización: IJIMAI, ISSN-e 1989-1660, Vol. 7, Nº. 2, 2021, págs. 250-261
• Idioma: inglés
• DOI: 10.9781/ijimai.2021.03.003
• Texto completo no disponible (Saber más ...)
• Dialnet Métricas: 1 Cita
• Resumen

  • Learning analytics (LA) in educational games is considered an emerging practice due to its potential of enhancing the learning process. Growing research on formative assessment has shed light on the ways in which students' meaningful and in-situ learning experiences can be supported through educational games. To understand learners' playful experiences during gameplay, researchers have applied LA, which focuses on understanding students' in-game behaviour trajectories and personal learning needs during play. However, there is a lack of studies exploring how further research on LA in educational games can be conducted. Only a few analyses have discussed how LA has been designed, integrated, and implemented in educational games. Accordingly, this systematic literature review examined how LA in educational games has evolved. The study findings suggest that: (1) there is an increasing need to consider factors such as student modelling, iterative game design and personalisation when designing and implementing LA through educational games; and (2) the use of LA creates several challenges from technical, data management and ethical perspectives. In addition to outlining these findings, this article offers important notes for practitioners, and discusses the implications of the study’s results.

• Referencias bibliográficas
  • W.-C. Hsu and H.-C. K. Lin, “Impact of applying WebGL technology to develop a web digital game-based learning system for computer programming...
  • F. Ke., “An implementation of design-based learning through creating educational computer games: A case study on mathematics learning during...
  • T.-Y. Liu and Y.-L. Chu, “Using ubiquitous games in an English listening and speaking course: Impact on learning outcomes and motivation,”...
  • S. Suh, S. W. Kim, and N. J. Kim, “Effectiveness of MMORPG‐based instruction in elementary English education in Korea,” Journal of Computer...
  • V. J. Shute, L. Wang, S. Greiff, W. Zhao, and G. Moore, “Measuring problem solving skills via stealth assessment in an engaging video game,”...
  • D. Burgos, C. Tattersall, and R. Koper, “Re-purposing existing generic games and simulations for e-learning,” Computers in Human Behavior,...
  • P. Moreno-Ger and D. Burgos, “The case for serious games analytics,” in Radical Solutions and Learning Analytics: Personalised Learning and...
  • D. Burgos, Radical solutions and learning Analytics, Singapore: Springer, 2020.
  • H. Fournier, R. Kop, and G. Durand, “Challenges to research in MOOCs,” Journal of Online Learning and Teaching / MERLOT, vol. 10, no. 1, pp....
  • J. Frommel, K. Rogers, J. Brich, D. Besserer, L. Bradatsch, I. Ortinau, ...and M. Weber, Integrated questionnaires: Maintaining presence in...
  • D. D. Reese, B.G. Tabachnick, and R. E. Kosko, “Video game learning dynamics: Actionable measures of multidimensional learning trajectories,”...
  • V. J. Shute and M. Ventura, Stealth assessment: Measuring and supporting learning in video games, London, England: The MIT Press, 2013.
  • B. R. Belland, “The role of construct definition in the creation of formative assessments in game-based learning,” in Assessment in gamebased...
  • V. J. Shute, M. Ventura, M. Bauer, and D. Zapata-Rivera, “Melding the power of serious games and embedded assessment to monitor and foster...
  • Á. Serrano-Laguna, J. Torrente, P. Moreno-Ger, and B. Fernández-Manjón. “Application of LA in educational videogames,” Entertainment Computing,...
  • I. J. Perez-Colado, V. M. Perez-Colado, I. Martínez-Ortiz, M. FreireMoran, and B. Fernández-Manjón, “UAdventure: The eAdventure reboot: Combining...
  • A. Tlili, F. Essalmi, M. Jemni, Kinshuk, and N.S. Chen, “A complete validated learning analytics framework: Designing issues from data preparation...
  • H. Fournier, R. Kop, and H. Sitlia, “The value of learning analytics to networked learning on a personal learning environment,” in Proceedings...
  • S. Powell and S. MacNeill, “Institutional readiness for analytics,” JISC CETIS Analytics Series, vol. 1, no. 8, 2012.
  • D. Gijbels and F. Dochy, “Students’ assessment preferences and approaches to learning: can formative assessment make a difference?,” Educational...
  • V. J. Shute and M. Ventura, “Stealth assessment,” in The SAGE Encyclopedia of Educational Technology, Thousand Oaks, United States: SAGE,...
  • C.C. van Nimwegen, D. Burgos, H.H. van Oostendorp and H.H. Schijf, “The paradox of the assisted user: guidance can be counterproductive” in...
  • C. Alonso-Fernandez, A. Calvo, M. Freire, I. Martinez-Ortiz, and B. Fernandez-Manjon. “Systematizing game learning analytics for serious games”...
  • A. Tlili and M. Chang, “Data analytics approaches in educational games and gamification Systems: Summary, challenges, and future insights,”...
  • Z. K. Papamitsiou and A.A. Economides, “Learning analytics and educational data mining in practice: A systematic literature review of empirical...
  • G. L. Saveski, W. Westera, L. Yuan, P. Hollins, B.F. Manjón, P.M. Ger, and K. Stefanov, “What serious game studios want from ICT research:...
  • C. Okoli and K. Schabram, “A guide to conducting a systematic literature review of information systems research,” Sprouts: Working Papers...
  • T. M. Connolly, E. A. Boyle, E. MacArthur, T. Hainey, and J. M. Boyle, “A systematic literature review of empirical evidence on computer games...
  • J. Webster and R. T. Watson, “Analyzing the past to prepare for the future: Writing a literature review,” MIS Quarterly, vol. 26, no. 2, pp....
  • M. Minović, M. Milovanović, U. Šošević, and M. Á. C. González. “Visualisation of student learning model in serious games,” Computers in Human...
  • C. Alonso-Fernández, I. Martínez‐Ortiz, R. Caballero, M. Freire, and B. Fernández‐Manjón, “Predicting students’ knowledge after playing a...
  • M. T. Cheng, Y. W. Lin and H. C. She, “Learning through playing virtual Age: Exploring the interactions among student concept learning, gaming...
  • M. Denden, A. Tlili, F. Essalmi, and M. Jemni, “Implicit modeling of learners’ personalities in a game-based learning environment using their...
  • F. Essalmi, A. Tlili, L. J. B. Ayed, and M. Jemni. “Toward modeling the learner’s personality using educational games,” International Journal...
  • C. M. Forsyth, A. C. Graesser, P. Pavlik Jr, Z. Cai, H. Butler, D. Halpern, and K. Millis. “Operation aries!: Methods, mystery, and mixed...
  • H. T. Hou, “Exploring the behavioral patterns of learners in an educational massively multiple online role-playing game (MMORPG),” Computers...
  • R. Israel-Fishelson and A. Hershkovitz, “Persistence in a game-based learning environment: The case of elementary school students learning...
  • D. Kerr and G. K. Chung. “Identifying key features of student performance in educational video games and simulations through cluster analysis,”...
  • M. A. Khenissi, F. Essalmi, M. Jemni, T. W. Chang, and N. S. Chen. “Unobtrusive monitoring of learners’ interactions with educational games...
  • M. Liu, J. Lee, J. Kang, and S. Liu. “What we can learn from the data: A multiple-case study examining behavior patterns by students with...
  • E. Lotfi, B. Amine, and B. Mohammed. “Players performances analysis based on educational data mining case of study: Interactive waste sorting...
  • T. Martin, C. Petrick Smith, N. Forsgren, A. Aghababyan, P. Janisiewicz, and S. Baker. “Learning fractions by splitting: Using learning analytics...
  • C. T. Wen, C. J. Chang, M. H. Chang, S. H. F. Chiang, C. C. Liu, F. K. Hwang, and C. C. Tsai. “The learning analytics of model-based learning...
  • G. Altanis, M. Boloudakis, S. Retalis, and N. Nikou. “Children with motor impairments play a kinect learning game: First findings from a pilot...
  • A. Calvo-Morata, D. C. Rotaru, C. Alonso-Fernández, M. Freire, I. Martínez-Ortiz, and B. Fernández-Manjón. “Validation of a cyberbullying...
  • A. R. Cano, B. Fernández‐Manjón, and Á. J. García‐Tejedor. “Using game learning analytics for validating the design of a learning game for...
  • D. Kerr. “Using data mining results to improve educational video game design,” Journal of Educational Data Mining, vol. 7, no. 3, pp. 1-17,...
  • Á. Serrano-Laguna, B. Manero, M. Freire, and B. Fernández-Manjón. “A methodology for assessing the effectiveness of serious games and for...
  • Y. Chaudy and T. Connolly. “Specification and evaluation of an assessment engine for educational games: Integrating learning analytics and...
  • M. Callaghan, N, McShane, A. G. Eguíluz, and M. Savin-Baden. “Extending the activity theory based model for serious games design in engineering...
  • Z. H. Chen and S. Y. Lee. “Application-driven educational game to assist young children in learning english vocabulary,” Journal of Educational...
  • K. Kiili and H. Ketamo. “Evaluating cognitive and affective outcomes of a digital game-based math test,” IEEE Transactions on Learning Technologies,...
  • K. Kiili, K. Moeller, and M. Ninaus, “Evaluating the effectiveness of a game-based rational number training-In-game metrics as learning indicators,”...
  • D. Rodríguez-Cerezo, A. Sarasa-Cabezuelo, M. Gómez-Albarrán, and J. L. Sierra, “Serious games in tertiary education: A case study concerning...
  • A. Capatina, G. Bleoju, E. Rancati, and E. Hoareau, “Tracking precursors of learning analytics over serious game team performance ranking,”...
  • A. B. Hernández-Lara, A. Perera-Lluna, and E. Serradell-López. “Applying learning analytics to students’ interaction in business simulation...
  • M. Kourakli, I. Altanis, S. Retalis, M. Boloudakis, D. Zbainos, and K. Antonopoulou. “Towards the improvement of the cognitive, motoric, and...
  • C. S. Loh and Y. Sheng. “Maximum similarity index (MSI): A metric to differentiate the performance of novices vs. multiple-experts in serious...
  • C. S. Loh and Y. Sheng. “Measuring the (dis-) similarity between expert and novice behaviors as serious games analytics,” Education and Information...
  • C. S. Loh, Y. Sheng, and I. H. Li. “Predicting expert-novice performance as serious games analytics with objective-oriented and navigational...
  • E. Rowe, J. Asbell-Clarke, R. S. Baker, M. Eagle, A. G. Hicks, T. M. Barnes, and T. Edwards. “Assessing implicit science learning in digital...
  • A. Slimani, F. Elouaai, L. Elaachak, O. B. Yedri, M. Bouhorma, and M. Sbert. “Learning analytics through serious games: Data mining algorithms...
  • E. L. Snow, L. K. Allen, M. E. Jacovina, and D. S. McNamara. “Does agency matter?: Exploring the impact of controlled behaviors within a gamebased...
  • K. Becker, “How are games educational? Learning theories embodied in games,” in DiGRA: Changing Views - Worlds in Play. Vancouver, Canada,...
  • E. Z. F., Liu, and C. H. Lin. “Developing evaluative indicators for educational computer games,” British Journal of Educational Technology,...
  • J. Moon and Z. Liu. “Rich Representations for Analyzing Learning Trajectories: Systematic Review on Sequential Data Analytics in GameBased...
  • A. Tlili, F. Essalmi, and M. Jemni, “An educational game for teaching computer architecture: Evaluation using learing analytics,” in 5th IEEE...
  • A. Pardo and G. Siemens, “Ethical and privacy principles for learning analytics,” British Journal of Educational Technology, vol. 45, no....
  • S. Welsh and S. McKinney, “Clearing the Fog: A learning Analytics Code of Practice,” in Proceedings of the Australasian Society for Computers...
  • S. Erhel and E. Jamet. “Digital game-based learning: Impact of instructions and feedback on motivation and learning effectiveness,” Computers...