Multimodal Data Value Chain (M-DVC): A Conceptual Tool to Support the Development of Multimodal Learning Analytics Solutions

• Shashi Kant Shankar ^[1] ; María Jesús Rodríguez-Triana ^[1] ; Adolfo Ruiz-Calleja ^[2] ; Luis P. Prieto ^[1] ; Alejandra Martínez-Monés ^[2] ; Pankaj Chejara ^[1]
  1. [1] Tallinn University

     Tallinn University

     Kesklinna linnaosa, Estonia

     
  2. [2] Universidad de Valladolid

     Universidad de Valladolid

     Valladolid, España

     
• Localización: Revista Iberoamericana de Tecnologías del Aprendizaje: IEEE-RITA, ISSN 1932-8540, Vol. 15, Nº. 2, 2020, págs. 113-122
• Idioma: inglés
• DOI: 10.1109/rita.2020.2987887
• Texto completo no disponible (Saber más ...)
• Resumen

  • Multimodal Learning Analytics (MMLA) systems, understood as those that exploit multimodal evidence of learning to better model a learning situation, have not yet spread widely in educational practice. Their inherent technical complexity, and the lack of educational stakeholder involvement in their design, are among the hypothesized reasons for the slow uptake of this emergent field. To aid in the process of stakeholder communication and systematization leading to the specification of MMLA systems, this paper proposes a Multimodal Data Value Chain (M-DVC). This conceptual tool, derived from both the field of Big Data and the needs of MMLA scenarios, has been evaluated in terms of its usefulness for stakeholders, in three authentic case studies of MMLA systems currently under development. The results of our mixed-methods evaluation highlight the usefulness of the M-DVC to elicit unspoken assumptions or unclear data processing steps in the initial stages of development. The evaluation also revealed limitations of the M-DVC in terms of the technical terminology employed, and the need for more detailed contextual information to be included. These limitations also prompt potential improvements for the M-DVC, on the path towards clearer specification and communication within the multi-disciplinary teams needed to build educationally-meaningful MMLA solutions.

• Referencias bibliográficas
  • R. Ferguson, “Learning analytics: Drivers, developments and chal-lenges,”Int. J. Technol. Enhanced Learn., vol. 4, nos. 5–6, pp....
  • A. Merceron, P. Blikstein, and G. Siemens, “Learning analytics: Frombig data to meaningful data,”J. Learn. Anal., vol. 2, no....
  • X. Ochoa, A. C. Lang, and G. Siemens, “Multimodal learning analytics,”Handbook Learn. Anal., vol. 1, pp. 129–141, May 2017.
  • P. Blikstein, “Multimodal learning analytics,” inProc. 3rd Int. Conf.Learn. Anal. Knowl., 2013, pp. 102–106.
  • F. H. Weinberg, “An experimental investigation of the interactionbetween sensory modality preference and mode of presentation...
  • W. Qinhong, “On mode, medium, and modality in multimodal dis-course,”Foreign Lang. Edu., vol. 4, no. 4, pp. 1–7, 2009.
  • C.-C. Chang, H. Lei, and J.-S. Tseng, “Media presentation mode, eng-lish listening comprehension and cognitive load in ubiquitous...
  • X. Ochoa and M. Worsley, “Augmenting learning analytics with mul-timodal sensory data,”J. Learn. Analytics, vol. 3, no. 2,...
  • L.-P. Morency, S. Oviatt, S. Scherer, N. Weibel, and M. Worsley, “ICMI2013 grand challenge workshop on multimodal learning analytics,”...
  • D. Di Mitri, M. Scheffel, H. Drachsler, D. Börner, S. Ternier, andM. Specht, “Learning pulse: A machine learning approach for predictingperformance...
  • M. E. Porter and C. Advantage, “Creating and sustaining superiorperformance,” inCompetitive Advantage, vol. 167. New York, NY,...
  • H. G. Miller and P. Mork, “From data to decisions: A value chain forbig data,”IT Prof., vol. 15, no. 1, pp. 57–59, Jan. 2013.
  • A. Ruiz-Calleja, M. J. Rodriguez Triana, L. P. Prieto, K. Poom-Valickis,and T. Ley, “Towards a living lab to support evidence-based educationalresearch...
  • W. N. A. Bork. (2018).Multimodal Teaching Analytics: Spanish Lan-guage Influence on Machine LearningModels for Teaching AnalyticsTools....
  • D. Di Mitri, J. Schneider, R. Klemke, M. Specht, and H. Drachsler,“Read between the lines: An annotation tool for...
  • M. Worsley and R. Martinez-Maldonado, “Multimodal learning analyt-ics’ past, present, and potential futures,” inProc. CrossMMLA LAK,2018,...
  • S. K. Shankar, L. P. Prieto, M. J. Rodriguez-Triana, and A. Ruiz-Calleja,“A review of multimodal learning analytics architectures,” inProc....
  • B. Schneider and P. Blikstein, “Unraveling students’ interaction arounda tangible interface using multimodal learning analytics,”J. Educ....
  • S. Oviatt, “Ten opportunities and challenges for advancing student-centered multimodal learning analytics,” inProc. Int. Conf. MultimodalInteract.,...
  • L. P. Prieto, M. J. Rodríguez-Triana, R. Martínez-Maldonado,Y. Dimitriadis, and D. Gaševi ́c, “Orchestrating...
  • S. Asghar and M. Umar, “Requirement engineering challenges indevelopment of software applications and selection of customer-off-the-shelf...
  • S. Kant Shankaret al., “A data value chain to model the processing ofmultimodal evidence in authentic learning scenarios,” inProc....
  • W. Greller and H. Drachsler, “Translating learning into numbers: Ageneric framework for learning analytics,”J. Educ. Technol....
  • M. A. Chatti, A. L. Dyckhoff, U. Schroeder, and H. Thüs, “A referencemodel for learning analytics,”Int. J. Technol. Enhanced Learn.,vol.4,nos....
  • H. Drachsler and W. Greller, “Privacy and analytics: It’s a delicate issuea checklist for trusted learning analytics,” inProc. 6th Int. Conf....
  • L. Ali, M. Asadi, D. Gaševi ́c, J. Jovanovi ́c, and M. Hatala, “Factorsinfluencing beliefs for adoption of a learning analytics...
  • Y.-S. Tsai and D. Gasevic, “Learning analytics in higher education—Challenges and policies: A review of eight learning analytics...
  • Y.-S. Tsai, P. M. Moreno-Marcos, K. Tammets, K. Kollom, andD. Gaševi ́c, “SHEILA policy framework: Informing institutional...
  • A. Ruiz-Calleja, S. Garcıa, K.Tammets, C. Aguerrebere, and T. Ley,“Scaling learning analytics up to thenational level: The experience...
  • S. K. Shankar, A. Ruiz-Calleja, L. P. Prieto, M. J. Rodríguez-Triana,and P. Chejara, “An architecture and data model to process...
  • D. M. Kaufman, “Applying educational theory in practice,”Brit. Med. J.,vol. 326, no. 7382, pp. 213–216, 2003.
  • F. Wang and M. J. Hannafin, “Design-based research and technology-enhanced learning environments,”Educ. Technol. Res. Develop., vol....
  • J. W. Creswell, “Mixed-methodresearch: Introduction and appli-cation,” inHandbook of Education Policy Research.Amsterdam,The...