Educational value of Systematic Mapping Studies: A replication study.

• Barros-Justo, Jose L. ^[1] ; Martínez-Araujo, Nelson ^[1] ; Olivieri, David N. ^[1] ; González-García, Alejandro ^[1]
  1. [1] Universidade de Vigo

     Universidade de Vigo

     Vigo, España

     
• Localización: Journal of Computer Science and Technology, ISSN-e 1666-6038, Vol. 19, Nº. 2, 2019 (Ejemplar dedicado a: Fiftieth Issue; e13), págs. 123-131
• Idioma: inglés
• DOI: 10.24215/16666038.19.e12
• Títulos paralelos:
  • Valor educativo de los estudios sistemáticos de mapeo: replicación de un estudio
• Enlaces
  • Texto completo
• Resumen
  • español

    Contribución: El objetivo de este estudio es el de validar los resultados de un estudio anterior sobre el valor educativo de los estudios sistemáticos de mapeo (SMS), y evaluar la posibilidad de generalizar aquellos resultados a contextos similares. Antecedentes: desde la aparición del paradigma de Ingeniería del Software Basada en Evidencias (EBSE) en 2004, pocos estudios se han dirigido a evaluar su impacto en el ámbito académico, y el valor educativo que los SMS pueden ofrecer a los estudiantes. En 2010 tres reconocidos investigadores presentaron un artículo sobre éste asunto en ICSE’10. El estudio hizo interesantes contribuciones. Creemos que, después de 8 años, una replicación de ese estudio puede ser útil para comprobar los hallazgos originales y, para guiar futuras intervenciones educativas. Preguntas de investigación: ¿Qué valor educativo proporcionan los SMS? Metodología: replicación de un estudio holístico multi-caso. Hallazgos: Esta replicación confirma todos los resultados, menos dos, del estudio original. Las diferencias pueden deberse a pequeñas variaciones en el contexto. La experiencia de realizar un SMS proporcionó a los estudiantes tanto destrezas para la investigación como un amplio conocimiento de su área de investigación. Animamos a otros investigadores a replicar este estudio, para conseguir mayor información sobre el valor educativo de éste método.

  • English

    Contribution: The goal of this study is to validate the results of a prior study on the educational value of systematic mapping studies (SMS) and evaluate the possibility of generalizing those results to similar contexts. Background: since the inception of the Evidence Based Software Engineering (EBSE) paradigm in 2004, few studies have aimed at evaluating their impact in the academic field, and the educational values that SMS can offer to the students. In 2010, three renowned researchers presented an article on this subject at ICSE'10. The study made interesting contributions. We believe that, after 8 years, a replication of that study can be useful to assess the original findings and to guide future educational interventions. Research Questions: What educational value does a SMS provide? Methodology: a replication of a multi-case holistic study. Findings: This replication confirms all but two of the results from the original work. The differences may be due to slight variations in the context. The experience of undertaking an SMS provided the students with both research skills and a broad understanding of a research area. We encourage other researchers to replicate this study, to gain further insights into the educational value of this method.

• Referencias bibliográficas
  • B. A. Kitchenham, D. Budgen, and P. Brereton, Evidence-Based Software Engineering and Systematic Reviews, vol. 4. CRC Press, 2015.
  • B. Kitchenham and S. Charters, “Guidelines for performing Systematic Literature Reviews in Software Engineering,” Tech. report, EBSE Tech....
  • K. Petersen, S. Vakkalanka, and L. Kuzniarz, “Guidelines for conducting systematic mapping studies in software engineering: An update,” Inf....
  • K. Petersen and C. Gencel, “Worldviews, research methods, and their relationship to validity in empirical software engineering research,”...
  • MENSURA), 2013 Jt. Conf. 23rd Int. Work., pp. 81–89, 2013.
  • B. Kitchenham, D. Budgen, and P. Brereton, “Using mapping studies as the basis for further research - A participant-observer case study,”...
  • B. Kitchenham and P. Brereton, “A systematic review of systematic review process research in software engineering,” Inf. Softw. Technol.,...
  • K. Petersen, R. Feldt, S. Mujtaba, and M. Mattsson, “Systematic Mapping Studies in Software Engineering,” 12th Int. Conf. Eval. Assess. Softw....
  • B. Kitchenham, P. Brereton, and D. Budgen, “The educational value of mapping studies of software engineering literature,” in 2010 ACM/IEEE...
  • C. Catal, “Teaching Evidence-Based Software Engineering to Master Students: A Single Lecture within a Course or an Entire Semester-Long Course?,”...
  • D. Castelluccia and G. Visaggio, “Teaching evidence-based software engineering:
  • learning by a collaborative mapping study of open source software,” ACM SIGSOFT Softw. Eng. Notes, vol. 38, pp. 1–4, 2013.
  • M. Lavallee, P. N. Robillard, and R. Mirsalari, “Performing systematic literature reviews with novices: An iterative approach,” IEEE Trans....
  • J. Biolchini, P. G. Mian, A. C. C. Natali, and G. H. Travassos, “Systematic review in software engineering,” Syst. Eng. Comput. Sci. Dep....
  • B. Pejcinovic, “Using Systematic Literature Reviews to Enhance Student Learning,” 2015 ASEE Annu. Conf. Expo., p. 26.1685.1-26.1685.13, 2015.
  • R. K. Yin, Case study research: Design and methods. Sage publications, 2013.
  • José L. Barros-Justo, N. Martínez-Araujo, and A. González-García, “Educational Value of Systematic Mapping Studies: A Replication. Complementary...