Improvement Process of Adaptive Questionnaires: Implementation and Early Experiences With e-valUAM

• Pablo Molins-Ruano ^[1] ; Francisco Borrego-Gallardo ^[1] ; Covadonga Sevilla ^[1] ; Francisco Jurado ^[1] ; Pilar Rodríguez ^[1] ; Sacha Gómez Moñivas ^[1]
  1. [1] Universidad Autónoma de Madrid

     Universidad Autónoma de Madrid

     Madrid, España

     
• Localización: Revista Iberoamericana de Tecnologías del Aprendizaje: IEEE-RITA, ISSN 1932-8540, Vol. 11, Nº. 3, 2016, págs. 187-193
• Idioma: inglés
• DOI: 10.1109/rita.2016.2589638
• Texto completo no disponible (Saber más ...)
• Dialnet Métricas: 1 Cita
• Resumen

  • Adaptive questionnaires allow identifying the most appropriate question at a particular moment during an evaluation process. There are several approaches to implement adaptive questionnaires, but not many to ensure their quality. This paper shows a procedure to improve the adaptive questionnaires quality by considering the relevance of each question. Therefore, a level is associated with each question, which allows analyzing the students' answers in order to identify how to improve the evaluation process. The proposed method has been implemented in e-valUAM that allows building adaptive questionnaires and has enabled carrying out the first experiments to validate the approach.

• Referencias bibliográficas
  • A. McAuley, B. Stewart, G. Siemens, and D. Cormier. (2010). The MOOC Model for Digital Practice. Social Sciences and Humanities Research Council...
  • A. N. Kumar, “Using online tutors for learning—What do students think?” in Proc. 34th Annu. Frontiers Edu. Conf. (FIE), Oct. 2004, pp. T3F/9–T3F13.
  • C. Bravo, W. R. van Joolingen, and T. de Jong, “Using co-lab to build system dynamics models: Students’ actions and on-line tutorial advice,”...
  • Y. He, S. C. Hui, and T. T. Quan, “Automatic summary assessment for intelligent tutoring systems,” Comput. Edu., vol. 53, no. 3, pp. 890–899,...
  • F. Jurado, M. Redondo, and M. Ortega, “eLearning standards and automatic assessment in a distributed eclipse based environment for learning...
  • J. J. Castro-Schez, M. A. Redondo, F. Jurado, and J. Albusac, “Experience applying language processing techniques to develop educational software...
  • H. Wainer et al., Computerized Adaptive Testing: A Primer. Mahwah, NJ, USA: Lawrence Erlbaum Associates, 2000.
  • A. A. Economides, “Personalized feedback in CAT,” WSEAS Trans. Adv. Eng. Edu., vol. 2, no. 3, pp. 174–181, Jul. 2005.
  • C. A. Chapelle and D. Douglas, Assessing Language Through Computer Technology. Cambridge, U.K.: Cambridge Univ. Press, 2006.
  • A. Ortigosa, P. Paredes, and P. Rodriguez, “AH-questionnaire: An adaptive hierarchical questionnaire for learning styles,” Comput. Edu., vol....
  • H. L. J. van der Maas and E.-J. Wagenmakers, “A psychometric analysis of chess expertise,” Amer. J. Psychol., vol. 118, no. 1, pp. 29–60,...
  • S. Klinkenberg, M. Straatemeier, and H. L. J. van der Maas, “Computer adaptive practice of maths ability using a new item response model for...
  • S. Stark, O. S. Chernyshenko, F. Drasgow, and L. A. White, “Adaptive testing with multidimensional pairwise preference items: Improving the...
  • D. A. Revicki and D. F. Cella, “Health status assessment for the twentyfirst century: Item response theory, item banking and computer adaptive...
  • D. J. Weiss, “Improving measurement quality and efficiency with adaptive testing,” Appl. Psychol. Meas., vol. 6, no. 4, pp. 473–492, Sep....
  • W. A. Sands, B. K. Waters, and J. R. McBride, Eds., Computerized Adaptive Testing: From Inquiry to Operation. Washington, DC, USA: APA, 1997.
  • R. Conejo, E. Guzmán, E. Millán, M. Trella, J. L. Pérez-De-La-Cruz, and A. Ríos, “SIETTE: A Web-based tool for adaptive testing,” Int. J....
  • M. Lilley, A. Pyper, and P. Wernick, “Attitudes to and usage of CAT in assessment in higher education,” Innov. Teach. Learn. Inf. Comput....
  • M. Antal and S. Koncz, “Student modeling for a Web-based selfassessment system,” Expert Syst. Appl., vol. 38, no. 6, pp. 6492–6497, Jun. 2011.
  • M. Virvou and C. Troussas, “Web-based student modeling for learning multiple languages,” in Proc. Int. Conf. Inf. Soc. (i-Society), Jun. 2011,...
  • J. Galvez, E. Guzman, R. Conejo, and E. Millan, “Student knowledge diagnosis using item response theory and constraint-based modeling,” in...
  • F. A. Dorça, L. V. Lima, M. A. Fernandes, and C. R. Lopes, “Automatic student modeling in adaptive educational systems through probabilistic...
  • P. Molins-Ruano, F. Borrego-Gallardo, C. Sevilla, F. Jurado, P. Rodríguez, and G. M. Sacha, “Constructing quality test with e-valUAM,” in...
  • C. González-Sacristán, P. Molins-Ruano, F. Díez, P. Rodríguez, and G. M. Sacha, “Computer-assisted assessment with item classification for...