Ir al contenido

Documat

Scalable authentic assessment of collaborative work assignments in wikis

  • Antonio Balderas [1] ; Manuel Palomo-Duarte [1] ; Juan Manuel Dodero [1] ; María Soledad Ibarra-Sáiz [1] ; Gregorio Rodríguez-Gómez [1]
    1. [1] Universidad de Cádiz

      Universidad de Cádiz

      Cádiz, España

  • Localización: International Journal of Educational Technology in Higher Education, ISSN 2365-9440, Nº. 15, 2018
  • Idioma: inglés
  • DOI: 10.1186/s41239-018-0122-1
  • Enlaces
  • Resumen

    • Wikis are appropriate tools for deploying authentic assessment experiences for learning and work scenarios in which a group of users are asked to develop a shared task. However, when the number of wiki users increases, the number of contributions can grow at a pace whereby accurately assessing them becomes a complex and non-scalable task. While different quantitative approaches have been shown to be scalable, they are usually coarse-grained and provide limited feedback about the assessment. This work proposes a scalable assessment methodology for wiki-based tasks, based on qualitative self- and peer assessment of wiki contributions. The methodology is implemented using a software tool and is applied as part of an undergraduate course, complementing a quantitative assessment approach. Positive evidence on the scalability of the method and how it implements a more fine-grained qualitative assessment than the regular quantitative approach is found, providing indicators for assessing both individual and group generic skills.

  • Referencias bibliográficas
    • Arevalillo-Herráez, M., Perez-Muñoz, R., & Ezbakhe, Y. (2010). A wiki based system to produce high quality teaching materials. In 5th...
    • Aronsson, L. (2002). Operation of a large scale, general purpose wiki website. In Proceedings of the 6th International ICCC/IFIP Conference...
    • Ashford-Rowe, K., Herrington, J., & Brown, C. (2014). Establishing the critical elements that determine authentic assessment. Assessment...
    • Balderas, A., de-la-Fuente-Valentin, L., Ortega-Gomez, M., Dodero, J. M., & Burgos, D. (2018). Learning management systems activity records...
    • Benlloch, J. V., Benet, G., Blanc, S., Gil, D., Busquets, J. V., Gil, P.,… Albaladejo, J. (2012). Análisis de la implantación de la asignatura...
    • Bhopale, S. D. (2013). Cloud migration benefits and its challenges issue. IOSR Journal of Computer Engineering, 1(8), 40–45.
    • Biggs, J. (2015). Assessment in a constructively aligned system. In International Conference Assessment for Learning in Higher Education....
    • Biggs, J. B., Tang, C. S., & Society for Research into Higher Education (2011). Teaching for quality learning at university: What the...
    • Bocconi, S., & Trentin, G. (2012). Wiki supporting formal and informal learning. New York: Nova Science Publishers.
    • Bondi, A. B. (2000). Characteristics of scalability and their impact on performance. In Proceedings of the second international workshop...
    • Boud, D., & Soler, R. (2015). Sustainable assessment revisited. Assessment & Evaluation in Higher Education, 0(0), 1–14.
    • Brodie, M. L., & Stonebraker, M. (1995). Migrating legacy systems: gateways, interfaces & the incremental approach. Massachusetts:...
    • Brown, S. (2014). Learning, teaching and assessment in higher education: global perspectives. Basingstoke: Palgrave Macmillan.
    • Brown, S., & Pickford, R. (2006). Assessing skills and practice. Abingdon: Routledge.
    • Cole, M. (2009). Using Wiki technology to support student engagement: Lessons from the trenches. Computers & Education, 52(1), 141–146.
    • Committee on the Foundations of Assessment, Pellegrino, J. W., Chudowsky, N., Glaser, R., Board on Testing and Assessment, Center for Education,...
    • De Wever, B., Van Keer, H., Schellens, T., & Valcke, M. (2011). Assessing collaboration in a wiki: the reliability of university students’...
    • Díaz, O., & Puente, G. (2012). Wiki scaffolding: aligning wikis with the corporate strategy. Information Systems, 37(8), 737–752 https://doi.org/10.1016/j.is.2012.05.002.
    • Dillenbourg P. (1999) What do you mean by 'collaborative learning'?. In P. Dillenbourg (Ed) Collaborative Learning Cognitive and Computational...
    • Elgort, I., Smith, A. G., & Toland, J. (2008). Is wiki an effective platform for group course work? Australasian Journal of Educational...
    • Falchikov, N., & Goldfinch, J. (2000). Student peer assessment in higher education: a meta-analysis comparing peer and teacher marks....
    • Florian-Gaviria, B., Glahn, C., & Fabregat Gesa, R. (2013). A software suite for efficient use of the European qualifications framework...
    • Fountain, R. (2005). Wiki pedagogy. Dossiers Pratiques. Profetic.
    • Gielen, S., Dochy, F., & Onghena, P. (2011). An inventory of peer assessment diversity. Assessment & Evaluation in Higher Education,...
    • Gulikers, J. T. M., Bastiaens, T. J., & Kirschner, P. A. (2004). A five-dimensional framework for authentic assessment. Educational Technology...
    • Hatzipanagos, S., & Warburton, S. (2009). Feedback as dialogue: Exploring the links between formative assessment and social software in...
    • Henkel, M. (2007). Can academic autonomy survive in the knowledge society? A perspective from Britain. Higher Education Research & Development,...
    • Herrington, J., & Herrington, A. (2006). Authentic conditions for authentic assessment: aligning task and assessment: In A. Bunker &...
    • Ibarra Saiz, M. S., Rodriguez Gomez, G., & Gomez Ruiz, M. A. (2012). Benefits of peer assessment and strategies for its practice at university....
    • Ibarra-Sáiz, M. S., & Rodríguez-Gómez, G. (2017). EvalCOMIX® a web-based programme to support collaboration in assessment. In Smart Technology...
    • Jackson, D. (2009). Wiki-tecture: The DRAPE artist residence and gallery. Journal of Architectural Education, 63(1), 97–106.
    • Jaksch, B., Kepp, S.-J., & Womser-Hacker, C. (2008). Integration of a wiki for collaborative knowledge development in an E-learning context...
    • Koper, R. (2014). Conditions for effective smart learning environments. Smart Learning Environments, 1(1), 5.
    • Lacuesta, R., Palacios, G., & Fernández, L. (2009). Active learning through problem based learning methodology in engineering education....
    • Leuf, B., & Cunningham, W. (2001). The wiki way: quick collaboration on the web. Boston: Addison-Wesley Professional.
    • Llorens, A., Llinàs-Audet, X., Ras, A., & Chiaramonte, L. (2013). The ICT skills gap in Spain: industry expectations versus university...
    • Lykourentzou, I., Papadaki, K., Vergados, D. J., Polemi, D., & Loumos, V. (2010). CorpWiki: A self-regulating wiki to promote corporate...
    • Macdonald, J. (2003). Assessing online collaborative learning: process and product. Computers & Education, 40(4), 377–391 https://doi.org/10.1016/S0360-1315(02)00168-9.
    • Minocha, S., Petre, M., & Roberts, D. (2008). Using wikis to simulate distributed requirements development in a software engineering course....
    • Mitchell, P. (2006). Wikis in education (Ed. Jane K). Moskaliuk, J., Kimmerle, J., & Cress, U. (2012). Collaborative knowledge building...
    • Mueller, J. (2005). The authentic assessment toolbox: enhancing student learning through online faculty development. Journal of Online Learning...
    • Oates, B. J. (2006). Action research. In Researching information systems and computing, (pp. 154–172). London: Sage Publications.
    • Onah, D. F. O., Sinclair, J., & Boyatt, R. (2014). Dropout rates of massive open online courses: behavioural patterns. In 6th international...
    • Ortega, F., González-Barahona, J. M., & Robles, G. (2007). The top-ten wikipedias-a quantitative analysis using wikixray. In ICSOFT (ISDM/EHST/DC),...
    • Ortega Valiente, J., & Reinoso Peinado, A. J. (2011). New educational approach based on the use of wiki platforms in university environments....
    • Palomo-Duarte, M., Dodero, J. M., García-Domínguez, A., Neira-Ayuso, P., Sales-Montes, N., Medina-Bulo, I., … Balderas, A. (2014). Scalability...
    • Parker, K., & Chao, J. (2007). "Wiki as a teaching tool." Interdisciplinary journal of knowledge and learning objects. Interdisciplinary...
    • Pearce, M., Zeadally, S., & Hunt, R. (2013). Virtualization. ACM Computing Surveys, 45(2), 1–39 https://doi.org/10.1145/2431211.2431216.
    • Robson, C., & McCartan, K. (2016). Real world research: a resource for users of social research methods in applied settings, (4th ed.,...
    • Rodríguez-Gómez, G., & Ibarra-Sáiz, M. S. (2015). Assessment as learning and empowerment: towards sustainable learning in higher education,...
    • Runeson, P., & Höst, M. (2009). Guidelines for conducting and reporting case study research in software engineering. Empirical Software...
    • Shute, V. J. (2008). Focus on formative feedback. Review of Educational Research, 78(1), 153–189.
    • Sousa, F., Aparicio, M., & Costa, C. J. (2010). Organizational wiki as a knowledge management tool. In Proceedings of the 28th ACM international...
    • Spencer, L. M., & Spencer, S. M. (1993). Competence at work: models for superior performance. New York: Wiley.
    • Su, F., & Beaumont, C. (2010). Evaluating the use of a wiki for collaborative learning. Innovations in Education and Teaching International,...
    • Trentin, G. (2009). Using a wiki to evaluate individual contribution to a collaborative learning project. Journal of Computer Assisted Learning,...
    • Viégas, F. B., Wattenberg, M., & Dave, K. (2004). Studying cooperation and conflict between authors with history flow visualizations....
    • Wattenberg, M., Viégas, F., & Hollenbach, K. (2007). Visualizing activity on Wikipedia with chromograms. In C. Baranauskas, P. Palanque,...
    • Xiao, Y., & Lucking, R. (2008). The impact of two types of peer assessment on students’ performance and satisfaction within a Wiki environment....
Fundación Dialnet

Mi Documat

Opciones de artículo

Opciones de compartir

Opciones de entorno