From human to automatic summary grading

• Autores: Iraide Zipitria Leaniz-Barrutia
• Directores de la Tesis: Ana Arruarte Lasa (dir. tes.) , Jon Ander Elorriaga Arandia (dir. tes.)
• Lectura: En la Universidad del País Vasco - Euskal Herriko Unibertsitatea ( España ) en 2011
• Idioma: inglés
• Tribunal Calificador de la Tesis: María Isabel Fernández de Castro (presid.) , Basilio Sierra Araujo (secret.) , Dietrich Albert (voc.) , Philippe Lopistéguy Poutz (voc.) , Peter Mark Hastings (voc.)
• Enlaces
  • Tesis en acceso abierto en: TESEO
• Resumen

  • One of the goals remaining in Artificial Intelligence in Education is to create applications to evaluate open-ended text in a human-like manner. This dissertation describes the design and develompent of a summary evaluation environment based on human performance. Based on previous research in psychology, critical summarization ability development contexts have been analysed to significantly reflect human summary grading decision making. An empirical study has been carried out to identify underlying processes in overall summary decision grading. As a result, overall grades are computed by applying a Bayesian network based model. The discourse grades involved in the global score are cohesion, coherence, use of language, comprehension and adequacy. Semantic information is comprehended by means of Latent Semantic Analysis, and syntactic information by means of Natural Language Processing tools. The resulting automatic discourse grades have proved to significantly reflect human decisions.