IBEREVAL OM: Mining Opinions from the new textual genres

• Autores: Alexandra Balahur Dobrescu , Ester Boldrini, Andrés Montoyo Guijarro , Patricio Martínez Barco
• Localización: Procesamiento del lenguaje natural, ISSN 1135-5948, Nº. 45, 2010, págs. 267-272
• Idioma: inglés
• Títulos paralelos:
  • IBEREVAL OM: Minería de opiniones en los nuevos géneros textuales
• Enlaces
  • Texto completo
• Resumen
  • español

    Con el grande aumento de la información subjetiva en la Web, hay una importante necesidad de desarrollar sistemas de Question Answering que sean eficientes y capaces de discriminar entre datos objetivos y subjetivos. Los participantes tendrán una colección de preguntas de opinión (Español e Inglés) en las cuales se deberán encontrar las respuestas. El Gold Standard será anotado previamente con el esquema de anotación EmotiBlog por 3 anotadores. El corpus EmotiBlog y la colección de preguntas presentados en (Balahur et al. 2009) se pondrá a disposición para el entrenamiento del sistema. Los participantes deberán devolver un listado de respuestas para cada una de las preguntas, (en el mismo idioma que la pregunta o en otro), un resumen de las respuestas –de las x% de las respuestas más importantes, de una manera no redundante, el Gold Standard para los resúmenes será extraído automáticamente de las anotaciones manuales teniendo en consideración el parámetro de “intensidad” de la opinión expresada.

  • English

    The increasing amount of subjective data on the Web is creating the need to develop effective Question Answering systems able to discriminate such information from factual data, and subsequently process it with specific methods. The participants in the IBEREVAL OM tasks will be given a set of opinion questions (in Spanish and English). Optionally, they will also be able to receive the same set of opinion questions, in which the source, target and expected polarity, as well as the time span the question is referring to are given. They will also be provided with a collection of blog posts, extracted using the Technorati blog search engine (in Spanish and English), in which the answers to the opinion questions should be found The gold standard for this blog posts collection will previously be annotated using the EmotiBlog scheme, by a number of 3 annotators. The EmotiBlog corpus and the set of questions presented in (Balahur et al., 2009) – in their present state will be provided for system training. The participants will be able to participate in two subtasks : 1) in the first one, they will be asked to provide the list of answers to each of the questions (in the same language as the questions, or in the other language); 2) in the second one, they will be asked to provide a summary of the question answers – the top x% of the most important answers, in a non-redundant manner. The Gold Standard for the summaries will be automatically extracted from the manual annotations, taking into account the “intensity” parameter of the opinions expressed.

• Referencias bibliográficas
  • Balahur, A. and Montoyo, A. 2008. An incremental multilingual approach to forming a culture dependent emotion triggers lexical database. In Proceedings...
  • Balahur, A, Steinberg, R., Rethinking Sentiment Analysis in the News:from Theory to Practice and back. In Proceedings of WOMSA 2008, Seville,...
  • Balahur, A., Boldrini, E., Montoyo, A., Martínez- Barco, P. 2009. Opinion and Generic Question Answering systems: a performance analysis....
  • Balahur, A., Boldrini, E., Montoyo, A., Martínez- Barco, P. 2009. Opinion Question Answering: Towards a Unified Approach. To appear in proceedings...
  • Balahur, A., Boldrini, E., Montoyo, A., Martínez- Barco, P. 2010. A Unified Proposal for Factoid and Opinionated Question Answering. To appear...
  • Balahur A., Steinberger, R., Kabadjov, M., Zavarella, V., van der Goot, E., Halkia, M., Pouliquen, B., Belyaeva, J. 2010. Sentiment Analysis...
  • Boldrini, E., Balahur, A. Martínez-Barco, P. and Montoyo A. 2009. EmotiBlog: An Annotation Scheme for EmotionDetection and Analysis in Non-Traditional...
  • Cardie. C. Wiebe. J. Wilson. T. Litman. D. 2003. Combining Low-Level and Summary Representations of Opinions for Multi- Perspective Question...
  • Kim, S.-M. and E.H. Hovy. 2005. Identifying Opinion Holders for Question Answering in Opinion Texts. Proceedings of the Workshop on Question...
  • Pang, B. and Lee, L. (2008). Opinion mining and sentiment analysis.
  • Shen. D. Leidner. J. Merkel. A. Klakow. D. 2007. The Alyssa system at TREC QA 2007: Do we need Blog06? In Proceedings of The Sixteenth Text...
  • Wiebe, J., Wilson, T., and C. Cardie. 2005. Annotating expressions of opinions and emotions in language. Language Resources and Evaluation,...
  • Yu. H. Hatzivassiloglou. V. 2003. Towards Answering Opinion Questions: Separating Facts from Opinions. In Proceedings of EMNLP-03. Wenjie,...
  • Li, F., Zheng, Z.,Yang T., Bu, F., Ge, R., Zhu, X., Zhang, X., and Huang, M. THU QUANTA at TAC 2008. QA and RTE track. In Proceedings of Human...