Evaluation of an automatic process for specialized web corpora collection and term extraction for Basque

• Autores: Antton Gurrutxaga Hernaiz, Igor Leturia Azkarate , Elisabete Pociello Irigoyen , Xavier Saralegi Urizar, Iñaki San Vicente
• Localización: E-lexicography in the 21st century: New challenges, new applications : proceedings of eLex 2009, Louvain-la Neuve, 22-24 october 2009 / Sylviane Granger (ed. lit.), Magali Paquot (ed. lit.), 2010, ISBN 978-2-87463-211-2, págs. 97-107
• Idioma: inglés
• Enlaces
  • Texto Completo Libro (pdf)
• Resumen

  • In this paper we describe the processes for collecting Basque specialized corpora in different domains from the Internet and subsequently extracting terminology out of them, using automatic tools in both cases. We evaluate the results of corpus compiling and term extraction by making use of a specialized dictionary recently updated by experts. We also compare the results of the automatically collected web corpus with those of a traditionally collected corpus, in order to analyze the usefulness of the Internet as a reliable source of information for terminology tasks.

• Referencias bibliográficas
  • ADURIZ, I., ALDEZABAL, I., ALEGRIA, I., ARTOLA, X., EZEIZA, N. and URIZAR, R. (1996). EUSLEM: A Lemmatiser / Tagger for Basque. In Proceedings...
  • AHMAD, K. and ROGERS, M. (2001). Corpus Linguistics and Terminology Extraction. In S.E. Wright and G. Budin (eds.) Handbook of Terminology...
  • ALEGRIA, I., GURRUTXAGA, A., LIZASO, P., SARALEGI, X., UGARTETXEA, S. and URIZAR, R. (2004a). An Xml-Based Term Extraction Tool for Basque....
  • ALEGRIA, I., GURRUTXAGA, A., LIZASO, P., SARALEGI, X., UGARTETXEA, S. and URIZAR, R. (2004b). Linguistic and Statistical Approaches to Basque...
  • ARETA N., GURRUTXAGA, A., LETURIA, I., ALEGRIA, I., ARTOLA, X., DÍAZ DE ILARRAZA, A., EZEIZA, N. and SOLOGAISTOA, A. (2007). ZT Corpus: Annotation...
  • BARONI, M. and BERNARDINI, S. (2004). BootCaT: Bootstrapping corpora and terms from the web. In Proceedings of the 4th International Conference...
  • BRODER, A.Z. (1997). On the resemblance and containment of documents. In Proceedings of Compression and Complexity of Sequences 1997. Los...
  • BRODER, A.Z. (2000). Identifying and filtering near-duplicate documents. In Proceedings of Combinatorial Pattern Matching: 11th Annual Symposium....
  • DUNNING, T. (1994). Accurate Methods for the Statistics of Surprise and Coincidence. Computational Linguistics, 19(1): 61-74.
  • FERRARESI, A., ZANCHETTA, E., BARONI, M. and BERNARDINI, S. (2008). Introducing and evaluating ukWaC, a very large web-derived corpus of English....
  • FLETCHER, W.H. (2004). Making the web more useful as a source for linguistic corpora. In U. Connor and T. Upton (eds). Corpus Linguistics...
  • KEHOE, A. and RENOUF, A. (2002). WebCorp: Applying the Web to Linguistics and Linguistics to the Web. In Proceedings of the WWW2002 Conference....
  • KILGARRIFF, A. and GREFENSTETTE, G. (2004). Introduction to the special issue on the Web as corpus. Computational Linguistics, 29: 333-348.
  • LETURIA, I., GURRUTXAGA, A., ALEGRIA, I. and EZEIZA, A. (2007a). CorpEus, a web as corpus tool designed for the agglutinative nature of Basque....
  • LETURIA, I., GURRUTXAGA, A., ARETA, A., ALEGRIA, I. and EZEIZA, A. (2007b). EusBila, a search service designed for the agglutinative nature...
  • LETURIA, I., SAN VICENTE, I,. SARALEGI, X. and LOPEZ DE LACALLE., M. (2008). Basque specialized corpora from the web: language-specific performance...
  • SARALEGI, X. and ALEGRIA, I. (2007). Similitud entre documentos multilingües de carácter científico-técnico en un entorno web. Procesamiento...
  • SARALEGI, X. and LETURIA, I. (2007). Kimatu, a tool for cleaning non-content text parts from HTML docs. In Proceedings of the 3rd Web as Corpus...
  • SEBASTIANI, F. (2002). Machine learning in automated text categorization. ACM Computing Surveys, 34(1): 1-47.