Spelling Normalisation of Basque Historical Texts

• Autores: Ander Soraluze Irureta, Manuel Padilla-Moyano, Ainara Estarrona Ibarloza, Izaskun Etxeberria Uztarroz
• Localización: Procesamiento del lenguaje natural, ISSN 1135-5948, Nº. 63, 2019, págs. 59-66
• Idioma: español
• Títulos paralelos:
  • Normalización de Textos Históricos Vascos
• Enlaces
  • Texto completo
• Resumen
  • español

    En este artículo se presenta y evalúa en un entorno real un método computacional con el objetivo de normalizar textos históricos vascos para que, una vez normalizados, puedan ser analizados con herramientas estándar de Procesamiento del Lenguaje Natural (PLN). Este trabajo de normalización forma parte de un proyecto en curso más general llamado Basque in the Making (BIM): A Historical Look at a European Language Isolate, cuyo objetivo principal es el estudio sistemático y diacrónico de ciertas características gramaticales de la lengua vasca.

  • English

    This paper presents a computational method and its evaluation in a real scenario with the aim of normalising Basque historical texts in order to be analysed using standard Natural Language Processing tools (NLP). This normalisation work is part of a more general ongoing project called Basque in the Making (BIM): A Historical Look at a European Language Isolate, whose main objective is the systematic and diachronic study of a number of grammatical features of the Basque language.

• Referencias bibliográficas
  • Alegria, I., O. Arregi, N. Ezeiza, and I. Fernández. 2006. Lessons from the development of a named entity recognizer for basque. Procesamiento...
  • Alegria, I., X. Artola, K. Sarasola, and M. Urkia. 1996. Automatic morphological analysis of basque. Literary and Linguistic Computing, 11(4):193–203.
  • Alegria, I., I. Etxeberria, M. Hulden, and M. Maritxalar. 2009. Porting basque morphological grammars to foma, an open-source tool. In Finite-State...
  • Bollmann, M., S. Dipper, J. Krasselt, and F. Petran. 2012. Manual and semi-automatic normalization of historical spelling-case studies from...
  • Bollmann, M. and A. Søgaard. 2016. Improving historical spelling normalization with bi-directional LSTMs and multi-task learning. arXiv preprint...
  • Etxeberria, I. 2016. Aldaera linguistikoen normalizazioa inferentzia fonologikoa eta morfologikoa erabiliz. Ph.D. thesis, Universidad del...
  • Etxeberria, I., I. Alegria, M. Hulden, and L. Uria. 2014. Learning to map variationstandard forms using a limited parallel corpus and the...
  • Etxeberria, I., I. Alegria, and L. Uria. 2019. Weighted finite-state transducers for normalization of historical texts. Natural Language Engineering,...
  • Etxeberria, I., I. Alegria, L. Uria, and M. Hulden. 2016. Evaluating the Noisy Channel Model for the Normalization of Historical Texts: Basque,...
  • Slovene. In Proceedings of the Tenth International Conference on Language Resources and Evaluation (LREC 2016), pages 1064–1069.
  • Jurish, B. 2010. Comparing canonicalizations of historical German text. In Proceedings of the 11th Meeting of the ACL Special Interest Group...
  • Kestemont, M., W. Daelemans, and G. D. Pauw. 2010. Weigh your words— memory-based lemmatization for Middle Dutch. Literary and Linguistic...
  • Moeller, S., G. Kazeminejad, A. Cowell, and M. Hulden. 2019. Improving low-resource morphological learning with intermediate forms from finite...
  • Novak, J. R., N. Minematsu, and K. Hirose. 2012. WFST-Based Graphemeto-Phoneme Conversion: Open Source tools for Alignment, Model-Building...
  • Pettersson, E., B. Megyesi, and J. Nivre. 2014. A multilingual evaluation of three spelling normalisation methods for historical text. Proceedings...
  • Pettersson, E., B. Megyesi, and J. Tiedemann. 2013. An SMT approach to automatic annotation of historical text. In Proceedings of the Workshop...
  • Scherrer, Y. and T. Erjavec. 2016. Modernising historical Slovene words. Natural Language Engineering, 22(6):881–905.
  • Tang, G., F. Cap, E. Pettersson, and J. Nivre. 2018. An evaluation of neural machine translation models on historical spelling normalization....
  • Uria, L. and R. Etxepare. 2011. Basyque: Aplicación para el estudio de la variación sintáctica. Linguamática, 3(1):35–44.