LVBERT: Transformer-Based Model for Latvian Language Understanding

• Artūrs Znotiņš ^[1] ; Guntis Barzdiņš ^[1]
  1. [1] University of Latvia

     University of Latvia

     Letonia

     
• Localización: Human Language Technologies – The Baltic Perspective: Proceedings of the Ninth International Conference Baltic HLT 2020 / coord. por Andrius Utka, Jurgita Vaičenonienė, Jolanta Kovalevskaitė, Danguolė Kalinauskaitė, 2024, ISBN 978-1-64368-116-0, págs. 111-115
• Idioma: inglés
• Enlaces
  • Texto completo
• Resumen

  • This paper presents LVBERT– the first publicly available monolingual language model pre-trained for Latvian. We show that LVBERT improves the stateof-the-art for three Latvian NLP tasks including Part-of-Speech tagging, Named Entity Recognition and Universal Dependency parsing. We release LVBERT to facilitate future research and downstream applications for Latvian NLP.