Tools for the Use of SignWriting as a Language Resource

• Antonio F. G. Sevilla ^[1] ; Alberto Díaz Esteban ^[1] ; José María Lahoz-Bengoechea ^[1]
  1. [1] Universidad Complutense de Madrid

     Universidad Complutense de Madrid

     Madrid, España

     
• Localización: LREC2020 9thWorkshop on the Representation and Processing of Sign Languages: Sign Language Resources in the Service of the Language Community, Technological Challenges and Application Perspectives : proceedings / coord. por Eleni Efthimiou, Stavroula-Evita Fotinea, Thomas Hanke, Julie A. Hochgesang, Jette Hedegaard Kristoffersen, Johanna Mesch, 2020, ISBN 979-10-95546-54-2, págs. 203-208
• Idioma: inglés
• Enlaces
  • Texto completo
• Resumen

  • Representation of linguistic data is an issue of utmost importance when developing language resources, but the lack of a standard written form in sign languages presents a challenge. Different notation systems exist, but only SignWriting seems to have some use in the native signer community. It is, however, a difficult system to use computationally, not based on a linear sequence of characters. We present the project “VisSE”, which aims to develop tools for the effective use of SignWriting in the computer. The first of these is an application which uses computer vision to interpret SignWriting, understanding the meaning of new or existing transcriptions, or even hand-written images. Two additional tools will be able to consume the result of this recognizer: first, a textual description of the features of the transcription will make it understandable for non-signers. Second, a three-dimensional avatar will be able to reproduce the configurations and movements contained within the transcription, making it understandable for signers even if not familiar with SignWriting. Additionally, the project will result in a corpus of annotated SignWriting data which will also be of use to the computational linguistics community.

• Referencias bibliográficas
  • Bouzid, Y. and Jemni, M. (2014). A virtual signer to interpret SignWriting. In Klaus Miesenberger, et al., editors, Computers Helping People...
  • Di Renzo, A., Lamano, L., Lucioli, T., Pennacchi, B., and Ponzo, L. (2006). Italian Sign Language (LIS): can we write it and transcribe it...
  • Forster, J., Schmidt, C., Koller, O., Bellgardt, M., and Ney, H. (2014). Extensions of the sign language recognition and translation corpus...
  • Hanke, T. (2004). HamNoSys – Representing Sign Lan-guage Data in Language Resources and Language Processing Contexts. In Proceedings of the...
  • Herrero, Á. (2003). Escritura alfabética de la lengua de signos española: once lecciones. Escritura alfabética de la lengua de signos española,...
  • Kennaway, R. (2004). Experience with and Requirements for a Gesture Description Language for Synthetic Animation. In Gerhard Goos, et al.,...
  • Kipp, M., Heloir, A., and Nguyen, Q. (2011). Sign language avatars: Animation and comprehensibility. In Hannes Högni Vilhjálmsson, et al.,...
  • Redmon, J. and Farhadi, A. (2018). Yolov3: An incremental improvement. arXiv.
  • Redmon, J., Divvala, S., Girshick, R., and Farhadi, A. (2016). You only look once: Unified, real-time object detection. In Proceedings of...
  • Redmon, J. (2013–2016). Darknet: Open source neural networks in c. http://pjreddie.com/darknet/.
  • Sánchez Jiménez, J. B., López Prieto, S., and Garrido Montoya, J. Á. (2019). Reconocimiento de lenguaje signoescritura mediante deep learning.
  • Stokoe, W. C. (1980). Sign language structure. Annual Review of Anthropology, 9(1):365–390.
  • Sutton, V. (1995). Lessons in sign writing. SignWriting.
  • Sutton, V. (2009). Signwriting: sign languages are written languages. Center for Sutton Movement Writing, CSMW, Tech. Rep.
  • Van der Hulst, H. and Channon, R. (2010). Notation systems. In Diane Brentari, editor, Sign languages, pages 151–172. Cambridge University...