Providing Automatic Multilingual Text Generation to Artificial Cognitive Systems

• Fernández, Carles ^[1] ; Rocai, Xavier ^[1] ; González, Jordi ^[2]
  1. [1] Universitat Autònoma de Barcelona

     Universitat Autònoma de Barcelona

     Barcelona, España

     
  2. [2] Universitat Politècnica de Catalunya

     Universitat Politècnica de Catalunya

     Barcelona, España

     
• Localización: VIAL, Vigo international journal of applied linguistics, ISSN 1697-0381, Nº. 5, 2008, págs. 37-62
• Idioma: inglés
• Enlaces
  • Texto completo
• Resumen

  • This contribution addresses the incorporation of a module for advanced user interaction into an artificial cognitive vision system to include the human-in-the-loop. Specifically, the document describes a method to automatically generate natural language textual descriptions of meaningful events and behaviors, in a controlled scenario. One of the goals of the system is to be capable of producing these descriptions in multiple languages. We will introduce some relevant stages of the whole system, and concentrate on the linguistic aspects which have been taken into account to derive final text from conceptual predicates. Some experimental results are provided for the description of simple and complex behaviors of pedestrians in an intercity crosswalk, for Catalan, English, Italian, and Spanish.

• Referencias bibliográficas
  • Arens, M., & Nagel, H.-H. 2003. “Behavioral Knowledge Representation for the Understanding and Creation of Video Sequences”. Proc. of...
  • Buxton, H., & Gong, S. 1995. “Visual surveillance in a dynamic and uncertain world”. AI-Magazine, I (78), 431-459.
  • Emele, M., Heid, U., Momma, S., and Zajac, R. 1990. “Organizing linguistic knowledge for multilingual generation”, Proceedings of the 13th...
  • Fernández, C., Baiget, P., Roca, X., & Gonzàlez, J. 2007. “Semantic Annotation of Complex Human Scenes for Multimedia Surveillance”. AI*IA...
  • Gerber, R., & Nagel, H.-H. 2008. “Representation of Occurrences for Road Vehicle Traffic”. (Elsevier, Ed.) Artificial Intelligence, 4-5...
  • Gonzàlez, J., Rowe, D., Varona, J., & Roca, F. 2008. “Understanding Dynamic Scenes based on Human Sequence Evaluation”. Image and Vision...
  • Hovy, E.H. 1993. “Automated discourse generation using discourse structure relations”. Artificial Intelligence, 63 (1-2): 341-385
  • Huerta, I., Rowe, D., Mozerov, M., & Gonzàlez, J. 2007. “Improving Background Subtraction based on a Casuistry of Colour-Motion Segmentation...
  • Kamp, H., & Reyle, U. 1993. From Discourse to Logic. Dordrecht, The Netherlands: Kluwer Academic Publishers.
  • Kojima, A., Izumi, M., Tamura, T., and Fukunaga, K. 2000. “Generating Natural Language Description of Human Behavior from Video Images”, ICPR2000,...
  • Kojima, A., Tamura, T., & Fukunaga, K. 2002. “Natural Language Description of Human Activities from Video Images Based on Concept Hierarchy...
  • Lou, J., Liu, Q., Tan, T., and Hu, W. 2002. “Semantic interpretation of object activities in a surveillance system”. Proc. Int. Conf. Pattern...
  • Marburger, H., Neumann, B., & Novak, H. 1981. “Natural Language Dialogue about Moving Objects in an Automatically Analyzed Traffic Scene”....
  • Nagel, H.-H. 2004. “Steps toward a Cognitive Vision System”. AI Magazine, II (25): 31-50.
  • Nevatia, R., Zhao, T., and Hongeng, S. 2003. “Hierarchical language-based representation of events in video streams”. Proc. IEEE Workshop...
  • Reiter, E., & Dale, R. 2000. Building Natural Language Generation Systems. Cambridge: Cambridge University Press.
  • Rowe, D., Rius, I., Gonzàlez, J., & Villanueva, J. 2005. “Improving Tracking by Handling Occlusions”. 3rd ICAPR: 384-393. UK: Springer...
  • Wilson, R., & Keil, F. (eds.). 2001. The MIT Encyclopedia of the Cognitive Sciences. Cambridge: MIT Press.