Ir al contenido

Documat

A Fuzzy System for Detection of Interaction Demanding and Nodding Assent Based on Stereo Vision

  • Autores: E. Aguirre, Miguel García Silvente Árbol académico, Antonio González Muñoz Árbol académico, Paul Rui, Rafael Muñoz Salinas Árbol académico
  • Localización: JoPha: Journal of Physical Agents, ISSN-e 1888-0258, Vol. 1, Nº. 1, 2007, págs. 15-26
  • Idioma: inglés
  • DOI: 10.14198/jopha.2007.1.1.03
  • Enlaces
  • Resumen

    • Despite of the advances achieved in the past years in order to design more natural interfaces between intelligent systems and humans, there is still a great effort to be done.

      Considering a robot as an intelligent system, the determination of some typical interaction situations is an interesting ability to achieve. This paper shows a fuzzy system that allows the visual detection of possible interaction demands and the shaking or nodding of the head. To achieve this objective, the robot has first to carry out the detection and tracking of the people using the stereo vision system. Then, the level of interest of a person to interact with the robot is calculated by analyzing his/her position and the pose of his/her head. The head pose is estimated in realtime by a view based approach using Support Vector Machines (SVM). Whenever the level of interest achieves an high value, the person is analyzed in more detail to detect the position and the motions of his/her arms as well as whether the person is shaking or nodding his/her head. This information is managed by a fuzzy system to detect a possible interest demand or the intention of the person to say yes or no using his/her head. At the end of the paper, some experiments are shown to validate the proposal.Finally, future work is addressed.

  • Referencias bibliográficas
    • [1] L. Snidaro, C. Micheloni, and C. Chiavedale, “Video security for ambient intelligence,” IEEE Transactions on Systems, Man and Cybernetics, Part...
    • [2] M. Bennewitz, F. Faber, D. Joho, M. Schreiber, and S. Behnke, “Integrating vision and speech for conversations with multiple persons,”...
    • [3] W. Song, D. Kim, J. Kim, and Z. Bien, “Visual servoing for a user’s mouth with effective intention reading in a wheelchair-based robotic arm,”...
    • [4] S. S. Ghidary, Y. Nakata, H. Saito, M. Hattori, and T. Takamori, “Multimodal interaction of human and home robot in the context of room...
    • [5] R. Muñoz-Salinas, E. Aguirre, M. García-Silvente, and A. González, "Un sistema visual difuso para la detección de intereses en la...
    • [6] O. Holland and G. Walter, "The pioneer of real artificial life," in Proceedings of the International Workshop on Artificial Life,...
    • [7] R. Beckers et al., "From local actions to global tasks: Stigmergy and collective robotics," in Proceedings of Artificial Life...
    • [8] J. L. Deneubourg, S. Goss, N. Franks, A. Sendova-Franks, C. Detrain, and L. Chretien, "The dynamics of collective sorting robot-like...
    • [9] T. Fong, I. Nourbakhsh, and K. Dautenhahn, "A survey of socially interactive robots," Robotics and Autonomous Systems, vol. 42,...
    • [10] C. Breazeal, Designing Sociable Robots, MIT Press, 2002.
    • [11] I. Nourbakhsh, J. Bobenage, S. Grange, R. Lutz, R. Meyer, and A. Soto, "An affective mobile robot educator with a full-time job,"...
    • [12] J. Pineau, M. Montemerlo, M. Pollack, N. Roy, and S. Thrun, "Towards robotic assistants in nursing homes: Challenges and results,"...
    • [13] B. Scassellati, "Foundations for a theory of mind for a humanoid robot," Ph.D. dissertation, 2001, supervisor-Rodney Brooks.
    • [14] K. Dautenhahn and A. Billard, "Bringing up robots or - the psychology of socially intelligent robots: from theory to implementation,"...
    • [15] J. Zlatev, "The epigenesis of meaning in human beings, and possibly in robots," Minds and Machines, vol. 11, no. 2, pp. 155–195,...
    • [16] K. Dautenhahn, "I could be you — the phenomenological dimension of social understanding," Cybernetics and Systems, vol. 25, no....
    • [17] S. Restivo, "Bringing up and booting up: Social theory and the emergence of socially intelligent robots," in IEEE International...
    • [18] K. Dautenhahn and B. Ogden, "From embodied to socially embedded agents: implications for interaction-aware robots," Cognitive...
    • [19] PtGrey, "Bumblebee. Binocular stereo vision camera system," [http://www.ptgrey.com](http://www.ptgrey.com), 2005.
    • [20] R. Muñoz-Salinas, E. Aguirre, and M. García-Silvente, "People detection and tracking using stereo vision and color," Image and...
    • [21] N. Cristianini and J. Shawe-Taylor, An Introduction to Support Vector Machines (and other Kernel Based Methods), C. U. Press, Ed. Cambridge...
    • [22] M. Harville, "Stereo person tracking with adaptive plan-view templates of height and occupancy statistics," Image and Vision...
    • [23] I. Haritaoglu, D. Beymer, and M. Flickner, "Ghost 3D: Detecting body posture and parts using stereo," in Workshop on Motion and...
    • [24] K. Hayashi, M. Hashimoto, K. Sumi, and K. Sasakawa, "Multiple-person tracker with a fixed slanting stereo camera," in 6th IEEE...
    • [25] C. Eldershaw and M. Yim, "Motion planning of legged vehicles in an unstructured environment," in IEEE International Conference...
    • [26] S. Thompson and S. Kagami, "Stereo vision terrain modeling for non-planar mobile robot mapping and navigation," in IEEE International...
    • [27] P. Viola and M. Jones, "Rapid object detection using a boosted cascade of simple features," in IEEE Conf. on Computer Vision...
    • [28] R. Lienhart and J. Maydt, "An extended set of Haar-like features for rapid object detection," in IEEE Conf. on Image Processing,...
    • [29] Intel, OpenCV: Open source Computer Vision library, 2005.
    • [30] D. Comaniciu, V. Ramesh, and P. Meer, "Real-time tracking of non-rigid objects using mean shift," in IEEE Conference on Computer...
    • [31] H. W. Kuhn, "The Hungarian method for the assignment problem," Naval Research Logistics Quarterly, vol. 2, pp. 83–97, 1955.
    • [32] S. Birchfield, "Elliptical head tracking using intensity gradients and color histograms," in IEEE Conference on Computer Vision...
    • [33] G. Henry and Dunteman, Principal Components Analysis, SAGE Publications, 1989.
    • [34] C. Chang and C. Lin, "Libsvm: A library for support vector machines," [http://www.csie.ntu.edu.tw/\~cjlin/libsvm/](http://www.csie.ntu.edu.tw/~cjlin/libsvm/),...
Fundación Dialnet

Mi Documat

Opciones de artículo

Opciones de compartir

Opciones de entorno