Influence analysis of piano music immersion virtual reality cooperationbasedon mapping equation

• Autores: Minju Wang
• Localización: Applied Mathematics and Nonlinear Sciences, ISSN-e 2444-8656, Vol. 8, Nº. 1, 2023, págs. 1499-1508
• Idioma: inglés
• Enlaces
  • Texto completo
• Resumen

  • In order to explore the influence of piano music immersive virtual reality cooperation, a method of VRimage recognition based on mapping equation is proposed. Firstly, through the feature extraction of the image, the maincolor of the target image is obtained, and the extracted results are smoothed. Through the two steps of color space conversion and tone reverse mapping, the morphological transformation of the image is realized to obtainthe transition image. The K-means clustering matching operation is performed on the transition image, and the optimal energy equation of color migration is obtained by hierarchical migration and global migration. The reverse mapping color migration algorithm is put into the virtual reality technology. A virtual piano is developedwith HTC Vive suite and Leap Motion sensor fixed on the helmet as the hardware platform, and Unity3Dandrelated StreamVR plug-ins and Leap Motion plug-ins as the software platform. The virtual piano forms a virtual keyboard with a cube component. By compiling the script response function of the cube component beingapproached and pressed or released, the performance events of the virtual piano keyboard are recorded, and the sound of the virtual piano is further realized with the help of MIDI. The experimental results showthat 400groups of data are collected for the four gesture movements, of which 300 groups are used for training modelingand 100 groups for recognition. The gesture recognition results based on HMM are shown in figure 3, and the visible recognition rate can reach more than 88%. It is proved that the immersion of 3D virtual piano is muchhigher than that of 2D virtual piano displayed on ordinary computer screen; Moreover, it can be played naturallywith both hands, and the sense of comfort and fluency is much stronger than the 2D virtual piano played with the help of mouse and keyboard