Abstract
Machine Learning has recently emerged as a new paradigm for processing all types of information. In particular, Artificial Intelligence is attractive to corporations & research institutions as it provides innovative solutions for unsolved problems, & it enjoys a great popularity among the general public. However, despite the fact that Machine Learning offers huge opportunities for the IT industry, Artificial Intelligence technology is still at its infancy, with many issues to be addressed. In this paper, we present a survey of quaternion applications in Neural Networks, one of the most promising research lines in artificial vision which also has a great potential in several other topics. The aim of this paper is to provide a better understanding of the design challenges of Quaternion Neural Networks & identify important research directions in this increasingly important area.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Notes
- 1.
The DECODA dataset is focused on speech mining methods from spontaneous speech recorded in call-centers. Its many application is to measure the robustness and weak-supervision performance of any model [4].
- 2.
The TIMIT dataset consists of 4,288 sentences, from 536 different speakers. It contains the audio examples and its transcription [8].
References
Arena, P., Fortuna, L., Muscato, G., Xibilia, M.G.: Multilayer perceptrons to approximate quaternion valued functions. Neural Netw. 10(2), 335–342 (1997)
Bayro-Corrochano, E., Scheuermann, G.: Geometric Algebra Computing: in Engineering and Computer Science. Springer Science & Business Media, Berlin (2010)
Bayro-Corrochano, E., Trujillo, N., Naranjo, M.: Quaternion fourier descriptors for the preprocessing and recognition of spoken words using images of spatiotemporal representations. J. Math. Imaging Vis. 28(2), 179–190 (2007)
Bechet, F., et al.: Decoda: a call-centre human-human spoken conversation corpus. In: LREC, pp. 1343–1347 (2012)
Chou, J.C.: Quaternion kinematic and dynamic differential equations. IEEE Trans. Robot. Autom. 8(1), 53–64 (1992)
Cui, Y., Takahashi, K., Hashimoto, M.: Design of control systems using quaternion neural network and its application to inverse kinematics of robot manipulator. In: Proceedings of the 2013 IEEE/SICE International Symposium on System Integration, pp. 527–532. IEEE (2013)
Gai, S., Yang, G., Wan, M.: Employing quaternion wavelet transform for banknote classification. Neurocomputing 118, 171–178 (2013)
Garofolo, J.S., Lamel, L.F., Fisher, W.M., Fiscus, J.G., Pallett, D.S.: DARPA TIMIT acoustic-phonetic continous speech corpus CD-ROM. NIST speech disc 1–1.1. NASA STI/Recon technical report n, 93 (1993)
Gaudet, C.J., Maida, A.S.: Deep quaternion networks. In: 2018 International Joint Conference on Neural Networks (IJCNN), pp. 1–8. IEEE (2018)
Greenblatt, A., Mosquera-Lopez, C., Agaian, S.: Quaternion neural networks applied to prostate cancer gleason grading. In: 2013 IEEE International Conference on Systems, Man, and Cybernetics, pp. 1144–1149. IEEE (2013)
He, K., Gkioxari, G., Dollár, P., Girshick, R.: Mask r-cnn. In: Proceedings of the IEEE international conference on computer vision, pp. 2961–2969 (2017)
He, K., Zhang, X., Ren, S., Sun, J.: Deep residual learning for image recognition. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 770–778 (2016)
Hirose, A.: Complex-Valued Neural Networks: Theories and Applications, vol. 5. World Scientific, Singapore (2003)
Hitzer, E., Nitta, T., Kuroe, Y.: Applications of clifford’s geometric algebra. Adv. Appl. Clifford Algebras 23(2), 377–404 (2013)
Hu, J., Shen, L., Sun, G.: Squeeze-and-excitation networks. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 7132–7141 (2018)
Jourabloo, A., Liu, X.: Large-pose face alignment via CNN-based dense 3D model fitting. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 4188–4196 (2016)
Kamnitsas, K., et al.: Efficient multi-scale 3D CNN with fully connected CRF for accurate brain lesion segmentation. Med. Image Anal. 36, 61–78 (2017)
Kobayashi, M., Muramatsu, J., Yamazaki, H.: Construction of high-dimensional neural networks by linear connections of matrices. Electronics and Communications in Japan (Part III: Fundamental Electronic Science), 86(11), 38–45 (2003)
Kolanowski, K., Świetlicka, A., Kapela, R., Pochmara, J., Rybarczyk, A.: Multisensor data fusion using elman neural networks. Appl. Math. Comput. 319, 236–244 (2018)
Kuroe, Y.: Models of clifford recurrent neural networks and their dynamics. In: The 2011 International Joint Conference on Neural Networks, pp. 1035–1041. IEEE (2011)
Kusamichi, H., Isokawa, T., Matsui, N., Ogawa, Y., Maeda, K.: A new scheme for color night vision by quaternion neural network. In: Proceedings of the 2nd International Conference on Autonomous Robots and Agents, vol. 1315. Citeseer (2004)
Liu, Y., Zheng, Y., Lu, J., Cao, J., Rutkowski, L.: Constrained quaternion-variable convex optimization: a quaternion-valued recurrent neural network approach. IEEE Trans. Neural Netw. Learn. Syst. 31(3), 1022–1035 (2019)
Luo, L., Feng, H., Ding, L.: Color image compression based on quaternion neural network principal component analysis. In: 2010 International Conference on Multimedia Technology, pp. 1–4. IEEE (2010)
Marins, J.L., Yun, X., Bachmann, E.R., McGhee, R.B., Zyda, M.J.: An extended kalman filter for quaternion-based orientation estimation using MARG sensors. In: Proceedings 2001 IEEE/RSJ International Conference on Intelligent Robots and Systems. Expanding the Societal Role of Robotics in the the Next Millennium (Cat. No. 01CH37180), vol. 4, pp. 2003–2011. IEEE (2001)
Olver, H., Sommer, G.: Computer Algebra and Geometric Algebra with Applications. Springer, Berlin (2005)
Oyama, K., Hirose, A.: Phasor quaternion neural networks for singular point compensation in polarimetric-interferometric synthetic aperture radar. IEEE Trans. Geosci. Remote Sens. 57(5), 2510–2519 (2018)
Parcollet, T., Morchid, M., Bousquet, P.M., Dufour, R., Linarès, G., De Mori, R.: Quaternion neural networks for spoken language understanding. In: 2016 IEEE Spoken Language Technology Workshop (SLT), pp. 362–368. IEEE (2016)
Parcollet, T., Morchid, M., Linares, G.: Deep quaternion neural networks for spoken language understanding. In: 2017 IEEE Automatic Speech Recognition and Understanding Workshop (ASRU), pp. 504–511. IEEE (2017)
Parcollet, T., et al.: Quaternion recurrent neural networks (2018). arXiv preprint arXiv:1806.04418
Su, H., Qi, C.R., Li, Y., Guibas, L.J.: Render for cnn: Viewpoint estimation in images using CNNS trained with rendered 3D model views. In: Proceedings of the IEEE International Conference on Computer Vision, pp. 2686–2694 (2015)
Takahashi, K., Takahashi, S., Cui, Y., Hashimoto, M.: Remarks on computational facial expression recognition from hog features using quaternion multi-layer neural network. In: Mladenov, V., Jayne, C., Iliadis, L. (eds.) EANN 2014. CCIS, vol. 459, pp. 15–24. Springer, Cham (2014). https://doi.org/10.1007/978-3-319-11071-4_2
Tay, Y., et al.: Lightweight and efficient neural natural language processing with quaternion networks (2019). arXiv preprint arXiv:1906.04393
Wang, P.S., Liu, Y., Guo, Y.X., Sun, C.Y., Tong, X.: O-CNN: Octree-based convolutional neural networks for 3D shape analysis. ACM Trans. Graph. (TOG) 36(4), 1–11 (2017)
Xu, D., Zhang, L., Zhang, H.: Learning algorithms in quaternion neural networks using GHR calculus. Neural Netw. World 27(3), 271 (2017)
Xu, D., Xia, Y., Mandic, D.P.: Optimization in quaternion dynamic systems: gradient, hessian, and learning algorithms. IEEE Trans. Neural Netw. Learn. Syst 27(2), 249–261 (2015)
Zhu, X., Xu, Y., Xu, H., Chen, C.: Quaternion convolutional neural networks. In: Proceedings of the European Conference on Computer Vision (ECCV), pp. 631–647 (2018)
Acknowledgments
This research has been supported by the project “Intelligent and sustainable mobility supported by multi-agent systems and edge computing (InEDGEMobility): Towards Sustainable Intelligent Mobility: Blockchain-based framework for IoT Security”, Reference: RTI2018-095390-B-C32, financed by the Spanish Ministry of Science, Innovation and Universities (MCIU), the State Research Agency (AEI) and the European Regional Development Fund (FEDER).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2020 Springer Nature Switzerland AG
About this paper
Cite this paper
García-Retuerta, D., Casado-Vara, R., Martin-del Rey, A., De la Prieta, F., Prieto, J., Corchado, J.M. (2020). Quaternion Neural Networks: State-of-the-Art and Research Challenges. In: Analide, C., Novais, P., Camacho, D., Yin, H. (eds) Intelligent Data Engineering and Automated Learning – IDEAL 2020. IDEAL 2020. Lecture Notes in Computer Science(), vol 12490. Springer, Cham. https://doi.org/10.1007/978-3-030-62365-4_43
Download citation
DOI: https://doi.org/10.1007/978-3-030-62365-4_43
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-62364-7
Online ISBN: 978-3-030-62365-4
eBook Packages: Computer ScienceComputer Science (R0)