Human Activity Recognition From Sensorised Patient's Data in Healthcare: A Streaming Deep Learning-Based Approach

• Sandro Hurtado ^[1] ; José García-Nieto ^[1] ; Anton Popov ^[2] ; Ismael Navas-Delgado ^[1]
  1. [1] Universidad de Málaga

     Universidad de Málaga

     Málaga, España

     
  2. [2] Igor Sikorsky Kyiv Polytechnic Institute
• Localización: IJIMAI, ISSN-e 1989-1660, Vol. 8, Nº. 1, 2023 (Ejemplar dedicado a: Special Issue on AI-driven Algorithms and Applications in the Dynamic and Evolving Environments), págs. 23-37
• Idioma: inglés
• DOI: 10.9781/ijimai.2022.05.004
• Enlaces
  • Texto completo (pdf)
• Resumen

  • Physical inactivity is one of the main risk factors for mortality, and its relationship with the main chronic diseases has experienced intensive medical research. A well-known method for assessing people’s activity is the use of accelerometers implanted in wearables and mobile phones. However, a series of main critical issues arise in the healthcare context related to the limited amount of available labelled data to build a classification model. Moreover, the discrimination ability of activities is often challenging to capture since the variety of movement patterns in a particular group of patients (e.g. obesity or geriatric patients) is limited over time. Consequently, the proposed work presents a novel approach for Human Activity Recognition (HAR) in healthcare to avoid this problem. This proposal is based on semi-supervised classification with Encoder-Decoder Convolutional Neural Networks (CNNs) using a combination strategy of public labelled and private unlabelled raw sensor data. In this sense, the model will be able to take advantage of the large amount of unlabelled data available by extracting relevant characteristics in these data, which will increase the knowledge in the innermost layers. Hence, the trained model can generalize well when used in real-world use cases. Additionally, real-time patient monitoring is provided by Apache Spark streaming processing with sliding windows. For testing purposes, a real-world case study is conducted with a group of overweight patients in the healthcare system of Andalusia (Spain), classifying close to 30 TBs of accelerometer sensor-based data. The proposed HAR streaming deep-learning approach properly classifies movement patterns in real-time conditions, crucial for long-term daily patient monitoring.

• Referencias bibliográficas
  • K. González, J. Fuentes, J. L. Márquez, “Physical inactivity, sedentary behavior and chronic diseases,” Korean journal of family medicine,...
  • W. L. Haskell, S. N. Blair, J. O. Hill, “Physical activity: health outcomes and importance for public health policy,” Preventive medicine,...
  • J. Wang, Y. Chen, S. Hao, X. Peng, L. Hu, “Deep learning for sensor-based activity recognition: A survey,” Pattern Recognition Letters, vol....
  • P. Bet, P. C. Castro, M. A. Ponti, “Fall detection and fall risk assessment in older person using wearable sensors: a systematic review,”...
  • A. Bourke, J. O’brien, G. Lyons, “Evaluation of a threshold-based tri-axial accelerometer fall detection algorithm,” Gait & posture,...
  • F. Bagala, C. Becker, A. Cappello, L. Chiari, K. Aminian, J. M. Hausdorff, W. Zijlstra, J. Klenk, “Evaluation of accelerometer-based fall...
  • F. M. Palechor, A. De la Hoz Manotas, P. A. Colpas, J. S. Ojeda, R. M. Ortega, M. P. Melo, “Cardiovascular disease analysis using supervised...
  • D. Arifoglu, A. Bouchachia, “Activity recognition and abnormal behaviour detection with recurrent neural networks,” Procedia Computer Science,...
  • G. Kalouris, E. I. Zacharaki, V. Megalooikonomou, “Improving cnn-based activity recognition by data augmentation and transfer learning,”...
  • A. Papagiannaki, E. I. Zacharaki, K. Deltouzos, R. Orselli, A. Freminet, S. Cela, E. Aristodemou, M. Polycarpou, M. Kotsani, A. Benetos,...
  • C. A. Ronao, S.-B. Cho, “Human activity recognition with smartphone sensors using deep learning neural networks,” Expert systems with applications,...
  • Y. Saez, A. Baldominos, P. Isasi, “A comparison study of classifier algorithms for cross-person physical activity recognition,” Sensors,...
  • T. Lv, X. Wang, L. Jin, Y. Xiao, M. Song, “Margin- based deep learning networks for human activity recognition,” Sensors, vol. 20, no. 7,...
  • F. Cruciani, A. Vafeiadis, C. Nugent, I. Cleland, P. McCullagh, K. Votis, D. Giakoumis, D. Tzovaras, L. Chen, R. Hamzaoui, “Feature learning...
  • J. R. Kwapisz, G. M. Weiss, S. A. Moore, “Activity recognition using cell phone accelerometers,” ACM SIGKDD Explorations Newsletter, vol....
  • A. Reiss, D. Stricker, “Introducing a new benchmarked dataset for activity monitoring,” in 2012 16th International Symposium on Wearable...
  • R. Chereshnev, A. Kertész-Farkas, “Hugadb: Human gait database for activity recognition from wearable inertial sensor networks,” in International...
  • M. Zhang, A. A. Sawchuk, “Usc-had: a daily activity dataset for ubiquitous activity recognition using wearable sensors,” in Proceedings of...
  • D. Balabka, “Semi-supervised learning for human activity recognition using adversarial autoencoders,” in Adjunct Proceedings of the 2019...
  • O. D. Lara, M. A. Labrador, “A survey on human activity recognition using wearable sensors,” IEEE communications surveys & tutorials,...
  • A. Subasi, K. Khateeb, T. Brahimi, A. Sarirete, “Human activity recognition using machine learning methods in a smart healthcare environment,”...
  • D. Anguita, A. Ghio, L. Oneto, X. Parra, J. L. Reyes- Ortiz, “Human activity recognition on smartphones using a multiclass hardwarefriendly...
  • L. Bao, S. S. Intille, “Activity recognition from user- annotated acceleration data,” in International conference on pervasive computing,...
  • W. Wu, S. Dasgupta, E. E. Ramirez, C. Peterson, G. J. Norman, “Classification accuracies of physical activities using smartphone motion sensors,”...
  • Y. Chen, Y. Xue, “A deep learning approach to human activity recognition based on single accelerometer,” in 2015 IEEE International Conference...
  • N. Y. Hammerla, S. Halloran, T. Plötz, “Deep, convolutional, and recurrent models for human activity recognition using wearables,” arXiv...
  • M. Zeng, T. Yu, X. Wang, L. T. Nguyen, O. J. Mengshoel, I. Lane, “Semi-supervised convolutional neural networks for human activity recognition,”...
  • A. D. Antar, M. Ahmed, M. A. R. Ahad, “Challenges in sensor-based human activity recognition and a comparative analysis of benchmark datasets:...
  • S. Slim, A. Atia, M. Elfattah, M. Mostafa, “Survey on human activity recognition based on acceleration data,” International Journal of Advanced...
  • Z. Hussain, M. Sheng, W. E. Zhang, “Different approaches for human activity recognition: A survey,” arXiv preprint arXiv:1906.05074, 2019.
  • A. Gupta, K. Gupta, K. Gupta, K. Gupta, “A survey on human activity recognition and classification,” in 2020 International Conference on...
  • S. Reddy, M. Mun, J. Burke, D. Estrin, M. Hansen, M. Srivastava, “Using mobile phones to determine transportation modes,” ACM Transactions...
  • F. Foerster, M. Smeja, J. Fahrenberg, “Detection of posture and motion by accelerometry: a validation study in ambulatory monitoring,” Computers...
  • J. R. Kwapisz, G. M. Weiss, S. A. Moore, “Activity recognition using cell phone accelerometers,” ACM SIGKDD Explorations Newsletter, vol....
  • A. Reiss, M. Weber, D. Stricker, “Exploring and extending the boundaries of physical activity recognition,” in 2011 IEEE International Conference...
  • M. Zhang, A. A. Sawchuk, “Usc-had: A daily activity dataset for ubiquitous activity recognition using wearable sensors,” in ACM International...
  • R. Chereshnev, A. Kertész-Farkas, “Hugadb: Human gait database for activity recognition from wearable inertial sensor networks,” in Analysis...
  • H. He, E. A. Garcia, “Learning from imbalanced data,” IEEE Transactions on knowledge and data engineering, vol. 21, no. 9, pp. 1263–1284,...
  • N. V. Chawla, K. W. Bowyer, L. O. Hall, W. P. Kegelmeyer, “Smote: synthetic minority over- sampling technique,” Journal of artificial intelligence...
  • K. T. Nguyen, F. Portet, C. Garbay, “Dealing with imbalanced data sets for human activity recognition using mobile phone sensors,” 2018.
  • S. Ertekin, J. Huang, L. Bottou, L. Giles, “Learning on the border: active learning in imbalanced data classification,” in Proceedings of...
  • D. A. Cieslak, T. R. Hoens, N. V. Chawla, W. P. Kegelmeyer, “Hellinger distance decision trees are robust and skew-insensitive,” Data Mining...
  • L. G. Fahad, S. F. Tahir, M. Rajarajan, “Activity recognition in smart homes using clustering based classification,” in 2014 22nd International...
  • A. Bulling, U. Blanke, B. Schiele, “A tutorial on human activity recognition using body-worn inertial sensors,” vol. 46, no. 3, 2014, doi:...
  • Z. Zhang, “Improved adam optimizer for deep neural networks,” in 2018 IEEE/ACM 26th International Symposium on Quality of Service (IWQoS),...
  • S. Ioffe, C. Szegedy, “Batch normalization: Accelerating deep network training by reducing internal covariate shift,” arXiv preprint arXiv:1502.03167,...
  • J. Snoek, H. Larochelle, R. P. Adams, “Practical bayesian optimization of machine learning algorithms,” in Advances in neural information...