Int J Performability Eng ›› 2022, Vol. 18 ›› Issue (9): 660-667.doi: 10.23940/ijpe.22.09.p7.660667

Previous Articles     Next Articles

Human Activity Recognition using Ensemble Convolutional Neural Networks and Long Short-Term Memory

Sonika Jindala,*, Monika Sachdevaa, and Alok Kumar Singh Kushwahab   

  1. aDepartment of Computer Science and Engineering, IKG Punjab Technical University Jalandhar, Kapurthala, 144603, India;
    bDepartment of Computer Science and Engineering, Guru Ghasidas Vishawavidyalya, Bilaspur, 495009, India
  • Submitted on ; Revised on ; Accepted on
  • Contact: *E-mail address:

Abstract: Recent advances in artificial intelligence have transformed the world into a place where things can be recognized, the surroundings can be learned, and future sequences can be predicted. The advent of advanced technologies has resulted in improving the system and reducing the cost of monitoring systems. This study proposes an advanced ensemble approach of convolutional neural networks and long short-term memory (CNN-LSTM) for human activity recognition. The proposed approach evaluates the spatio-temporal features and recognizes the activities with enhanced accuracy. The method determines the activities by utilizing the RGB, skeleton, and depth-based attributes available in the dataset of UTD-MHAD. The experiments are conducted for the hand/arm-based 21 activities for which videos were captured with the help of depth and inertial sensors. The result evaluations are conducted with the measures of accuracy, precision, recall, and f-measure. These evaluations indicate the superior performance of the proposed ensemble approach compared to state-of-art techniques.

Key words: human activity recognition, image and video processing, pattern recognition, convolutional neural networks, long short-term memory