Multimedia ResearchISSN:2582-547X

Crowd Behaviour Recognition using Enhanced Butterfly Optimization Algorithm based Recurrent Neural Network

Abstract

The crowd emotion recognition is a motivating research area that helps the security personals by means of the public emotions to interpret the crowd activity in a region. Approximately several conventional techniques exploit the lowlevel visual features to comprehend the behaviors of a crowd which widen the gap between the high as well as the low-level features. The objective model is used to expand the automatic algorithm for emotion recognition; hence this work uses the Recurrent Neural Network (RNN). The Bhattacharya distance is used for effectual emotion recognition, which is necessary to choose video keyframes. The keyframes are subjected to the Space-Time Interest Points (STI) descriptor which extracts features that structure input vector to the classifier. RNN is trained by exploiting the enhanced Butterfly Optimization Algorithm (Enhanced-BOA). The developed classifier identifies the crowd emotions, like Escape, Angry, Happy, Fight, Running/Walking, Normal, as well as Violence. The experimentation of the developed technique revealed that developed technique obtained a maximum accuracy, sensitivity as well as specificity, correspondingly.

References

  • Y. Zhang, L. Qin, R. Ji, S. Zhao, Q. Huang and J. Luo, "Exploring Coherent Motion Patterns via Structured Trajectory Learning for Crowd Mood Modeling," in IEEE Transactions on Circuits and Systems for Video Technology, volume. 27, number. 3, page no. 635-648, March 2017.
  • Y. Mao, X. Fan, Z. Fan and W. He, "Modeling Group Structures With Emotion in Crowd Evacuation," IEEE Access, volume. 7, page no. 140010-140021, 2019.
  • P. Lv, Z. Zhang, C. Li, Y. Guo, B. Zhou and M. Xu, "Crowd Behavior Evolution With Emotional Contagion in Political Rallies," in IEEE Transactions on Computational Social Systems, vol. 6, no. 2, pp. 377-386, April 2019.
  • H. Fradi, B. Luvison and Q. C. Pham, "Crowd Behavior Analysis Using Local Mid-Level Visual Descriptors," IEEE Transactions on Circuits and Systems for Video Technology, volume. 27, number. 3, page no. 589-602, March 2017.
  • Y. Li, "A Deep Spatiotemporal Perspective for Understanding Crowd Behavior," in IEEE Transactions on Multimedia, volume. 20, number. 12, page no. 3289-3297, Dec. 2018.
  • X. Wang, Z. He, R. Sun, L. You, J. Hu and J. Zhang, "A Crowd Behavior Identification Method Combining the Streakline With the High-Accurate Variational Optical Flow Model," in IEEE Access, vol. 7, pp. 114572-114581, 2019.
  • C. Schuldt, L. Barbara, and S.- Stockholm, “Recognizing Human Actions : A Local SVM Approach ∗ Dept . of Numerical Analysis and Computer Science,” Pattern Recognition,” ICPR. Proc. 17th Int. Conf., volume. 3, page no. 32–36, 2004.
  • W. Yin, K. Kann, M. Yu, H. Schütze, Comparative study of cnn and rnn for nat- ural language processing, 2017.
  • S. Han , J. Kang , H. Mao , Y. Hu , X. Li , Y. Li , D. Xie , H. Luo , S. Yao , Y. Wang , Ese: efficient speech recognition engine with sparse lstm on fpga, in: Proceedings of the ACM/SIGDA International Symposium On Field-Programmable Gate Arrays, ACM, page no. 75–84, 2017.
  • C. Wigington , S. Stewart , B. Davis , B. Barrett , B. Price , S. Cohen , Data augmenta- tion for recognition of handwritten words and lines using a cnn-lstm network, in: 14th IAPR International Conference On Document Analysis and Recognition (ICDAR), IEEE, page no. 639–645. 2017.
  • R. B. Blair and A. E. Launer, "Butterfly diversity and human land use: Species assemblages along an urban grandient," Biological conservation, volume. 80, page no. 113-125, 1997.
  • E. Pollard and T. J. Yates, Monitoring butterflies for ecology and conservation: the British butterfly monitoring scheme: Springer Science & Business Media, 1994.
  • M. S. Bodri, "Puddling Behavior of Temperate Butterflies: Preference for Urine of Specific Mammals?,"The Journal of the Lepidopterists' Society, volume. 72, page no. 116-121, 2018.
  • D. Yang, G. Li, and G. Cheng, "On the efficiency of chaos optimization algorithms for global optimization," Chaos, Solitons & Fractals, volume. 34, page no. 1366-1375, 2007.
  • C. Rim, S. Piao, G. Li, and U. Pak, "A niching chaos optimization algorithm for multimodal optimization,"Soft Computing, volume. 22, page no. 621-633, 2018.
  • R. Cristin,Dr.V.Cyril Raj and Ramalatha Marimuthu,"Face Image Forgery Detection by Weight Optimized Neural Network Model",Multimedia Research,Volume 2, Issue 2, April 2019.
  • Raviraj Vishwambhar Darekar,Ashwinikumar Panjabrao Dhande,"Emotion Recognition from Speech Signals Using DCNN with Hybrid GA-GWO Algorithm",Multimedia Research,Volume 2, Issue 4, October 2019.
    •

Access options

  • Price $
  • Offer $
Buy article PDF

DOI : https://doi.org/10.46253/j.mr.v3i3.a3

Author information

Affiliations

Western University of Ontario, Ontario, Canada

Publisher Information

  • Received

    11 May

  • Revised

    25 June

  • Accepted

    3 July

Keywords
Crowd Behaviour; Video Surveillance; Emotion Recognition; Optimization; RNN

Publisher : Resbee Info Technologies Pvt Ltd