Multimedia ResearchISSN:2582-547X

Multi-Object Tracking Using Improved Lion-Based Clustering With Reference To LVP Pattern

Abstract

MOT in video surveillance is still a challenging aspect due to various complexities like complex occlusion, different poses, small sizes of objects, and so on. Henceforth more research works are under process that concentrate on solving object tracking problems by considering both spatial and visual information. Under these circumstances, this paper aims to propose a new MOT model that tracks the objects precisely. At first, the visibility model of tracking is proposed based on the second derivative model, which considers the second derivative function to predict the objects. Secondly, a spatial tracking model is developed using a nonlinear function. Meanwhile, the objects are tracked by subjecting a new optimization algorithm namely Female Update enabled Cub Updating in LA (FU-CU-LA) that effectively tracks the objects even if moved to the subsequent frames. Subsequently, spatial tracking and optimization-based tracking are integrated, and finally, the resultant center point is integrated with the visual tracking model. The proposed FU-CU-LA-based tacking system is compared with other models to certain measures and proves the superiority of the proposed work.

References

  • Liu, R., Huang, M., Wang, L., Bi, C. and Tao, Y., “PDT-YOLO: A Roadside Object-Detection Algorithm for Multiscale and Occluded Targets”, Sensors, Vol. 24(7), pp.2302, 2024.
  • Jeonghwan Gwak, " Multi-object tracking through learning relational appearance features and motion patterns", Computer Vision and Image Understanding, vol. 162, pp. 103-115, September 2017.
  • Wan Li and Cheng Wenzhi, " An online learned hough forest model based on improved multi-feature fusion matching for multi-object tracking", Multimedia Tools and Applications, pp. 1-14, 2018.
  • Li Liang-qun, ZhanXi-yang, Liu Zong-xiang, and XieWei-xin, " Fuzzy logic approach to visual multi-object tracking", Neurocomputing, vol. 281, pp. 139-151, 2018.
  • Liye Gui, Lisha He, Zhongyi Ni, and Tianlong Hong, " Visualized image segmentation for multi-object tracking by weak clustering technique", Multimedia Tools and Applications, pp. 1-9, 2018.
  • Zhao, R., Zhang, X. and Zhang, J., “PSMOT: Online Occlusion-Aware Multi-Object Tracking Exploiting Position Sensitivity”, Sensors, Vol. 24(4), p.1199, 2024.
  • Wang, Y.H., Hsieh, J.W., Chen, P.Y., Chang, M.C., So, H.H. and Li, X., “Smiletrack: Similarity learning for occlusion-aware multiple object tracking”, In Proceedings of the AAAI Conference on Artificial Intelligence (Vol. 38, No. 6, pp. 5740-5748), 2024, March.
  • Ju Hong Yoon, Chang-Ryeol Lee, Ming-Hsuan Yang and Kuk-Jin Yoon, " Structural Constraint Data Association for Online Multi-object Tracking", International Journal of Computer Vision, pp. 1-21, 2018.
  • S. C. Wong, V. Stamatescu, A. Gatt, D. Kearney, I. Lee, and M. D. McDonnell, "Track Everything: Limiting Prior Knowledge in Online Multi-Object Recognition," in IEEE Transactions on Image Processing, vol. 26, no. 10, pp. 4669-4683, Oct. 2017.
  • W. Hu, W. Li, X. Zhang, and S. Maybank, "Single and Multiple Object Tracking Using a Multi-Feature Joint Sparse Representation," in IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 37, no. 4, pp. 816-833, 1 April 2015.
  • A. Dehghan and M. Shah, "Binary Quadratic Programing for Online Tracking of Hundreds of People in Extremely Crowded Scenes," in IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 40, no. 3, pp. 568-581, 1 March 2018.
  • S. Li, G. Battistelli, L. Chisci, W. Yi, B. Wang and L. Kong, "Computationally Efficient Multi-Agent Multi- Object Tracking With Labeled Random Finite Sets," in IEEE Transactions on Signal Processing, vol. 67, no. 1, pp. 260-275, 1 Jan.1, 2019.
  • S. Duffner and J. Odobez, "Track Creation and Deletion Framework for Long-Term Online Multiface Tracking," in IEEE Transactions on Image Processing, vol. 22, no. 1, pp. 272-285, Jan. 2013.
  • H. Yang, S. Qu, C. Chen and B. Yang, "Multiple Objects Tracking With Improved Sparse Representation and Rank Based Dynamic Estimation," in IEEE Access, vol. 6, pp. 42264-42278, 2018.
  • W. Luo, B. Stenger, X. Zhao, and T. Kim, "Trajectories as Topics: Multi-Object Tracking by Topic Discovery," in IEEE Transactions on Image Processing, vol. 28, no. 1, pp. 240-252, Jan. 2019.
  • X. Zhou, Y. Li, B. He and T. Bai, "GM-PHD-Based Multi-Target Visual Tracking Using Entropy Distribution and Game Theory," in IEEE Transactions on Industrial Informatics, vol. 10, no. 2, pp. 1064-1076, May 2014.
  • P. Chen, Y. Dang, R. Liang, W. Zhu, and X. He, "Real-Time Object Tracking on a Drone With Multi-Inertial Sensing Data," in IEEE Transactions on Intelligent Transportation Systems, vol. 19, no. 1, pp. 131-139, Jan. 2018.
  • Z. H. Khan, I. Y. Gu, and A. G. Backhouse, "Robust Visual Object Tracking Using Multi-Mode Anisotropic Mean Shift and Particle Filters," in IEEE Transactions on Circuits and Systems for Video Technology, vol. 21, no. 1, pp. 74-87, Jan. 2011.
  • Y. Lee, Z. Tang, and J. Hwang, "Online-Learning-Based Human Tracking Across Non-Overlapping Cameras," in IEEE Transactions on Circuits and Systems for Video Technology, vol. 28, no. 10, pp. 2870-2883, Oct. 2018.
  • K. Ahmadi and E. Salari, "Small dim object tracking using a multi objective particle swarm optimisation technique," in IET Image Processing, vol. 9, no. 9, pp. 820-826, 9 2015.
  • W. Qu, D. Schonfeld, and M. Mohamed, "Real-Time Distributed Multi-Object Tracking Using Multiple Interactive Trackers and a Magnetic-Inertia Potential Model," in IEEE Transactions on Multimedia, vol. 9, no. 3, pp. 511-519, April 2007.
  • Y. Yun, I. Y. Gu, and H. Aghajan, "Multi-View ML Object Tracking With Online Learning on Riemannian Manifolds by Combining Geometric Constraints," in IEEE Journal on Emerging and Selected Topics in Circuits and Systems, vol. 3, no. 2, pp. 185-197, June 2013.
  • J. Liu, X. Cao, Y. Li, and B. Zhang, "Online Multi-Object Tracking Using Hierarchical Constraints for Complex Scenarios," in IEEE Transactions on Intelligent Transportation Systems, vol. 19, no. 1, pp. 151-161, Jan. 2018.
  • J. Li, X. Zhou, S. Chan, and S. Chen, "Robust Object Tracking via Large Margin and Scale-Adaptive Correlation Filter," in IEEE Access, vol. 6, pp. 12642-12655, 2018.
  • K. Granström, L. Svensson, S. Reuter, Y. Xia and M. Fatemi, "Likelihood-Based Data Association for Extended Object Tracking Using Sampling Methods," in IEEE Transactions on Intelligent Vehicles, vol. 3, no. 1, pp. 30- 45, March 2018.
  • Rajakumar Boothalingam, " Optimization using lion algorithm: a biological inspiration from lion’s social behavior", Evolutionary Intelligence, vol.11, no. 1-2, pp.31–52, 2018.
  • Xiaolong Zhou, Youfu Li, Bingwei He, and TianxiangBai, "GM-PHD-Based Multi-Target Visual Tracking Using Entropy Distribution and Game Theory", IEEE transactions on industrial informatics, Vol. 10, No. 2, pp. 1064- 1076, May 2014.
  • Felix M. Philip and Rajeswari Mukesh, " Hybrid tracking model for multiple object videos using second derivative based visibility model and tangential weighted spatial tracking model", International Journal of Computational Intelligence Systems, vol. 9, no. 5, 2016.
  • UCSD datasets http://www.svcl.ucsd.edu/projects/anomaly/dataset.htm.
  • Heng, W.J., Ngan, K.N., “The implementation of object-based shot boundary detection using edge tracing and tracking”, Proceedings of the 1999 IEEE International Symposium on Circuits and Systems, Vol. 4, pp. 439-442, 1999.
  • Kanungo, Tapas, Qigong Zheng, “Estimating degradation model parameters using neighborhood pattern distributions: an optimization approach”, IEEE Transactions onPattern Analysis and Machine Intelligence, Vol. 26, no. 4, pp 520-524, 2004.
  • Kratz L, Nishino K., "Tracking pedestrians using local spatio-temporal motion patterns in extremely crowded scenes", IEEE Trans Pattern Anal Mach Intell., vol. 34, no. 5, pp. 987-1002, 2012.
  • Multiple objects tracking performance from http://www3.ntu.edu.sg/home/JSYUAN/index_files/papers/04270203_Yang_Yuan_Wu_CVPR07.pdf
  • T. Y. Hung and K. C. Fan, "Local vector pattern in high-order derivative space for face recognition," IEEE International Conference on Image Processing (ICIP), pp. 239-243, 2014.