Object Detection and Visual Intelligence in Retail Environments: A Deep Learning Approach for Inventory and Behavior Analytics

Hewa Zangana

doi:10.58190/imiens.2025.124

Authors

Hewa Majeed Zangana Duhok Polytechnic University, Duhok, Iraq https://orcid.org/0000-0001-7909-254X

DOI:

https://doi.org/10.58190/imiens.2025.124

Keywords:

Behavior Analytics, Deep Learning, Inventory Management, Object Detection, Visual Intelligence

Abstract

The integration of visual intelligence technologies in retail environments has revolutionized inventory tracking and customer behavior analysis. This study proposes a comprehensive deep learning-based framework that leverages advanced object detection models to enhance retail operations through real-time visual insights. Our method integrates state-of-the-art architectures such as YOLOv8 and Mask R-CNN to accurately identify, track, and classify products on shelves while simultaneously analyzing shopper interactions and movement patterns. By utilizing annotated datasets collected from real-world retail scenarios, the system demonstrates high accuracy in both inventory status recognition and behavioral inference, outperforming traditional sensor-based methods. Furthermore, we introduce a hybrid loss function and a scene-aware postprocessing module that improves detection in occluded or dynamic environments. The experimental results show that our approach enables automated planogram compliance checks, customer heatmap generation, and actionable analytics, thus supporting intelligent decision-making for retailers. This research contributes a scalable and real-time visual system that bridges the gap between deep learning and practical retail intelligence.

Downloads

Download data is not yet available.

References

[1] Y. Amit, P. Felzenszwalb, and R. Girshick, “Object detection,” in Computer Vision: A Reference Guide, Springer, 2021, pp. 875–883.

[2] W. Chen, Y. Li, Z. Tian, and F. Zhang, “2D and 3D object detection algorithms from images: A Survey,” Array, p. 100305, 2023.

[3] J. Deng, X. Xuan, W. Wang, Z. Li, H. Yao, and Z. Wang, “A review of research on object detection based on deep learning,” in Journal of Physics: Conference Series, IOP Publishing, 2020, p. 012028.

[4] L. Du, R. Zhang, and X. Wang, “Overview of two-stage object detection algorithms,” in Journal of Physics: Conference Series, IOP Publishing, 2020, p. 012033.

[5] C. Chen, M.-Y. Liu, O. Tuzel, and J. Xiao, “R-CNN for small object detection,” in Computer Vision–ACCV 2016: 13th Asian Conference on Computer Vision, Taipei, Taiwan, November 20-24, 2016, Revised Selected Papers, Part V 13, Springer, 2017, pp. 214–230.

[6] M. Li, H. Zhu, H. Chen, L. Xue, and T. Gao, “Research on object detection algorithm based on deep learning,” in Journal of Physics: Conference Series, IOP Publishing, 2021, p. 012046.

[7] J. Wang, S. Jiang, W. Song, and Y. Yang, “A comparative study of small object detection algorithms,” in 2019 Chinese control conference (CCC), IEEE, 2019, pp. 8507–8512.

[8] C. Cuevas, E. M. Yáñez, and N. García, “Labeled dataset for integral evaluation of moving object detection algorithms: LASIESTA,” Computer Vision and Image Understanding, vol. 152, pp. 103–117, 2016.

[9] A. Raghunandan, P. Raghav, and H. V. R. Aradhya, “Object detection algorithms for video surveillance applications,” in 2018 International Conference on Communication and Signal Processing (ICCSP), IEEE, 2018, pp. 563–568.

[10] B. Mahaur, N. Singh, and K. K. Mishra, “Road object detection: a comparative study of deep learning-based algorithms,” Multimed Tools Appl, vol. 81, no. 10, pp. 14247–14282, 2022.

[11] Y. Xiao et al., “A review of object detection based on deep learning,” Multimed Tools Appl, vol. 79, pp. 23729–23791, 2020.

[12] H. M. Zangana, F. M. Mustafa, and M. Omar, “A Hybrid Approach for Robust Object Detection: Integrating Template Matching and Faster R-CNN,” EAI Endorsed Transactions on AI and Robotics, vol. 3, 2024.

[13] R. Padilla, S. L. Netto, and E. A. B. Da Silva, “A survey on performance metrics for object-detection algorithms,” in 2020 international conference on systems, signals and image processing (IWSSIP), IEEE, 2020, pp. 237–242.

[14] Z. Li, Y. Du, M. Zhu, S. Zhou, and L. Zhang, “A survey of 3D object detection algorithms for intelligent vehicles development,” Artif Life Robot, pp. 1–8, 2022.

[15] A. Bouguettaya, A. Kechida, and A. M. TABERKIT, “A survey on lightweight CNN-based object detection algorithms for platforms with limited computational resources,” International Journal of Informatics and Applied Mathematics, vol. 2, no. 2, pp. 28–44, 2019.

[16] R. Huang, J. Pedoeem, and C. Chen, “YOLO-LITE: a real-time object detection algorithm optimized for non-GPU computers,” in 2018 IEEE international conference on big data (big data), IEEE, 2018, pp. 2503–2510.

[17] K. Li and L. Cao, “A review of object detection techniques,” in 2020 5th International Conference on Electromechanical Control Technology and Transportation (ICECTT), IEEE, 2020, pp. 385–390.

[18] J. Ren and Y. Wang, “Overview of object detection algorithms using convolutional neural networks,” Journal of Computer and Communications, vol. 10, no. 1, pp. 115–132, 2022.

[19] H. LUO and H. CHEN, “Survey of object detection based on deep learning,” Acta Electonica Sinica, vol. 48, no. 6, p. 1230, 2020.

[20] L. Zhao and S. Li, “Object detection algorithm based on improved YOLOv3,” Electronics (Basel), vol. 9, no. 3, p. 537, 2020.

[21] R. Zhao, X. Niu, Y. Wu, W. Luk, and Q. Liu, “Optimizing CNN-based object detection algorithms on embedded FPGA platforms,” in Applied Reconfigurable Computing: 13th International Symposium, ARC 2017, Delft, The Netherlands, April 3-7, 2017, Proceedings 13, Springer, 2017, pp. 255–267.

[22] A. Kumar, Z. J. Zhang, and H. Lyu, “Object detection in real time based on improved single shot multi-box detector algorithm,” EURASIP J Wirel Commun Netw, vol. 2020, pp. 1–18, 2020.

[23] P. Kumar, A. Singhal, S. Mehta, and A. Mittal, “Real-time moving object detection algorithm on high-resolution videos using GPUs,” J Real Time Image Process, vol. 11, pp. 93–109, 2016.

[24] M. Haris and A. Glowacz, “Road object detection: A comparative study of deep learning-based algorithms,” Electronics (Basel), vol. 10, no. 16, p. 1932, 2021.

[25] L. Galteri, M. Bertini, L. Seidenari, and A. Del Bimbo, “Video compression for object detection algorithms,” in 2018 24th International Conference on Pattern Recognition (ICPR), IEEE, 2018, pp. 3007–3012.

[26] P. Malhotra and E. Garg, “Object detection techniques: a comparison,” in 2020 7th International Conference on Smart Structures and Systems (ICSSS), IEEE, 2020, pp. 1–4.

[27] A. John and D. Meva, “A comparative study of various object detection algorithms and performance analysis,” International Journal of Computer Sciences and Engineering, vol. 8, no. 10, pp. 158–163, 2020.

[28] W. Sun, L. Dai, X. Zhang, P. Chang, and X. He, “RSOD: Real-time small object detection algorithm in UAV-based traffic monitoring,” Applied Intelligence, pp. 1–16, 2021.

[29] L. Peng, H. Wang, and J. Li, “Uncertainty evaluation of object detection algorithms for autonomous vehicles,” Automotive Innovation, vol. 4, no. 3, pp. 241–252, 2021.

[30] N. Yadav and U. Binay, “Comparative study of object detection algorithms,” International Research Journal of Engineering and Technology (IRJET), vol. 4, no. 11, pp. 586–591, 2017.

[31] P. Rajeshwari, P. Abhishek, P. Srikanth, and T. Vinod, “Object detection: an overview,” Int. J. Trend Sci. Res. Dev.(IJTSRD), vol. 3, no. 1, pp. 1663–1665, 2019.

[32] X. Zou, “A review of object detection techniques,” in 2019 International conference on smart grid and electrical automation (ICSGEA), IEEE, 2019, pp. 251–254.

[33] Y. Zhou et al., “Mmrotate: A rotated object detection benchmark using pytorch,” in Proceedings of the 30th ACM International Conference on Multimedia, 2022, pp. 7331–7334.

[34] S. R. Waheed, N. M. Suaib, M. S. M. Rahim, M. M. Adnan, and A. A. Salim, “Deep learning algorithms-based object detection and localization revisited,” in journal of physics: conference series, IOP Publishing, 2021, p. 012001.