AI-YOLO Based Smart Laboratory Security for Automated Face Recognition and Suspicious Activity Detection
DOI:
https://doi.org/10.30871/jaic.v10i1.11936Keywords:
AI-YOLO, Face Recognition, MediaPipe Pose, Laboratory Security, Smart CampusAbstract
Ensuring laboratory security is a critical consideration within campus environments to effectively prevent theft and suspicious activities. Traditional CCTV systems predominantly rely on manual monitoring, resulting in delayed responses to incidents. This research seeks to develop and implement an Artificial Intelligence (AI)-based laboratory security system, integrating three primary models: YOLOv5 for human object detection, Face Recognition for individual identification, and Media Pipe Pose for real-time analysis of suspicious movements. The system is designed as a Flask-based monitoring website, which displays activity logs, detected individual identities, and automated notifications based on image processing results on a Raspberry Pi connected to CCTV cameras. The research methodology employs an applied experimental approach, encompassing stages such as system design, face dataset collection, data encoding utilizing the Face Recognition Library, and performance evaluation under two lighting conditions (bright and dark) and three distance variations. The test results indicate that the Face Recognition method operates optimally at a distance of 2 meters in bright lighting conditions, achieving an accuracy of up to 92%. However, its performance declines at distances exceeding 3 meters and under low-light conditions. Conversely, MediaPipe Pose exhibits high stability, with an average accuracy of 94% in bright conditions and 89% in dark conditions, and is capable of transmitting real-time notifications for activities such as lifting objects or placing hands into pockets. The AI-based laboratory security system developed has demonstrated effectiveness, adaptability, and responsiveness in the automatic detection of identities and suspicious activities. The integration of YOLO v5, Face Recognition, and MediaPipe Pose models offers an intelligent and efficient security solution that facilitates the implementation of the Smart Campus concept within educational environments.
Downloads
References
[1] S. Yao et al., “From Lab to Field: Real-World Evaluation of an AI-Driven Smart Video Solution to Enhance Community Safety,” Aug. 2023, doi: 10.1016/j.iot.2025.101716.
[2] L. Ali, F. Alnajjar, M. M. A. Parambil, M. I. Younes, Z. I. Abdelhalim, and H. Aljassmi, “Development of YOLOv5-Based Real-Time Smart Monitoring System for Increasing Lab Safety Awareness in Educational Institutions,” Sensors, vol. 22, no. 22, Nov. 2022, doi: 10.3390/s22228820.
[3] M. Janapati, L. P. Allamsetty, T. T. Potluri, and K. V. Mogili, “Gait-Driven Pose Tracking and Movement Captioning Using OpenCV and MediaPipe Machine Learning Framework,” Engineering Proceedings, vol. 82, no. 1, 2024, doi: 10.3390/ecsa-11-20470.
[4] W. Zhang et al., “Combined MediaPipe and YOLOv5 range of motion assessment system for spinal diseases and frozen shoulder,” Sci Rep, vol. 14, no. 1, Dec. 2024, doi: 10.1038/s41598-024-66221-8.
[5] A. S. Dileep, S. S. Nabilah, S. Sreeju, K. Farhana, and S. Surumy, “Suspicious Human Activity Recognition using 2D Pose Estimation and Convolutional Neural Network,” in 2022 International Conference on Wireless Communications, Signal Processing and Networking, WiSPNET 2022, Institute of Electrical and Electronics Engineers Inc., 2022, pp. 19–23. doi: 10.1109/WiSPNET54241.2022.9767152.
[6] C. W. Wahome, G. Ling, and L. Ma, “Multi-modal fall detection using improved YOLOv5 and mediapipe,” in ASIG 2024 - Proceedings of the 2nd Asia Symposium on Image and Graphics, Association for Computing Machinery, Inc, Apr. 2025, pp. 29–35. doi: 10.1145/3718441.3718446.
[7] V. P. Kothari and P. S. Chakurkar, “Towards safer environments: A YOLO and MediaPipe-based human fall detection system with alert automation,” MethodsX, vol. 15, Dec. 2025, doi: 10.1016/j.mex.2025.103623.
[8] S. Malaikrisanachalee, N. Wongwai, and E. Kowcharoen, “ESPCN-YOLO: A High-Accuracy Framework for Personal Protective Equipment Detection Under Low-Light and Small Object Conditions,” Buildings, vol. 15, no. 10, May 2025, doi: 10.3390/buildings15101609.
[9] B. R. Ardabili et al., “Understanding Policy and Technical Aspects of AI-enabled Smart Video Surveillance to Address Public Safety,” Computational Urban Science, vol. 3, no. 1, Dec. 2023, doi: 10.1007/s43762-023-00097-8.
[10] Y. M. Manu, S. V. Shashikala, N. Darshan, A. P. Dheeraj, N. J. Hemanth, and N. B. Gowda, “Smart Surveillance Camera Using AI,” in 2nd IEEE International Conference on Advances in Information Technology, ICAIT 2024 - Proceedings, Institute of Electrical and Electronics Engineers Inc., 2024. doi: 10.1109/ICAIT61638.2024.10690287.
[11] M. Sujkowski, J. Kozuba, P. Uchronski, A. Banas, P. Pulit, and L. Gryzewska, “Artificial Intelligence Systems for Supporting Video Surveillance Operators at International Airport,” in Transportation Research Procedia, Elsevier B.V., 2023, pp. 1284–1291. doi: 10.1016/j.trpro.2023.11.273.
[12] O. E. Putra, R. Devita, and N. Wahyudi, “Safe Security System Using Face Recognition Based on IoT,” SinkrOn, vol. 8, no. 2, pp. 1021–1030, 2023, doi: 10.33395/sinkron.v8i2.12231.
[13] N. Afiyat and G. Mubtadi, “Rancang Bangun Sistem Keamanan Laboratorium Menggunakan Face Recognition Berbasis Internet of Thing (IoT),” QOMARUNA Journal of Multidisciplinary Studies, vol. 2024, no. 01, pp. 20–41, 2024.
[14] Noel Ipe Johnson, Jereena John, and Dalbina Dalan, “Artificial Intelligence in Surveillance Camera,” International Journal of Advanced Research in Science, Communication and Technology, pp. 28–32, Jun. 2022, doi: 10.48175/ijarsct-4904.
[15] H. Sabit, “Artifical Intelligence-Based Smart Security System Using Internet of Things for Smart Home Applications,” Electronics (Switzerland), vol. 14, no. 3, Feb. 2025, doi: 10.3390/electronics14030608.
[16] S. Dill et al., “Accuracy Evaluation of 3D Pose Reconstruction Algorithms Through Stereo Camera Information Fusion for Physical Exercises with MediaPipe Pose,” Sensors, vol. 24, no. 23, pp. 1–18, 2024, doi: 10.3390/s24237772.
[17] M. K. Ganesh, “Shoplifting Detection System Using YOLOv5, MediaPipe Pose Estimation, and Machine Learning-Based Behavior Analysis,” International Journal of Advance Research in Multidisciplinary, vol. 3, no. 2, 2025, doi: 10.5281/zenodo.15590304.
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2026 Nurul Khaerani Hamzidah, Syahrir Syahrir, Ainun Jariyah, Carlos Agunar Da Costa, Sitti Saenab, Dul Arafat Muin, Nur Ichzan As
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
Authors who publish with this journal agree to the following terms:
- Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution License (Attribution-ShareAlike 4.0 International (CC BY-SA 4.0) ) that allows others to share the work with an acknowledgement of the work's authorship and initial publication in this journal.
- Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in this journal.
- Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work (See The Effect of Open Access).
