Low-Cost Camera-Based Smart Surveillance System for Detecting, Recognizing, and Tracking Masked Human Face

Low-Cost Camera-Based Smart Surveillance System for Detecting, Recognizing, and Tracking Masked Human Face

surveillance system

face detection

face recognition

face tracking

low-cost camera

face mask.

A surveillance system is still the most exciting and practical security system to prevent crime effectively. The primary purpose of this system is to recognize the identity of the face caught by the camera. With the advancement of the Internet of things, surveillance systems were implemented on edge devices such as the low-cost Raspberry mobile camera. It raises the challenge of unstructured image/video where the video contains low quality, blur, and variations of human poses. The challenge is increasing because people used to wear a mask during the Covid -19 pandemic.  Therefore, we proposed developing an all-in-one surveillance system with face detection, recognition, and face tracking capabilities. This system integrated three modules: MTCNN face detector, VGGFace2 face recognition, and Discriminative Single-Shot Segmentation (D3S) tracker to create a system capable of tracking the faces of people caught on surveillance camera. We also train new face mask data to recognize and track. This system obtains data from the Raspberry Pi camera and processes images on the cloud as a mobile sensor approach. The proposed system successfully implemented and obtained competitive results in detection, recognition, and tracking under an unconstrained surveillance camera.

Haryadi, Ervan Adiwijaya

Jati, Grafika

Husodo, Ario Yudo

Jatmiko, Wisnu

International Journal of Interactive Mobile Technologies (iJIM); Vol. 15 No. 23 (2021); pp. 104-119

1865-7923

International Association of Online Engineering (IAOE), Vienna, Austria

2021-12-08

Copyright (c) 2021 Ervan Adiwijaya Haryadi, Grafika Jati, Ario Yudo Husodo, Wisnu Jatmiko

https://creativecommons.org/licenses/by/4.0

application/pdf

eng

info:eu-repo/semantics/article

info:eu-repo/semantics/publishedVersion

Peer-reviewed Article