Please use this identifier to cite or link to this item:https://hdl.handle.net/20.500.12259/129081
Type of publication: research article
Type of publication (PDB): Straipsnis Clarivate Analytics Web of Science / Article in Clarivate Analytics Web of Science (S1)
Field of Science: Informatika / Informatics (N009)
Author(s): Mujahid, Abdullah;Awan, Mazhar Javed;Yasin, Awais;Mohammed, Mazin Abed;Damaševičius, Robertas;Maskeliūnas, Rytis;Abdulkareem, Karrar Hameed
Title: Real-time hand gesture recognition based on deep learning YOLOv3 model
Is part of: Applied sciences. Basel : MDPI, 2021, vol. 11, iss. 9
Extent: p. 1-15
Date: 2021
Keywords: Convolutional neural network;Hand gesture;Digital image processing;YOLOv3;Artificial intelligence
Abstract: Using gestures can help people with certain disabilities in communicating with other people. This paper proposes a lightweight model based on YOLO (You Only Look Once) v3 and DarkNet-53 convolutional neural networks for gesture recognition without additional preprocessing, image filtering, and enhancement of images. The proposed model achieved high accuracy even in a complex environment, and it successfully detected gestures even in low-resolution picture mode. The proposed model was evaluated on a labeled dataset of hand gestures in both Pascal VOC and YOLO format. We achieved better results by extracting features from the hand and recognized hand gestures of our proposed YOLOv3 based model with accuracy, precision, recall, and an F-1 score of 97.68, 94.88, 98.66, and 96.70%, respectively. Further, we compared our model with Single Shot Detector (SSD) and Visual Geometry Group (VGG16), which achieved an accuracy between 82 and 85%. The trained model can be used for real-time detection, both for static hand images and dynamic gestures recorded on a video
Internet: https://www.vdu.lt/cris/bitstream/20.500.12259/129081/2/ISSN2076-3417_2021_V_11_9.PG_1-15.pdf
https://hdl.handle.net/20.500.12259/129081
https://doi.org/10.3390/app11094164
Affiliation(s): Taikomosios informatikos katedra
Vytauto Didžiojo universitetas
Appears in Collections:1. Straipsniai / Articles
Universiteto mokslo publikacijos / University Research Publications

Files in This Item:
marc.xml7.78 kBXMLView/Open

MARC21 XML metadata

Show full item record
Export via OAI-PMH Interface in XML Formats
Export to Other Non-XML Formats


CORE Recommender

Page view(s)

22
checked on Jun 6, 2021

Download(s)

8
checked on Jun 6, 2021

Google ScholarTM

Check

Altmetric


This item is licensed under a Creative Commons License Creative Commons