AI Chat Paper
Note: Please note that the following content is generated by AMiner AI. SciOpen does not take any responsibility related to this content.
{{lang === 'zh_CN' ? '文章概述' : 'Summary'}}
{{lang === 'en_US' ? '中' : 'Eng'}}
Chat more with AI
Powered by AMiner. Clicking this button will take you away from SciOpen.
Home Big Data Mining and Analytics Article
PDF (16.4 MB)
Cite
EndNote(RIS) BibTeX
Collect
Submit Manuscript AI Chat Paper
Show Outline
Outline
Show full outline
Hide outline
Outline
Show full outline
Hide outline
Open Access

An Intelligent Heuristic Manta-Ray Foraging Optimization and Adaptive Extreme Learning Machine for Hand Gesture Image Recognition

Department of Electronics and Communication Engineering, Chaitanya (Deemed to be University), Warangal 506001, India.
Department of Electronics and Communication Engineering, Sri Indu College of Engineering & Technology, Sheriguda, Hyderabad 501510, India.
Department of Electronics and Communication Engineering, Vel Tech Rangarajan Dr. Sagunthala R&D Institute of Science and Technology, Chennai 600062, India.
Department of Electronics and Communication Engineering, Malla Reddy Engineering College for Women (Autonomous), Telangana 500100, India.
Department of Electronics and Communication Engineering, Nalla Narasimha Reddy Education Society’s Group of Institutions-Integrated Campus, Hyderabad 500088, India.
STI Laboratory, the IDMS Team, Faculty of Sciences and Techniques, Moulay Ismail University of Meknès, Errachidia 52000, Morocco.
Show Author Information

Abstract

The development of hand gesture recognition systems has gained more attention in recent days, due to its support of modern human-computer interfaces. Moreover, sign language recognition is mainly developed for enabling communication between deaf and dumb people. In conventional works, various image processing techniques like segmentation, optimization, and classification are deployed for hand gesture recognition. Still, it limits the major problems of inefficient handling of large dimensional datasets and requires more time consumption, increased false positives, error rate, and misclassification outputs. Hence, this research work intends to develop an efficient hand gesture image recognition system by using advanced image processing techniques. During image segmentation, skin color detection and morphological operations are performed for accurately segmenting the hand gesture portion. Then, the Heuristic Manta-ray Foraging Optimization (HMFO) technique is employed for optimally selecting the features by computing the best fitness value. Moreover, the reduced dimensionality of features helps to increase the accuracy of classification with a reduced error rate. Finally, an Adaptive Extreme Learning Machine (AELM) based classification technique is employed for predicting the recognition output. During results validation, various evaluation measures have been used to compare the proposed model’s performance with other classification approaches.

Keywords

hand gesture recognitionskin color detectionmorphological operationsMultifaceted Feature Extraction (MFE) modelHeuristic Manta-ray Foraging Optimization (HMFO)Adaptive Extreme Learning Machine (AELM)

References

[1]
H. N. Saha, S. Tapadar, S. Ray, S. K. Chatterjee, and S. Saha, A machine learning based approach for hand gesture recognition using distinctive feature extraction, in Proc. 2018 IEEE 8th Annual Computing and Communication Workshop and Conference (CCWC), Las Vegas, NV, USA, 2018, pp. 91–98.
Crossref Google Scholar
[2]
M. Oudah, A. Al-Naji, and J. Chahl, Hand gesture recognition based on computer vision: A review of techniques, Journal of Imaging, vol. 6, no. 8, p. 73, 2020.
Crossref Google Scholar
[3]
G. Devineau, F. Moutarde, W. Xi, and J. Yang, Deep learning for hand gesture recognition on skeletal data, in Proc. 2018 13th IEEE International Conference on Automatic Face & Gesture Recognition (FG 2018), Xi’an, China, 2018, pp. 106–113.
Crossref Google Scholar
[4]
A. Jaramillo-Yánez, M. E. Benalcázar, and E. Mena-Maldonado, Real-time hand gesture recognition using surface electromyography and machine learning: A systematic literature review, Sensors, vol. 20, no. 9, p. 2467,2020.
Crossref Google Scholar
[5]
F. Zhan, Hand gesture recognition with convolution neural networks, in Proc. 2019 IEEE 20th International Conference on Information Reuse and Integration for Data Science (IRI), Los Angeles, CA, USA, 2019, pp. 295–298.
Crossref Google Scholar
[6]
S. Skaria, A. Al-Hourani, M. Lech, and R. J. Evans, Hand-gesture recognition using two-antenna Doppler radar with deep convolutional neural networks, IEEE Sensors Journal, vol. 19, no. 8, pp. 3041–3048, 2019.
Crossref Google Scholar
[7]
X. Y. Wu, A hand gesture recognition algorithm based on DC-CNN, Multimedia Tools and Applications, vol. 79, pp. 9193–9205, 2020.
Crossref Google Scholar
[8]
Y. He, G. Li, Y. Liao, Y. Sun, J. Kong, G. Jiang, D. Jiang, B. Tao, S. Xu, and H. Liu, Gesture recognition based on an improved local sparse representation classification algorithm, Cluster Computing, vol. 22, pp. 10935–10946, 2019.
Crossref Google Scholar
[9]
G. Li, H. Tang, Y. Sun, J. Kong, G. Jiang, D. Jiang, B. Tao, S. Xu, and H. Liu, Hand gesture recognition based on convolution neural network, Cluster Computing, vol. 22, pp. 2719–2729, 2019.
Crossref Google Scholar
[10]
W. -J. Li, C. -Y. Hsieh, L. -F. Lin, and W. -C. Chu, Hand gesture recognition for post-stroke rehabilitation using leap motion, in Proc. 2017 International Conference on Applied System Innovation (ICASI), Sapporo, Japan, 2017, pp. 386–388.
Google Scholar
[11]
J. -H. Kim, G. -S. Hong, B. -G. Kim, and D. P. Dogra, DeepGesture: Deep learning-based gesture recognition scheme using motion sensors, Displays, vol. 55, pp. 38–45, 2018.
Crossref Google Scholar
[12]
G. Benitez-Garcia, L. Prudente-Tixteco, L. C. Castro-Madrid, R. Toscano-Medina, J. Olivares-Mercado, G. Sanchez-Perez, and L. J. G. Villalba, Improving real-time hand gesture recognition with semantic segmentation, Sensors, vol. 21, no. 2, p. 356, 2021.
Crossref Google Scholar
[13]
M. Al-Hammadi, G. Muhammad, W. Abdul, M. Alsulaiman, M. A. Bencherif, T. S. Alrayes, H. Mathkour, and M. A. Mekhtiche, Deep learning-based approach for sign language gesture recognition with efficient hand gesture representation, IEEE Access, vol. 8, pp. 192527–192542, 2020.
Crossref Google Scholar
[14]
M. Luo, F. Nie, X. Chang, Y. Yang, A. G. Hauptmann, and Q. Zheng, Adaptive unsupervised feature selection with structure regularization, IEEE Transactions on Neural Networks and Learning Systems, vol. 29, no. 4, pp. 944–956, 2018.
Crossref Google Scholar
[15]
B. Remeseiro and V. Bolon-Canedo, A review of feature selection methods in medical applications, Computers in Biology and Medicine, vol. 112, p. 103375, 2019.
Crossref Google Scholar
[16]
Y. Hu, Y. Wong, W. Wei, Y. Du, M. Kankanhalli, and W. Geng, A novel attention-based hybrid CNN-RNN architecture for sEMG-based gesture recognition, PLoS ONE, vol. 13, no. 10, p. e0206049, 2018.
Crossref Google Scholar
[17]
S. Jadooki, D. Mohamad, T. Saba, A. S. Almazyad, and A. Rehman, Fused features mining for depth-based hand gesture recognition to classify blind human communication, Neural Computing and Applications, vol. 28, pp. 3285–3294, 2017.
Crossref Google Scholar
[18]
H. Badi, A. Hamza, and S. Hasan, New method for optimization of static hand gesture recognition, in Proc. 2017 Intelligent Systems Conference (IntelliSys), London, UK, 2017, pp. 542–544.
Crossref Google Scholar
[19]
, M. C. Ariesta, F. Wiryana, and G. P. Kusuma, A survey of hand gesture recognition methods in sign language recognition, Pertanika Journal Science and Technology, vol. 26, no. 4, pp. 1659–1675, 2018.
Google Scholar
[20]
Y. Chen, L. Zhao, X. Peng, J. Yuan, and D. N. Metaxas, Construct dynamic graphs for hand gesture recognition via spatial-temporal attention, arXiv preprint arXiv: 1907.08871, 2019.
Google Scholar
[21]
M. J. Cheok, Z. Omar, and M. H. Jaward, A review of hand gesture and sign language recognition techniques, International Journal of Machine Learning and Cybernetics, vol. 10, pp. 131–153, 2019.
Crossref Google Scholar
[22]
D. Chen, G. Li, Y. Sun, J. Kong, G. Jiang, H. Tang, Z. Ju, H. Yu, and H. Liu, An interactive image segmentation method in hand gesture recognition, Sensors, vol. 17, no. 2, p. 253, 2017.
Crossref Google Scholar
[23]
C. Bhuvaneshwari and A. Manjunathan, Advanced gesture recognition system using long-term recurrent convolution network, Materials Today: Proceedings, vol. 21, pp. 731–733, 2020.
Crossref Google Scholar
[24]
R. F. Pinto, C. D. B. Borges, A. M. A. Almeida, and I. C. Paula, Static hand gesture recognition based on convolutional neural networks, Journal of Electrical and Computer Engineering, , 2019.
Crossref Google Scholar
[25]
A. Mujahid, M. J. Awan, A. Yasin, M. A. Mohammed, R. Damaševičius, R. Maskeliūnas, and K. H. Abdulkareem, Real-time hand gesture recognition based on deep learning YOLOv3 model, Applied Sciences, vol. 11, no. 9, p. 4164, 2021.
Crossref Google Scholar
[26]
H. I. Mohammed, J. Waleed, and S. Albawi, An inclusive survey of machine learning based hand gestures recognition systems in recent applications, IOP Conf. Ser.: Mater. Sci. Eng., vol. 1076, p. 012047, 2021.
Crossref Google Scholar
[27]
K. Rzecki, Classification algorithm for person identification and gesture recognition based on hand gestures with small training sets, Sensors, vol. 20, no. 24, p. 7279, 2020.
Crossref Google Scholar
[28]
K. M. Sagayam and D. J. Hemanth, ABC algorithm based optimization of 1-D hidden Markov model for hand gesture recognition applications, Computers in Industry, vol. 99, pp. 313–323, 2018.
Crossref Google Scholar
[29]
Y. -L. Chung, H. -Y. Chung, and W. -F. Tsai, Hand gesture recognition via image processing techniques and deep CNN, Journal of Intelligent and Fuzzy Systems, vol. 39, no. 3, pp. 4405–4418, 2020.
Crossref Google Scholar
[30]
T. Ozcan and A. Basturk, Transfer learning-based convolutional neural networks with heuristic optimization for hand gesture recognition, Neural Computing and Applications, vol. 31, pp. 8955–8970, 2019.
Crossref Google Scholar
[31]
S. Sharma, S. Jain, and , A static hand gesture and face recognition system for blind people, in Proc. 2019 6th International Conference on Signal Processing and Integrated Networks (SPIN), Noida, India, 2019, pp. 534–539.
Crossref Google Scholar
[32]
P. S. Neethu, R. Suguna, and D. Sathish, An efficient method for human hand gesture detection and recognition using deep learning convolutional neural networks, Soft Computing, vol. 24, no. 20, pp. 15239–15248, 2020.
Crossref Google Scholar
[33]
T. Chaikhumpha and P. Chomphuwiset, Real-time two hand gesture recognition with condensation and hidden Markov models, in Proc. 2018 International Workshop on Advanced Image Technology (IWAIT), Chiang Mai, Thailand, 2018, pp. 1–4.
Crossref Google Scholar
[34]
A. Marium, D. Rao, D. R. Crasta, K. Acharya, and R. D’Souza, Hand gesture recognition using webcam, American Journal of Intelligent Systems, vol. 7, no. 3, pp. 90–94, 2017.
Google Scholar
[35]
M. H. Rahman and J. Afrin, Hand gesture recognition using multiclass support vector machine, International Journal of Computer Applications, vol. 74, no. 1, pp. 39–43, 2013.
Crossref Google Scholar
[36]
Z. Wang, B. Chen, and J. Wu, Effective inertial hand gesture recognition using particle filtering based trajectory matching, Journal of Electrical and Computer Engineering, vol. 2018, pp. 1–9, 2018.
Crossref Google Scholar
[37]
Y. S. Tan, K. M. Lim, C. Tee, C. P. Lee, and C. Y. Low, Convolutional neural network with spatial pyramid pooling for hand gesture recognition, Neural Computing and Applications, vol. 33, pp. 5339–5351, 2021.
Crossref Google Scholar
Big Data Mining and Analytics
Volume 6 Issue 3,
September 2023
Pages 321-335
DOI: 10.26599/BDMA.2022.9020036
Cite this article:
Khetavath S, Sendhilkumar NC, Mukunthan P, et al. An Intelligent Heuristic Manta-Ray Foraging Optimization and Adaptive Extreme Learning Machine for Hand Gesture Image Recognition. Big Data Mining and Analytics, 2023, 6(3): 321-335. https://doi.org/10.26599/BDMA.2022.9020036

804

Views

109

Downloads

32

Crossref

4

Web of Science

16

Scopus

0

CSCD

Altmetrics
Received: 17 September 2022
Accepted: 29 September 2022
Published: 07 April 2023
© The author(s) 2023.

The articles published in this open access journal are distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/).
Return