Graphical Abstract
View original image
Download original image
Research Article | Open Access
Control Robotic Hand Depending on Voice Commands and IoT
Aymen Dhafer Abdul-nafa1(
), Suha S. Ahmed2(),
), Suha S. Ahmed2(), Abstract
A need for a prosthetic hand device has arisen based on the fact that many people lose one of their upper limbs for various reasons. Many systems are available to control prosthetic hands, such as electromyography (EMG) and mechanomyography (MMG). These systems present many problems, including complexity, high cost, and other issues. Voice commands are among the solutions recommended to address these issues. The proliferation of the Internet, voice recognition technology built into mobile phones, and Internet of Things (IoT) technology has facilitated the use of voice commands to operate prosthetic devices. In this paper, robotic prosthetics were controlled using this technology in the context of five different movement classes. This study involved five participants and reports as accuracy rate of 97%.
Keywords
References
[1]
F. Cordella, A.L. Ciancio, R. Sacchetti, et al. Literature review on needs of upper limb prosthesis users. Frontiers in Neuroscience, 2016, 10: 209. https://doi.org/10.3389/fnins.2016.00209
[2]
Y.F. Fang, N. Hettiarachchi, D.L. Zhou, et al. Multi-modal sensing techniques for interfacing hand prostheses: A review. IEEE Sensors Journal, 2015, 15(11): 6065−6076. https://doi.org/10.1109/JSEN.2015.2450211
[3]
T. Triwiyanto, A.M. Maghfiroh, S.D. Musvika, et al. State of the Art Methods of Machine Learning for Prosthetic Hand Development: A Review. In: Proceeding of the 3rd International Conference on Electronics, Biomedical Engineering, and Health Informatics, 2023: 555–574.
[4]
M.S.H. Talpur, M.Z.A. Bhuiyan, G.J. Wang. Energy-efficient healthcare monitoring with smartphones and IoT technologies. International Journal of High Performance Computing and Networking, 2015, 8(2): 186−194. https://doi.org/10.1504/IJHPCN.2015.070019
[5]
M.M. Islam, A. Rahaman, M.R. Islam. Development of smart healthcare monitoring system in IoT environment. SN Computer Science, 2020, 1(3): 185. https://doi.org/10.1007/s42979-020-00195-y
[6]
E.V. Polyakov, M.S. Mazhanov, A.Y. Rolich, et al. Investigation and development of the intelligent voice assistant for the Internet of Things using machine learning. In: Proceedings of 2018 Moscow Workshop on Electronic and Networking Technologies (MWENT), 2018: 1–5.
[7]
C.M. Oppus, J.R.R. Prado, J.C. Escobar, et al. Brain-computer interface and voice-controlled 3D printed prosthetic hand. In: Proceedings of 2016 IEEE Region 10 Conference (TENCON), 2017: 2689–2693.
[8]
P. Samant, R. Agarwal. Real-time speech recognition system for prosthetic arm control. International Journal of Sensing,Computing &Control, 2015, 5(1): 39−46.
[9]
P. Fang, Y.J. Geng, Z. Wei, et al. New control strategies for multifunctional prostheses that combine electromyographic and speech signals. IEEE Intelligent Systems, 2015, 30(4): 47−53. https://doi.org/10.1109/MIS.2015.40
[10]
N. Viniegra, J. Ierache. Control of a robotic hand through voice commands and biosignals. In: Iberoamerican Workshop on Human-Computer Interaction. Cham: Springer, 2021: 32–43.
[11]
M. Jafarzadeh, Y. Tadesse. End-to-end learning of speech 2D feature-trajectory for prosthetic hands. In: Proceedings of 2020 Second International Conference on Transdisciplinary AI (TransAI), 2020: 25–33.
[12]
R. Venkatagiri, A. Anish, S. Sujan, et al. Design and development of bionic hand using voice control. International Journal of Innovative Science and Research Technology, 2017, 2(5): 526−530.
[13]
A. Agosti. Una religione afferrabile e terrena: due inediti di Franco Venturi sull’idea comunista. Passato e Presente, 2015, 33(95): 121−131.
[14]
X. Mi, F. Qian, Y. Zhang, et al. An empirical characterization of IFTTT: ecosystem, usage, and performance. In: Proceedings of ACM Internet Measurement Conference, 2017: 398–404, 2017.
[15]
H. Isyanto, A.S. Arifin, M. Suryanegara. Design and implementation of IoT-based smart home voice commands for disabled people using google assistant. In: Proceedings of 2020 International Conference on Smart Technology and Applications (ICoSTA), 2020: 1–6.
[16]
ESP. ESP32 Series Datasheet. 2021.
Pages 288-295
Cite this article:
Abdul-nafa AD, Ahmed SS, Ahmed YS, et al. Control Robotic Hand Depending on Voice Commands and IoT. Nano Biomedicine and Engineering, 2023, 15(3): 288-295. https://doi.org/10.26599/NBE.2023.9290028
Metrics & Citations
Article History
Copyright
Rights and Permissions
京公网安备11010802044758号