Show Outline
Figures (4)
Tables (4)
Table 1
Table 2
Table 3
Table 4
Research paper | Open Access
Developing a novel assistive technology, empowering the deaf to speak, using visual feedback.
Singh S1(
),
), Abstract
Background: Profoundly deaf children beyond 5 years of age and deaf adults with no prior access to hearing have limited options to learn oral speech. They rely mainly on sign language for communication. This is because, in the absence of hearing, the brain of a deaf person is not able to process any feedback of its own speech efforts.
Method: We have developed a novel assistive technology that provides visual feedback of speech efforts to the brain of a deaf person learning to speak on a smart phone or computer, in the absence of auditory feedback. We propose that a deaf person with compensatory heightened visual processing skills, should be able to use this visual feedback to develop speech.
Results: The first prototype of our novel assistive technology was used on 72 deaf persons (children and adults) attending deaf schools in Delhi. They progressed from speaking no sounds to about 18 sounds in 6 months.
Conclusion: Assistive technology using sensory substitution is a promising new approach to help deaf children and adults develop oral speech using visual feedback. More research needs to be carried out in developing this technology further.
References
[1]
Aimoni, C., Corazzi, V., Mazza, N., et al. (2018). Binaural, sequential or simultaneous cochlear implants in children: A review. In Cochlear Implants: Advances, Efficacy and Future Directions.
[2]
Anon (2020). Hand Gesture to Speech and Text Conversion Device. International Journal of Innovative Technology and Exploring Engineering, 9.
[3]
Anon Teoria statistica delle classi e calcolo delle probabilità - Carlo E. Bonferroni - Google Books. Available at: https://books.google.co.in/books/about/Teoria_statistica_delle_classi_e_calcolo.html?id=3CY-HQAACAAJ&redir_esc=y [Accessed November 18, 2023].
[4]
Bina, A. (2020). The link between Brain and Hearing system. Journal of Otolaryngology-ENT Research, 12.
[5]
Bola, Ł., Zimmermann, M., Mostowski, P., et al. (2017). Task-specific reorganization of the auditory cortex in deaf humans. Proc Natl Acad Sci U S A, 114.
[6]
Buchman, C.A., Gifford, R.H., Haynes, D.S., et al. (2020). Unilateral cochlear implants for severe, profound, or moderate sloping to profound bilateral sensorineural hearing loss a systematic review and consensus statements. JAMA Otolaryngol Head Neck Surg, 146.
[7]
Cardin, V., Grin, K., Vinogradova, V., et al. (2020). Crossmodal reorganisation in deafness: Mechanisms for functional preservation and functional change. Neurosci Biobehav Rev, 113.
[8]
Carlson, M.L., Sladen, D.P., Gurgel, R.K., et al. (2018). Survey of the American Neurotology Society on Cochlear Implantation: Part 1, Candidacy Assessment and Expanding Indications. Otology and Neurotology, 39.
[9]
Chu, C., Dettman, S., Choo, D. (2020). Early intervention intensity and language outcomes for children using cochlear implants. Deafness and Education International, 22.
[10]
Clark, G. (2012). The multi-channel cochlear implant and the relief of severe-to-profound deafness. Cochlear Implants Int, 13.
[11]
Deep, N.L., Dowling, E.M., Jethanamest, D., et al. (2019). Cochlear Implantation: An Overview. J Neurol Surg B Skull Base, 80.
[12]
Deuchar, M. (2013). British sign language,
[13]
Dunn, C., Newton, L. (1986). A comprehensive model for speech development in hearing -impaired children. Top Lang Disord, 6.
[14]
Eagleman, D. (2014). Plenary talks: A vibrotactile sensory substitution device for the deaf and profoundly hearing impaired.
[15]
Ferraro, J.A. (2002). Hearing: Its Physiology and Pathophysiology. Ear Hear, 23.
[16]
Grady, D. (1993). The vision thing: Mainly in the brain. Discover, 14.
[17]
Guerrette, M.C., Saint-Aubin, J., Richard, M., et al. (2018). Overt language production plays a key role in the Hebb repetition effect. Mem Cognit, 46.
[18]
Juang, B. ‐H (1984). On the Hidden Markov Model and Dynamic Time Warping for Speech Recognition—A Unified View. AT&T Bell Laboratories Technical Journal, 63.
[19]
Keate, E., Javkin, H., Antonanzas-Barroso, N., et al. (1994). A system for teaching speech to profoundly deaf children using synthesized acoustic & articulatory patterns. In Proceedings of the 1st Annual ACM Conference on Assistive Technologies, Assets 1994.
[20]
Kral, A., Hartmann, R., Tillein, J., et al. (2001). Cochlear Implants and Brain Plasticity Delayed Maturation and Sensitive Periods in the Auditory Cortex Behavioral Deficits in Congenital Deprivation. Audiol Neurootol, 6.
[21]
Kujala, T., Näätänen, R. (2010). The adaptive brain: A neurophysiological perspective. Prog Neurobiol, 91.
[22]
Lazard, D.S., Giraud, A.L., Gnansia, D., et al. (2012). Understanding the deafened brain: Implications for cochlear implant rehabilitation. Eur Ann Otorhinolaryngol Head Neck Dis, 129.
[23]
Lee, H.L., Devlin, J.T., Shakeshaft, C., et al. (2007). Anatomical traces of vocabulary acquisition in the adolescent brain. Journal of Neuroscience, 27.
[24]
Ling, D. (1978). Speech development in hearing-impaired children. J Commun Disord, 11.
[25]
Lokesh, S., Devi, M.R. (2019). Speech recognition system using enhanced mel frequency cepstral coefficient with windowing and framing method. Cluster Comput, 22.
[26]
Møller, A.R., Moore, B.C.J. (2001). Hearing: Its Physiology and Pathophysiology. J Acoust Soc Am, 109.
[27]
Monteiro, C.G., Cordeiro, A.A. de A., da Silva, H.J., et al. (2016). Children’s language development after cochlear implantation: A literature review. Codas, 28.
[28]
Naples, J.G., Ruckenstein, M.J. (2020). Cochlear Implant. Otolaryngol Clin North Am, 53, 87–102.
[29]
Nickerson, R.S., Kalikow, D.N., Stevens, K.N. (1976). Computer-aided speech training for the deaf. J Speech Hear Disord, 41.
[30]
Rauschecker, A.M., Pringle, A., Watkins, K.E. (2008). Changes in neural activity associated with learning to articulate novel auditory pseudowords by covert repetition. Hum Brain Mapp, 29.
[31]
R Core Team. (2022). R: A Language and Environment for Statistical Computing. R Foundation for Statistical Computing, Vienna.
[32]
Reagan, T. (1995). A sociocultural understanding of deafness: American sign language and the culture of deaf people. International Journal of Intercultural Relations, 19.
[33]
Rosen, R.S. (2010). American sign language curricula: A review. Sign Lang Stud, 10.
[34]
Seal, B.C. (2021). Speech development for children with impaired hearing. In Introduction to aural rehabilitation: Serving children and adults with hearing loss, 3rd ed.
[35]
Seymour, J.L., Low, K.A., Maclin, E.L., et al. (2017). Reorganization of neural systems mediating peripheral visual selective attention in the deaf: An optical imaging study. Hear Res, 343.
[36]
Shamma, S. (2001). On the role of space and time in auditory processing. Trends Cogn Sci, 5.
[37]
Sharma, S.D., Cushing, S.L., Papsin, B.C., et al. (2020). Hearing and speech benefits of cochlear implantation in children: A review of the literature. Int J Pediatr Otorhinolaryngol, 133, 109984.
[38]
Simon, M., Lazzouni, L., Campbell, E., et al. (2020). Enhancement of visual biological motion recognition in early-deaf adults: Functional and behavioral correlates. PLoS One, 15.
[39]
Singh, S., Liasis, A., Rajput, K., et al. (2004). Event-related potentials in pediatric cochlear implant patients. Ear Hear, 25.
[40]
Singh, S., Vashist, S., Ariyaratne, T.V. (2015). One-year experience with the CochlearTM Paediatric Implanted Recipient Observational Study (Cochlear P-IROS) in New Delhi, India. J Otol, 10.
[41]
Stolcke, A., Chen, B., Franco, H., et al. (2006). Recent innovations in speech-to-text transcription at SRI-ICSI-UW. IEEE Trans Audio Speech Lang Process, 14.
[42]
Striem-Amit, E., Vannuscorps, G., Caramazza, A. (2018). Plasticity based on compensatory effector use in the association but not primary sensorimotor cortex of people born without hands. Proc Natl Acad Sci U S A, 115.
[43]
Swanwick, R. (2020). 4 ‘Total Communication’ – current policy and practice. In Issues in Deaf Education.
[44]
Thomas, E.S., Zwolan, T.A. (2019). Communication Mode and Speech and Language Outcomes of Young Cochlear Implant Recipients: A Comparison of Auditory-Verbal, Oral Communication, and Total Communication. Otology and Neurotology, 40.
[45]
WMA General Assembly (2008). World Medical Asssociation Declaration of Helsinki: Ethical Principles for Medical Research Involving Human Subjects (as amended by the 59th WMA General Assembly, Seoul, October 2008). World Medical Association.
[46]
Wood, D. (1992). Total communication in the education of deaf children. Dev Med Child Neurol, 34.
[47]
World Health Organization (2018). Deafness prevention: Estimates. WHO.
[48]
Yarkoni, T., Poldrack, R.A., Van Essen, D.C., et al. (2010). Cognitive neuroscience 2.0: Building a cumulative science of human brain function. Trends Cogn Sci, 14.
[49]
Zeki, S. (2004). The neurology of ambiguity. Conscious Cogn, 13.
Pages 12-19
Cite this article:
S S, K N, R C, et al. Developing a novel assistive technology, empowering the deaf to speak, using visual feedback.. Journal of Otology, 2025, 20(1): 12-19. https://doi.org/10.26599/JOTO.2025.9540003
Metrics & Citations
Article History
Copyright
Rights and Permissions
京公网安备11010802044758号