Immersive Technologies for Accessible User Experiences

  • Living reference work entry
  • First Online:
Encyclopedia of Computer Graphics and Games
  • 28 Accesses

Synonyms

Extended reality; Usability; User experience

Definition

Immersive technologies encompass hardware and software that provide sensory feedback in the form of visual, auditory, haptic, or olfactory cues employing diverse human interface devices. Coupled with human-centered design considering varying human factors associated with perception, cognition, and physical ergonomics, these technologies aim to provide accessible user experiences. Although accessibility is typically associated with removing barriers for those experiencing disabilities, usability should be used instead because its purpose is the ease of use regardless of the end-user.

Introduction

Immersive technologies enable cross-sensory experiences that blur the frontier between virtual and real worlds (Suh and Prophet 2018). The cross-sensory stimuli are also referred to as multimodal or cross-modal because of the use, combination, integration, or translation of sensory cues into diverse installations (i.e., artistic,...

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Institutional subscriptions

References

  • Ahmed, S., Rehman, S. M., Ukkonen, L., & Björninen, T.:Glove-integrated slotted patch antenna for wearable UHF RFID reader. In 2018 IEEE International Conference on RFID Technology & Application (RFID-TA) (pp. 1–5). IEEE. (2018)

    Google Scholar 

  • Baragash, R.S., Al-Samarraie, H., Alzahrani, A.I., Alfarraj, O.: Augmented reality in special education: a meta-analysis of single-subject design studies. Eur. J. Spec. Needs Educ. 35(3), 382–397 (2020)

    Article  Google Scholar 

  • Bobrova, E.V., Reshetnikova, V.V., Frolov, A.A., Gerasimenko, Y.P.: Use of imaginary lower limb movements to control brain–computer interface systems. Neurosci. Behav. Physiol. 50(5), 585–592 (2020)

    Article  Google Scholar 

  • Bryant, L., Brunner, M., Hemsley, B.: A review of virtual reality technologies in the field of communication disability: implications for practice and research. Disabil. Rehabil. Assist. Technol. 15(4), 365–372 (2020)

    Article  Google Scholar 

  • Carreon, A., Smith, S.J., Mosher, M., Rao, K., Rowland, A.: A review of virtual reality intervention research for students with disabilities in K–12 settings. J. Spec. Educ. Technol., 0162643420962011 (2020)

    Google Scholar 

  • Casillas-Figueroa, R., Morán, A.L., Meza-Kubo, V., Ramírez-Fernández, C., Acosta-Quiroz, C., Orihuela-Espina, F., Montero-Hernandez, S.: ReminiScentia: sha** olfactory interaction in a personal space for multisensory stimulation therapy. Pers. Ubiquitous Comput., 1–17 (2020)

    Google Scholar 

  • Checa, D., Ramon, L., Bustillo, A.: Virtual reality travel training simulator for people with intellectual disabilities. In: International Conference on Augmented Reality, Virtual Reality and Computer Graphics Springer, Cham, pp. 385–393 (2019)

    Chapter  Google Scholar 

  • Cheok, M.J., Omar, Z., Jaward, M.H.: A review of hand gesture and sign language recognition techniques. Int. J. Mach. Learn. Cybern. 10(1), 131–115 (2019)

    Article  Google Scholar 

  • Cherni, H., Métayer, N., Souliman, N.: Literature review of locomotion techniques in virtual reality. Int. J. Virtual Real. 20(1), 1–20 (2020)

    Article  Google Scholar 

  • Cinieri, S., Kapralos, B., Uribe-Quevedo, A., Lamberti, F.: Eye tracking and speech driven human-avatar emotion-based communication. In: 2020 IEEE 8th International Conference on Serious Games and Applications for Health (SeGAH) IEEE, pp. 1–5 (2020)

    Google Scholar 

  • Clay, V., König, P., Koenig, S.: Eye tracking in virtual reality. J. Eye Mov. Res. 12(1) (2019)

    Google Scholar 

  • Coogan, C.G., He, B.: Brain-computer interface control in a virtual reality environment and applications for the internet of things. IEEE Access. 6, 10840–10849 (2018)

    Article  Google Scholar 

  • Cowan, B., Kapralos, B., Collins, K.: Does improved sound rendering increase player performance? A graph-based spatial sound framework. IEEE Tran. Games. (2020)

    Google Scholar 

  • De Oliveira, L.C., Andrade, A.O., De Oliveira, E.C., Soares, A., Cardoso, A., Lamounier, E.: Indoor navigation with mobile augmented reality and beacon technology for wheelchair users. In: 2017 IEEE EMBS International Conference on Biomedical & Health Informatics (BHI) IEEE, pp. 37–40 (2017)

    Chapter  Google Scholar 

  • Fralish, B., Nickels, M., Garcia, J.: Improved physiology and psychosocial well-being for individuals with physical disabilities through virtual reality immersion: a case study. J. Dev. Phys. Disabil. 30(6), 771–782 (2018)

    Article  Google Scholar 

  • Guarese, R., Bastidas, F., Becker, J., Giambastiani, M., Iquiapaza, Y., Macedo, L., Nedel, L., Maciel, A., Zambetta, F., van Schyndel, R.: Cooking in the dark: a mixed reality empathy experience for the embodiment of blindness. In: Proceedings of the 1st XR in Games Workshop. SBC (2021)

    Google Scholar 

  • Gupta, T., Sisodia, M., Fazulbhoy, S., Raju, M., Agrawal, S.: Improving accessibility for dyslexic impairments using augmented reality. In: 2019 International Conference on Computer Communication and Informatics (ICCCI) IEEE, pp. 1–4 (2019)

    Google Scholar 

  • Jeong, K., Kim, J., Kim, M., Lee, J., Kim, C.: Asymmetric interface: user interface of asymmetric virtual reality for new presence and experience. Symmetry. 12(1), 53 (2020)

    Article  Google Scholar 

  • Kalra, S., Jain, S., Agarwal, A.: Gesture controlled tactile augmented reality interface for the visually impaired. JITR. 14(2), 125–151 (2021)

    Google Scholar 

  • Kapralos, B., Collins, K., Uribe-Quevedo, A.: The senses and virtual environments. Senses Soc. 12(1), 69–75 (2017)

    Article  Google Scholar 

  • Kim, K., Jeong, J.H., Cho, J.H., Kim, S., Kang, J., Ryu, J., Lee, S.W.: Development of a human-display interface with vibrotactile feedback for real-world assistive applications. Sensors. 21(2), 592 (2021)

    Article  Google Scholar 

  • LaViola Jr., J.J., Kruijff, E., McMahan, R.P., Bowman, D., Poupyrev, I.P.: 3D user interfaces: theory and practice. Addison-Wesley Professional (2017)

    Google Scholar 

  • Masnadi, S., Williamson, B., González, A.N.V., LaViola, J.J.: Vriassist: an eye-tracked virtual reality low vision assistance tool. In: 2020 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW) IEEE, pp. 808–809 (2020)

    Chapter  Google Scholar 

  • Massiceti, D., Hicks, S.L., van Rheede, J.J.: Stereosonic vision: exploring visual-to-auditory sensory substitution map**s in an immersive virtual reality navigation paradigm. PLoS One. 13(7), e0199389 (2019)

    Article  Google Scholar 

  • Matthews, S., Uribe-Quevedo, A., Theodorou, A.: Rendering optimizations for virtual reality using eye-tracking. In: 2020 22nd Symposium on Virtual and Augmented Reality (SVR) IEEE, pp. 398–405 (2020)

    Chapter  Google Scholar 

  • Mirzaei, M., Kan, P., Kaufmann, H.: EarVR: using ear haptics in virtual reality for deaf and hard-of-hearing people. IEEE Trans. Vis. Comput. Graph. 26(5), 2084–2093 (2020)

    Article  Google Scholar 

  • Nassif, A.B.., Shahin, I., Attili, I., Azzeh, M., Shaalan, K.: Speech recognition using deep neural networks: a systematic review. IEEE Access. 7, 19143–19165 (2019)

    Article  Google Scholar 

  • Reynal, M., Imbert, J.P., Aricò, P., Toupillier, J., Borghini, G., Hurter, C.: Audio focus: interactive spatial sound coupled with haptics to improve sound source location in poor visibility. Int. J. Hum.-Comput. Stud. 129, 116–128 (2019)

    Article  Google Scholar 

  • Robern, G., Uribe-Quevedo, A., Sukhai, M., Coppin, P., Lee, T., Ingino, R.: Work-in-progress-exploring VR conference navigation employing audio cues. In: 2021 7th International Conference of the Immersive Learning Research Network (iLRN) IEEE, pp. 1–3 (2021)

    Google Scholar 

  • Saha, D., Sayyed, A.S., Saif, A.F.M., Shahnaz, C., Fattah, S.A.: Eye gaze controlled immersive video navigation system for disabled people. In: 2019 IEEE R10 Humanitarian Technology Conference (R10-HTC) (47129) IEEE, pp. 30–35 (2019)

    Chapter  Google Scholar 

  • Shao, Q., Sniffen, A., Blanchet, J., Hillis, M.E., Shi, X., Haris, T.K., Liu, J., Lamberton, J., Malzkuhn, M., Quandt, L.C., Mahoney, J.: Teaching American sign language in mixed reality. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 4(4), 1–27 (2020)

    Article  Google Scholar 

  • Skarbez, R., Smith, M., Whitton, M.C.: Revisiting Milgram and Kishino’s reality-virtuality continuum. Front. Virtual Real. 2, 27 (2021)

    Article  Google Scholar 

  • Sorgini, F., Caliò, R., Carrozza, M.C., Oddo, C.M.: Haptic-assistive technologies for audition and vision sensory disabilities. Disabil. Rehabil. Assist. Technol. 13(4), 394–421 (2018)

    Article  Google Scholar 

  • Spagnol, S., Wersényi, G., Bujacz, M., Bălan, O., Herrera Martínez, M., Moldoveanu, A., Unnthorsson, R.: Current use and future perspectives of spatial audio technologies in electronic travel aids. Wirel. Commun. Mob. Comput. (2018)

    Google Scholar 

  • Speicher, M., Hall, B.D., Nebeling, M.: What is mixed reality? In: Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems, pp. 1–15 (2019)

    Google Scholar 

  • Suh, A., Prophet, J.: The state of immersive technology research: a literature analysis. Comput. Hum. Behav. 86, 77–90 (2018)

    Article  Google Scholar 

  • Tabafunda, A., Matthews, S., Akhter, R., Uribe-Quevedo, A., Sun, W., Horsburgh, S., LaFontaine, C.: Development of a non-immersive VR Reminiscence therapy experience for patients with dementia. In: International Conference on Human-Computer Interaction Springer, Cham, pp. 509–517 (2020)

    Google Scholar 

  • Tashev, I.J., Gamper, H.: Head-related transfer function personalization for the needs of spatial audio in mixed and virtual reality. J. Acoust. Soc. Am. 141(5), 3536–3536 (2017)

    Article  Google Scholar 

  • Teófilo, M., Lourenço, A., Postal, J., Lucena, V.F.: Exploring virtual reality to enable deaf or hard of hearing accessibility in live theaters: a case study. In: International Conference on Universal Access in Human-Computer Interaction Springer, Cham, pp. 132–148 (2018)

    Google Scholar 

  • Theil, A., Buchweitz, L., Gay, J., Lindell, E., Guo, L., Persson, N.K., Korn, O.: Tactile board: a multimodal augmentative and alternative communication device for individuals with deafblindness. In: 19th International Conference on Mobile and Ubiquitous Multimedia, pp. 223–228 (2020)

    Chapter  Google Scholar 

  • Tölgyessy, M., Dekan, M., Chovanec, Ľ., Hubinský, P.: Evaluation of the azure Kinect and its comparison to Kinect V1 and Kinect V2. Sensors. 21(2), 413 (2021)

    Article  Google Scholar 

  • Wang, K.J., Liu, Q., Zhao, Y., Zheng, C.Y., Vhasure, S., Liu, Q., Thakur, P., Sun, M., Mao, Z.H.: Intelligent wearable virtual reality (VR) gaming controller for people with motor disabilities. In: 2018 IEEE International Conference on Artificial Intelligence and Virtual Reality (AIVR) IEEE, pp. 161–164 (2018a)

    Google Scholar 

  • Wang, D., Song, M., Naqash, A., Zheng, Y., Xu, W., Zhang, Y.: Toward whole-hand kinesthetic feedback: a survey of force feedback gloves. IEEE Trans. Haptics. 12(2), 189–204 (2018b)

    Article  Google Scholar 

  • Yuan, S.N.V., Ip, H.H.S.: Using virtual reality to train emotional and social skills in children with autism spectrum disorder. London J. Prim. Care. 10(4), 110–112 (2018)

    Article  Google Scholar 

  • Zhao, Y., Bennett, C.L., Benko, H., Cutrell, E., Holz, C., Morris, M.R., Sinclair, M.: Enabling people with visual impairments to navigate virtual reality with a haptic and auditory cane simulation. In: Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems, pp. 1–14 (2018)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Alvaro Uribe-Quevedo .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2022 Springer Nature Switzerland AG

About this entry

Check for updates. Verify currency and authenticity via CrossMark

Cite this entry

Uribe-Quevedo, A. (2022). Immersive Technologies for Accessible User Experiences. In: Lee, N. (eds) Encyclopedia of Computer Graphics and Games. Springer, Cham. https://doi.org/10.1007/978-3-319-08234-9_449-1

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-08234-9_449-1

  • Received:

  • Accepted:

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-08234-9

  • Online ISBN: 978-3-319-08234-9

  • eBook Packages: Springer Reference Computer SciencesReference Module Computer Science and Engineering

Publish with us

Policies and ethics

Navigation