Subject-Matter/Problem Background
Listening in complex situations can be challenging for anyone. Additionally 20% of people worldwide suffer from some sort of hearing loss. Research shows gamified sensorimotor interaction could be conducive to better assessment and improved hearing.

Summary of Approach
A VR stealth game with sensorimotor interaction, where you must navigate difficult listening situations during a spaceship party, and identify alien words between the sounds of the spaceship engine, music, and party-goers.

XR Platform
VR with Meta Quest 2

Project Presentation
https://docs.google.com/presentation/d/1Ty7iIWqb8ung7CajjrNHrQfGe4K8NuWhSwCmrxyYDVU/edit?usp=sharing

References
Cherry, E. C. (1953). Some experiments on the recognition of speech, with one and two ears. JASA, 25(5), 975–979
McDermott, J. H. (2009). The cocktail party problem. Current Biology, 19(22), 1024–1027.
Beck DL, Danhauer JL, Abrams HB, et al. Audiologic considerations for people with normal hearing sensitivity yet hearing difficulty and/or speech-in-noise problems. Hearing Review, 25(10), 28-38.
WHO (2021). World report on hearing.
Whitton, J. P., Hancock, K. E., Shannon, J. M., & Polley, D. B. (2017). Audiomotor Perceptual Training Enhances Speech Intelligibility in Background Noise. Current Biology, 27(21), 3237-3247.
Lelo de Larrea-Mancera, E. S., Philipp, M. A., Stavropoulos, T., Carrillo, A. A., Cheung, S., Koerner, T. K., Molis, M. R., Gallun, F. J., & Seitz, A. R. (2021). Training with an auditory perceptual learning game transfers to speech in competition. Journal of Cognitive Enhancement, 6(1), 47–66.

Full Credits for all Team Members and Contributors
Ayanna Seals - Research Scientist

E. Sebastian L.L.M. - Research Scientist

Min Kwak - XR Designer & 3D Artist

Ai Xia - Game Designer & Producer

Pedro Sodre - Sound Designer & Audio Programmer

Sid Chou - Developer

Mariette Papic - Artist & Storyteller