ProtoSound: A Personalized and Scalable Sound Recognition System for Deaf and Hard of Hearing Users

Publications

teaser image of ProtoSound: A Personalized and Scalable Sound Recognition System for Deaf and Hard of Hearing Users

ProtoSound: A Personalized and Scalable Sound Recognition System for Deaf and Hard of Hearing Users

Dhruv Jain, Khoa Nguyen, Steven Goodman, Rachel Grossman-Kahn, Hung Ngo, Aditya Kusupati, Ruofei Du, Alex Olwal, Leah Findlater, and Jon E. Froehlich
Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems (CHI), 2022.
Keywords: accessibility, deaf, Deaf, hard of hearing, sound awareness



pdf, lowres, doi | website, project, video, code | abstract | cited by, cite

Videos

ProtoSound: A Personalized and Scalable Sound Recognition System for Deaf and Hard of Hearing Users

youtube, mp4 | cite

Talks

Cited By

  • SoundVizVR: Sound Indicators for Accessible Sounds in Virtual Reality for Deaf or Hard of Hearing Users. ASSETS '22: The 24th International ACM SIGACCESS Conference on Computers and Accessibility.Ziming Li, Shannon Connell, Shannon Connell, Wendy Dannels, Roshan Peiris, and Roshan Peiris. source | cite | search
  • HiSSNet: Sound Event Detection and Speaker Identification Via Hierarchical Prototypical Networks for Low-Resource Headphones. arXiv.2303.07538.N Shashaank, Berker Banar, Mohammad Rasool Izadi, Jeremy Kemmerer, Shuo Zhang, and Chuan-Che Huang. source | cite | search
  • A Multimodal Prototypical Approach for Unsupervised Sound Classification. arXiv.2306.12300.Saksham Singh Kushwaha and Magdalena Fuentes. source | cite | search
  • Silent Delivery: Make Instant Delivery More Accessible for the DHH Delivery Workers Through Sensory Substitution. Distributed, Ambient and Pervasive Interactions.Shichao Huang, Xiaolong Li, Shang Shi, Haoye Dong, Xueyan Cai, Kecheng Jin, Jiayi Wu, Weijia Lin, Jiayu Yao, Yuqi Hu, Fangtian Ying, and Cheng Yao. source | cite | search
  • Socio-Technical Trust for Multi-Modal Hearing Assistive Technology. 2023 IEEE International Conference on Acoustics, Speech, and Signal Processing Workshops (ICASSPW).Jennifer Williams, Tayyaba Azim, Anna-Maria Piskopani, Alan Chamberlain, and Shuo Zhang. source | cite | search
  • A Survey on Artificial Intelligence-Based Acoustic Source Identification. IEEE Access.Ruba Zaheer, Iftekhar Ahmad, Daryoush Habibi, Kazi Yasin Islam, and Quoc Viet Phung. source | cite | search

    • Stay In Touch