Holographic Sign Language Interpreters for Deaf Education

Instructional Innovation Grant, 2020-2022

Holographic Sign Language Interpreters

ACM SIGGRAPH 2022 Educator's Forum

Publications

  1. Yang, F.-C., Mousas, C., & Adamo, N. (2022). Holographic Sign Language Avatar Interpreter: A User Interaction Study in a Mixed Reality Classroom. Computer Animation and Virtual Worlds, 33(3-4), e2082.
  2. Yang, F.-C., Mousas, C., & Adamo, N. (2022). Holographic Sign Language Interpreters. In ACM SIGGRAPH 2022 Educator's Forum (pp. 1-2).

Project Desription

The goal of this project is to develop and assess the efficacy of a system of 3D holographic sign language interpreters. The proposed signing avatars, displayed as 3D holograms in a mixed reality environment, can be used by deaf learners in the classroom, at home, and while interacting with digital educational materials. Their usability will be evaluated in collaboration with deaf students at Purdue University, as well as deaf children, their teachers and parents at the Indiana School for the Deaf (ISD). Evaluation of the holographic signing avatars’ pedagogical efficacy will be conducted at ISD in the context of K-1 math education.

Key Personnel

Nicoletta Adamo
Card image cap

Computer Graphics Technology

Ronnie Wilbur
Card image cap

Speech, Language, & Hearing Sciences

Christos Mousas
Card image cap

Computer Graphics Technology

Fu-Chia Yang
Card image cap

Computer Graphics Technology