Anon-Emoji: An optical see-Through augmented reality system for children with autism spectrum disorders to promote understanding of facial expressions and emotions

Research output: Contribution to journalConference articleResearchpeer-review

Facial expressions are an important part of human communication. However, children with autism spectrum disorders (ASD) are often suffering from difficulties of understanding non-verbal cues and form appropriate responses. Traditional approaches including labeling formatted photographs of human facial expressions from a third person's perspective could help them learn and improve such skills. Yet such training systems are often in lack of real time feedback. As Optical See-Through (OST) Augmented Reality (AR) headsets possess the advantages of near-eyes display and better depth alignment between virtual renderings and the environment, we decided on an OST AR approach for the system. In this paper, we present a system designed for OST AR headsets that occludes the subject's facial expressions with an emotion-presenting 3D emoji model. We hope this system could help us understand how children with ASD perceive emotions through standard emotion presenting systems and help them enhance their skills of understanding facial expressions.

Original languageEnglish
JournalAdjunct Proceedings of the 2019 IEEE International Symposium on Mixed and Augmented Reality, ISMAR-Adjunct 2019
Pages (from-to)448-450
Number of pages3
DOIs
Publication statusPublished - Oct 2019
Externally publishedYes
Event18th IEEE International Symposium on Mixed and Augmented Reality, ISMAR-Adjunct 2019 - Beijing, China
Duration: 14 Oct 201918 Oct 2019

Conference

Conference18th IEEE International Symposium on Mixed and Augmented Reality, ISMAR-Adjunct 2019
CountryChina
CityBeijing
Period14/10/201918/10/2019
SponsorArcSoft, Dell, et al., Intel, Sensetime, State Key Laboratory of Virtual Reality Technology and Systems (VR)

Bibliographical note

Publisher Copyright:
© 2019 IEEE.

    Research areas

  • Augmented-Reality, Autism-spectrum-disorders, Emoji, Emotion-understanding, Head-pose-Tracking, Optical-see-Through

ID: 301824405