Anon-Emoji: An optical see-Through augmented reality system for children with autism spectrum disorders to promote understanding of facial expressions and emotions
Research output: Contribution to journal › Conference article › Research › peer-review
Standard
Anon-Emoji : An optical see-Through augmented reality system for children with autism spectrum disorders to promote understanding of facial expressions and emotions. / Sun, Ran; Haraldsson, Harald; Zhao, Yuhang; Belongie, Serge.
In: Adjunct Proceedings of the 2019 IEEE International Symposium on Mixed and Augmented Reality, ISMAR-Adjunct 2019, 10.2019, p. 448-450.Research output: Contribution to journal › Conference article › Research › peer-review
Harvard
APA
Vancouver
Author
Bibtex
}
RIS
TY - GEN
T1 - Anon-Emoji
T2 - 18th IEEE International Symposium on Mixed and Augmented Reality, ISMAR-Adjunct 2019
AU - Sun, Ran
AU - Haraldsson, Harald
AU - Zhao, Yuhang
AU - Belongie, Serge
N1 - Publisher Copyright: © 2019 IEEE.
PY - 2019/10
Y1 - 2019/10
N2 - Facial expressions are an important part of human communication. However, children with autism spectrum disorders (ASD) are often suffering from difficulties of understanding non-verbal cues and form appropriate responses. Traditional approaches including labeling formatted photographs of human facial expressions from a third person's perspective could help them learn and improve such skills. Yet such training systems are often in lack of real time feedback. As Optical See-Through (OST) Augmented Reality (AR) headsets possess the advantages of near-eyes display and better depth alignment between virtual renderings and the environment, we decided on an OST AR approach for the system. In this paper, we present a system designed for OST AR headsets that occludes the subject's facial expressions with an emotion-presenting 3D emoji model. We hope this system could help us understand how children with ASD perceive emotions through standard emotion presenting systems and help them enhance their skills of understanding facial expressions.
AB - Facial expressions are an important part of human communication. However, children with autism spectrum disorders (ASD) are often suffering from difficulties of understanding non-verbal cues and form appropriate responses. Traditional approaches including labeling formatted photographs of human facial expressions from a third person's perspective could help them learn and improve such skills. Yet such training systems are often in lack of real time feedback. As Optical See-Through (OST) Augmented Reality (AR) headsets possess the advantages of near-eyes display and better depth alignment between virtual renderings and the environment, we decided on an OST AR approach for the system. In this paper, we present a system designed for OST AR headsets that occludes the subject's facial expressions with an emotion-presenting 3D emoji model. We hope this system could help us understand how children with ASD perceive emotions through standard emotion presenting systems and help them enhance their skills of understanding facial expressions.
KW - Augmented-Reality
KW - Autism-spectrum-disorders
KW - Emoji
KW - Emotion-understanding
KW - Head-pose-Tracking
KW - Optical-see-Through
UR - http://www.scopus.com/inward/record.url?scp=85078794472&partnerID=8YFLogxK
U2 - 10.1109/ISMAR-Adjunct.2019.00052
DO - 10.1109/ISMAR-Adjunct.2019.00052
M3 - Conference article
AN - SCOPUS:85078794472
SP - 448
EP - 450
JO - Adjunct Proceedings of the 2019 IEEE International Symposium on Mixed and Augmented Reality, ISMAR-Adjunct 2019
JF - Adjunct Proceedings of the 2019 IEEE International Symposium on Mixed and Augmented Reality, ISMAR-Adjunct 2019
Y2 - 14 October 2019 through 18 October 2019
ER -
ID: 301824405