Exploring Gesture and Gaze Proxies to Communicate Instructor's Nonverbal Cues in Lecture Videos
Research output: Chapter in Book/Report/Conference proceeding › Article in proceedings › Research › peer-review
Standard
Exploring Gesture and Gaze Proxies to Communicate Instructor's Nonverbal Cues in Lecture Videos. / Wagner, Tobias; Hirzle, Teresa; Huckauf, Anke; Rukzio, Enrico.
CHI 2023 - Extended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems. Association for Computing Machinery, Inc., 2023. 113.Research output: Chapter in Book/Report/Conference proceeding › Article in proceedings › Research › peer-review
Harvard
APA
Vancouver
Author
Bibtex
}
RIS
TY - GEN
T1 - Exploring Gesture and Gaze Proxies to Communicate Instructor's Nonverbal Cues in Lecture Videos
AU - Wagner, Tobias
AU - Hirzle, Teresa
AU - Huckauf, Anke
AU - Rukzio, Enrico
N1 - Publisher Copyright: © 2023 Owner/Author.
PY - 2023
Y1 - 2023
N2 - Teaching via lecture video has become the defacto standard for remote education, but videos make it difficult to interpret instructors' nonverbal referencing to the content. This is problematic, as nonverbal cues are essential for students to follow and understand a lecture. As remedy, we explored different proxies representing instructors' pointing gestures and gaze to provide students a point of reference in a lecture video: no proxy, gesture proxy, gaze proxy, alternating proxy, and concurrent proxies. In an online study with 100 students, we evaluated the proxies' effects on mental effort, cognitive load, learning performance, and user experience. Our results show that the proxies had no significant effect on learning-directed aspects and that the gesture and alternating proxy achieved the highest pragmatic quality. Furthermore, we found that alternating between proxies is a promising approach providing students with information about instructors' pointing and gaze position in a lecture video.
AB - Teaching via lecture video has become the defacto standard for remote education, but videos make it difficult to interpret instructors' nonverbal referencing to the content. This is problematic, as nonverbal cues are essential for students to follow and understand a lecture. As remedy, we explored different proxies representing instructors' pointing gestures and gaze to provide students a point of reference in a lecture video: no proxy, gesture proxy, gaze proxy, alternating proxy, and concurrent proxies. In an online study with 100 students, we evaluated the proxies' effects on mental effort, cognitive load, learning performance, and user experience. Our results show that the proxies had no significant effect on learning-directed aspects and that the gesture and alternating proxy achieved the highest pragmatic quality. Furthermore, we found that alternating between proxies is a promising approach providing students with information about instructors' pointing and gaze position in a lecture video.
KW - Education
KW - Eye-tracking
KW - Gaze
KW - Gesture
KW - Lecture video
UR - http://www.scopus.com/inward/record.url?scp=85158117914&partnerID=8YFLogxK
U2 - 10.1145/3544549.3585842
DO - 10.1145/3544549.3585842
M3 - Article in proceedings
AN - SCOPUS:85158117914
BT - CHI 2023 - Extended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems
PB - Association for Computing Machinery, Inc.
T2 - 2023 CHI Conference on Human Factors in Computing Systems, CHI 2023
Y2 - 23 April 2023 through 28 April 2023
ER -
ID: 347300683