TY - BOOK

T1 - Interacting on and around Large Displays

T2 - Towards Improved Mid-Air Text Entry, Improved Understanding of Input Modalities, and Extended Boundaries of Interaction

AU - Markussen, Anders

PY - 2015

Y1 - 2015

N2 - Over the past two decades, interactions on and around large high-resolution displays have gainedincreasing levels of attention in research and in practice. This thesis explores and comparesinteraction techniques for large displays that operate up-close and at a distance. More specifically,the focus of this thesis is on three aspects of large display interactions: (1) Improved Mid-Air TextEntry; (2) Improved Understanding of Input Modalities; and (3) Extended Boundaries ofInteraction.To improve support for mid-air text entry, Paper 1 conducted a design space analysis, andthree mid-air text entry methods were evaluated to establish a baseline for mid-air text entryperformance. The most promising technique, Projected QWERTY, reached a text entry rate of 13.2Words Per Minute (WPM). Paper 2 aimed to improve mid-air text entry rates by adapting Word-Gesture Keyboards (WGKs), a previously successfully text entry method for touch- and pen-basedinput, to work as a technique for mid-air text entry. With a text entry rate of 20.6 WPM after 10sessions of text entry, the mid-air WGK provided faster text entry rates than previously evaluatedmethods for mid-air text entry. An improved version of the keyboard even showed text entry ratesof 28.1 WPM on the first session of an accelerated learning study where a limited set of phraseswere repeatedly transcribed. Paper 3 build on the result from Paper 1 and Paper 2, and propose newdirections for text entry research for large displays.To improve understanding of the differences between input modalities for large displays, themid-air WGK was compared to a touch-based functionally equivalent WGK. The touch-basedkeyboard was found to be significantly faster than the mid-air WGK, indicating that touch basedinteraction may be preferable for text entry. However, future work could potentially increase textentry rates of the mid-air keyboard by studying and identifying the specific properties that resultedin the performance benefits of the touch-based keyboard. Paper 3 also proposed the Back Of theHand (BOH) as a novel interaction modality for large displays that could have some of theadvantages of both touch and mid-air interaction. To assess the potential of this novel interactionmodality, Paper 4 presents a tracking solution that was developed and tested as an input method forsmart watches. Further studies are needed to explore the potential interaction techniques supportedby this novel tracking solution, and assess its potential to work as a new input modality for largedisplays.Finally, Paper 5 presents Off-Limits, a novel interaction concept for large displays that usesoff-screen pointing to allow direct reach of content that reside outside the display boundaries, takingadvantage of users’ perceived location of off-screen content. Off-Limits was found to providesignificant benefits over touch-based interaction. The results show that an extension of interactionsbeyond the boundaries of the display can increase users’ performance.

AB - Over the past two decades, interactions on and around large high-resolution displays have gainedincreasing levels of attention in research and in practice. This thesis explores and comparesinteraction techniques for large displays that operate up-close and at a distance. More specifically,the focus of this thesis is on three aspects of large display interactions: (1) Improved Mid-Air TextEntry; (2) Improved Understanding of Input Modalities; and (3) Extended Boundaries ofInteraction.To improve support for mid-air text entry, Paper 1 conducted a design space analysis, andthree mid-air text entry methods were evaluated to establish a baseline for mid-air text entryperformance. The most promising technique, Projected QWERTY, reached a text entry rate of 13.2Words Per Minute (WPM). Paper 2 aimed to improve mid-air text entry rates by adapting Word-Gesture Keyboards (WGKs), a previously successfully text entry method for touch- and pen-basedinput, to work as a technique for mid-air text entry. With a text entry rate of 20.6 WPM after 10sessions of text entry, the mid-air WGK provided faster text entry rates than previously evaluatedmethods for mid-air text entry. An improved version of the keyboard even showed text entry ratesof 28.1 WPM on the first session of an accelerated learning study where a limited set of phraseswere repeatedly transcribed. Paper 3 build on the result from Paper 1 and Paper 2, and propose newdirections for text entry research for large displays.To improve understanding of the differences between input modalities for large displays, themid-air WGK was compared to a touch-based functionally equivalent WGK. The touch-basedkeyboard was found to be significantly faster than the mid-air WGK, indicating that touch basedinteraction may be preferable for text entry. However, future work could potentially increase textentry rates of the mid-air keyboard by studying and identifying the specific properties that resultedin the performance benefits of the touch-based keyboard. Paper 3 also proposed the Back Of theHand (BOH) as a novel interaction modality for large displays that could have some of theadvantages of both touch and mid-air interaction. To assess the potential of this novel interactionmodality, Paper 4 presents a tracking solution that was developed and tested as an input method forsmart watches. Further studies are needed to explore the potential interaction techniques supportedby this novel tracking solution, and assess its potential to work as a new input modality for largedisplays.Finally, Paper 5 presents Off-Limits, a novel interaction concept for large displays that usesoff-screen pointing to allow direct reach of content that reside outside the display boundaries, takingadvantage of users’ perceived location of off-screen content. Off-Limits was found to providesignificant benefits over touch-based interaction. The results show that an extension of interactionsbeyond the boundaries of the display can increase users’ performance.

UR - https://soeg.kb.dk/permalink/45KBDK_KGL/fbp0ps/alma99122228280305763

M3 - Ph.D. thesis

BT - Interacting on and around Large Displays

PB - Department of Computer Science, Faculty of Science, University of Copenhagen

ER -