After Rigid Interfaces: Investigating Interaction with Deformable Interfaces and the Design of Shape-Changing Interfaces

Research output: Book/ReportPh.D. thesisResearch

  • Giovanni Maria Troiano
Deformable and shape-changing interfaces are rapidly emerging in the field of
human-computer interaction (HCI). Deformable interfaces provide users with newer
input possibilities such as bending, squeezing, or stretching, which were impossible to
achieve with rigid interfaces. Shape-changing interfaces can reconfigure their shape
dynamically, providing users with new affordances and output modalities. This thesis
contributes to both the field of deformable interfaces and shape-changing interfaces
through empirical research.
In the area of deformable interfaces, this thesis presents two studies (1) a user
study with a prototype of an elastic, deformable display, and (2) a user study of
deformable interfaces for performing music. The first study reports a guessability
study with an elastic, deformable display where 17 participants suggested fitting
gestures for 29 tasks, including navigation and manipulation of 3D graphical objects.
Results from the first study describe a user-defined gestures set for elastic, deformable
displays, showing how participants used depth and elasticity of the display to simulate
various deformations, rotations, and displacements. The second study investigates
how musicians use deformable interfaces to perform electronic music. First, we
invited musicians with different backgrounds (e.g., performers, DJs, instrument
builders) to three workshops, where we made them explore 10 deformable objects and
generate ideas on how to use those to perform music. Then, we implemented sensors
in the five preferred objects and programmed them for controlling sounds with
computer software. Finally, we ran a performance study where six musicians
performed music with deformable interfaces at their studios. Results from the
performance study show that musicians systematically map deformations to certain
musical parameters and that deformable interfaces are generally used as tools to filter
and modulate sounds.
In the area of shape-changing interfaces, this thesis presents two work (1) an
analysis of sketches made by 21 participants designing either shape-changing radios
and mobile phones, and (2) a large-scale analysis of 340 science fiction (Sci-Fi)
movies that analyses behavioral qualities of shape change, and how they support
particular functionalities of shape-changing interfaces. The first work presents an
analysis of 42 sketches of shape-changing interfaces, specifically radio and mobile
phone. The result of this analysis shows a range of interesting design elements, but
also a lack of conventions on the use of metaphors with shape change and the need to
extend present vocabulary. Also, the analysis shows how metaphors and dynamic
affordances in shape change can be used to convey particular information (e.g., big-isurgent,
loud-is-up). The second work presents a large-scale analysis of 340 Sci-Fi
movies that identifies instances of shape-changing interfaces. Results from the
analysis reveals emergent behavioral patterns of shape change, namely
Reconfiguration, Transformation, Adaptation and Physicalization.
In synthesis, the work presented in this thesis shows (1) implications of usefulness
for deformable interfaces and how their new input modalities can redefine the way
users interact with computers, and (2) how a systematic understanding of
conventional design elements and behavioral qualities of shape change can help the
design of shape-changing interfaces in the future.
Original languageEnglish
PublisherDepartment of Computer Science, Faculty of Science, University of Copenhagen
Publication statusPublished - 2016

ID: 167547651