Pull Gestures with Coordinated Graphics on Dual-Screen Devices

November 2022

Pull Gestures with Coordinated Graphics on Dual-Screen Devices

Authors:

Vivian Shen and Chris Harrison

Abstract:

A new class of dual-touchscreen device is beginning to emerge, either constructed as two screens hinged together, or as a single display that can fold. The interactive experience on these devices is simply that of two 2D touchscreens, with little to no synergy between the interactive areas. In this work, we consider how this unique, emerging form factor creates an interesting 3D niche, in which out-of-plane interactions on one screen can be supported with coordinated graphics in the other orthogonal screen. Following insights from an elicitation study, we focus on "pull gestures", a multimodal interaction combining on-screen touch input with in air movement. These naturally complement traditional multitouch gestures such as tap and pinch, and are an intriguing and useful way to take advantage of the unique geometry of dual-screen devices.
@conference{Shen-2022-135217,
author = {Vivian Shen And Chris Harrison},
title = {Pull Gestures with Coordinated Graphics on Dual-Screen Devices},
booktitle = {Proceedings of the 2022 International Conference on Multimodal Interaction},
year = {2022},
month = {November},
publisher = {AM},
keywords = {Augmented Interfaces, Multimodal Interaction},
}
Copyright notice: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.