Automated help system for novice older users from touchscreen gestures

December 2016

Automated help system for novice older users from touchscreen gestures

Authors:

Daisuke Sato, Tetsuro Morimura, Takayuki Katsuki, Yosuke Toyota, Tsuneo Kato, and Hironobu Takagi

Abstract:

Older adults who have never used smartphone often suffers from getting used to smartphone gestures because of their lack of basic knowledge or skills with the latest technologies like gesture-oriented touchscreens. In this paper, we propose a user modeling method for inferring problems novice users face for smartphone from their touchscreen gestures. The output of user model is used by automated help enabling them to acquire touchscreen gestures. We apply a feature extraction approach based on the frequent pattern mining of gesture sequence to the user modeling. The learned user model detects types of problems in real time and is used for automated help. To optimize of instruction timing and its selection, we use a Bayesian reinforcement learning approach, which balances the exploration-exploitation trade-off. We evaluate the effectiveness of the method by using a prototype assistant system for a map application. The evaluation with older (60+) novice users showed positive results. The performance of the prototype system and the potential for further application is discussed.
@conference{Sato-2016-126513,
author = {Daisuke Sato And Tetsuro Morimura And Takayuki Katsuki And Yosuke Toyota And Tsuneo Kato And Hironobu Takagi},
title = {Automated help system for novice older users from touchscreen gestures},
booktitle = {Proceedings of 23rd International Conference on Pattern Recognition (ICPR '16)},
year = {2016},
month = {December},
pages = {3073 - 3078},
}
Copyright notice: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.