WYSIWYF Display: A Visual/Haptic Interface to Virtual Environment

August 1999

WYSIWYF Display: A Visual/Haptic Interface to Virtual Environment

Authors:

Yasuyoshi Yokokohji, Ralph L. Hollis, and Takeo Kanade

Abstract:

To build a VR training system for visuomotor skills, an image displayed by a visual interface should be correctly registered to a haptic interface so that the visual sensation and the haptic sensation are both spatially and temporally consistent. In other words, it is desirable that what you see is what you feel (WYSIWYF). In this paper, we propose a method that can realize correct visual/haptic registration, namely WYSIWYF, by using a vision-based, object-tracking technique and a video-keying technique. Combining an encountered-type haptic device with a motion-command-type haptic rendering algorithm makes it possible to deal with two extreme cases (free motion and rigid constraint). This approach provides realistic haptic sensations, such as free-to-touch and move-and-collide. We describe a first prototype and illustrate its use with several demonstrations. The user encounters the haptic device exactly when his or her hand reaches a virtual object in the display. Although this prototype has some remaining technical problems to be solved, it serves well to show the validity of the proposed approach.
@article{Yokokohji-1999-122051,
author = {Yasuyoshi Yokokohji And Ralph L. Hollis And Takeo Kanade},
title = {WYSIWYF Display: A Visual/Haptic Interface to Virtual Environment},
journal = {Proceedings of Presence},
year = {1999},
month = {August},
volume = {8},
number = {4},
pages = {412 - 434},
}
Copyright notice: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.