Publication Details

Download

Bastian Pfleging, Tanja Doering, Michael Kienast, Albrecht Schmidt
SpeeT: A Multimodal Interaction Style Combining Speech and Touch Interaction in Automotive Environments
Adjunct Proceedings of the 3rd International Conference on Automotive User Interfaces and Interactive Vehicular Applications, pp. 65-66, Salzburg, Austria, 2011. (bib)

SpeeT is an interactive system implementing an approach for combining touch gestures with speech in automotive environ- ments, exploiting the specific advantages of each modality. The main component of the implemented prototype is a speech- enabled, multi-touch steering wheel. A microphone recognizes speech commands while a wheel-integrated tablet allows touch gestures to be recognized. Using this steering wheel, the driver can control objects of the simulated car environment (e.g., win- dows, cruise control). The idea is to use the benefits of both inter- action styles and to overcome the problems of each single interac- tion style. While touch input is well suited for controlling func- tions, speech is powerful to select specific objects from a large pool of items. The combination simplifies the problem of remem- bering possible speech commands by two means: (1) speech is used to specify objects or functionalities and (2) in smart envi- ronments - particularly in cars - interaction objects are visible to the user and do not need to be remembered. Our approach is specifically designed to support important rules in UI design, namely: provide feedback, support easy reversal of action, reduce memory load, and make opportunities for action visible.