AG 1, AG 2, AG 3, AG 4   Info

Expert Audience

-- Not specified --

Saarbrücken

Human perception is frequently multimodal in nature. Subjective experiences of objects or events are often informed by information sensed via two or more modalities (for example, vision, sound, and touch). With the current move towards multimedia, it is important for interface designers to take such user effects into account in order to make best advantage of current technology and to avoid the production of inappropriate perceptions. Two illusions, the McGurk effect and ventrilloquism, are demonstrated to highlight the potentially striking nature of multimodal perceptions. Before senses can interact in this manner, however, the perceiver must attribute information obtained via different sources (for example, the eyes and ears) to a single underlying object or event (for example, a person speaking on a video screen). An experimental investigation of the mental processes underlying this attribution is presented, together with implications for interface design. Preliminary findings of several experiments using a virtual
haptic
(touch) interface are also described. Potential perceptual interactions
between
visual and haptic modalities are outlined in relation to system design.

Thomas Rist

--email hidden

passcode not visible

logged in users only