Master student

AG 1, AG 2, AG 3, AG 4, AG 5, SWS, RG1, MMCI   Info

Public Audience

English

90 Minutes

Saarbrücken

We tackle a new challenge of modeling a perceptual experience in which a stimulus in one modality gives rise to an experience in a different sensory modality, termed synesthesia. To meet the challenge, we propose a probabilistic framework based on graphical models that enables to link visual modalities and auditory modalities via natural language text. An online prototype system is developed for allowing human judgement to evaluate the model’s performance. Experimental results indicate usefulness and applicability of the framework. Finally, a new probabilistic model that captures corresponding information from arbitrary data will be introduced.

IMPRS-CS Office

0681 93 25 225

--email hidden

passcode not visible

logged in users only