Multisensory Processes, Learning & Sensory Substitution

Principal Investigator | Overview | LINE staff implicated | External collaborators | Representative Publications | Financial Support

Principal Investigator

  • Professor Micah M. Murray



Multisensory processes are fundamental in scaffolding perception, cognition, and learning across the lifespan. Currently, it is poorly understood when and how pairs of stimuli from different sensory modalities are integrated rather than processed as separate entities. Multisensory research in humans has largely focused on cataloguing phenomena and their neural correlates. This research has been groundbreaking on several levels. Such notwithstanding, many core mechanisms still remain undetermined. By filling these knowledge gaps, this project will have direct impact on the models of the brain’s functional organization and more accurate application of multisensory processes in education, and rehabilitation.

WP1: Core Mechanisms of Multisensory Integration

  • We will resolve major outstanding concerning multisensory integration: 1) their identification and concordance across fMRI, EEG, and behaviour, 2) their distinction from unisensory integration, and 3) their generalization across tasks.

WP2: Multisensory Integration in the Service of Real-World Perception

  • We will characterize behavioural and brain correlates of how multisensory processes facilitate vision in impoverished viewing conditions, providing a key step toward applying multisensory research outside the laboratory. 

WP3: Multisensory Integration in the Service of Real-World Memory

  • Our pioneering results on how single encounters with multisensory objects benefit memory for exclusively visual and auditory objects challenge longstanding dogmas. WP3 will determine boundary conditions for these effects and their neural underpinnings; a key step in applications in school and geriatric settings.

WP4: Generalisation across Multisensory Processes

  • We previously provided the first evidence that how strongly an individual responds to multisensory, but not unisensory, stimuli predicts whether the individual’s memory would benefit from multisensory contexts. WP4 will determine how an individual’s capacity to integrate multisensory information is coupled across functions from mere stimulus detection to object recognition and memory.


LINE staff implicated

Current staff

Past staff

  • Sarah Amrein (MS student)
  • Jacques Anken (PhD student)
  • Domenica Buetu (Research Scientist)
  • Céline Cappe (post-doc)
  • Camille Crézé (Research Assistant)
  • Laura De Santis (PhD student)
  • Shai Helfand (visiting student)
  • Lysiann Kalmbach (MS student)
  • Sandra Lehmann (MS student)
  • Raphaël Meylan (PhD student)
  • Michael Notter (Research Assistant)
  • Holger Sperdin (PhD student)
  • Antonia Thelen (PhD student)
  • Ulrike Toepel (Research Scientist)


External collaborators

  • Prof. Amir Amedi (Hebrew University, Jerusalem, Israel)
  • Prof. Pascal Barone (Université Paul Sabatier Toulouse, France)
  • Prof. David Lewkowicz (Northeastern University, Boston, MA, USA)
  • Dr. Roberto Martuzzi (Ecole Polytechnique Federale de Lausanne, Switzerland)
  • Prof. Lee Miller (UC Davis, California, USA)
  • Dr. Vincenzo Romei (University of Sussex, UK)
  • Prof. Eric Rouiller (University of Fribourg, Switzerland)
  • Dr. Daniel Sanabria and Ms. Beatriz Sarmiento (University of Granada, Spain)
  • Prof. Charles E. Schroeder (Columbia University, New York, USA)
  • Prof. Charles Spence (University of Oxford, UK)
  • Prof. Durk Talsma (University of Ghent, Belgium)
  • Dr. Antonia Thelen (Vanderbilt University, Nashville, TN, USA)
  • Prof. Gregor Thut (University of Glasgow, UK)
  • Prof. Mark Wallace (Vanderbilt University, Nashville, TN, USA)
  • Prof. Glenn Wylie (Kessler Foundation Research Center, New Jersey, USA)



Representative Publications

A full list of publications can be found here.

Financial Support

Current funding:

  • Swiss National Science Foundation grant #320030-169206 (2017-2020)
  • A grantor advised by Carigest SA (2016-2020)

Completed funding:

  • Swiss National Science Foundation grant #320030-149982 (2013-2017)
  • Swiss National Science Foundation grant #310030B-133136 (2010-2013)
  • Swiss National Science Foundation grant #3100A0-118419 (2007-2010)
  • Swiss National Science Foundation grant #3200B0-105680 (2004-2007)
  • The Leenaards Foundation, Prize for the promotion of scientific research (2005-2008)



CHUV - BH 08.078 - rue du Bugnon 46 - CH-1011 Lausanne
Tel. +41 21 314 13 21
cibm-logo.svg chuv-logo.svg universite_de_lausanne-logo.svg epfl-logo.svg universite_de_geneve-logo.svg hopitaux_universitaires_de_geneve_2015-logo.svg