Can sensory data be fed through unusual sensory channels?  And can the brain learn to extract the meaning of such information streams?

Yes and yes. Sensory substitution is a non-invasive technique for circumventing the loss of one sense by feeding its information through another channel. We are leveraging this technique to develop a non-invasive, low-cost vibratory vest to allow those with deafness or severe hearing impairments to perceive auditory information through small vibrations on their torso.

VAC

(Figure from Scott Novich and David Eagleman)

 Watch a video explaining the background and future of the Vest from the Being Human conference:

To make this work, we are capitalizing on recent advances in audio codecs and digital signal processing. In parallel, we are forging new research paths to maximize the information capacity of skin--for example, by using small 'sweeps' of vibratory motors rather than a single motor that turns on and off. As it turns out, people are much better at detecting these sweeps (green data points, below):

VACprelimData

(Data from Novich and Eagleman, under review)


For the larger theoretical ideas behind this project, see a 3 minute video on BigThink: Welcome to Your Future Brain.

The long term goal of our work is to better understand how sensory streams can be re-packaged into atypical sensory channels to restore perception or give new perceptions. Beyond applications for hearing, this research will contribute to a generalized framework for designing devices to send any kinds of information to the brain for sensory processing via atypical sensory modalities. Such a framework will feed both rehabilitative and assistive technologies

For more on the principles of neural plasticity that underlie this work, please keep an eye out for David's 2014 book on brain plasticity, LiveWired.

From the Blog

  • Perception on TNT
    Perception on TNT

    I am the scientific advisor for the TNT television drama, Perception, starring Eric McCormack and Rachael Leigh Cook. Learn more about the show.

  • Remembering a trail blazer - Francis Crick
    Remembering a trail blazer - Francis Crick

    Francis Crick, one of the premier biologists of the 20th century, passed away July 28, 2004, in San Diego. On his 88th birthday last June, I brought him chocolates and spent the day with him in his home in La Jolla.

  • Silicon Immortality: Downloading Consciousness into Computers
    Silicon Immortality: Downloading Consciousness into Computers

    Well before we understand how brains work, we may find ourselves able to digitally copy the brain's structure and able to download the conscious mind into a computer. What are the possibilities and challenges?

  • Discovering amulets inside the mummy
    Discovering amulets inside the mummy

    I recently posted about my scanning of a 3,000 year old mummy, Neskhons. Now, by analyzing the data in several different ranges of electron density, I've found something unexpected: inside the mummy's torso are 4 small funerary amulets.

You are here:   HomeResearchSensory Substitution


Coming in 2014