Biosingularity

Feeling your words: Hearing with your face

Posted on: January 25, 2009

The movement of facial skin and muscles around the mouth plays an important role not only in the way the sounds of speech are made, but also in the way they are heard according to a study by scientists at Haskins Laboratories, a Yale-affiliated research laboratory.

Caption: This is a listener wired for sounds.

Credit: Takayuki Ito / Haskins Laboratories


“How your own face is moving makes a difference in how you ‘hear’ what you hear,” said first author Takayuki Ito, a senior scientist at Haskins.

When, Ito and his colleagues used a robotic device to stretch the facial skin of “listeners” in a way that would normally accompany speech production they found it affected the way the subjects heard the speech sounds.

The subjects listened to words one at a time that were taken from a computer-produced continuum between the words “head” and “had.” When the robot stretched the listener’s facial skin upward, words sounded more like “head.” With downward stretch, words sounded more like “had.” A backward stretch had no perceptual effect.

And, timing of the skin stretch was critical — perceptual changes were only observed when the stretch was similar to what occurs during speech production.

These effects of facial skin stretch indicate the involvement of the somatosensory system in the neural processing of speech sounds. This finding contributes in an important way to our understanding of the relationship between speech perception and production. It shows that there is a broad, non-auditory basis for “hearing” and that speech perception has important neural links to the mechanisms of speech production.

Details of this study are reported in an article titled “Somatosensory function in speech perception” by Ito, Mark Tiede, and David J. Ostry which appeared in the Proceedings of the National Academy of Sciences (PNAS). All of these researchers are scientists affiliated with Haskins Laboratories. Tiede is also at the Research Laboratory of Electronics at the Massachusetts Institute of Technology and Ostry is a Professor in the Department of Psychology at McGill University.

Haskins Laboratories was founded in 1935 by the late Dr. Caryl P. Haskins. This independent research institute has been in New Haven, Connecticut since 1970 when it formalized affiliations with Yale University and the University of Connecticut. The Laboratories’ primary research focus is on the science of the spoken and written word.

Source Yale University

About these ads

1 Response to "Feeling your words: Hearing with your face"

[...] star is born next door (many more beyond), black hole jets. —Miscellaneous: hearing with your face, a look at invention and education, Nobel laureates speak out for scientific funding, Obama’s [...]

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s

Enter your email address to subscribe to this blog and receive notifications of new posts by email.

Join 936 other followers

Follow me on Twitter

Medical Professional Database Award

 Doctor

Visitors Now

who's online

Blog Stats

  • 1,407,615 hits

Categories

Top Rated

Flickr Photos

moscow mime

crete 11

Feeling autumnal evening winds

Snowy Plover Malibu Lagoon 1606

Soar

Today's sunrise - Explored October 30, 2014 -  # 1

The clown and the crocodile.

@ ungherese

A New Day

Cosmos/波斯菊/コスモス(秋桜)

More Photos

Maps

Networked blogs

Follow

Get every new post delivered to your Inbox.

Join 936 other followers

%d bloggers like this: