Relating features of hearing to the perception of speech The bottom line The auditory system encodes the properties of sound that are essential to recognizing speech but its a lot more complicated than that ID: 160016
Download Presentation The PPT/PDF document "Speech perception" is the property of its rightful owner. Permission is granted to download and print the materials on this web site for personal, non-commercial use only, and to display it on your personal computer provided you do not modify the materials and that you retain all copyright notices contained in the materials. By downloading content from our website, you accept the terms of this agreement.
Slide1
Speech perception
Relating features of hearing to the perception of speechSlide2
The bottom line
The auditory system encodes the properties of sound that are essential to recognizing speech, but it’s a lot more complicated than that.Slide3
ProductionSlide4
AcousticsSlide5
VowelsSlide6
Consonants
Laughter can soothe and healSlide7
Place and manner of articulationSlide8
Speech cuesSlide9
Important acoustic featuresSlide10
Envelope v. Spectral InformationSlide11
Fine structure: VoicingSlide12
Fine structure: Intonation contour
Marianna made the marmalade.Slide13
Fine structure: Tone
split white swing defeat
mother
high level
hemp
rising
horse
falling- rising
scold
fallingSlide14
Redundancy leads to robust perception
Frequency (Hz)
Amplitude (dB)
2100
400 Hz bandwidth
.5 1 1.5 2.0
Amplitude (dB)
.5 1 1.5 2.0
.5 1 1.5 2.0
1 Hz
4 Hz
64 Hz
Interrupted
FilteredSlide15
Variability in acoustics: Co-articulationSlide16
Variability in acoustics: Speaker
Winnfield, LA
Vancouver, BC
Brooklyn, NYSlide17
Variability in acoustics: Top-down influences
another thing coming OR another think coming?Slide18
Multisensory integrationSlide19
Conclusions
Speech is produced by spectral and temporal modifications (by articulators) of a vibrating source (vocal folds).
The amplitude spectrum and the envelope of sound carry much of the information in speech. The fine structure contributes to pitch-related aspects of speech.
Sound associated with a phoneme is influenced by preceding and following phonemes, by the speaker, and by many other factors.
Speech is highly resistant to corruption and interference.
Acoustic and semantic context important in speech recognition.
Speech is a multisensory phenomenon.