Ryan M Corey and Andrew C Singer Capture spatial information about sound scene Localize and separate multiple sound sources Enhance signals in noisy environments Microphone Arrays Farfield speech recognition ID: 1040344
Download Presentation The PPT/PDF document "Microphone Array Projects" is the property of its rightful owner. Permission is granted to download and print the materials on this web site for personal, non-commercial use only, and to display it on your personal computer provided you do not modify the materials and that you retain all copyright notices contained in the materials. By downloading content from our website, you accept the terms of this agreement.
1. Microphone Array ProjectsRyan M. Corey and Andrew C. Singer
2. Capture spatial information about sound sceneLocalize and separate multiple sound sourcesEnhance signals in noisy environmentsMicrophone ArraysFar-field speech recognitionVoice communicationSpatial SoundProcessingAssistive listeningAugmented reality
3. Microphone array designs for real-world data collectionRecord raw multichannel audio data for later analysisTest new audio source separation algorithmsPolished, reliable design we can easily reproduceCompetent engineer could assemble in a day or twoFirmware, drivers, and documentationCalibration and test dataPick your own application!Assistive listeningMachine auditionAudio augmented reality3D audio/video productionEntertainment, gaming, music, karaoke…What we want
4. Most wearable electronics have only 2-4 micsLarge arrays give better spatial resolutionMany microphones (~ 8-32)Large total length/area (10’s of cm)Many possible wearable designsHead, neck, shoulders, torso, glasses…Should be portable, comfortable, safeRecord raw data for later analysis(Optional) Real-time spatial audio processingAdd a programmable processor< 10 ms total mic-to-ear latency for real-time listeningProject 1: Wearable Microphone ArrayU. Washington “COSINE”, 2009B. Widrow (Stanford), 2000
5. New tech makes it easier to build huge microphone arrays(Digital) MEMS microphonesImproved embedded processingNeed good multichannel data for signal processing researchDesign modules that can be scaled to dozens/hundreds of micsNeed large bandwidth for raw dataNeed synchronized sampling between modulesOK to demonstrate small setup that we can later scale upPortable and reconfigurableRecord in different environmentsRearrange modules for different array shapesProject 2: Huge Microphone ArrayMIT “LOUD”, 2004
6. Augmented listening headphonesRobot/drone microphone arrayBinaural recording (virtual 3D audio)Audio augmented realityAnything with microphones on it!Other IdeasContactRyan M. Corey119 Coordinated Science Labcorey1@Illinois.eduPut a mic on it