Liam OSullivan Electronic and Electrical Engineering Trinity College Dublin Ireland Trinity College Dublin Tailoring Tabletop Interfaces for Musical Control Proliferation of multitouch ID: 418892
Download Presentation The PPT/PDF document "Tailoring Tabletop Interfaces for Musica..." is the property of its rightful owner. Permission is granted to download and print the materials on this web site for personal, non-commercial use only, and to display it on your personal computer provided you do not modify the materials and that you retain all copyright notices contained in the materials. By downloading content from our website, you accept the terms of this agreement.
Slide1
Tailoring Tabletop Interfaces for Musical Control
Liam O'SullivanElectronic and Electrical Engineering, Trinity College Dublin, Ireland
Trinity College DublinSlide2
Tailoring Tabletop Interfaces for Musical Control
Proliferation of multitouch teechnology:Smart phone/ iPod etc.
iPad
/ Galaxy tab etc.
Microsoft Surface, Diamond Touch etc.Bespoke multitouch
tables. Smart phone/ iPod.
Liam O’Sullivan, Trinity College Dublin.Slide3
Tailoring Tabletop Interfaces for Musical Control
Traditional/ acoustic musical instruments: Direct manipulation of the sound producing mechanism -> feedback in multiple modes.
Tight input-output
coupling -> fast system response.
Result: sense of intimate control.
Liam O’Sullivan, Trinity College Dublin.Slide4
Tailoring Tabletop Interfaces for Musical Control
Computer-based interactive music system (IMS):Control of complex musical output, timbre.
Interface detached from the sound
generator.Disrupts the player's perceived relationship with the system
.Liam O’Sullivan, Trinity College Dublin.Slide5
Tailoring Tabletop Interfaces for Musical Control
Wessel et. al. - design goals for control intimacy:Ease of use/ potential for virtuosity.Highly reactive system.
Meaningful interactions.
Liam O’Sullivan, Trinity College Dublin.Slide6
Tailoring Tabletop Interfaces for Musical Control
Related Work:The reacTable: modular synthesis paradigm.SurfaceMusic: traditional instrument interaction metaphors & physical models.
Liam O’Sullivan, Trinity College Dublin.Slide7
Tailoring Tabletop Interfaces for Musical Control
Benefits of camera system for a musical interface:Multitouch input- collaborative & bi-manual play, multiple gesture scales.Simultaneous control of many parameters.
Superimposed feedback on control surface.
Liam O’Sullivan, Trinity College Dublin.Slide8
Tailoring Tabletop Interfaces for Musical Control
Weaknesses with regard to intimate musical control:Low temporal resolution/ high latency.Poor strength-of-interaction detection.GUI designs.
Liam O’Sullivan, Trinity College Dublin.Slide9
Tailoring Tabletop Interfaces for Musical Control
Prototype 1:twoHand: relates shapes to sound parameters.Another camera-based system!
Liam O’Sullivan, Trinity College Dublin.Slide10
Tailoring Tabletop Interfaces for Musical Control
Approach:Examination of all functional stages of an IMS.Sensing, Processing, Feedback.Liam O’Sullivan, Trinity College Dublin.Slide11
Tailoring Tabletop Interfaces for Musical Control
Acoustic sensing: sampling in 1 KHz range.Gesture recognition: capturing expressive intent.Mapping input to output: complex mapping is more engaging, simultaneous control of many parameters.
Virtual objects: qualities mapped to sound synthesis parameters.
Sound synthesis: physical models.
Liam O’Sullivan, Trinity College Dublin.Slide12
Tailoring Tabletop Interfaces for Musical Control
Diffraction and reflection of vibrational waves in plates- difficult to model. Liam O’Sullivan, Trinity College Dublin.Slide13
Tailoring Tabletop Interfaces for Musical Control
Abstract graphical controllers based on sound symbolism:
Liam O’Sullivan, Trinity College Dublin.Slide14
Tailoring Tabletop Interfaces for Musical ControlPilot user survey of audio-visual mappings:
Liam O’Sullivan, Trinity College Dublin.Slide15
Tailoring Tabletop Interfaces for Musical Control
Automation of low level processes using fuzzy logic:Liam O’Sullivan, Trinity College Dublin.Slide16
Tailoring Tabletop Interfaces for Musical Control
Thank you!Talk to me at my poster!lmosulli@tcd.ieLiam O’Sullivan, Trinity College Dublin.