Merging science and practice David Kirsh UCSD Cognitive Science Assoc Director ACCHI Erik Viirre MD PhD UCSD School of Medicine Sheldon Brown UCSD Visual Arts Director of ACCHI ID: 404079
Download Presentation The PPT/PDF document "1 Imaginarium" is the property of its rightful owner. Permission is granted to download and print the materials on this web site for personal, non-commercial use only, and to display it on your personal computer provided you do not modify the materials and that you retain all copyright notices contained in the materials. By downloading content from our website, you accept the terms of this agreement.
Slide1
1
ImaginariumMerging science and practice
David
Kirsh
, UCSD Cognitive Science, Assoc. Director ACCHI
Erik
Viirre
M.D. Ph.D.,
UCSD School of Medicine
Sheldon Brown
, UCSD Visual Arts, Director
of ACCHI
Plus collaborators…Slide2
Objectives
Observation: Study the nature of distributed creativity in the natural setting of:
Brain storming
Design
Creative ExpressionTheory: Build a more comprehensive theory of activity and sensory involvement during brainstormingDesign: Explore impact of changes in environment design on imagination, creativity and problem solvingSlide3
Imaginarium Technology
Binocular eye tracking among groupsVideo cameras coordinated with eye trackingKinects for gesture detection
Portable ERP caps
Precise sound localization
Whiteboard and other surface captureAutomated Annotation of design sessionRemote interaction with other sitesSlide4
Analytic Techniques
Ethnographic coding, activity analysis, Datamining for patterns among different capture recordsMachine learning using VATIC and crowd sourcing to classify events defined via activity analysis
Analyses using theories of distributed, situated and embodied cognitionSlide5
Collaborators Relevant Research Basis
Kirsh: NSF on Distributed Creative CognitionIn choreography being expanded to musicMakeig,
Saygin
: ERP (E
vent Related Potentials) during activityTrivedi: Video and Auditory awareness systems.Viirre: Eye Tracking for wayfinding, medical diagnosis and therapyBrown: User analytics of virtual worldsSlide6
Observation Set-Up for Distributed Creative Cognition in Choreography - Kirsh
Mandeville Auditorium
Cal-IT2Slide7
Oculomotor Measuring EquipmentSlide8Slide9Slide10
Video Engineering
Wide Angle Camera to identify headHigh resolution camera slaved to get face/eye activityAnalysis of video image (visible/IR)Slide11
Body and Gaze TrackingSlide12
Tool for CollaborationCentered around whiteboard, display table, workbenchAnnotation
Command interaction (Kinect)Slide13
Medical Evaluation
Monitoring of Movement controlFall RiskMovement controlADL
Evaluation of Disease progression
Vestibular
ParkinsonsDiagnosis?Cerebrovascular vs. NeurodegenerativeSlide14
Research Questions
Are binocular indices sensitive indicators of neural disruptionWhat do “natural” eye movements look like? Combined Eye-HeadHead FreeScan pathsSlide15
Embedded Cognition Theory
Interaction with physical objectsMental planning, practiceLearning theory of tasks Slide16
Principals
Erik Viirre, MedicineDavid Kirsch, Cog SciMohan Trivedi, Engineering
Sheldon Brown, Visual ArtsSlide17
Funding Sources
Industry PartnersMedical ResearchDOD/VANIHNSF Computing, sensors, creativity, social sciences