M Mancini G Volpe F Odone Analysis of the qualities of human movement in individual performances project2enterfacenet Project objectives Investigation human movements ID: 511048
Download Presentation The PPT/PDF document "A. Camurri" is the property of its rightful owner. Permission is granted to download and print the materials on this web site for personal, non-commercial use only, and to display it on your personal computer provided you do not modify the materials and that you retain all copyright notices contained in the materials. By downloading content from our website, you accept the terms of this agreement.
Slide1
A. Camurri, M. Mancini, G. Volpe, F. Odone
Analysis of the qualities of human movement in individual performances
project2@enterface.net Slide2
Project objectives Investigation :
human movements movements expressive qualities
sensory substitution techniques Application : enable blind people to perceive bodily movement
Context
2
Project 2 | Analysis of the qualities of human movement in individual performancesSlide3
Movement Features Considered3
Project 2 | Analysis of the qualities of human movement in individual performancesWe are considering three different kinds of characteristics of the dynamic of a movement
Is it
fluid or rigid? With how much energy is the subject performing the movement? Could we spot an impulsive behaviour within the execution of the movement?Slide4
Extraction Techniques (accelerometers)4
Project 2 | Analysis of the qualities of human movement in individual performancesStarting from the data available from the accelerometers
we
extract some characteristics of the dynamics of the movements analysedSlide5
Extraction Techniques (video sequences)5
Project 2 | Analysis of the qualities of human movement in individual performancesEvaluating the behaviour of the optical flow between each pair of frames of the sequence considered, by analysing the evolution of the resulting histogram of the optical flowSlide6
Interactive Sonification6
Project 2 | Analysis of the qualities of human movement in individual performancesDefinition: data exploration by interactively manipulating the data’s transformation into sound
Data from accelerometers, webcam
TransformationSlide7
System architecture7Project 2 |
Analysis of the qualities of human movement in individual performancesSlide8
Experiment: Testing and Validation of the System8
Project 2 | Analysis of the qualities of human movement in individual performancesInvestigation of the user’s capabilities and sensibility in recognizing individual movement qualities by means of the auditory modalitySlide9
Experiment: Testing and Validation of the System9
Project 2 | Analysis of the qualities of human movement in individual performancesQ1: Is it possible for the user to understand the mapping between his movement qualities
(fluid – rigid, low energy – high energy, impulsive movements) and the associated
sonifications while exploring the feature space?Q2: Given a particular movement feature, which is the sound that represents it the most?Q3 Is it possible for the user to distinguish the proposed movement qualities only through the auditory domain ?Slide10
Experiment (I)10Project # | Title of the projectSlide11
Equipment 11Project # | Title of the projectSlide12
Experiment (II)12Project # | Title of the projectSlide13
Collected Feedbacks13Project # | Title of the project
n
ot
at allvery muchSlide14
Collected Feedbacks (II)14Project # | Title of the project
Sound
responsive to the movements
easy to manipulateLearning of the Systeminteresting intuitivenot confusing
Features
easy to differentiate between movements features
noticeable difference between using one or more limbs
Equipment
comfortable enough Slide15
System Evaluation: Fluid/Rigid – Low/High Energy
15Project # | Title of the project
Fluid/Rigid
movements - Low/High EnergyLow/High Energy Movements
Sounds generated by the system resulted to intuitive for
the use
rs with or without trainingSlide16
System Evaluation: Fluid/Rigid Movements16
Project # | Title of the project
Sonification
of rigid movements with low energy was significantly better recognized after the trainingSlide17
System Evaluation: Fluid/Rigid Movements17
Project # | Title of the project
ANOVA
Sum of SquaresdfMean SquareFSig.Rigidity
LowEnergy
Between Groups
.4171
.417
10.015.004
Within Groups
.958
23
.042
Total
1.375
24
Rigidity
High
Energy
Between Groups
.000
1
.000
.007
.933
Within Groups
1.375
23
.060
Total
1.375
24
Fluidity
Low
Energy
Between Groups
.065
1
.065
1.659
.210
Within Groups
.895
23
.039
Total
.960
24
Fluidity
High
Energy
Between Groups
.010
1
.010
.131
.720
Within Groups
1.750
23
.076
Total
1.760
24
Slide18
GAME :MOVE IN THE DARK18
Project # | Title of the projectSlide19
Conclusions19Project 2 |
Analysis of the qualities of human movement in individual performancesQ1: Is it possible for the user to understand the mapping between his movement qualities (fluid – rigid, low energy – high energy, impulsive movements) and the associated sonifications while exploring the feature space?
Answer:
YesQ2: Given a particular movement feature, which is the sound that represents it the most?Answer: Future WorkQ3 Is it possible for the user to distinguish the proposed movement qualities only through the auditory domain ?Answer: YesSlide20
TEAM
20Project 2 | Analysis of the qualities of human movement in individual performances
UNIGE – CASA PAGANINI - DIBRIS
KTH
MAASTRICHT UNIVERSITY