21-07-2017 | Original Article | Uitgave 6/2018 Open Access

Communication for coordination: gesture kinematics and conventionality affect synchronization success in piano duos
- Tijdschrift:
- Psychological Research > Uitgave 6/2018
Introduction
Kinematics of effective cueing gestures
Gesture mimicry to facilitate synchronization
Current study
Methods
Interactive duo performance experiment
Participants
Composer
|
Piece
|
Tempo
|
Meter
|
---|---|---|---|
André
|
Sonata Facile, Op. 56
|
100
|
4/4
|
J.C.F. Bach
|
Sonata in C major for 4 Hands
|
90
|
2/2
|
Beethoven
|
String Quartet No. 3, Op. 18
|
65
|
2/4
|
Diabelli
|
Jugendfreude, Op. 163, No. 2
|
220
|
4/4
|
Diabelli
|
Sonates Mignonnes, Op. 150, No. 1
|
70
|
4/4
|
Haydn
|
Divertimento in G major
|
95
|
2/4
|
Haydn
|
String Quartet in G major, Op. 76
|
65
|
2/4
|
Kuhlau
|
Rondo, Op. 111
|
135
|
2/4
|
Löschhorn
|
Kinderstücke, Op. 182, No. 6
|
45
|
2/2
|
Mozart
|
Divertimento in F major, KV. 138
|
135
|
4/4
|
Mozart
|
Piano Sonata in B-flat major, K. 358
|
160
|
4/4
|
Pleyel
|
Quartet in A, Op. 20, No. 2
|
120
|
4/4
|
Ravel
|
Quartet in F major
|
110
|
4/4
|
Schubert
|
Overture in F major for 4 Hands
|
60
|
2/2
|
Strauss
|
Sperl-Polka, Op. 133
|
135
|
2/4
|
Stimuli and equipment
Procedure
Analysis
Alignment of audio/MIDI and motion capture data
Gesture position, velocity, acceleration, and jerk
Primo-secondo note asynchronies
Gesture-following experiment
Participants
Stimuli and equipment
Procedure
Results
Indicators of beat position
Motion parameter
|
Point
|
Interactive duo performance task
|
Gesture-following task
|
||||
---|---|---|---|---|---|---|---|
Aligned (%)
|
Median
|
SD
|
Aligned (%)
|
Median
|
SD
|
||
Head position
|
Peak
|
44
|
0.90
|
0.25
|
42
|
1.05
|
0.45
|
Trough
|
56
|
0.22
|
0.31
|
34
|
0.43
|
0.44
|
|
Head velocity
|
Peak
|
22
|
0.80
|
0.27
|
38
|
1.10
|
0.42
|
Trough
|
39
|
0.28
|
0.36
|
38
|
0.56
|
0.44
|
|
Head acceleration
|
Peak
|
50
|
0.89
|
0.24
|
50
|
1.09
|
0.28
|
Trough
|
33
|
0.71
|
0.28
|
63
|
0.89
|
0.29
|
Gesture properties that support successful synchronization
Alignment between leaders’ gestures and sounded performance (H2)
Motion parameter
|
Point
|
Leader onsets
|
||
---|---|---|---|---|
Aligned (%)
|
Median
|
SD
|
||
Head position
|
Peak
|
50
|
0.89
|
0.24
|
Trough
|
50
|
0.22
|
0.29
|
|
Head velocity
|
Peak
|
44
|
0.83
|
0.28
|
Trough
|
44
|
0.31
|
0.35
|
|
Head acceleration
|
Peak
|
61
|
0.90
|
0.21
|
Trough
|
39
|
0.71
|
0.24
|
Gesture smoothness and magnitude (H3–4)
Gesture prototypicality (H5)
Evaluating predictors of synchronization success
Gesture coordination and note synchronization in interactive duo performance task
Similarity in leader–follower gesture patterns (H6)
Motion parameter
|
Max correlation strength
|
Max correlation lag (IBIs)
|
||
---|---|---|---|---|
Mean
|
SD
|
Mean
|
SD
|
|
Position
|
0.69
|
0.15
|
−0.24
|
0.64
|
Velocity
|
0.56
|
0.22
|
−0.40
|
0.59
|
Acceleration
|
0.55
|
0.21
|
−0.41
|
0.63
|