Melody and Motion

This project aims at studying the relationship between melodic contour perception and body motion. The interaction of bodily responses to rhythmic content are fairly well understood in terms of physical motion, entrainment and synchronization. In terms of pitch material, several models have been suggested regarding the embodied nature of conceptual space as well as in the form of physical motion. In this project, we take melody as the central unit and analyse the gestural responses to melodic contour. The project will include a study of theoretical rules for well-formed melodies from various cultures. The project aims at developing methods for computational analysis of motion capture data for sound tracings. An exploration of the relationships of these to contours, and contour typologies, and additional work in the interaction of melodic contour with sound and timbre features form a part of this project.

This project uses the following datasets and methodologies for understanding the motor representations of melodic contour. 



Sound Stimuli Distribution:

Genre \ Stimulus Presentation Recordings Pitch extracted + Resynthesized
Joik 4 4
North Indian Classical Music 4 4
Jazz Scat 4 4
Vocalise 4 4

Video examples of sound tracings:

0. A vanilla tracing
1. Percussive tracing
2. Inspired by genre (posture change)
3. A tracing representing high pitch does not necessarily have to be large in height. A different feature might be more important.
Download media file



Download media file



Download media file



Download media file





Published Aug. 9, 2017 11:34 AM - Last modified Aug. 15, 2018 11:27 AM