Poster at SMC 2017 - Exploring Melody and Motion Features in “Sound Tracings”

The 14th Sound and Music Computing Conference is organised at Aalto University, Espoo, Finland 5th-8th July 2017. Tejaswinee Kelkar, and Alexander Refsum Jensenius present a paper on describing feature sets to compare melodic contours and people's tracings of them.

Contour features that compare to contour features of people's tracings of chosen melodies.


Pitch and spatial height are often associated when describing music. In this paper we present results from a sound-tracing study in which we investigate such sound--motion relationships. The subjects were asked to move as if they were creating the melodies they heard, and their motion was captured with an infra-red, marker-based camera system. The analysis is focused on calculating feature vectors typically used for melodic contour analysis. We use these features to compare melodic contour typologies with motion contour typologies. This is based on using proposed feature sets that were made for melodic contour similarity measurement. We apply these features to both the melodies and the motion contours to establish whether there is a correspondence between the two, and find the features that match the most. We find a relationship between vertical motion and pitch contour when evaluated through features rather than simply comparing contours.

Published July 11, 2017 5:11 PM - Last modified July 11, 2017 5:15 PM