Lecture + Workshop: Interactive Sonification (Dr. Hermann)
A guest lecture and hands-on workshop on sonification of music-related body motion with Dr. Thomas Hermann from Bielefeld University.
Lecture: Interactive Sonification for Biofeedback Applications and Exploratory Data Analysis
The lecture will start with an overview of the research areas of auditory display and sonification and the available sonification techniques, illustrated by a number of example applications to showcase how sound can be productively used to facilitate understanding and interaction in various contexts. Subsequently, we will focus on interactive sonification, the research focus on how users can profit from being integrated within a tightly closed interaction loop. Interaction allows users to query multiple 'auditory views' of the underlying data. Selected examples – from sports to exploratory data analysis – illustrate how interactive sonification provides task-oriented information. Throughout the workshop, guidelines for the design of interactive sonification systems will be given.
In the hands-on workshop we will work in smaller teams on selected interactive sonification designs according to the teams' preferences, for instance (a) in contexts such as online sonification of body motions, or (b) interactive navigation of parameter mapping sonifications so that interesting auditory views can be selected quickly. For the implementation of such systems the BRIX2; physical computing platform for rapid prototyping will be provided, together with software templates to sonify sensor data in real-time. Likewise, sonification software templates in SuperCollider3 and python as well as some data sets will be provided to experiment with data analysis and data review sonifications. This will allow participants to practice sonification design procedures. Finally, after project team presentations, we will discuss the results and revisit and discuss design guidelines for interactive sonification.