Workshop: Interactive Sonification

A guest lecture and hands-on workshop on sonification of music-related body motion with Dr. Thomas Hermann from Bielefeld University.

We will work in smaller teams on selected interactive sonification designs according to the teams' preferences, for instance (a) in contexts such as online sonification of body motions, or (b) interactive navigation of parameter mapping sonifications so that interesting auditory views can be selected quickly. For the implementation of such systems the BRIX2; physical computing platform for rapid prototyping will be provided, together with software templates to sonify sensor data in real-time. Likewise, sonification software templates in SuperCollider3 and python as well as some data sets will be provided to experiment with data analysis and data review sonifications. This will allow participants to practice sonification design procedures. Finally, after project team presentations, we will discuss the results and revisit and discuss design guidelines for interactive sonification.

Program (preliminary)

Time Content Location
Thursday    
10:15 Workshop Part 1: Practical Session / Preparations for Sonification experiments 103
12:00 Lunch break  
13:00 Workshop Part 2: Sonification Techniques in a nutshell 103
14:15 Lecture: Interactive Sonification for Biofeedback Applications and Exploratory Data Analysis Sem 2
16:00 Workshop Part 3: Hands-on Session in project teams 103
17:30 Team status presentations  & Discussion  
18:00 End of day 103
Friday    
10:15 Workshop Part 4:Model-based Sonification, Interactive Sonification, Blended Sonification 103
12:00 Lunch break  
13:00 Discussion and Conclusion 103
14:00 End of workshop  

Bring a laptop + headphones!

Lecture: Interactive Sonification for Biofeedback Applications and Exploratory Data Analysis

The lecture will start with an overview of the research areas of auditory display and sonification and the available sonification techniques, illustrated by a number of example applications to showcase how sound can be productively used to facilitate understanding and interaction in various contexts. Subsequently, we will focus on interactive sonification, the research focus on how users can profit from being integrated within a tightly closed interaction loop. Interaction allows users to query multiple 'auditory views' of the underlying data. Selected examples – from sports to exploratory data analysis – illustrate how interactive sonification provides task-oriented information. Throughout the workshop, guidelines for the design of interactive sonification systems will be given.

Bio

Dr. Thomas Hermann studied physics at Bielefeld University. From 1998 to 2001 he was a member of the interdisciplinary Graduate Program “Task-oriented Communication”. He started the research on sonification and auditory display in the Neuroinformatics Group and received a Ph.D. in Computer Science in 2002 from Bielefeld University (thesis: Sonification for Exploratory Data Analysis). After research stays at the Bell Labs (NJ, USA, 2000) and GIST (Glasgow University, UK, 2004), he is currently assistant professor and head of the Ambient Intelligence Group within CITEC, the Center of Excellence in Cognitive Interaction Technology, Bielefeld University. His research focus is sonification, datamining, human-computer interaction and cognitive interaction technology.

Organizer

fourMs
Published May 3, 2017 9:02 PM - Last modified Oct. 14, 2017 9:40 PM