Here is a description of video files and their properties.
AudioAnalysis is a small program for displaying the spectrum and spectrogram of incoming audio in realtime. It also provides realtime analyses of various perceptually relevant features.
An application for realtime spectral analysis of audio and video.
A basic audio and video recorder, with the possibility to control brightness, contrast and saturation in realtime.
Simple, winamp-style, realtime video synthesis based on audio input.
This little instrument/composition is inspired by Ge Wang’s Clix for Chuck.
Several features can be extracted from a video file.
Two scripts for reading GDIF data from SDIF files into Matlab.
ImageSonifyer plays sound from images.
The Jamoma GDIF tools are developed for recording and playing back GDIF files based on the SDIF format.
This software enables realtime streaming of mocap data from the MoCap toolbox for Matlab, synchronised with audio.
The MoCap Synthesiser is a set of generic tools for making real time motion tracking devices into musical instruments. One feature extraction module and two sound modules are included.
Mocapgrams are helpful tools for visualising a longer segment of mocap data. They allow easy visualisation of recurring patterns and periodicities in the mocapdata, and interconnectivity between markers.
Use any standard game controller (or other Human Interface Device) as a multipurpose music controller.
MuMYO is a musical instrument prototype, aimed to investigate the use of the MYO armand with various instrumental actions.
A demonstration of distributed synchronisation of musical nodes.
The Musical Gestures Toolbox (MGT) is a collection of tools for creating visualizations of video files. The toolbox was primarily developed for music researchers, but is also used for sports, dance, healthcare, architecture, and interaction design.
The Musical Gestures Toolbox for Matlab is aimed at analysing music-related body motion, using sets of audio, video and motion capture data as source material.
This is a collection of modules and abstractions developed in and for the graphical programming environment Max/MSP/Jitter.
The Musical Gestures Toolbox for Python is a collection of tools for video visualization and video analysis.
Musical Gestures Toolbox for doing various video-related tricks in the terminal. This is mainly based on the power of FFmpeg and ImageMagick.
An app for iOS and Android that collects data for MusicLab events.
Phidgets2MIDI is a small program for using electronic devices built with a Phidgets interfacekit to control MIDI instruments.
StreamViewer is a mxj-object for Max that visualises individual data streams.
TimeLapser takes an image from a webcam at a regular interval.
How can you best edit a video file for analytical usage? In the following, we will go through some editing principles and look at relevant software.
Sonification is the process of turning data into sound. Here we look at some video sonification strategies.
This article presents a set of video-based visualisation techniques developed for the analysis of music-related body motion.
A standalone application for creating visualizations and extract motion features from video files.
VideoEditor is a minimal video editing application for doing basic trimming, cropping, rotating and colour adjustments to a video file. Nothing more, nothing less.
VideoMix is a software for mixing and projecting videos in real time. The software allows simple sound-video interaction, face recognition, and some basic video editing.
This UDP datagram unpacker is a quick and easy way to use Xsens MVN data in Max/MSP.