fourMs Software

Audio and video analysis

• Musical Gestures Toolbox — The Musical Gestures Toolbox (MGT) is a collection of tools for creating visualizations of video files; the actively maintained flagship is MGT-python, with MGT-matlab and MGT-max variants also available under the fourMs organization.
• VideoAnalysis — A standalone application for creating visualizations and extracting motion features from video files.
• AudioVideoAnalysis — An application for realtime spectral analysis of audio and video.
• AudioAnalysis — A program for displaying the spectrum and spectrogram of incoming audio in real time, with optional analysis of perceptual features such as pitch, brightness, loudness and noisiness.

Motion capture tools

• Xsens MVN datagram unpacker — A quick and easy UDP datagram unpacker for using Xsens MVN motion capture data in Max/MSP.
• MoCap Synthesiser — A set of generic tools for turning real-time motion tracking devices into musical instruments, including feature extraction and sound modules such as those used in the SoundSaber.
• Mocapgrams — Tools for visualising longer segments of motion capture data, making recurring patterns, periodicities, and interconnectivity between markers easier to see.
• mcrtanimate — Enables realtime streaming of motion capture data from the MoCap Toolbox for Matlab, synchronised with audio, for 3D animation.
• IIR MoCap Filters — A Max/MSP patch implementing real-time IIR low-pass filters and differentiators for motion capture data, for extracting velocity and acceleration with minimal delay.
• Residual Analysis — A Matlab function that performs residual analysis of motion capture data to help determine its frequency content and a reasonable filter cut-off frequency.
• Kinectofon — An instrument for creating sound from a Kinect sensor, turning depth images into motiongrams that are sonified through an inverse-FFT process.
• KinectRecorder — A Max patch for recording the two video streams (colour and depth) from a Kinect sensor into a single combined video file.
• GDIF in Matlab — Two Matlab scripts for reading GDIF data from SDIF files. Available as a small download on its original page, which remains on the site; not migrated to GitHub.

Audio/video recording and playback

• AudioVideoRecorder — A basic audio and video recorder, with the possibility to control brightness, contrast and saturation in real time.
• TimeLapser — Takes an image from a webcam at a regular interval.
• VideoEditor — A minimal video editing application for doing basic trimming, cropping, rotating and colour adjustments to a video file.
• VideoMix — Software for mixing and projecting videos in real time, supporting simple sound-video interaction, face recognition, and basic video editing.
• VideoViewer — Displays the image from a webcam in fullscreen on a computer screen.

Max patches and instruments

• ImageSonifyer — Plays sound from images.
• MultiControl — Use any standard game controller (or other Human Interface Device) as a multipurpose music controller.
• Phidgets2MIDI — A small program for using electronic devices built with a Phidgets interfacekit to control MIDI instruments.
• MuMYO — A musical instrument prototype exploring the use of the Myo armband with various instrumental actions.
• Click-It — A small instrument/composition inspired by Ge Wang's Clix for Chuck.
• Musical Fireflies — A demonstration of distributed synchronisation of musical nodes, inspired by the flashing synchrony of fireflies.
• JamomaGDIF — Tools developed for recording and playing back GDIF files based on the SDIF format.
• AudioVideoSynthesis — Simple, winamp-style, realtime video synthesis based on audio input.

Mobile and web apps

• MusicLab App — An app for iOS and Android that collects data for MusicLab events.