Motion Capture
The blog posts of this section relate to the course MCT4053 Motion Capture (from 2022) and to the discontinued course MCT4043 Music-related Motion Tracking (2019 to 2021). The aim of these courses is to provide knowledge and skills in recording, visualising, and analysing human body motion. This includes learning about human anatomy and biomechanics and getting hands-on experience with setting up, calibrating, tracking, and recording with different types of motion capture systems.
-
KineMapper
A Max for Live device that maps motion data from a smartphone to controls in Ableton Live.
-
A Body Instrument: Exploring the Intersection of Voice and Motion
Manipulate your voice with your body
-
Generative Music with IMU data
Eight routes to meta-control
-
Simple yet unique way of playing music
Gestures can be more intuitive to play around with
-
Xyborg: Wearable Control Interface and Motion Capture System for Manipulating Sound
Witness my transition from human to machine - with piezo discs
-
Motion Controlled Sampler in Ableton
A fun and creative way of sampling
-
Developing Techniques for Air Drumming Using Video Capture and Accelerometers
Creating MIDI scores using only data from air drumming
-
Reconfigurations: Reconfiguring the Captured Body in Dance
Building cooperative visual, kinaesthetic, and sonic bodies
-
Myo My – That keyboard sure tastes good with some ZOIA on top
Extending the keyboard through gestures and modular synthesis.
-
Playing music standing vs. seated; whats the difference?
A study of saxophonist in seated vs standing position
-
What is a gesture?
There are many takes on gesticulation and its meanings, however, I wanted to take the time to delimit what a gesture is, possible categories and gesturing patters.
-
Walking in Seasons
Sonification of motion
-
Exploring the influence of expressive body movement on audio parameters of piano performances
How expressive body movement influence music?
-
Motion (and emotion) in recording
The first time I went to a recording studio in the early nineties, my eagerness to (music)-world domination—as well as my fascination for the possibility to put my beautiful playing to a magnetic tape—totally over-shadowed that the result sounded crappy, at least for a while.
-
Shim-Sham Motion Capture
We've learned about motion capture in a research environment. But what about motion capture in the entertainment field? In this project I attempted to make an animation in Blender based on motion captured in the lab using the Optitrack system. Beside this, I also analysed three takes of a Shim Sham dance. For more details and some sneak peaks read this blog post.
-
Kodaly EarTrainer-App
App for training your ears based on old Hungarian methodolgy
-
'Air' Instruments Based on Real-Time Motion Tracking
Let's make music with movements in the air.
-
An air guitar experiment with OpenCV
Get to know OpenCV by building an air guitar player. Shaggy perm not required.
-
Posture Guard
Back pains, neck pains, shoulder pains - what do they all have in common? They are caused by bad posture while working on a laptop. So I made a program that makes the laptop help out maintaining a good posture while working.
-
A Brief Workshop on Motion Tracking
Since our spring semester of motion tracking was a purely digital experience, a few of us got to together to quickly test out the OptiTrack system within the Portal.
-
a t-SNE adventure
A system for interactive exploration of sound clusters with phone sensors
-
Breathing through Max
For the COVID-19 version of motion-capture, I developed a system to track your rate of breath and sonify it through Max. It emphasized the tenants of biofeedback and hopes to serve as a responsive system for stress relief.
-
Sound Painting
An application that tracks, visualizes and sonifies the motion of colors.
-
How music related motion tracking can sound
During the course 'Music related Motion Tracking' there were several approaches among the students to realize their ideas. The Opti-Track system, new to all of us consists of infrared-cameras, markers and a software with calibration tools. We were exploring the functions from scratch during the first week when hosting the 'Nordic-stand-still-championship' on both campus.
-
MoCap Recap - Two weeks recap of a Motion Tracking workshop
During weeks 10-11 we attended the Music related motion tracking course (MCT4043) as part of the MCT program. The week started with the installation of the OptiTrack system in Oslo, placement of cameras, connecting wires to hubs and software installation and setup. we got familiar with the Motive:Body software and was able to run calibrations, set and label markers, record motion data, export it in a correct way and experiment with sonifying the results with both recorded and streamed motion capture data.