Motion Tracking
The blog posts of this section relate to the course MCT4043 Music-related Motion Tracking. The aim of the course is to provide the basic principles of technologies for capturing different types of human motion, explore computational analysis of motion data and inform about the main methodological challenges of using motion capture technologies in musical application and in research.
-
Developing Techniques for Air Drumming Using Video Capture and Accelerometers
Creating MIDI scores using only data from air drumming
-
Reconfigurations: Reconfiguring the Captured Body in Dance
Building cooperative visual, kinaesthetic, and sonic bodies
-
Myo My – That keyboard sure tastes good with some ZOIA on top
Extending the keyboard through gestures and modular synthesis.
-
Playing music standing vs. seated; whats the difference?
A study of saxophonist in seated vs standing position
-
What is a gesture?
There are many takes on gesticulation and its meanings, however, I wanted to take the time to delimit what a gesture is, possible categories and gesturing patters.
-
Walking in Seasons
Sonification of motion
-
Exploring the influence of expressive body movement on audio parameters of piano performances
How expressive body movement influence music?
-
Motion (and emotion) in recording
The first time I went to a recording studio in the early nineties, my eagerness to (music)-world domination—as well as my fascination for the possibility to put my beautiful playing to a magnetic tape—totally over-shadowed that the result sounded crappy, at least for a while.
-
Shim-Sham Motion Capture
We've learned about motion capture in a research environment. But what about motion capture in the entertainment field? In this project I attempted to make an animation in Blender based on motion captured in the lab using the Optitrack system. Beside this, I also analysed three takes of a Shim Sham dance. For more details and some sneak peaks read this blog post.
-
Kodaly EarTrainer-App
App for training your ears based on old Hungarian methodolgy
-
'Air' Instruments Based on Real-Time Motion Tracking
Let's make music with movements in the air.
-
An air guitar experiment with OpenCV
Get to know OpenCV by building an air guitar player. Shaggy perm not required.
-
Posture Guard
Back pains, neck pains, shoulder pains - what do they all have in common? They are caused by bad posture while working on a laptop. So I made a program that makes the laptop help out maintaining a good posture while working.
-
A Brief Workshop on Motion Tracking
Since our spring semester of motion tracking was a purely digital experience, a few of us got to together to quickly test out the OptiTrack system within the Portal.
-
a t-SNE adventure
A system for interactive exploration of sound clusters with phone sensors
-
Breathing through Max
For the COVID-19 version of motion-tracking, I developed a system to track your rate of breath and sonify it through Max. It emphasized the tenants of biofeedback and hopes to serve as a responsive system for stress relief.
-
Sound Painting
An application that tracks, visualizes and sonifies the motion of colors.
-
How music related motion tracking can sound
During the course 'Music related Motion Tracking' there were several approaches among the students to realize their ideas. The Opti-Track system, new to all of us consists of infrared-cameras, markers and a software with calibration tools. We were exploring the functions from scratch during the first week when hosting the 'Nordic-stand-still-championship' on both campus.
-
MoCap Recap - Two weeks recap of a Motion Tracking workshop
During weeks 10-11 we attended the Music related motion tracking course (MCT4043) as part of the MCT program. The week started with the installation of the OptiTrack system in Oslo, placement of cameras, connecting wires to hubs and software installation and setup. we got familiar with the Motive:Body software and was able to run calibrations, set and label markers, record motion data, export it in a correct way and experiment with sonifying the results with both recorded and streamed motion capture data.