In this project, people in two separate rooms are videotaped. The two video feeds are fed through Processing, converted into silhouettes and superimposed over each other. Both rooms receive the same projection of the superimposed silhouettes. When silhouettes from the two rooms overlap, the overlapped area turns red and a midi note is sent to an external audio program (Reason, in this case).

The video feeds are initialized using a background subtraction technique, so only new objects in the space (ie: people) are fed back as silhouettes. The program sends midi notes using the RWMidi library. The program contains four different modes, some in which participants hear the same sounds, some in which they hear different sounds. All notes are currently in the C major scale. 

My version sounds like this (all sounds can be modulated in the sound program you choose):

Audio clip: Adobe Flash Player (version 9 or above) is required to play this audio clip. Download the latest version here. You also need to have JavaScript enabled in your browser.

Processing Code

For the 24h Thesis I also created live video filters with Processing. These are composite frames of filtered video. 

Processing Code: [1] [2] 

One of my projects for last week’s 24h Thesis was this noise-generating box. It has two speakers, four buttons and two potentiometers mounted on a cardboard box and connected together with a breadboard and an Arduino. Each button has a different sound, which can be modulated with the two potentiometers. It sounds like this: 

Audio clip: Adobe Flash Player (version 9 or above) is required to play this audio clip. Download the latest version here. You also need to have JavaScript enabled in your browser.

I’m still learning how to play it!

Arduino Code