But since the project is still in the early formative stages, we still have time to mull over those possibilities and hopefully as more of the visual aspects are set, a complementary audio accompaniment methodology will become apparent.
In the meantime, figuring out what language/program/technology would allow for easy creation of data-to-audio systems has been a personal focus of mine for a couple weeks now.
So far, I've been leaning towards Pure Data due to its relative ease of use and for how well the GEM multimedia library handles webcam feeds.
Now it's too early to say what we'll be doing with our video data, but I can show you a possibility; below is a patch I put together yesterday to show a simple motion-sensing midi generator. To put it simply, it monitors five pixels located in a vertical line down the middle of the video window and when anything changes, it starts to output midi notes. Now I could go into more detail, but I believe in the beauty of self-education, so located below is a download link for the patch and a short demo video of me waving my arm to make some sweet sounds.
Get the patch!
Make sure to watch in fullscreen!
But this is only one part of the possible sonic range that we can traverse, with the midi data being generated from the video, we can now think about how to utilize those notes. One option is to pass the notes to a separate program to generate the sounds. To see if this was possible, I threw together a quick midi-controlled track in Jeskola Buzz and after some fidgeting with MIDI Yoke I got everything to work together.
I've recorded a quick session with the Buzz track and my Monome running flin. [so I have some midi to work with]
Click the image for the audio!
So that's all that I'll say for now about the audio side of things, but there will surely be more into to come in the coming months. Stay tuned!
No comments:
Post a Comment