Musical Code

Leave a comment

More and more intelligent and dynamic interactions can happen within today’s browsers and networks, when I visited the Digital Revolution at the Barbican in London last year, there was an audio piece by Zach Lieberman called Play The World, where you could play international radio-stations on a piano. Each key makes the system listen to radio around the world to find one playing that particular not, then feeds that radio station onto the speakers.

This mock up is from Zach Liberemans DevArt page with all of the information on from the project

Connections between live tweets and graphic interfaces have been around a long time, (visible tweets, tweetbeam, and more) but I discovered that those clever audio tinklers have also got tweets to play music!

Although The Listening Machine is no longer live it has archived a few excerpts from different times of the day and it makes for interesting listening as they do have their own tempo and feel…

listeningmachine

So with some clever coding you can interact with live comments, this leads me with the question; could you do this with a physical interaction, with something like a kinect or a leap motion, so instead of a physical key, a gesture can control the trigger?

found via @MetaMusical @ConversationEDU @olliebown – https://theconversation.com/explainer-interactive-composition-33594

Advertisements

Gesture Recognition

Leave a comment

Mogees – gesture recognition to play music. I found this video and think that the possibilities are enormous, it almost seemed to good to be true!

http://www.brunozamborlin.com/mogees/

In this video we show how it is possible to perform gesture recognition just with contact microphones and transform every surface into an interactive board.
Through gesture recognition techniques we detect different kind of fingers-touch and associate them with different sounds.
In the video we used two different audio synthesis techniques:
1- physic modelling, which consists in generating the sound by simulating physical laws;
2- concatenative synthesis (audio mosaicing), in which the sound of the contact microphone is associated with its closest frame present in a sound database.

The system can recognise both fingers-touches and objects that emit a sound, such as the coin shown in the video.