In a previous post (“Minecraft and Creative Space”) I tried to point out the contributions that technology can make to our creative pursuits. The idea was that software like Minecraft allows us to do things we could have never done otherwise, although it requires that we do those things in certain ways (i.e. with colorful little cubes).
There is a great website out there called KinectHacks (www.kinecthacks.net). Let me start off by saying that the Kinect is an accessory for the XBox 360 which allows users to put down all the little devices and become the controllers themselves. Instead of buttons and joysticks, a player navigates menus and games with their body’s movements and spoken commands.
Some industrious hackers (in the good sense) have dismantled the Kinect’s basic functionality in order to apply it to diverse new contexts. In addition to Dance Central, we’ve now got motion-controlled robots, interactive advertisements, Minority Report-like computer screens, and even medical imaging applications. There’s a lot of really great stuff on there that I could mention, but I want to hone in on a few musical contributions.
Ever heard of a theremin? It’s like that but way cooler.
People can use their movements to produce music. Granted, that statement describes singing or playing just about any instrument pretty darn accurately. I will also grant that, strictly speaking, these performers are just modifying the characteristics of music that is being played by an external device. Set your reservations aside.
I think that something special is going on here. The idea that people can get up in front of camera and move around and have that translated into a different expressive medium is pretty exciting. We can listen to their movements in a way not quite as pure as the movements themselves, but it’s getting closer. Movements become sounds, tastes become tactile sensations, sounds become smells. That last one is a little weird, but I think the point is still interesting. What if our technology could allow us to produce art that engages all of our senses?
This is what actual life is like – we are constantly surrounded with overlapping sensations of sight, touch, taste, sound, and smell, and it can be hard to differentiate (and why do that?). What our technology has failed to do so far is accurately replicate this holistic experience; it has always required well defined limits between audio, visual, etc.
The Kinect hackers have offered us a glimpse into the future wherein these superfluous distinctions can finally be abandoned. The more refined our technology becomes, the more genuinely it reflects actual life – we’re talking about restoring sight to the blind and creating whole new virtual realities! That’s pretty cool to imagine, and we won’t have to imagine for much longer.