How Kinect works?

January 12 2011

Sorry for the Microsoft-heavy angle on my posts, but hey I’m in Redmond so that’s what I’m surrounded with!

The Kinect controller is proving to be quite popular, both in mainstream gaming but also in the hacky-designerly-sensorium domain. It’s a great bundle of sensors at a super affordable price. How does it exactly works? Well that is less obvious to properly understand the many facets that give Kinect all its power.

The XBoX’s Engineering Blog recently published a nice article detailing how the thing actually works. It’s worth the read and makes a good primer on the topic of machine learning. It goes to some details about the development of the whole system, failures they had along the way, and how they rely on prototyping with users to validate their ideas.

The well-established rules for HCI didn’t always apply when designing interactions for a living room with a 10-foot gesture experience, but that’s what made the process exciting! Through play testing we were able to better understand how users behaved, how much body movement was comfortable while gesturing for extended periods of time, and what natural gestures conflicted with the gesture sets we were exploring.

http://www.xbox.com/en-US/Live/EngineeringBlog/122910-HowYouBecometheController

Below is an older video explaining the Kinect.

If you can see this, then you might need a Flash Player upgrade or you need to install Flash Player if it’s missing. Get Flash Player from Adobe. This error may appear if the URL path to the embedded object is broken or you have connectivity issue to the embedded object. Powered BY XVE Various Embed.

January 14 2011
jordi.parra permalink

Daniel Shiffman, the guy that worked on the openkinnect Processing library has released a very well explained documentation that includes a few examples. It’s worth checking it out, looks very simple! :)

http://bit.ly/eDvm5S

January 15 2011

Sweet that the community is coming up fast with libraries and support for the Kinect. It’s only a start as getting the distance value for each pixel is one thing, figuring out people, skeleton move and the tracking of body parts is a whole different story. This requires a very considerable amount of advanced computation.

I assume that over time, we’ll see more commercial and free skeleton tracking packages to make the most of the Kinect. In the meantime, it’s a lot of fun to fiddle with that extra layer of data and a good excuse to launch Processing again!

Leave A New Comment

Captcha Challenge * Time limit is exhausted. Please reload CAPTCHA.