GESTURE INTERFACES

Last year, I created a couple of small demos to learn more about interactions with webcam streams.

I'm very interested into gesture detection as I believe it will be the next big change in how we interact with our browsers and applications. Soon it will be no required to touch a mouse or a keyboard to execute basic actions.

The idea was to try to capture the frames on real time and perform some manipulations on them to trace the user's head and hands, with the final objective of creating an interactive menu that doesn't require a physical input (mouse/keyboard).

The demos are far from a final stage as I got busy with other tasks in the office (so my free time was suddenly reduced to 0) but they are still interesting to share ;)

-> GESTURE INTERFACE - OPTION MENU

First trial of a menu tracking the user opened/closed fist

-> GESTURE INTERFACE - HEAD TRACKING

Not being happy with the last demo problems with high/low luminosity environments, I decided to try a new head tracking library which does an amazing job normalizing the frames captured by the webcam.
On this demo we are applying a simple reflection effect on the webcam stream and identifying the user head.