Gesture Control in JS using Webcam

After Leap Motion, I&#x27;ve been very giddy to see where we will soon be in terms of parsing sign language in front of a webcamera.<p>Hopefully someone finds a financial incentive to pursue that venture. Maybe there&#x27;s a Duolingo-like idea waiting to be taken advantage of.

It&#x27;s very impressive that this works at all, although it&#x27;s extremely inaccurate for me.

Really hard to navigate. I gave up.

Looks cool! I once tried something similar and released it as a reveal.js plugin:<p><a href="https://github.com/functino/reveal.js-wave-plugin" rel="nofollow">https:&#x2F;&#x2F;github.com&#x2F;functino&#x2F;reveal.js-wave-plugin</a><p>But I just used the WebcamSwiper-Lib.<p>Maybe you could try to package it as a Plugin too - so there would be no need for a fork.

Impressive. I&#x27;ve found that shaking my head was more effective for controlling the slides - but it gives a weird effect...

This is pretty amazing – seems to just work. Probably quite dependant on the webcam though.<p>Remember to move your hand above&#x2F;below the screen before swiping else you&#x27;ll swipe back and forwards all the time!

I sometimes use this <a href="http://www.cameramouse.org/" rel="nofollow">http:&#x2F;&#x2F;www.cameramouse.org&#x2F;</a> when both my hands are too cramped to hold the mouse any more. I also find it fun to play with.

This blew my mind.<p>It&#x27;s weird how scrolling forward from your right to your left is more easily detected than scrolling backwards from your left to your right, but it&#x27;s an amazing proof of concept.

Just saw something similar done by my local tourism department a few weeks back. Got good press here. <a href="http://when-it-rains.com/" rel="nofollow">http:&#x2F;&#x2F;when-it-rains.com&#x2F;</a>

i presented this a few weeks ago at the viennajs meetup <a href="http://miniqr.com/onsnap.r" rel="nofollow">http:&#x2F;&#x2F;miniqr.com&#x2F;onsnap.r</a> audiocontrol your presentation

Didn&#x27;t work very well. May be the quality of the webcam though

For SlideShare lovers, you have <a href="http://shirsenduk.github.io/SlideShareHandsFree/" rel="nofollow">http:&#x2F;&#x2F;shirsenduk.github.io&#x2F;SlideShareHandsFree&#x2F;</a>

Seems to depend on proper skin detection, which can work out of the box if the light is right. Au contraire js-aruco needs preparation, but has some nice 3D capabilities.

I really don&#x27;t get the comparison to Kinect at the beginning, since this is _just_ a simple motion detector and the only fun thing is the execution environment.

I couldn&#x27;t get a gesture recognised with my MacBook Air. (Maybe the lighting is a little bad with a window behind me.)

Doesn&#x27;t work for me :( The webcam was clearly on, and it was taking microphone input.

There&#x27;s a bit of confusion on the slides. Mixing up getUserMedia with WebRTC.

This reminds me Minority Report interface scene.

For a proof of concept, this is pretty amazing.

Very impressive. Well done!