Teachable Machine: Teach a machine using your camera, live in the browser

deeplearn.js author here...<p>We do <i>not</i> send <i>any</i> webcam &#x2F; audio data back to a server, all of the computation is totally client side. The storage API requests are just downloading weights of a pretrained model.<p>We&#x27;re thinking about releasing a blog post explaining the technical details of this project, would people be interested?

Pretty neat! Good overview without overwhelming right off the bat. Would be cool if they showed off common pitfalls like over fitting, or even segued into general statistics!

How long before I can teach my computer gestures that are mapped to real computer functions? For example, scroll up&#x2F;down, switch apps, save document, cut&#x2F;copy&#x2F;paste, etc.<p>One could probably map each gesture to a regular USB device that acts as a second keyboard and mouse? The hard part is identifying enough unique gestures?

I don&#x27;t have a camera here. Did anyone try it? How does it work?

The value-add for this demo is amazing, it&#x27;s going to be many people&#x27;s first approachable experience of ml, or things just like this will be. I expect a lot more of this stuff to appear in UI&#x2F;UX. It&#x27;s fun, intuitive, and a game changer away from dumb screens to fully interactive machines with their own knowledge graph.

You can solve problems using Machine learning without coding from a while ago.. azure machine learning have this features from more than a year ago.<p>I&#x27;ve solve regression, classification and recommendation problems with it and the best part is it deploys an web service with a few clicks.

Does anyone know what this uses under the hood? I loved the demo, but I would like a similarly easy way to get started locally with Python, for example.<p>Is there an ML library that can easily start capturing images from the webcam so you can play around with training a model?

be aware, at least in Chrome, once you give teachablemachine.withgoogle.com permission to use you camera, unless you revoke that permission is has permission to use your camera without further permission including from iframes. In other words every ad from and analytics from Google could start injecting camera access.<p>I wish chrome would give the option to only give permission &quot;this time&quot; and I wish it didn&#x27;t allow camera access from cross domain iframes.

What makes it non-mobile? Is it something about the expected performance of the JS? or are there apis being used im not thinking about?

this is really cool, openframeworks-esque in browser javascript<p>if you like this I would highly recommend looking at openframeworks.<p>the interactive browser part excites me want to try to make something with deeplearn.js

Hmm. I wonder if one could train this with dick pics and embed into popular messenger apps client-side... &quot;this picture was classified as a penis&quot;, to counter morons sending their dick as first message.

Am I the only paranoid one who thinks this is just Google&#x27;s way of capturing millions of faces in their database? Or did Apple beat them to it?

i bet it&#x27;s fine tuning an ImageNet CNN