Show HN: Hacky Meta Glasses GPT4 Vision Integration

This is a fantastic demo. I&#x27;ve tried to build these type of prototypes for all Meta Headsets in the past but their very limited API&#x2F;SDKs block you from doing anything meaningful with computer vision. They are too scared of devs getting access to the camera.<p>Hope that Apple Vision Pro gives a more robust api to developers and that forces Meta to open up.<p>I will use this approach for a poc I have in mind. Great job and thank you for open sourcing!

I love this demo! 35 seconds, terrible video quality, but it shows you can unlock so much more. Great job.

Nice work Devon!<p>It may be “super hacky” as you say, but these projects are important.<p>We may have had a theoretical understanding that this was possible, but seeing your demo opens up our experiential understanding.<p>Lights up totally different parts of the brain.

This is awesome! I got my glasses a couple weeks ago. I’m in Vegas and actually wore them for the first time yesterday. They’re actually really nice and i was thinking how cool it world be to hook it into gpt4v.

Meta folks if you are reading this , please give us a real SDK. Great hack though until we get that!

somewhat off-topic but this is the first time I see bun actually used for something other than &quot;let&#x27;s compare it to node&quot;

What have others experience been using Hey Meta with their Meta glasses? Myself not great as it feels like a beta feature.. doesn&#x27;t run reliably. Tho good effort by them using current technology.<p>What the glasses do now reliably are taking photos, short videos and transferring them into the Meta View app. Bluetooth audio transferring from my car stereo into the glasses is annoying and I couldn&#x27;t find a setting to change &#x2F; stop that.<p>As for Meta Vision there&#x27;s so much innovation to happen here, nice!! gives me tons of ideas

Obviously this is the future just need a bit more powerful tech.

How about for the quest 2&#x2F;3? Anyone did that?<p>What similar quality vision models are there outside gpt4 ? It’s annoying it has so maybe (albeit mostly hack-prompt-able) restrictions.

Awesome demo, short simple and to the point.<p>I did not know Meta released smart glasses. Has anybody found them useful or is it more of a novelty?

Really cool and actually a real use case.

Very nice hack! I did a very similar project integrating ChatGPT bot but using WhatsApp business account instead of fake facebook contact. I got my account blocked when Meta discovered I&#x27;m not a business unfortunately. I&#x27;ll retake the project with the FB account, it seems much easier.<p>Great job!

Very cool! Hacker ethos (make a fake account to leverage sending photos), short and simple demo. Nice job

Matter of time until someone hacks Meta&#x27;s glasses to cheat on tests.

I wish meta glasses were an open platform and we could directly integrate with vision&#x2F;llm apis.

I will wait for some kind of version that does not require a facebook account. Cool demo tho.

Bookmarklets are still a thing? I just sorta assumed browsers shut them down years ago

When Google Glass was around there was a big social pushback. Have we accepted the use of these devices around ourselves since then?

Hey Meta, send a photo to Eez Discheaperon Amazon