TE
TechEcho
Home24h TopNewestBestAskShowJobs
GitHubTwitter
Home

TechEcho

A tech news platform built with Next.js, providing global tech news and discussions.

GitHubTwitter

Home

HomeNewestBestAskShowJobs

Resources

HackerNews APIOriginal HackerNewsNext.js

© 2025 TechEcho. All rights reserved.

The Visual Microphone: Passive Recovery of Sound from Video

121 pointsby csomabout 10 years ago

11 comments

jsprogrammerabout 10 years ago
Patent pending? The approach should be trivially obvious for anyone familiar with the basics.<p>What happened to the MIT License and liberating knowledge, does MIT not do that anymore?
评论 #9255762 未加载
评论 #9256148 未加载
评论 #9257041 未加载
kaoDabout 10 years ago
Previous discussion: <a href="https://news.ycombinator.com/item?id=8131785" rel="nofollow">https:&#x2F;&#x2F;news.ycombinator.com&#x2F;item?id=8131785</a>
评论 #9254734 未加载
downandoutabout 10 years ago
Well that&#x27;s pretty scary. I can see one application of this already: casinos in the US are legally prohibited from recording audio on their floors, but have perfectly positioned cameras everywhere. Beyond that, I&#x27;m guessing every spy agency on earth will be buying solutions based on this.<p>It would be interesting to know what the genesis of this project was - for example if the NSA or CIA was involved in suggesting to a professor that MIT take a look at this area. This is a very mission-specific technology.
评论 #9258559 未加载
评论 #9256325 未加载
评论 #9256288 未加载
catshirtabout 10 years ago
could you do it the other way around?<p>how accurately can we recreate a 3d space from sound? what assumptions&#x2F;information would you need to make it more accurate?
评论 #9256053 未加载
bltabout 10 years ago
William T. Freeman is an outstanding vision researcher. His list of publications (<a href="http://billf.mit.edu/publications/all" rel="nofollow">http:&#x2F;&#x2F;billf.mit.edu&#x2F;publications&#x2F;all</a>) is full of these simple, clever solutions for problems slightly outside the mainstream. I really admire his work.
yshalabiabout 10 years ago
Rubinstein was also behind the work on using pixel intensity variations to visualize... stuff. They used it to extract heart rates. I am guessing sillier methods used, but now to recover induced vibrations due to sound. Interesting work.
baldfatabout 10 years ago
Someone give this to the writers of crappy TV that uses the enhanced photo line I am sure they will flip out at the whole new story lines created by this.<p>CSI has forever been changed. Bet you it is on next season on multiple of TV crime shows.
sjtrnyabout 10 years ago
This is an interesting extension of the ideas from this paper by the same author&#x2F;s <a href="http://people.csail.mit.edu/mrub/vidmag/" rel="nofollow">http:&#x2F;&#x2F;people.csail.mit.edu&#x2F;mrub&#x2F;vidmag&#x2F;</a>.
Animatsabout 10 years ago
They&#x27;re making progress. At 5000 FPS, it&#x27;s not surprising that they can recover audio. But from 60 FPS, that&#x27;s striking. That works because some imagers don&#x27;t take the whole frame at once.
评论 #9254997 未加载
评论 #9255360 未加载
yummybearabout 10 years ago
I wonder how this would perform on iPhone 6&#x27;s (or others) high speed camera.
Naushadabout 10 years ago
Slowly, the creative imaginations coming to life. Eagle Eye....