TE
科技回声
首页24小时热榜最新最佳问答展示工作
GitHubTwitter
首页

科技回声

基于 Next.js 构建的科技新闻平台,提供全球科技新闻和讨论内容。

GitHubTwitter

首页

首页最新最佳问答展示工作

资源链接

HackerNews API原版 HackerNewsNext.js

© 2025 科技回声. 版权所有。

Ask HN: What's the algorithm behind Polycam 3D reconstruction? Any one?

8 点作者 starboyy超过 3 年前
Anyone who can reverse engineer and tell the algorithm behind polycam app? https:&#x2F;&#x2F;poly.cam&#x2F;<p>It is just amazing!!

1 comment

GistNoesis超过 3 年前
The title of the webpage is LIDAR 3d scanner. I don&#x27;t have an IPhone to try the app, so based on the videos and the information I could gather online.<p>It seems they have multiple operating modes. One mode use rgb image only and standard photogrammetry like meshroom. In the other mode they use the information from the LIDAR sensor to help with depth and camera registration, with some sort of RGB-D SLAM algorithms.<p>Looking for point-cloud fusion algorithms and the pcl library should get you started.<p>There is probably some deep-learning involved but it&#x27;s not yet end-to-end deep learning, in particular this is not NERFies.<p>If you look at the recent publications of their Senior computer vision engineer, <a href="https:&#x2F;&#x2F;scholar.google.com&#x2F;citations?view_op=list_works&amp;hl=en&amp;hl=en&amp;user=ywtRolwAAAAJ" rel="nofollow">https:&#x2F;&#x2F;scholar.google.com&#x2F;citations?view_op=list_works&amp;hl=e...</a> you will find the following &quot;A Learned Stereo Depth System for Robotic Manipulation in Homes&quot; <a href="https:&#x2F;&#x2F;arxiv.org&#x2F;pdf&#x2F;2109.11644.pdf" rel="nofollow">https:&#x2F;&#x2F;arxiv.org&#x2F;pdf&#x2F;2109.11644.pdf</a> it should get you some approximate idea of how it work.