For those curious like me, NeRFs are Neural Radiance Fields: <a href="https://www.matthewtancik.com/nerf" rel="nofollow">https://www.matthewtancik.com/nerf</a>
Just saw this on twitter and the results look pretty awesome <a href="https://twitter.com/akanazawa/status/1577686321119645696?s=20&t=KK3lbhjgotge6cS694K3hg" rel="nofollow">https://twitter.com/akanazawa/status/1577686321119645696?s=2...</a>
I tried it today. Nerfstudio is amazing. I also like the pragmatic approach to its UI: launch a command-line / text UI program, publish a localhost URL, access a rich WebUI in the browser.<p>NeRF rendering latency is extremely low and frames are delivered over WebRTC. Which means that there's no fundamental problem to stream WebUI over the Internet.<p>Nerfstudio already supports all leading NeRF flavours and also includes their own. It instantly makes a staple for all future NeRF research.
I am extremely excited for this technology to mature to a point where realtime novel view synthesis becomes possible. The idea of being able to take a few photographs and be able to recreate an appreciably decent 6DOF viewing experience is a very powerful enabling technology.<p>Nerfstudio looks like something that is finally accessible enough that I will be able to start experimenting without having to spend enormous amounts of effort on tooling. Can't wait to check it out! It looks like some of the processing pipelines might be a good fit for merging with WebODM to make it even more friendly to work with.
GTC 2022
Re-imagining Robot Autonomy with Neural Environment Representations, with Q&A from EMEA region [A41181b]
<a href="https://register.nvidia.com/flow/nvidia/gtcfall2022/attendeeportal/page/sessioncatalog/session/1658290782694001pCH6" rel="nofollow">https://register.nvidia.com/flow/nvidia/gtcfall2022/attendee...</a>
I didn’t know what NeRFs were so I had to look it up. This article seems like a good introduction for anyone else that’s out of the loop like me:
<a href="https://www.matthewtancik.com/nerf" rel="nofollow">https://www.matthewtancik.com/nerf</a>
Speaking of NeRFs, here’s a Google Imagen powered text to NeRF model:<p><a href="https://dreamfusion3d.github.io/gallery.html" rel="nofollow">https://dreamfusion3d.github.io/gallery.html</a>
If you're going to make an app like this, at least use electron or something similar and create an integrated package instead of relying on a python UI over a bunch of command line tools.<p>Also how does it compare to Nvidia Instant Nerf (performance etc)?