Nerfstudio: A collaboration friendly studio for NeRFs

It would be helpful if that site didn't just assume all visitors already know what a NeRF is.

For those curious like me, NeRFs are Neural Radiance Fields: <a href="https:&#x2F;&#x2F;www.matthewtancik.com&#x2F;nerf" rel="nofollow">https:&#x2F;&#x2F;www.matthewtancik.com&#x2F;nerf</a>

NeRF applied to Maps soon<p><a href="https:&#x2F;&#x2F;twitter.com&#x2F;jeffdean&#x2F;status&#x2F;1524612819160735745?lang=en" rel="nofollow">https:&#x2F;&#x2F;twitter.com&#x2F;jeffdean&#x2F;status&#x2F;1524612819160735745?lang...</a><p>another paper toward Earth sized multi scale models (5 minutes)<p><a href="https:&#x2F;&#x2F;www.youtube.com&#x2F;watch?v=Pn9ia2fsiwY" rel="nofollow">https:&#x2F;&#x2F;www.youtube.com&#x2F;watch?v=Pn9ia2fsiwY</a>

Just saw this on twitter and the results look pretty awesome <a href="https:&#x2F;&#x2F;twitter.com&#x2F;akanazawa&#x2F;status&#x2F;1577686321119645696?s=20&amp;t=KK3lbhjgotge6cS694K3hg" rel="nofollow">https:&#x2F;&#x2F;twitter.com&#x2F;akanazawa&#x2F;status&#x2F;1577686321119645696?s=2...</a>

I tried it today. Nerfstudio is amazing. I also like the pragmatic approach to its UI: launch a command-line &#x2F; text UI program, publish a localhost URL, access a rich WebUI in the browser.<p>NeRF rendering latency is extremely low and frames are delivered over WebRTC. Which means that there&#x27;s no fundamental problem to stream WebUI over the Internet.<p>Nerfstudio already supports all leading NeRF flavours and also includes their own. It instantly makes a staple for all future NeRF research.

I am extremely excited for this technology to mature to a point where realtime novel view synthesis becomes possible. The idea of being able to take a few photographs and be able to recreate an appreciably decent 6DOF viewing experience is a very powerful enabling technology.<p>Nerfstudio looks like something that is finally accessible enough that I will be able to start experimenting without having to spend enormous amounts of effort on tooling. Can&#x27;t wait to check it out! It looks like some of the processing pipelines might be a good fit for merging with WebODM to make it even more friendly to work with.

GTC 2022 Re-imagining Robot Autonomy with Neural Environment Representations, with Q&amp;A from EMEA region [A41181b] <a href="https:&#x2F;&#x2F;register.nvidia.com&#x2F;flow&#x2F;nvidia&#x2F;gtcfall2022&#x2F;attendeeportal&#x2F;page&#x2F;sessioncatalog&#x2F;session&#x2F;1658290782694001pCH6" rel="nofollow">https:&#x2F;&#x2F;register.nvidia.com&#x2F;flow&#x2F;nvidia&#x2F;gtcfall2022&#x2F;attendee...</a>

I didn’t know what NeRFs were so I had to look it up. This article seems like a good introduction for anyone else that’s out of the loop like me: <a href="https:&#x2F;&#x2F;www.matthewtancik.com&#x2F;nerf" rel="nofollow">https:&#x2F;&#x2F;www.matthewtancik.com&#x2F;nerf</a>

Actually kind of excited by these techs, it would be fun to play CoD in a realistic downtown SF or LA.

Speaking of NeRFs, here’s a Google Imagen powered text to NeRF model:<p><a href="https:&#x2F;&#x2F;dreamfusion3d.github.io&#x2F;gallery.html" rel="nofollow">https:&#x2F;&#x2F;dreamfusion3d.github.io&#x2F;gallery.html</a>

Good demo video: <a href="https:&#x2F;&#x2F;www.youtube.com&#x2F;watch?v=nSFsugarWzk" rel="nofollow">https:&#x2F;&#x2F;www.youtube.com&#x2F;watch?v=nSFsugarWzk</a>

If you&#x27;re going to make an app like this, at least use electron or something similar and create an integrated package instead of relying on a python UI over a bunch of command line tools.<p>Also how does it compare to Nvidia Instant Nerf (performance etc)?