This is neat but Splats are not really mean to be edited in this way.<p>Splats are sort of like byte code, they are the compiled and optimized representation of reflected light as semi-transparent guassians.<p>Or you can think of them as the PDF equivalent of a Google or Word Doc. All the logic is gone, and you just have final optimized results.<p>Generally when you edit PDFs, the results are not great and you cannot make major edits because the layout won't reflow, etc.<p>So while this is cool, I don't think it will take off unless there is another innovation in terms of either using AI to "reflow" the lighting and surfaces after an edit, or inferring more directly the underlying representations (true surface properties and the light sources.)
There's an app for Quest 3 called Gracia, which allows you to see these in 3D space:<p>- <a href="https://www.meta.com/en-gb/experiences/gracia/25784099001234165/" rel="nofollow">https://www.meta.com/en-gb/experiences/gracia/25784099001234...</a><p>- <a href="https://www.gracia.ai" rel="nofollow">https://www.gracia.ai</a>
It's neat to explore how Gaussian splats represent different optical phenomena, like how the reflections seen in the eyes are represented as splats suspended within the object, with the surface of the eye being semi-transparent.
Did anyone build a text-to-splat 3D generation model? Seems like it would be pretty straightforward? Should make it really easy to generate assets for video games.<p>EDIT: yep - <a href="https://gsgen3d.github.io/" rel="nofollow">https://gsgen3d.github.io/</a>
Is there a reading guide to the maths behind Gaussian splats? All the resources I could find either assumed lots of knowledge (including what a "3D Gaussian" even is), or were written for complete lay-person (and probably includes some AI grift).
This is cool!<p>Any tips for an app to use on iOS to capture the necessary .ply data?<p>Scaniverse is a great app by Niantic that can do this on-device, but it isn't very customizable and can't export its raw scanning data (exported .plys do not have the data this editor requires).