A browser plugin for Unity

You can also render Unity inside of Firefox. Infinite recursion potential.

The current title here on HN of “Firefox in Unity” is incorrect. This is based on Servo, not Firefox. From what I understand as a very casual observer that hasn’t been keeping up with things, Servo’s architecture is rather more conducive to this application both in embedding convenience and rendering, being able to render pages in a way that will make them perfect quality regardless of your 3D perspective, whereas I imagine Firefox <i>might</i> still be at the “rasterise the viewport and use it as a tile” level, though maybe WebRender (applying Servo’s renderer to Firefox) has resolved that? As I say, I haven’t been keeping up with things. Anyway, the correct title for the article is “A browser plugin for Unity”.

This is something I&#x27;ve wanted for years, for numerous uses like collaboration, Method of loci, and documentation. Overlaying our built-in spatial awareness with focused data is an area of information architecture with a lot of untapped potential.<p>there is also this which allows multiple windows within unity (there&#x27;s a demo you can try): <a href="https:&#x2F;&#x2F;zenfulcrum.com&#x2F;browser" rel="nofollow">https:&#x2F;&#x2F;zenfulcrum.com&#x2F;browser</a>

This seems similar to ZFBrowser which implements chromium in unity, and is used by Tabletop Simulator. I wonder how the performance compares?

I remember when this sort of functionality arrived in Second Life.<p>It enabled a lot of easy &#x27;shared experiences&#x27;. eg: Watching a live video stream of an event with people, or group presentations etc.

As the author of the first web browser plugin for Unity (HTMLTexture) I must say I&#x27;m very impressed by this. Kudos.<p>Sounds like Unity has changed enough under the hood that the technique I used (calling gl_bind() behind Unity&#x27;s back, using the texture ID you pass in, to basically write to the texture Unity is using for your mesh) no longer works.

For anyone else looking to embed a modern browser in their Windows&#x2F;macOS&#x2F;Linux* C++ application, you might consider Dullahan: source: <a href="https:&#x2F;&#x2F;bitbucket.org&#x2F;lindenlab&#x2F;dullahan&#x2F;src&#x2F;master&#x2F;" rel="nofollow">https:&#x2F;&#x2F;bitbucket.org&#x2F;lindenlab&#x2F;dullahan&#x2F;src&#x2F;master&#x2F;</a> and example screenshot: <a href="https:&#x2F;&#x2F;bitbucket.org&#x2F;lindenlab&#x2F;dullahan&#x2F;raw&#x2F;master&#x2F;docs&#x2F;webcube.png" rel="nofollow">https:&#x2F;&#x2F;bitbucket.org&#x2F;lindenlab&#x2F;dullahan&#x2F;raw&#x2F;master&#x2F;docs&#x2F;web...</a><p>I recently updated it to use Chromium 81 and would have updated it to the most recent version (84) if there weren&#x27;t some non-trivial changes needed to make video&#x2F;audio streaming work again.<p>It&#x27;s what we use in Second Life and would welcome other users&#x27; comments to help improve it.

What are the security guarantees about this?

I&#x27;m sure having a browser in game as a million uses but ...<p>Oculus Rift has in game browser built into their OS. In any game and any time I can pull up a browser in VR (or any desktop app). Pin a walkthru up. Pin up video chat with a friend.<p>It seems like browser in VR would be better served at an OS level. The OS could provide a way for the app to request VR be placed in the scene. Ideally it happens in a way the app can&#x27;t look at the screen since a game shouldn&#x27;t be able to look at the contents of your browser window.

&gt;As we do not have control over the binding of the texture and the Unity context, the current design for updating this texture uses a blit (copy) via Servo’s surfman-chains API<p>I don&#x27;t think this is necessary. You should be able to make Texture objects that ref existing native textures in Unity and I&#x27;ve been able to use OES_EGL_image_external extensions to sample Android decoded video textures sampled from Unity shaders.<p>Its not the most widely available option but the perf is much better.

What is wrong when something cool like this triggers a response along the lines of &#x27;finally I can get tracked while being in-game&#x27;?

I’m a little disappointed the WebGL demo didn’t show what happens when the “outer” viewport moves.

More like Servo in Unity... And from what I recall, Servo is not even an alpha at this point