This produces a kind of artefact I haven't seen before, involving little chains of circles and diamonds, e.g. <a href="https://nvlabs-fi-cdn.nvidia.com/stylegan3/images/stylegan3-r-ffhq-1024x1024/1805.png" rel="nofollow">https://nvlabs-fi-cdn.nvidia.com/stylegan3/images/stylegan3-...</a>, <a href="https://nvlabs-fi-cdn.nvidia.com/stylegan3/images/stylegan3-r-ffhq-1024x1024/0037.png" rel="nofollow">https://nvlabs-fi-cdn.nvidia.com/stylegan3/images/stylegan3-...</a> (hair). I think they follow those glowing coordinate-ish lines from the internal representation.<p>It also seems to have given some faces contact lenses! <a href="https://nvlabs-fi-cdn.nvidia.com/stylegan3/images/stylegan3-r-ffhq-1024x1024/1863.png" rel="nofollow">https://nvlabs-fi-cdn.nvidia.com/stylegan3/images/stylegan3-...</a>, <a href="https://nvlabs-fi-cdn.nvidia.com/stylegan3/images/stylegan3-r-ffhq-1024x1024/0269.png" rel="nofollow">https://nvlabs-fi-cdn.nvidia.com/stylegan3/images/stylegan3-...</a>
I appreciate the section on "Synthetic image detection":<p>"While new generator approaches enable new media synthesis capabilities, they may also present a new challenge for AI forensics algorithms for detection and attribution of synthetic media. In collaboration with digital forensic researchers participating in DARPA's SemaFor program, we curated a synthetic image dataset that allowed the researchers to test and validate the performance of their image detectors in advance of the public release. Please see here for more details on detection" <a href="https://github.com/NVlabs/stylegan3-detector" rel="nofollow">https://github.com/NVlabs/stylegan3-detector</a><p>It's important to see this sort of thing happening more and more.
You can't use any of it commercially. Nothing within is under an acceptable software license (nor an open source license, nor a free software license). Advanced warning.
I know HN doesn't like hype, but as an AI neophyte, I find this incredible. Nvidia is doing it again. This is likely going to help with 3D generation, the next cornerstone. Imagine that we are solving the problems so fast.
There are videos that show what they mean by "details glued to image coordinates" in StyleGAN2: <a href="https://nvlabs-fi-cdn.nvidia.com/stylegan3/videos/" rel="nofollow">https://nvlabs-fi-cdn.nvidia.com/stylegan3/videos/</a>
From the license file:<p>> 3.4 Patent Claims. If you bring or threaten to bring a patent claim against any Licensor (including any claim, cross-claim or counterclaim in a lawsuit) to enforce any patents that you allege are infringed by any Work, then your rights under this License from such Licensor (including the grant in Section 2.1) will terminate immediately.<p>Is such a clause legal? I have basically zero knowledge of such things, but it seems like it should be illegal to punish someone for a good faith patent claim.
> This material is based upon work supported by the US Defense Advanced Research Projects Agency (DARPA) under Contracts No.R00112030005, HR001120C0123, HR001120C0124 and FA8750-20-2-1004 and the Air Force Research Laboratory (AFRL) under Contract No. FA8750-20-2-1004.<p>This is why AI is just a marketing term with no real future.<p>There isn't room for corporations to profit from it out of the gate + into the future indefinitely. No one is going to pay an AWS tax to use their models on every single API hit forever. No one is going to pay nVidia a license fee to use their image recognition tools forever. If the creators of HTML, CSS, and Javascript wanted license fees we wouldn't be using them right now either.<p>There are two groups of people, off the top of my head, who care about all of this:<p>1) The US Military, because the budget for their murder robots is theoretically infinite.<p>2) Google and Facebook because the budget for their spyware is theoretically infinite.<p>To everyone else, it's much ado about nothing.