Hey HN, one of the team members here!<p>I hope you all enjoy playing with the new and improved generator! We've been hard at work improving the model quality since the last time the site was posted[1]<p>As both a professional fantasy illustrator & software engineer, I find the concept of AI creativity so fascinating. On one hand, I know that mathematically AI only can hallucinate images that fit within the distribution of things that it's seen. But from the artist perspective, the model's ability to blend two existing styles into something so distinctly new is so incredible (and not to mention also commercially useful!)<p>Anyways, happy to answer any question, thoughts, or concerns!<p>---<p>[1] <a href="https://news.ycombinator.com/item?id=20511459" rel="nofollow">https://news.ycombinator.com/item?id=20511459</a>]
Links to related projects in anime art generation for those interested:<p>Waifu Labs v2, referenced in this post (generate amazing custom anime face images):
<a href="https://waifulabs.com" rel="nofollow">https://waifulabs.com</a> (write-up is the above link: <a href="https://waifulabs.com/blog/ai-creativity" rel="nofollow">https://waifulabs.com/blog/ai-creativity</a>)<p>This Anime Does Not Exist (AI-generated anime-style artwork): <a href="https://thisanimedoesnotexist.ai" rel="nofollow">https://thisanimedoesnotexist.ai</a> (write-up <a href="https://www.gwern.net/Faces#extended-stylegan2-danbooru2019-aydao" rel="nofollow">https://www.gwern.net/Faces#extended-stylegan2-danbooru2019-...</a> and <a href="https://nearcyan.com/this-anime-does-not-exist" rel="nofollow">https://nearcyan.com/this-anime-does-not-exist</a>)<p>This Waifu Does Not Exist (AI-generated anime-style faces): <a href="https://thiswaifudoesnotexist.net" rel="nofollow">https://thiswaifudoesnotexist.net</a> (write-up: <a href="https://www.gwern.net/Faces#twdne" rel="nofollow">https://www.gwern.net/Faces#twdne</a>)<p>There's also a <i>lot</i> of literate on e.g. automatic manga coloration, auto-translation, image superresolution, anime frame interpolation, and much more. Worth checking out some places like <a href="https://old.reddit.com/r/AnimeResearch/" rel="nofollow">https://old.reddit.com/r/AnimeResearch/</a> if you're interested!
This is extremely impressive. It’s the first GAN I have seen which lets you tweak the result in a meaningful way rather than being just random.<p>I think the speed that GANs have come in to the world has really shaken people up and it’s hard to process what this all means and what it will result in. Especially the ones which generate based on real people.<p>But the feeling this gives me, is what happens for the future of art. Sure, this example is no where even close to replacing real artists, but it’s already generating images better than I can draw after a year of practice. It does give me a feeling of “what is the point”. Which might be an irrational feeling, but I’m sure others feel the same.
This isn't really creativity is it? I like to call stuff like this statistical copying, and indeed, the linked Wikipedia article on GANs says:<p>> Given a training set, this technique learns to generate new data with the same statistics as the training set.<p>There isn't a creative process here nor any creative introspection going on. While the technical results are impressive, this article does not address creativity even superficially, and just slaps the label on. There isn't any AI either. It's machine learning, i.e., statistical models and algorithms.
> Step 43636: During this phase, the training gets unstable at times, so we have snapshots of occasional horrors like this.<p>Ah, make that <i>three</i> things the public shouldn't see being made: sausage, legislation, and waifus.
This is mind-blowingly good. You keep pushing the state of the art further to the point of broad applicability. It won't be long until everyone can be an artist without putting in the ten thousand hours of drudgery of training their muscles, hand-eye coordination, structure of shape and perspective, etc. I can't wait!<p>Do you have a team page? How many of you are there? Do you work with gwern and nearcyan? Are you going to raise for this? (You should totally scale this!)<p>Great work, and keep it up!
It's funny how people complained about github copilot 'stealing' people code, but nobody here complained about this AI 'stealing' artworks.<p>Don't get me wrong, I have nothing against this, but I think we should start discusing morality of AI generated content, even if it doesn't train on existing artworks/code.
The image quality is good, but now I realize I'm experiencing "uncanny waifu". Authentic character designs bear two things in common:<p>1. Simplifications of reality(the actual artist training method would be traditional studies off life and photo reference followed by gradual reduction and symbolization to a style)<p>2. Symbolic meaning. Things like the style of eyes, clothing, etc are all meant to signal personality. This is stuff that current AI techniques don't really touch upon in any direct sense.<p>Since the ML method is built on interpolating off final results, it's going to lack in these qualities and produce something that is consistently an "average impression". Akin to asking the algorithm to generate mythical heroes by mashing up the various stories: you get a hero that is somehow the average of Icarus, Heracles and Achilles, which would be less of a character than the originals.
I found the most interesting part was the evocative comment about the 'vast and parched' nature of the latent space.<p>I wonder if the OP's intuition regarding the sparseness of the latent space, and the relatively small area occupied by the 'useful' manifold? embedded within it provide us any clues as to what symbol grounding might look like for some neuro-symbolic infrastructure that sits atop that latent space.<p>I.e. how should we be trying to represent concepts like 'male' and 'female' within that space?<p>Is it important to have these concepts represented as a low dimensional manifold?<p>Is it important that this manifold be easily described by some simple geometric form like a convex polytope?<p>Is it important that nuances and variations on the concept be separable within the bounds of the concept-specific manifold?<p>What other properties might be important?
What methods are there to estimate how many unique characters a model can generate? The answer is not infinitely many, but determining when two images are of different 'characters' is fuzzy.
So putting <i>some</i> Anime digital illustrators out of work? ....or I could see many simply use them and pretend they did it themselves?<p>Obvioisly there will be plenty of illustrators doing custom work that these can't (yet) replicate.<p>Also good for those countless anime avatar'd Twitter users.
Amazing work and progress. The previous version appears almost toyish in comparison.<p>FYI uBlock Origin complains about the registration link, because it on "Peter Lowe’s Ad and tracking server list".
I don't want to go all SJW on you guys, amazing work, but can you try to make sure there's an inclusive array of starting faces please? Talking about things like skin tones, thanks!