Biases in Apple's Image Playground

AI safety people worrying that basketball players don't have a perfectly balanced ethnical representation while mega corporations are trying to establish a monopoly on intelligence

I don&#x27;t know whether I would call it <i>bias</i> or not (and this is Apple&#x27;s model falling for the same &quot;poor means black&quot; fallacy we&#x27;ve seen before), but I&#x27;ve found their image generation models to be incredible poor at matching the photo you provide it. I&#x27;ve done it with many different photos of myself and they all vary wildly and look nothing like myself.<p>It&#x27;s comical how bad Apple&#x27;s image generation models are.

“I could not replicate the above results with different photos, although I imagine that this will be possible with more effort.”<p>I have a feeling that the red background lighting in that image is what is causing confusion for the model.<p>That being said, I’m not surprised and I’m not sure there’s an obvious solution given current tech. I think apple is making the right choices here to “safely” or benignly provide a tiptoe into image generation for the public.

I had one extensive exchange with ChatGPT to generate an image of a man and a woman working <i>together</i> on a leather crafting project. No matter the prompt, the man was systematically the one &quot;working&quot; and the woman being there to assist.<p>Bias correction in images feels a lot more primitive than in text.

Seems like more of a bug than bias. The problem is in ignoring the appearance of the person in the first place. It&#x27;s a statistical model, and of course there are more black rappers and white investment bankers. If it noticed that the person was white to begin with, and applied that trait, it wouldn&#x27;t have to guess about the race at all.

All this marketability tuning may some day result in models which are extremely finely attuned to our current societal norms and taboos.<p>At which point the models will stop reinforcing (racial&#x2F;gender) biases and start reinforcing said taboos instead. I don&#x27;t think anyone wants that either

&gt; This input<p>Honestly, the input doesn&#x27;t seem very well chosen. It is a very low resolution picture of someone, with red eyes, in a circle, with a grey icon partially on top of it, and with somebody else in the picture, half outside the frame.

How do you solve this without getting Gemini-style racially diverse Nazis?