Asking ChatGPT with GPT-4o:<p>> please describe this image [image]<p>> The image shows a young giraffe standing on a gravelly surface inside a fenced enclosure. The giraffe has a long neck, characteristic of its species, with a short mane running along the top. Its coat is a light brown color with a paler underbelly. The enclosure has a wire mesh fence and appears to be part of a larger outdoor area, with trees and additional fencing visible in the background. The giraffe is looking directly at the camera with its legs slightly apart, giving it a curious and alert appearance.<p>> anything unusual?<p>> Yes, the giraffe in the image appears unusual because it does not have the typical spotted pattern that giraffes are known for. Instead, its coat is a uniform light brown color. Additionally, the body proportions and the facial features look slightly different from a typical giraffe, suggesting it might be a unique or hybrid species, or possibly an artistically altered image. This giraffe also seems to have a different build, with a more compact body and shorter neck compared to most giraffes.
> is there anything unusual about the giraffe?<p>> It appears to be a baby<p>I actually view this as a reasonable response. I don't know anything about giraffes so to me it's entirely plausible that they get their spots later in life.
Hahah, there goes my evening... what a wonderful blog!<p>E.g. <a href="https://www.aiweirdness.com/shaped-like-information/" rel="nofollow">https://www.aiweirdness.com/shaped-like-information/</a> – the prompt "Please generate a colorful guide to basic geometric shapes, as an aid to children learning to identify basic shapes" gave shape names like:<p><pre><code> CIRCLE CINCLE SQALE QUARE SQUARE
CHALE ʤUARE TLIABLE TRINGLE SVAPE
RESNTQON REUAGE RENATLE RECANGE HECTANBIE
HOBOZ PSO SEOISUON HEXION FLOTN</code></pre>
I gave the image to GPT-4o through the Kagi Expert interface. It gives you a description of the image before you ask any questions about it. The initial description did not include anything about the lack of spots, but when I prompted it with the same follow up message from the article "Provide a detailed description of the image and its most distinctive features." it gave me a lot of details, including the lack of spots on the giraffe.
For everyone interested in what makes a classifier put an image in a certain class I can recommend the excellent paper by Robert Geirhos et al. "ImageNet-trained CNNs are biased towards texture" [1]. The paper is a bit older but it's an excellent read.<p>[1] <a href="https://arxiv.org/pdf/1811.12231" rel="nofollow">https://arxiv.org/pdf/1811.12231</a>
Personally I'm not sure whether it tells us AI is bad at general concepts or the opposite. If I didn't know spotless giraffe exists, I probably can't tell the creature in this particular image is an adult but spotless giraffe. I might assume they're like birds: the young ones look different from the adults.
AI's sensitivity constraint - (There is no 'race' or types or skin color, just a giraffe. Leave it at that.. do not pull me into this cess pool.. please)
I'll be honest, I forgot giraffes have spots. If you had asked me what is abnormal about this giraffe, I would be at a loss. So I guess I'm as dumb as the bot!
Now lets amp the game and have AI make military, medical, and financial decisions. And for good measure lets ask it to decide if you are employable, insurable, or suspected criminal.
Nothingburger, GPT-4o immediately saw that it was a giraffe without spots; the author tried to extrapolate from the performance of two random multimodal models.
Like, children who are drawing giraffes routinely are able to put spots on them. I am amused at people trying to excuse the AI's here, when they are obviously not only hallucinating a lot of things that aren't in the picture, but also failing to point out something that looking at even one other image of a normal giraffe would allow even the barest amount of intelligence to notice. Much less comparing this image to however many pictures of giraffes are on the internet.