"Different" or "out of distribution" in the context of LLM actually means "wrong."<p>When people are different, they are wrong relative to each other. When someone is in a far-off subculture (far left, far right, super goth, super avant garde, etc.) they are "wrong" to the majority culture. Compared to the mainstream cultural understanding, anarcho-primitivism is wrong, it's incorrect, it does not fit. You will not find it being used to explain current events in mainstream newspapers or CNN. Because it is wrong.<p>However, the difference between people and LLM is that the person has a sense of self, an agency, etc, and the LLM is just a tool. When a person is wrong, they have an opinion that differs, it's maybe interesting, there may be some value to glean from talking to them and understanding what reasons they have for being wrong. When an LLM is wrong, it's a tool that is malfunctioning. It's just wrong. By the way, when an employee is wrong, they're a tool that is malfunctioning; that's why weird out of distribution people make bad employees (and why they tend not to become employees).<p>This is the same critique of hallucination. "Hallucination" is a word we use to describe when the model does not fit reality. But both the model and reality are relative, of course. The same applies for human to human we just assign different value judgements, and rightly so.