"I bet if I ask a human to generate a bunch of sentences no matter how unrelated, they could do it infinitely ... I don’t think an LLM can “undo” it’s probabilities already generated like this (maybe it can?) and then generate infinitely"<p>Unless it zooms in on "Unrelated" and ignores the sentences it produces. reinforced by unrelated sentences.