or can a LLM generate a sudoku which it has not been trained with?<p>LLM's are neural networks that are trained with a massive amount of data. Their training data can contain all the publicly available sudokus that in the internet.<p>So, can it really be creative enough to come up with any sudoku that it doesn't even see before?<p>I would expect that they could not because they are not trained with. Because they are just next word predicter.
It doesn't take creativity to do that. There are tons of sudoku generators already, all you would need to do is run one until it produced a novel result.<p>Novelty isn't equivalent to creativity. If it were, a random number generator would be the most creative force in existence.