If you train an LLM on only formally verified code, it should not be expected to generate formally verified code.<p>Similarly, if you train an LLM on only published ScholarlyArticles ['s abstracts], it should not be expected to generate publishable or true text.<p>Traceability for Retraction would be necessary to prevent lossy feedback.