The idiocy of trying to sanitize LLMs for "safety" knows no bounds.<p>Recently I was trying to generate fake social security numbers so I could run some regression tests.<p>ChatGPT will refuse to do so, even though it "knows" the numbers are fake and meaningless.<p>So, I asked for random numbers in the format of XXX-XX-XXXX along with fake names and addresses, and it happily obliged.<p>And of course we've all heard the anecdote where if you ask for popular bittorrent sites, you'll be denied. But if you ask what websites are popular for bittorents so you can avoid them, it'll happily answer you.