We really need to disabuse ourselves — and each other — of this rather idiot “just a tool” notion around today’s LLMs and whatever tomorrow’s “AI” bring.<p>At no time in human history has a carpenter had a hammer that could instantaneously, unguided, and upon request knock 3,500 nails into a new load-bearing wall, based solely on a poorly-understood statistical hunch as to where each successive nail should go, and then confidently (but extremely fallibly) assure the carpenter that the wall would survive the next earthquake.<p>With zero understanding, whatsoever, of what a load-bearing wall, earthquake, or indeed a nail were, or any knowledge (much less culpability) for being an unreliable “tool”.<p>Now, the thorny question… was this written by a LLM?