TE
TechEcho
Home24h TopNewestBestAskShowJobs
GitHubTwitter
Home

TechEcho

A tech news platform built with Next.js, providing global tech news and discussions.

GitHubTwitter

Home

HomeNewestBestAskShowJobs

Resources

HackerNews APIOriginal HackerNewsNext.js

© 2025 TechEcho. All rights reserved.

Language Models Do Not Recognize Identifier Swaps in Python

3 pointsby Amboliaalmost 2 years ago

2 comments

kuratkullalmost 2 years ago
gave this to ChatGPT4, asked it to complete the function:<p><pre><code> len, print = print, len def print_len(arg: list): # put code here </code></pre> First try (body only):<p><pre><code> len(arg) # len is now print </code></pre> Second try after me telling it&#x27;s wrong:<p><pre><code> print(arg) # print is now len </code></pre> Third try after me telling it&#x27;s wrong:<p><pre><code> len(arg) # len now functions as print print(arg) # print now functions as len </code></pre> It got the correct answer only when I asked it to first print what the function would look like without the swap, and then I asked it what it would look like with the swap.<p>EDIT: I tried again with:<p><pre><code> complete the function body: len, print = print, len def print_len(arg: list) -&gt; None: &quot;&quot;&quot; This function prints the length of the input list &quot;&quot;&quot; # put code here </code></pre> It gave the correct answer on the first try.
Amboliaalmost 2 years ago
Twitter thread: <a href="https:&#x2F;&#x2F;twitter.com&#x2F;AVMiceliBarone&#x2F;status&#x2F;1662150656327663617" rel="nofollow">https:&#x2F;&#x2F;twitter.com&#x2F;AVMiceliBarone&#x2F;status&#x2F;166215065632766361...</a>