Why nobody is recognising the feat by the Chinese? 5% of computing power to reach the same outcomes as OpenAI's ChatGPT.
All I hear is crickets on an open field.
This got submitted to HN just a few minutes before your post [1].<p>When ChatGPT-3 came out I said two things: (1) this is not going to develop godlike intelligence even if you scale it up considerably [2], but (2) we had no idea how these work so that particular model was terribly inefficient and there will be future models that are more efficient.<p>And here we are. First-mover advantage turned out to be a disadvantage. If you are OpenAI or Facebook and have a good model you're going to be inclined to take what you've got and try to improve its accuracy. The right thing to do is throw it out and start all over using everything we know about how to increase efficiency, but there's the fear that it won't be as good as the original model, customers won't want to rebuild all their RAG vectors, etc. See [4]<p>[1] <a href="https://garymarcus.substack.com/p/five-things-most-people-dont-seem" rel="nofollow">https://garymarcus.substack.com/p/five-things-most-people-do...</a><p>[2] they get the right answer by the wrong method, hallucinations won't go away, past a certain point trying to improve performance will be like pushing a bubble around under a rug, see [3] Structurally inadequate for many tasks such as sorting (that N log N thing) and chess (look at a few million moves with alpha-beta and you can beat the worst player at the chess club, look at a few billion you beat grandmasters)<p>[3] <a href="https://en.wikipedia.org/wiki/Asymptote" rel="nofollow">https://en.wikipedia.org/wiki/Asymptote</a><p>[4] <a href="https://en.wikipedia.org/wiki/Disruptive_innovation" rel="nofollow">https://en.wikipedia.org/wiki/Disruptive_innovation</a>
Perhaps crickets because nobody wants to wake the beast (market sell-off). But I believe it's a tempest in a teapot. Technology is changing so rapidly now (almost vertical rate of change) that by this time next year this "revelation" is likely to be moot. Just stick to what you trust in your work, and keep moving forward. The problems will be figured out and fixed by the market very quickly--or else.