Transformer architecture is the foundation current paradigm of AI. I agree it's great but what's next, do you think there should have been an innovation since then and another competitor maybe?<p>It was 2017 when the architecture was proposed and in 2024, 7 years have passed and we are heading towards "Globalization" as Peter Thiel says it.<p>I would love to know, how far is the next big breakthrough in this Technology that goes from 0 to 1.
No one at the commercial AI research labs knows what they're doing. As far as they are concerned there is nothing beyond gradient descent but it's accepted among academic researchers that gradient descent is insufficient for creating anything truly intelligent.
You can't get guess these things before they happen.<p>> do you think there should have been an innovation since then and another competitor maybe?<p>What does "should have" mean? There's no conspiracy to suppress the development of alternative approaches, there's no council or committee which decides these things - people would love the discover something new and amazing which is better, they just haven't been able to do it.