This is a great article. The author breaks down key advancements in AI--from Nvidia's release of CUDA in 2006, deep learning using CNNs in 2012, followed by recent language translation models and their shortcomings.<p>The coverage of transformers is particularly well-done, including their novel approach to language translation and their generality.<p>Quanta Magazine has covered transformers as well [1,2].<p>[1] Will Transformers Take Over Artificial Intelligence? - <a href="https://www.quantamagazine.org/will-transformers-take-over-artificial-intelligence-20220310/" rel="nofollow">https://www.quantamagazine.org/will-transformers-take-over-a...</a><p>[2] How Transformers Seem to Mimic Parts of the Brain - <a href="https://www.quantamagazine.org/how-ai-transformers-mimic-parts-of-the-brain-20220912/" rel="nofollow">https://www.quantamagazine.org/how-ai-transformers-mimic-par...</a>