Geoffrey Hinton had an excellent series on neural networks from 2011 for Coursera available here <a href="https://m.youtube.com/playlist?list=PLoRl3Ht4JOcdU872GhiYWf6jwrk_SNhz9" rel="nofollow">https://m.youtube.com/playlist?list=PLoRl3Ht4JOcdU872GhiYWf6...</a> detailing the fundamentals of machine learning. The series was later wholesale replaced by another led by Andrew Ng of Google. I really adored Geoffrey’s lectures and recommend it to anyone looking to get into the space. It ends with him hinting at the idea of attention networks, but sadly I can’t find any later lectures from him on the topic.
Full interview:<p><a href="https://youtu.be/H7DgMFqrON0" rel="nofollow">https://youtu.be/H7DgMFqrON0</a><p>The particular mention is at ~3:32.<p>edit: the link was initially pointing to a (admittedly not very high quality) techcrunch article. The part mentioned there where GH closes his speech by "I'm particularly proud of the fact that one of my students fired Sam Altman" is at ~3:32 of the video in the current link.
We changed the URL from <a href="https://techcrunch.com/2024/10/09/after-winning-nobel-for-foundational-ai-work-geoffrey-hinton-says-hes-proud-ilya-sutskever-fired-sam-altman/" rel="nofollow">https://techcrunch.com/2024/10/09/after-winning-nobel-for-fo...</a>, which cherry-picks a single detail (doubtless the most sensational), to the video itself.<p>With cases like this, it's helpful to remember that we're trying to optimize HN for one thing, intellectual curiosity [1]. Remembering that often turns borderline calls into easy ones.<p>[1] <a href="https://hn.algolia.com/?dateRange=all&page=0&prefix=true&sort=byDate&type=comment&query=curiosity%20optimiz%20by:dang" rel="nofollow">https://hn.algolia.com/?dateRange=all&page=0&prefix=true&sor...</a>
This is what clickbait-by-design looks like. The headline is, minor omission aside that Ilya was Hinton’s student, the entire article.<p>I am sure folks here can find a better use of their time than to dogpile on sama. We have enough of those threads to go around that this one is incredibly below the belt.<p>So please help keep HN relatively drama/snide free, and flag this article.<p>Special thanks to TechCrunch for keeping the quality of their articles high. We couldn’t have done it without you.