TE
TechEcho
Home24h TopNewestBestAskShowJobs
GitHubTwitter
Home

TechEcho

A tech news platform built with Next.js, providing global tech news and discussions.

GitHubTwitter

Home

HomeNewestBestAskShowJobs

Resources

HackerNews APIOriginal HackerNewsNext.js

© 2025 TechEcho. All rights reserved.

Ilya Sutskever talk on Sequence to sequence learning with neural networks

3 pointsby miletus5 months ago

1 comment

aprilthird20215 months ago
This recap misses one major point from the talk.<p>He mentions that biologically all mammals follow a scaling law of body size to brain size. The glaring exception is hominids, the ancestors of and present day humans. So there is a way that&#x27;s different than everything else.<p>Meaning, just because the scaling law of data to AI quality is what we see right now, it doesn&#x27;t mean a new fundamental paradigm or architecture can&#x27;t come around and change that scaling law significantly on us. There&#x27;s precedent for that.