TE
TechEcho
Home24h TopNewestBestAskShowJobs
GitHubTwitter
Home

TechEcho

A tech news platform built with Next.js, providing global tech news and discussions.

GitHubTwitter

Home

HomeNewestBestAskShowJobs

Resources

HackerNews APIOriginal HackerNewsNext.js

© 2025 TechEcho. All rights reserved.

Ask HN: Why is query, key, value in LLMs so hard to explain?

2 pointsby valtyabout 1 year ago
I have watched so many YouTube videos on this and no one seems to be able to explain it properly.<p>Each explanation is so dramatically different from one another as well.<p>I feel like its another infamously difficult to explain topic like &quot;monads&quot;.<p>I am desperately waiting for a 3Blue1Brown video on transformers to hopefully resolve this ambiguity.<p>I am looking for a visual intuition, and something that tries to answer common questions and ambiguities that arise, and explains the history and why we do things this way.<p>The best approach I found currently is Serrano.Academy https:&#x2F;&#x2F;www.youtube.com&#x2F;watch?v=UPtG_38Oq8o&amp;pp=ygUUdHJhbnNmb3JtZXIgbmV0d29ya3M%3D. They try to visualize things in 2 dimensions with examples and show the linear transformations.<p>Karpathy had a unique way of conceptualizing it as a directed graph with a &quot;communication phase&quot; which further confused me.<p>For such a historic topic, I think we need a better explanation!

1 comment

neximo64about 1 year ago
Try HeduAI on youtube
评论 #39615551 未加载