TE
TechEcho
Home24h TopNewestBestAskShowJobs
GitHubTwitter
Home

TechEcho

A tech news platform built with Next.js, providing global tech news and discussions.

GitHubTwitter

Home

HomeNewestBestAskShowJobs

Resources

HackerNews APIOriginal HackerNewsNext.js

© 2025 TechEcho. All rights reserved.

Netflix's Key-Value Data Abstraction Layer

93 pointsby gslin8 months ago

4 comments

ericmcer8 months ago
Can anyone explain why Netflix is considered to have such high tier engineering? Just from a super high level view they store and serve ~5000 videos saved at a few different qualities (4?) so lets say a total of 20,000 videos. Those files only change when specific privileged users update them.<p>Compare that with Youtube where ~5,000 videos are uploaded, processed into different formats&#x2F;qualities every minute, and can be added by anyone with an email. It seems like Netflix has a fairly trivial problem when compared with video sharing or content sharing sites.
评论 #41592680 未加载
评论 #41601577 未加载
评论 #41593362 未加载
评论 #41592664 未加载
评论 #41597256 未加载
评论 #41592713 未加载
评论 #41593353 未加载
评论 #41608361 未加载
snicker78 months ago
This API is very similar to DynamoDB, which is basically a hash table of B-trees.<p>My experience is that this architecture can lead to very chatty applications if you have a rich data model (eg a graph).
评论 #41592011 未加载
评论 #41597514 未加载
jerf8 months ago
For anyone looking for a TL;DR, I&#x27;d suggest starting at <a href="https:&#x2F;&#x2F;netflixtechblog.com&#x2F;introducing-netflixs-key-value-data-abstraction-layer-1ea8a0a11b30#6f49" rel="nofollow">https:&#x2F;&#x2F;netflixtechblog.com&#x2F;introducing-netflixs-key-value-d...</a> , which HN is truncating so you can&#x27;t see it but I&#x27;ve directly linked to a later section in the post with a #. Up to that point it&#x27;s basically &quot;a networked HashMap&lt;String, SortedMap&lt;Bytes, Bytes&gt;&gt;&quot;. But the ability to return partial results based on a timeout with a pagination token is somewhat unusual and the next section called &quot;Signaling&quot; is at least worth a look.
throwaway9843938 months ago
Back in the 2000s it was common to have libraries and services which would expose high level database functions to applications rather than give them direct database access. It solved so many problems.