TE
TechEcho
Home24h TopNewestBestAskShowJobs
GitHubTwitter
Home

TechEcho

A tech news platform built with Next.js, providing global tech news and discussions.

GitHubTwitter

Home

HomeNewestBestAskShowJobs

Resources

HackerNews APIOriginal HackerNewsNext.js

© 2025 TechEcho. All rights reserved.

Slicer: Auto-Sharding for Datacenter Applications

58 pointsby mlernerover 3 years ago

4 comments

gnabgibover 3 years ago
From 2016. It&#x27;s nice to have the option between the slides[0], 22m of audio[1] and whitepaper[2]<p>[0]: <a href="https:&#x2F;&#x2F;www.usenix.org&#x2F;system&#x2F;files&#x2F;conference&#x2F;osdi16&#x2F;osdi16-adya.pdf" rel="nofollow">https:&#x2F;&#x2F;www.usenix.org&#x2F;system&#x2F;files&#x2F;conference&#x2F;osdi16&#x2F;osdi16...</a> [1]: <a href="https:&#x2F;&#x2F;2459d6dc103cb5933875-c0245c5c937c5dedcca3f1764ecc9b2f.ssl.cf2.rackcdn.com&#x2F;osdi16&#x2F;adya.mp3" rel="nofollow">https:&#x2F;&#x2F;2459d6dc103cb5933875-c0245c5c937c5dedcca3f1764ecc9b2...</a> [2]: <a href="https:&#x2F;&#x2F;www.usenix.org&#x2F;system&#x2F;files&#x2F;conference&#x2F;osdi16&#x2F;osdi16-adya.pdf" rel="nofollow">https:&#x2F;&#x2F;www.usenix.org&#x2F;system&#x2F;files&#x2F;conference&#x2F;osdi16&#x2F;osdi16...</a>
jzelinskieover 3 years ago
Slicer is mentioned briefly in the PWL talk on Zanzibar[0]. I&#x27;ve chatted with a few folks from Uber that worked on Ringpop[1], which was inspired by Slicer, but doesn&#x27;t have any of the novel dynamic balancing properties. I still don&#x27;t think there&#x27;s anything anbalagous outside of Google.<p>[0]: <a href="https:&#x2F;&#x2F;youtu.be&#x2F;1nbSbe3kw2U?t=1612" rel="nofollow">https:&#x2F;&#x2F;youtu.be&#x2F;1nbSbe3kw2U?t=1612</a><p>[1]: <a href="https:&#x2F;&#x2F;github.com&#x2F;uber&#x2F;ringpop-go" rel="nofollow">https:&#x2F;&#x2F;github.com&#x2F;uber&#x2F;ringpop-go</a>
评论 #29778097 未加载
bognitionover 3 years ago
Super interesting.<p>The TL;DR is that google built a system to shard client requests into different services&#x2F;task by some largish shard key. The example they provide is to shard requests into ML model services by the underlying language (English vs Chinese) as different languages need different models.<p>Rather than requiring each product team to manage sharding, google built a custom layer to do it for any team to use. In practice it&#x27;s not used by that many teams (~20 services at Google use it).
评论 #29776066 未加载
new_realistover 3 years ago
Does Slicer work with range partitions?