TE
科技回声
首页24小时热榜最新最佳问答展示工作
GitHubTwitter
首页

科技回声

基于 Next.js 构建的科技新闻平台,提供全球科技新闻和讨论内容。

GitHubTwitter

首页

首页最新最佳问答展示工作

资源链接

HackerNews API原版 HackerNewsNext.js

© 2025 科技回声. 版权所有。

Peloton: Uber’s Unified Resource Scheduler for Diverse Cluster Workloads

54 点作者 r4um超过 6 年前

6 条评论

elvinyung超过 6 年前
&gt;Kubernetes hasn’t been able to scale to the large clusters that Uber requires, i.e. 10,000-plus, nor does it support elastic resource sharing. It is also not the ideal scheduler for batch workloads due to the high-churn nature of batch jobs.<p>Feels like a semi-weird justification for NIH. Isn&#x27;t there pretty active work in addressing most&#x2F;all of those objections in k8s?
评论 #18339942 未加载
评论 #18339476 未加载
romed超过 6 年前
It&#x27;s interesting how big of a difference it makes when you allow local disk I&#x2F;O, and you need to schedule around it. At Google they disintermediate storage and all (not really all) I&#x2F;O goes to their cluster FS (Colossus, sort of). They don&#x27;t have to schedule around I&#x2F;O resources because every process has access to the full I&#x2F;O resources of the entire cluster at any time from any node. By contrast as soon as you let some open source or off-the-shelf commercial thing leak into your operations, it will demand ordinary POSIX disk I&#x2F;O and then you&#x27;ve got big problems. I propose that some companies would actually be better off concentrating on disintermediated storage more, and I&#x2F;O workload scheduling less.
评论 #18340118 未加载
评论 #18341650 未加载
评论 #18342762 未加载
SteveNuts超过 6 年前
I&#x27;m always bummed when I don&#x27;t see Nomad listed in blog posts like these. It has quite a few powerful features that people overlook.
dominotw超过 6 年前
CMU has a &quot;self driving&quot; db with the same name <a href="https:&#x2F;&#x2F;github.com&#x2F;cmu-db&#x2F;peloton" rel="nofollow">https:&#x2F;&#x2F;github.com&#x2F;cmu-db&#x2F;peloton</a>
评论 #18339280 未加载
crb超过 6 年前
Nothing in the article about this being open source or available to the public?
评论 #18341452 未加载
mistrial9超过 6 年前
from the article -- Peloton is built on top of Mesos
评论 #18341490 未加载