TE
TechEcho
Home24h TopNewestBestAskShowJobs
GitHubTwitter
Home

TechEcho

A tech news platform built with Next.js, providing global tech news and discussions.

GitHubTwitter

Home

HomeNewestBestAskShowJobs

Resources

HackerNews APIOriginal HackerNewsNext.js

© 2025 TechEcho. All rights reserved.

Borg: The Next Generation [pdf]

104 pointsby blopeurabout 5 years ago

10 comments

blopeurabout 5 years ago
Paper : <a href="https:&#x2F;&#x2F;dl.acm.org&#x2F;doi&#x2F;abs&#x2F;10.1145&#x2F;3342195.3387517" rel="nofollow">https:&#x2F;&#x2F;dl.acm.org&#x2F;doi&#x2F;abs&#x2F;10.1145&#x2F;3342195.3387517</a><p>Video : <a href="https:&#x2F;&#x2F;www.youtube.com&#x2F;watch?v=1qUQsZwbu6s" rel="nofollow">https:&#x2F;&#x2F;www.youtube.com&#x2F;watch?v=1qUQsZwbu6s</a>
jeffbeeabout 5 years ago
This is a really valuable contribution, just to benchmark whatever you are doing vs what&#x27;s possible, in a similar way that the large datacenter operators have shown everyone that PUE of 1.1 is achievable. This data shows that you can achieve &gt; 60% utilization of both compressible and incompressible resources, overcommit both kinds of resources by 200%, while scheduling task arrivals at over 100 per second. It really is an extremely valuable glimpse into how the bigs operate.
justicezyxabout 5 years ago
Was involved in this research project for a few months in early 2019. Feel free to post some questions that are not sensitive to internal details, and I can answer them here.<p>Edit: not one of the coauthors, since I left the team in April 2019.
评论 #23034289 未加载
epistasisabout 5 years ago
Does Borg also track and allocate network usage? That has been an issue for me in compute environments in the past for high IO situations.
评论 #23034258 未加载
评论 #23037141 未加载
评论 #23034210 未加载
remusabout 5 years ago
The resource usage section at the end was really interesting, and surprising to me. 1% of jobs use 99% of resources! It would be interesting to try and understand how this pattern came about and if there&#x27;s particular engineering decisions that tend to lead to this situation where you have a handful of incredibly resource intensive jobs and loads of very lightweight jobs.
评论 #23043925 未加载
kgravesabout 5 years ago
Interesting, I can only wish to run this sort of tech for my own small company.
评论 #23034381 未加载
评论 #23034028 未加载
评论 #23033995 未加载
评论 #23033775 未加载
polskibusabout 5 years ago
How much different&#x2F;better&#x2F;worse is this compared to Kubernetes?
评论 #23034285 未加载
评论 #23034347 未加载
gautamcgoelabout 5 years ago
Is Borg essentially Google&#x27;s version of Condor?
评论 #23034984 未加载
评论 #23034790 未加载
throwaway29303about 5 years ago
What is Borg written in? C, C++ or Go?
评论 #23038336 未加载
pwgabout 5 years ago
Also a name clash with Borg the backup utility (which is the #5 item returned from a google search for &quot;borg&quot; for me when I just tested what would come back):<p><a href="https:&#x2F;&#x2F;borgbackup.readthedocs.io&#x2F;en&#x2F;stable&#x2F;" rel="nofollow">https:&#x2F;&#x2F;borgbackup.readthedocs.io&#x2F;en&#x2F;stable&#x2F;</a>
评论 #23035214 未加载
评论 #23034997 未加载
评论 #23034720 未加载