TE
TechEcho
Home24h TopNewestBestAskShowJobs
GitHubTwitter
Home

TechEcho

A tech news platform built with Next.js, providing global tech news and discussions.

GitHubTwitter

Home

HomeNewestBestAskShowJobs

Resources

HackerNews APIOriginal HackerNewsNext.js

© 2025 TechEcho. All rights reserved.

Scaling Git, and some back story

143 pointsby dstaheliover 8 years ago

8 comments

sdesolover 8 years ago
&gt; 1st party == 3rd party<p>This was actually the first thing that I actually noticed about Visual Studio Team Services, when I first looked at integrating my search and code analytics engine with VSTS. It was quite apparent that they wanted to make 3rd party developers, first class citizens.<p>Anybody who has ever worked in Enterprise, knows feature requirements are heavily driven by politics. And if you can&#x27;t support the weirdest edge cases, resistance for adoption can become insurmountable. Having looked at VSTS, you could easily tell they wanted to reduce as much push back as possible.
评论 #13570825 未加载
contextfreeover 8 years ago
Related backstory&#x2F;POV from one of the lead developers behind this effort who&#x27;s now outside MSFT in this tweet thread: <a href="https:&#x2F;&#x2F;twitter.com&#x2F;xjoeduffyx&#x2F;status&#x2F;827633982116212736" rel="nofollow">https:&#x2F;&#x2F;twitter.com&#x2F;xjoeduffyx&#x2F;status&#x2F;827633982116212736</a>
luckydudeover 8 years ago
I think they sort of gave up too soon on splitting up their repos. We&#x27;ve been through this before and made BitKeeper support a workflow where you can start with a monolithic repo, have ongoing development in it, and have another &quot;could&quot; of split up repos, sort of like submodules except with full on DSCM semantics.<p>Might take a look at section 5 of this:<p><a href="http:&#x2F;&#x2F;mcvoy.com&#x2F;lm&#x2F;bkdocs&#x2F;productline.pdf" rel="nofollow">http:&#x2F;&#x2F;mcvoy.com&#x2F;lm&#x2F;bkdocs&#x2F;productline.pdf</a><p>which has some Git vs BK performance numbers. We actually made BK pretty pleasant in large repos even over NFS (which has to be slower than NTFS, right?).<p>And BK is open source under the Apache 2 license so there are no licensing issues.<p>I get it, Git won, clearly. But it&#x27;s a shame that it did, the world gave up a lot for that &quot;win&quot;.
protomokover 8 years ago
Great to see MS working on this, and also posting the code!<p>&quot;As a side effect, this approach also has some very nice characteristics for large binary files. It doesn’t extend Git with a new mechanism like LFS does, no turds, etc. It allows you to treat large binary files like any other file but it only downloads the blobs you actually ever touch.&quot;<p>It seems every day I see another attempt to scale Git to support storage of large files. IMHO lack of large file support is the Achilles Heel of git. So far I am somewhat happy with Git LFS despite some pretty serious limitations - mainly the damage a user who doesn&#x27;t have Git LFS installed can inflict when they push a binary file to a repo.<p>I&#x27;m curious what other folks on HN use to store large files in Git without allowing duplication?
评论 #13572098 未加载
bostandover 8 years ago
The sooner they admit TFS is dead and commit 100% to git the better.<p>In fact, I think everyone should use git :)
评论 #13565340 未加载
评论 #13569517 未加载
quanticleover 8 years ago
Related discussion: <a href="https:&#x2F;&#x2F;news.ycombinator.com&#x2F;item?id=13559662" rel="nofollow">https:&#x2F;&#x2F;news.ycombinator.com&#x2F;item?id=13559662</a><p>This article covers the end-to-end approach, whereas the other article and discussion are more focused on the GVSF filesystem driver used to support scaling git to repositories with hundreds of thousands of files and hundreds of gigabytes of history.
microcolonelover 8 years ago
Good story. It&#x27;d be interesting to see a portable version (which I guess would have to either run on Mono or be rewritten in something else); or maybe Google will release some of theirs. I&#x27;m impressed that Microsoft had the courage to scale mostly-vanilla git instead of hacking Mercurial.
评论 #13570056 未加载
sigmonsaysover 8 years ago
these articles are less genuine and interesting because it is the same person with the same theme <a href="https:&#x2F;&#x2F;news.ycombinator.com&#x2F;submitted?id=dstaheli" rel="nofollow">https:&#x2F;&#x2F;news.ycombinator.com&#x2F;submitted?id=dstaheli</a>
评论 #13570013 未加载
评论 #13570905 未加载