TE
科技回声
首页24小时热榜最新最佳问答展示工作
GitHubTwitter
首页

科技回声

基于 Next.js 构建的科技新闻平台,提供全球科技新闻和讨论内容。

GitHubTwitter

首页

首页最新最佳问答展示工作

资源链接

HackerNews API原版 HackerNewsNext.js

© 2025 科技回声. 版权所有。

Distributed Systems Reading List

554 点作者 dedalus超过 4 年前

17 条评论

shred45超过 4 年前
I find "distributed systems" to be a huge source of imposter syndrome. Despite having worked almost exclusively with distributed applications for several years now, it is difficult to consider myself experienced. When I'm asked if I've worked with distributed systems, I don't think they are asking me if I've managed a Hadoop cluster. They are interested in building new applications using some of the primitives discussed in this post. All of these links are great, but the fact is that building and operating tools like this is hard. In addition to consensus primitives, your system may need very precise error handling, structured logging, distributed tracing, resource monitoring, schema evolution, etc. In the end, I probably pause for a second too long when answering that question, but I don't think its because of a lack of experience, quite the opposite!
评论 #25347390 未加载
评论 #25345027 未加载
评论 #25351250 未加载
评论 #25350307 未加载
评论 #25386247 未加载
评论 #25356073 未加载
评论 #25347253 未加载
projectileboy超过 4 年前
Great list. Only thing I’d add for the other enterprise developers out there is to first default to not building a distributed system at all, but rather build a much smaller monolith. In 25 years I’ve worked for so many orgs that wanted to build The World’s Most Scalable System for what would <i>maybe</i> be a few hundred concurrent users. Not surprisingly, those projects tend to tank.
评论 #25344266 未加载
评论 #25344135 未加载
评论 #25345394 未加载
评论 #25344243 未加载
评论 #25344089 未加载
评论 #25344693 未加载
maurys超过 4 年前
I&#x27;ve enjoyed listening to the MIT Distributed Systems lectures too.<p>They do paper reviews and I pick the papers&#x2F;topics which seem the most interesting (rather than doing them in order).<p>They are great if you&#x27;ve already gone over the basics using &quot;Designing Data Intensive Applications&quot; or &quot;Distributed Systems for Fun and Profit&quot;.<p><a href="https:&#x2F;&#x2F;www.youtube.com&#x2F;playlist?list=PLrw6a1wE39_tb2fErI4-WkMbsvGQk9_UB" rel="nofollow">https:&#x2F;&#x2F;www.youtube.com&#x2F;playlist?list=PLrw6a1wE39_tb2fErI4-W...</a>
kohlerm超过 4 年前
good list but for me the reference is now Martin Kleppmanns new lecture: <a href="https:&#x2F;&#x2F;www.youtube.com&#x2F;playlist?list=PLeKd45zvjcDFUEv_ohr_HdUFe97RItdiB" rel="nofollow">https:&#x2F;&#x2F;www.youtube.com&#x2F;playlist?list=PLeKd45zvjcDFUEv_ohr_H...</a>
评论 #25343467 未加载
评论 #25342867 未加载
评论 #25344217 未加载
评论 #25348959 未加载
评论 #25343006 未加载
libraryofbabel超过 4 年前
Good list, but is it still being actively updated? Not having Kleppmann’s seminal <i>Designing Data-Intensive Applications</i> (2017) on it would indicate no.<p>Alex Petrov’s <i>Database Internals: A Deep Dive Into How Distributed Data Systems Work</i> (2019) is another essential recent reference that should be here. Not as broad as Kleppmann but dives a lot deeper into certain topics.
评论 #25349808 未加载
评论 #25357710 未加载
评论 #25347047 未加载
Zaheer超过 4 年前
HighScalability is also a great practical blog for this. I&#x27;ve learned a ton and implemented learnings based on some of their write-ups: <a href="http:&#x2F;&#x2F;highscalability.com&#x2F;" rel="nofollow">http:&#x2F;&#x2F;highscalability.com&#x2F;</a>
ahelwer超过 4 年前
I guess I&#x27;m pretty opinionated about this, but it was odd the author talked about the necessity of changing the way you think without also including anything about TLA+. IMO the &quot;way you think&quot; about distributed systems - if you want to be effective - will basically end up looking exactly like you think when writing a TLA+ spec, and learning TLA+ is a fast-track method of thinking like a distributed systems engineer. This is much, much more important in day-to-day work on distributed systems than knowing how a bunch of distributed systems algorithms work.
评论 #25345586 未加载
deepGem超过 4 年前
I&#x27;m surprised there is no mention of the Bitcoin white paper. One of the most practical consensus protocols out there. Sure there is a lot of emphasis on the currency itself but I found the consensus protocol explanation so simple and easy to understand, as opposed to the Paxos algorithm.
评论 #25345238 未加载
dumb1224超过 4 年前
I don&#x27;t know if it belongs to the same category; but I find distributed learning very interesting and related. It has been a trending topic in biomedical field. In an area you can&#x27;t gather enough data ethically, distributed systems are key.<p>Example: <a href="https:&#x2F;&#x2F;ascopubs.org&#x2F;doi&#x2F;10.1200&#x2F;CCI.19.00047" rel="nofollow">https:&#x2F;&#x2F;ascopubs.org&#x2F;doi&#x2F;10.1200&#x2F;CCI.19.00047</a>
danesparza超过 4 年前
I would add the &#x27;Secret Lives of Data&#x27; presentation about &#x27;Raft&quot; to this list: <a href="http:&#x2F;&#x2F;thesecretlivesofdata.com&#x2F;raft&#x2F;" rel="nofollow">http:&#x2F;&#x2F;thesecretlivesofdata.com&#x2F;raft&#x2F;</a><p>It&#x27;s a fantastic visual walk through of the Raft consensus protocol (used in many modern distributed systems like Consul).
hb4ch超过 4 年前
Great list, but half of the entry link is dead.
abledon超过 4 年前
How long would it take to realistically get through all these books? for the average developer... i&#x27;m thinking 3-4 years? and this includes taking weekends outside of work to painfully work through every chapter (+ break weekends since working+studying this in evening would probably lead to burnout in 1 year)
评论 #25347546 未加载
评论 #25347978 未加载
denkmoon超过 4 年前
It&#x27;s missing the bible. Andrew Tanenbaum&#x27;s Distributed Systems: Principles and Paradigms.
cyberfart超过 4 年前
Another really good reading about distributed systems is Kyle Kingsbury&#x27;s (aphyr) distsys-class notes:<p><a href="https:&#x2F;&#x2F;github.com&#x2F;aphyr&#x2F;distsys-class" rel="nofollow">https:&#x2F;&#x2F;github.com&#x2F;aphyr&#x2F;distsys-class</a>
rlewkov超过 4 年前
Several links no found
mav3rick超过 4 年前
Most of the links in comments are useful. But after a point it&#x27;s hard to find small projects to implement to practice these. I had to do 2PC for a class.
DJBunnies超过 4 年前
Following.