TE
科技回声
首页24小时热榜最新最佳问答展示工作
GitHubTwitter
首页

科技回声

基于 Next.js 构建的科技新闻平台,提供全球科技新闻和讨论内容。

GitHubTwitter

首页

首页最新最佳问答展示工作

资源链接

HackerNews API原版 HackerNewsNext.js

© 2025 科技回声. 版权所有。

FoundationDB Record Layer

321 点作者 davelester超过 6 年前

18 条评论

wwilson超过 6 年前
This is very cool!<p>FoundationDB excites a lot of people because it&#x27;s an extremely scalable and extremely reliable distributed database that supports ACID transactions, and which is both open-source and has Apple standing behind it. And yeah, all of that is pretty nice.<p>But arguably the real power comes from the fact that it exposes a relatively low-level data model that can then be wrapped in one or more stateless &quot;layers&quot;. All of these layers write to the same storage substrate, so you can have your document database, your SQL database, your time-series database, your consensus&#x2F;coordination store, your distributed task queue, etc., etc., but you&#x27;re only actually operating one stateful system. Your SREs will thank you.<p>Writing these layers to be scalable and high-performance can be challenging, but it looks like Apple is actively doing it and willing to release the results to the rest of us. This also suggests that their previous open-sourcing of the MongoDB-compatible document layer wasn&#x27;t a one-off fluke. All of this is very good news for everybody who needs to run databases in the real world.<p>Full disclosure: I worked on FoundationDB a long, long time ago.
评论 #18906409 未加载
评论 #18909718 未加载
评论 #18906837 未加载
评论 #18906992 未加载
评论 #18909362 未加载
评论 #18908066 未加载
abalone超过 6 年前
Apple low key does some cool server projects with a Java bent. They&#x27;ve contributed to Netty (well, they hired core developers).[1]<p>They&#x27;ve been basically put them to work reimplementing it in Swift.[2] It&#x27;s open and out there but not a lot of people paying attention. While it&#x27;s still early days I think there may a year where, suddenly, Swift on the server is a super serious thing and all this work they&#x27;ve been doing on little old CloudKit kind of takes over the world.<p>Just a fun prediction.. but it wouldn&#x27;t be the first time Apple pulled something like that.<p>I do like that Swift&#x27;s non-tracing garbage collection model is well suited for server apps. Rust is cool too but maybe Swift would be a little friendlier and thus better suited to inherit Java&#x27;s mantle. I mean can you just imagine if Apple is slowly building up Swift to overtake Java on the server? That that&#x27;s one of their long game master plans? I know that sounds completely crazy.. It just might work. They do run one of the biggest data center networks in the world so they have a pretty good testbed and can justify a hefty R&amp;D budget.<p>[1] <a href="https:&#x2F;&#x2F;www.infoq.com&#x2F;presentations&#x2F;apple-netty" rel="nofollow">https:&#x2F;&#x2F;www.infoq.com&#x2F;presentations&#x2F;apple-netty</a><p>[2] <a href="https:&#x2F;&#x2F;github.com&#x2F;apple&#x2F;swift-nio" rel="nofollow">https:&#x2F;&#x2F;github.com&#x2F;apple&#x2F;swift-nio</a>
评论 #18911065 未加载
spullara超过 6 年前
I had built a layer like this one for my startup Bagcheck called Havrobase[1] (it was on top of HBase&#x2F;Solr, here is the motivating blog post[2]) that ultimately I put on top of MySQL&#x2F;Solr and other stores. Later, when we started Wavefront, I ported that layer to FDB and that still powers their metadata. Really a good fit and very much like this record layer. I highly recommend this approach for 24&#x2F;7 services as you never need to have maintainence windows for schema upgrades and the like.<p>[1] <a href="https:&#x2F;&#x2F;github.com&#x2F;spullara&#x2F;havrobase" rel="nofollow">https:&#x2F;&#x2F;github.com&#x2F;spullara&#x2F;havrobase</a> [2] <a href="https:&#x2F;&#x2F;javarants.com&#x2F;havrobase-a-searchable-evolvable-entity-store-on-top-of-hbase-and-solr-d305f90a3eaa" rel="nofollow">https:&#x2F;&#x2F;javarants.com&#x2F;havrobase-a-searchable-evolvable-entit...</a><p>Initially at Wavefront we were using HBase for telemetry, Zookeeper for the service mesh and MySQL Cluster for entity metadata. All that was moved on top of FDB with 3 different layers that we developed.<p>I&#x27;m excited that this kind of database is now going to be available more broadly and with the confidence that CloudKit is using the same technology since to date implementing something like this was basically a DIY project.
评论 #18909099 未加载
manigandham超过 6 年前
Glad Apple is releasing all of this, I wonder what kickstarted it all?<p>The paper is rather interesting: <a href="https:&#x2F;&#x2F;www.foundationdb.org&#x2F;files&#x2F;record-layer-paper.pdf" rel="nofollow">https:&#x2F;&#x2F;www.foundationdb.org&#x2F;files&#x2F;record-layer-paper.pdf</a>
评论 #18909109 未加载
lima超过 6 年前
This might be the first good alternative to etcd for configuration stores that need real-time updates.<p>Like Kubernetes.<p>Many Kubernetes scaling issues are etcd-related.<p>RethinkDB is dead-ish, and CockroachDB is treating their changefeeds as an enterprise feature that requires a Kafka instance to stream to :(
评论 #18907648 未加载
评论 #18908209 未加载
评论 #18910112 未加载
ryanworl超过 6 年前
Congrats to the team at Apple for getting this released! They have had a busy few months with getting the document layer released, the FDB Summit, and now the record layer.
jwr超过 6 年前
Very interesting. I&#x27;ve been looking closely at FoundationDB as a way forward (to replace RethinkDB and Cassandra in existing systems). It&#x27;s one of the few contenders for a really interesting take on a distributed database.<p>I am not sure if I will use the record layer (I&#x27;ve been planning to write &quot;my layer&quot; myself), but it will definitely be an interesting thing to look at.
评论 #18906908 未加载
bcx超过 6 年前
I learned that basically all of Imessages and contacts are stored on foundation DB, it&#x27;s pretty great this is making it into opensource. Thanks Apple!
评论 #18907533 未加载
georgewfraser超过 6 年前
Seeing this soon after the AWS “wire compatible with Mongo” kerfuffle, it makes me think: it would be amazing if the cloud vendors would offer a managed FDB service. An open-source, cloud-agnostic, horizontally scalable, document-oriented transactional database would be an incredible tool. I know AWS is going in the opposite direction these days with proprietary “wire compatible” services but a guy can dream...
评论 #18910195 未加载
评论 #18911291 未加载
评论 #18909129 未加载
devj超过 6 年前
Few doubts:<p>1. Any reason to write it in Java instead of C, C++, Rust, etc?<p>2. Any reason to use Protobuf instead of Flatbuffers, Avro, etc?<p>3. Can FoundationdDB be used with Apache Arrow?
评论 #18912223 未加载
mbesto超过 6 年前
Has anyone ever used FoundationDB and <i>not</i> found it successful? All I read is &quot;it supports RDMS + NoSQL and can be distributed&quot;. So what use cases <i>doesn&#x27;t</i> it solve?
评论 #18908342 未加载
评论 #18910095 未加载
pier25超过 6 年前
So why would Apple be doing this now? Maybe preparing the terrain to enter the cloud space and compete with Azure and AWS in a couple of years?<p>After all, it&#x27;s no mystery Apple wants to expand their services revenue. Their hardware revenue it&#x27;s not growing as much as it used to.
mathnode超过 6 年前
Does anyone know if FoundationDB is gaining ground over Cassandra at Apple?
评论 #18907738 未加载
nschiefer超过 6 年前
The preprint of the paper is now up on arXiv.org: <a href="https:&#x2F;&#x2F;arxiv.org&#x2F;abs&#x2F;1901.04452" rel="nofollow">https:&#x2F;&#x2F;arxiv.org&#x2F;abs&#x2F;1901.04452</a>
continuations超过 6 年前
Does that mean FDB now supports secondary indexes?<p>If that&#x27;s the case, how does FDB compare to ScyllaDB now that they both have secondary indexes?
评论 #18912216 未加载
评论 #18908540 未加载
gigatexal超过 6 年前
This is super exciting. Can’t wait to have some time this weekend to play with it.
Artemis2超过 6 年前
This is powering CloudKit. Very cool!
akavel超过 6 年前
Can someone please ELI5&#x2F;executive summary to me what are the benefits of FoundationDB? Assuming I know the basics of PostgreSQL and ElasticSearch? I see some hype around it, but I can&#x27;t understand what&#x27;s the breakthrough. As a helping question: can you maybe try to tell me who are the expected users of it, vs. PSQL, ES? Or, when I should choose it over them? Also, what are its disadvantages? (I suspect bigger complexity, and bigger cost&#x2F;worse effectiveness at small scale?) TIA!
评论 #18911280 未加载