Scribe[1], Scuba[2], Hive[3], and folly[4]. It's neat for sure, but speaking as an outsider without the resources to learn (much less create!) an entire universe of data infrastructure and SDKs, it feels like I'm in the corner eating dinner at the kids' table.<p>At any rate, I'm glad somebody out there is doing this stuff.<p>[1]: <a href="https://engineering.fb.com/2019/10/07/core-infra/scribe/" rel="nofollow">https://engineering.fb.com/2019/10/07/core-infra/scribe/</a><p>[2]: <a href="https://research.facebook.com/publications/scuba-diving-into-data-at-facebook/" rel="nofollow">https://research.facebook.com/publications/scuba-diving-into...</a><p>[3]: <a href="https://research.facebook.com/publications/hive-a-warehousing-solution-over-a-map-reduce-framework/" rel="nofollow">https://research.facebook.com/publications/hive-a-warehousin...</a><p>[4]: <a href="https://github.com/facebook/folly/tree/main">https://github.com/facebook/folly/tree/main</a>
What it's like to be a Facebook engineer in this context:
It's your oncall week, and all of a sudden you get an urgent task that you must resolve in the next few days: Figure out how to replace a crypto algorithm in some component your code depends on or else we tell your manager that you're not playing ball.