Really nice having this all written down, having some chronology & epochs laid out to talk about.<p>Couple sections after that stirred me a bit. They're kind of framed a bit as the hardware challenges, as data-center challenges, but I feel like this all applies double to the software, to what glues the system together.<p>> <i>Technology islands and industry ecosystems</i><p>> <i>The initial success of WSCs was driven by being different, out of necessity reinventing many of the then-conventional approaches to system design. However, as WSCs have scaled, and their adoption has increased via public cloud providers, a broad industry ecosystem supports WSC use cases, allowing "build vs buy" decisions.</i><p>> <i>Custom designs work best when they target some unique needs of WSC workloads or systems that are currently not satisfied cost-effectively by existing solutions in the market (for example, the design of TPU accelerators for WSC machine learning workloads). For more mature markets, however, volume economics often reduce costs and increase velocity, favoring products built on top of industry standards (example, server form factors). Focus on building modular, composable, and interoperable architectures built on standardized interfaces; without this focus on composability and standards, you may end up on a "tech island" unique to yourself because one custom component forces all others to be custom too. In
many ways, this is the hardware equivalent of the monoliths-vs-microservices tradeoff.</i><p>And,<p>> <i>Optimizing the time variable of Moore’s law: agility, modularity, and interoperability</i><p>> <i>The traditional formulation of Moore’s law (performance doubles every two years for the same cost) typically focuses on three variables: performance, cost, and time. As performance and cost improvements start slowing down, focusing on the time variable — the velocity of hardware development — can be a good way to optimize the "area-under-the curve" for continued improvements. Incremental smaller benefits, but at more finer granularities, when compounded, can still achieve exponential benefits.</i><p>> <i>To achieve such agile, faster improvements, we need to build more modular hardware platforms with appropriate investment in interfaces, standards, etc. Chiplets in particular allow us to co-design in a multi-die system context, allowing cost advantages from die geometries, but also mix-and-match integration across heterogeneous IP blocks and different process technologies.</i><p>> <i>The emergence of open source hardware, is another particularly exciting development in this context and enables a more collaborative ecosystem that hardware designers can build on — open-source IP blocks (e.g., Caliptra root of trust), verification and testing suites (e.g., CHIPS alliance, OpenCompute), and even open source tools/PDKs (e.g., OpenRoad). Given how profound open source software has been to WSCs, the opportunity to have a similar impact with open source hardware is significant.</i><p>The discussion on roofshotting, on mild 1.3X-2x improvements, done repeatedly, and revisiting & reapplying old successes I think dovetails with the discussion of modularity. Finding patterns that are broad & reappliable across domains is a huge win. Kubernetes for example keeps getting compared to Docker Compose. But docker compose is good for assembling a set of containers. Where-as Kubernetes is a set of management/manufacturing patterns for that happen to include containers. There's platform modularity by scoping your systems layer bigger, by reusing the wins.<p>I am very hopeful we see a compatibility of datacenters start to emerge. CXL as a very fast fabric interconnect is exciting. Ultra Ethernet Consortium borrowing some RDMA style wins is promising. Hopefully we see industry players arise & serve this market, make a competitive and rich supply side ecosystem that data center builders can keep extracting value from. Right now the market feels early & a boutique interest; getting chiplets and interconnects back to bread and butter of chip making would help drive innovation upwards.