> we talk about programming like it is about writing code, but the code ends up being less important than the architecture, and the architecture ends up being less important than social issues.<p>A thousand times this! This puts into words something that's been lurking in the back of my mind for a very long time.
Discussed at the time:<p><i>The Success and Failure of Ninja</i> - <a href="https://news.ycombinator.com/item?id=23157783">https://news.ycombinator.com/item?id=23157783</a> - May 2020 (38 comments)<p>(Reposts are fine after a year or so! links to past threads are just to satisfy extra-curious readers)
This is hilarious to me:<p><pre><code> Android, which uses it for some large component of the system that I've never quite understood
</code></pre>
Ninja is really a huge part of AOSP, the build system initially used makefiles. Things got complex really fast with a custom declarative build system (soong) and a failed/aborted migration to bazel. Google developed kati (<a href="https://github.com/google/kati">https://github.com/google/kati</a>) which converts Makefiles to ninja build files (or should I say file), which really is huge:<p><pre><code> λ wc -l out/build-qssi.ninja
3035442 out/build-qssi.ninja
</code></pre>
Going from makefiles/soong to ninja is painful, it takes several minutes even in a modern machine but it simply flies once ninja picks it up.
> I also believe that programmers feel latency and it affects their mood even if they don't notice it. (Google has recently done some research in this area that kinda confirmed my belief, here's hoping they'll publish it publicly!)<p>Anyone knows if it happened? Has the google research on latency been published?
Ninja is pretty popular with gamedevs.<p>I was amused by this line:<p>> But Windows is still a huge platform in terms of developers, and those developers are starved for tools.<p>As a primarily Windows dev I feel that it is poor Linux devs who are starved for tools! Living life without a good debugger (Visual Studio) or profiler (Superluminal) is so tragic. ;(<p>It does feel like in recent years the gap between the two platforms is increasingly minimal. I definitely like all the Rust utilities that generally work crossplatform for example.
I switched to samurai for the few things I have that still used ninja; it's an improvement in every possible way.<p>But regardless, I think those kinds of build systems are just wrong. What I want from a build system is to hash the content of all the transitive inputs and look up if it exists or not in a registry.
Most interesting point to me<p>> You must often compromise between correctness and convenience or performance and you should be intentional when you choose a point along that continuum. I find some programmers are inflexible when considering this dynamic, where it's somehow obvious that one of those concerns dominates, but in my experience the interplay is pretty subtle; for example, a tool that trades off correctness for convenience might overall produce a more correct ecosystem than a more correct but less convenient alternative, if programmers end up avoiding the latter.
> Relatedly, please forgive me for the embarrassing name.<p>The name is great!<p>PS. It's possible to make it even faster if we implement this: <a href="https://github.com/ninja-build/ninja/issues/2157">https://github.com/ninja-build/ninja/issues/2157</a> But you explained in the article that the tool intentionally lacks state, even tiny hints from previous runs.
I had my stint with build systems. Nx, Bazel to name a few. In the past I was always the go to guy to configure these stuffs.<p>OP said that ninja is small enough to be implemented in your favorite programming language. I wonder if there is step by step tutorial to create your own build system?
Man, I was so afraid this was going to be about Fortnite. Turns out it was a fantastic read. I feel really sad but unsurprised about his description of what it's like to be an Open Source maintainer.
### Statistics ###<p>ninja has ~26 kloc, ~3,100 commits, and only a quarter of them by the original author (although by loc changed their weight is higher). Interesting!<p><a href="https://github.com/ninja-build/ninja/graphs/contributors">https://github.com/ninja-build/ninja/graphs/contributors</a><p>### Bunch of other comments ###<p><i>> users of ninja ... all Meson projects, which appears to increasingly be the build system used in the free software world;</i><p>So, AFAICT, that hasn't turned out to be the case.<p><i>> the code ends up being less important than the architecture, and the architecture ends up being less important than social issues.</i><p>Well... sometimes. Other times, the fact that there's good code that does something goes a very long way, and people live with the architectural faults. And as for the social issues - they rarely stand in opposition to the code itself.<p><i>> Some pieces of Ninja took struggle to get to and then are obvious in retrospect. I think this is true of much of math</i><p>Yup. And the some of the rest of math becomes obvious when some re-derives it using alternative and more convenient/powerful techniques.<p><i>> I think the reason so few succeed at this is that it's just too tempting to mix the layers.</i><p>As an author of a library that also focuses on being a "layer" of sorts (<a href="https://github.com/eyalroz/cuda-api-wrappers/">https://github.com/eyalroz/cuda-api-wrappers/</a>), I struggle with this temptation a lot! Especially when, like the author says, the boundaries of the layers are not as clear as one might imagine.<p><i>> I strongly believe that iteration time has a huge impact on programmer satisfaction</i><p>I'm pretty certain that the vast majority developers perform 10x more incremental builds than full builds. So, not just satisfaction - it's just most of what we do. It's also those builds which we wait-out rather than possible go look for some distraction:<p><a href="https://xkcd.com/303/" rel="nofollow">https://xkcd.com/303/</a><p>OTOH, the article doesn't mention interaction with build artifact caching schemes, which lessen the difference between building from scratch and building incrementally.<p><i>> Peter Collingbourne found Ninja and did the work to plug it into the much more popular CMake ... If anyone is responsible for making Ninja succeed out there in the real world, Peter is due the credit.</i><p>It is so gratifying when a person you didn't know makes your software project that much more impactful! Makes you really feel optimistic again about humanity and socialism and stuff.