Nvidia H100 GPU Shipments by Customer

&quot;Nvidia spends around $3,320 to manufacture a single H100 unit, which is then sold to end customers for a price ranging from $25,000 to $30,000.&quot; <a href="https:&#x2F;&#x2F;www.techspot.com&#x2F;news&#x2F;99839-nvidia-garners-reported-1000-profit-each-h100-gpu.html" rel="nofollow noreferrer">https:&#x2F;&#x2F;www.techspot.com&#x2F;news&#x2F;99839-nvidia-garners-reported-...</a><p>I&#x27;m sure a customer ordering 150.000 will get a discount, but how much? (150.000 x 25.000 = 3.75 billion)

Incredible that Meta has 1.5x the amount as Google and Amazon combined. For all the criticisms of Zuckerberg, Meta is an insanely strong and well-aligned organization, and their open-source contributions are unparalleled.

How would this &#x27;Omdia&#x27; know who got how many GPUs?

I see many Chinese companies there. Wasn&#x27;t nvidia not allow to sell this kind of gpus to China?

It’ll be interesting to see how long these GPUs are in use, AND what the secondary market will look like in 5 years. Will NVidia shaft Microsoft and Meta like they shaft consumers re: driver support and other artificial limitations&#x2F;planned obsolescence.<p>Theoretically Microsoft for example just needs to train one or two models and then retrain every so often, so I’m skeptical that NVidia will continue to knock it out of the park from a sales perspective. I wouldn’t be caught dead holding NVDA stock right now.

There is no source on this info, which would be commercial in confidence at the very least.<p>Also: how come Chinese companies are on this list!? I thought H100 exports to China were banned by the Biden administration!

Meta committed to spend $20 B per year on servers for 2023 and 2024. A large fraction of that is going to Nvidia for AI-powered, OCP-derived custom boxes that accept H100&#x27;s.<p>The hilarious part is Zuck can&#x27;t articulate a strategy for this spending at all.

*Who did NVIDIA sell its H100 to that isn&#x27;t classified?

As I understand a H100 (SXM) gets you about 4 Petaflops on FP8. So 150k H100 is about 600 Exaflops on FP8. That is huge. Maybe enough to get AGI?