Nvidia Ampere GA100 GPU Powered Tesla A100: 1 PetaOps Compute and 96 GB HBM2 Mem

Would not want to be Graphcore right now.

Relevant discussion: <a href="https:&#x2F;&#x2F;news.ycombinator.com&#x2F;item?id=23178950" rel="nofollow">https:&#x2F;&#x2F;news.ycombinator.com&#x2F;item?id=23178950</a>

This is partially speculation, the currently shipping version has 40GB of HBM2 @ 1.6TB&#x2F;s. Hypothetically future versions could have 96GB at a faster speed.

Time of GPU ownership of independent Deep Learning researchers is over. It didn&#x27;t even last a decade!