Pretty impressive what the Cerebras folks seem to have accomplished here, reportedly verified by Argonne National Labs. Interested in hardware folks’ take on the architecture as a realistic path forward for training larger and larger models.
That's impressive. Although I'm more into 3D/Physics simulation e so I'd like to test one of these super GPU computers one day and see how fast they are.