I'm really skeptical of Eteched. They make claims about how their chips are "optimized for transformers", as if Nvidia's Tensor Cores aren't optimized for those workloads too. Plus, if they really are only good at transformers, they'd get screwed over if SSMs or some other models become dominant. And their website has a "tokens per second" graph with no Y-axis, which is never a good look.<p>I think that if you want to build an AI chip company, you have to leverage some novel technology (processing-in-memory, photonics, etc) that counter-positions you against Nvidia. Trying to beat Nvidia at optimizing digital logic seems like a losing battle.