Tencent's 'Hunyuan-T1'–The First Mamba-Powered Ultra-Large Model

Not sure what they mean by ultra large. Hopefully it doesn't mean it's bigger than 1T parameters, if so, the results look pretty bad because R1 beats this model on a lot of benchmark and R1 is less than 700B parameters.

It's neat to see someone scale up an alternative architecture.