https://twitter.com/mprkhrst/status/1717936411561591042<p>Looks like an exact clone of the Andromeda Cluster built by Nat Friedman and Daniel Gross (https://andromeda.ai/.<p>Last I checked, P5 EC2 instances on AWS (H100s on AWS) are insanely expensive. Not sure how this startup will be able to compete with on-prem prices without eating the cost themselves.
> Not sure how this startup will be able to compete with on-prem prices without eating the cost themselves.<p>Well, if you look at the company behind it, their whole thing seems to be optimizing cloud costs so maybe that has some part in it?<p>But yeah they were definitely "inspired" by Andromeda Cluster
AWS makes it almost impossible for startups to get access to GPUs, so this would help a lot of startups out significantly if done right. A lot depends on what “cheap” means though…