Hey HN,<p>I'm exploring serverless platforms for hosting custom machine learning models and could use some advice from those who have experience with these services. I get that "serverless" still involves servers, but I'm looking at options that market themselves this way.<p>I'm considering:<p>modal.com
runpod.io
replicate.com
beam.cloud<p>I'm curious about two main things:
Pricing: How do the costs compare for running custom ML models on these platforms? Any detailed breakdowns would be great.
Cold Start Time: How quickly can each platform start up a custom model from a cold start? Are there big differences in startup times?<p>If you've used any of these, I'd love to hear your thoughts and experiences.