We are the developers of an open-source package Metaflow that we started at Netflix. Metaflow provides a human-friendly interface to the full stack of ML infrastructure, including data access, compute, workflow orchestration, and versioning. It is used by hundreds of companies across industries.<p>Over the past years, we have seen that there are two major stumbling blocks for folks who want to learn to build real-world ML applications:<p>1) Setting up the full infrastructure stack in the cloud costs time and money. The investment is worth it once you know what you want to do, but that's not always the case in the beginning when you just want to explore.<p>2) While many excellent ML/AI tutorials exist publicly, there aren't that many hands-on, interactive environments showing how to map models to real-world workflows, running on real infrastructure.<p>This Show HN release is about our attempt to address (1) and (2): We host free, fully-featured sandbox environments that include a private Kubernetes cluster, metadata service and UI, and a workflow orchestrator backed by Argo Workflows (1). If you like what you see, you can set up a similar environment in your cloud account using our open-source Terraform templates.<p>In addition, leaning on industry experts, we have created a number of tutorials covering NLP, computer vision, OpenAI Whisper, and recommendation systems (2).<p>Hopefully you'll find these resources useful. Let us know what you think!
As much as self-citation is bad ;-), I want to share the live coding session we had last month: how to build a recommender system pipeline entirely in the browser (<a href="https://www.youtube.com/watch?v=PkKs6oWREr4">https://www.youtube.com/watch?v=PkKs6oWREr4</a>) through the Outerbounds Sandbox (all code is freely available).
Feel free to ask any questions about Metaflow, the Metaflow sandbox stack, etc. here!<p>Also, we'd love to know how you like to learn AI and ML topics. What tools do you use to test ideas on production-ready ML infrastructure?
Neat. I’ve built some courseware and a sort of similar platform that I’m going to soft launch next month. I built it out of about a decade of necessity in working with coworkers and customers on these types of problems and not really having anything like this. The thing is, I don’t really want to run the platform long term.<p>Are you hiring?