Thanks for sharing the project Kevlar1818.<p>BentoML author here - we are building BentoML to empower Data Scientists to ship prediction services instead of delivering "models" to dev teams. We proposed a workflow that made it easy for data scientists to create and test prediction services and then deploy them to cloud platforms such as AWS Lambda, SageMaker or Docker/Kubernetes.<p>Happy to answer more questions, cheers!
Interesting project, I've heard a lot of good things about GraphPipe for Model Serving with support for multiple languages (Go, Python, Java) <a href="https://github.com/oracle/graphpipe" rel="nofollow">https://github.com/oracle/graphpipe</a>
The project's documentation gives a better overview of its capabilities:<p><a href="https://bentoml.readthedocs.io/en/latest/quickstart.html" rel="nofollow">https://bentoml.readthedocs.io/en/latest/quickstart.html</a>