Interesting project, I've heard a lot of good things about GraphPipe for Model Serving with support for multiple languages (Go, Python, Java) <a href="https://github.com/oracle/graphpipe" rel="nofollow">https://github.com/oracle/graphpipe</a>