In my opinion, this is way too "abstract". Kinda like someone let ChatGPT run wild repackaging existing libraries with new APIs.<p>So this library abstracts away BentoML with a custom API. BentoML itself abstracts away its own internal framework. That inner framework abstracts away HuggingFace diffusers with a different API. And HF diffusers itself is a rather huge library that abstracts away using PyTorch to load the model and run it. HF diffusers contains lots of useful things for designing and training models, but none of that makes it through the 3 layers of API changes introduced here.<p>I predict that debugging any kind of production app using this is going to be pure hell. You'll have 30 function deep call stacks across millions of lines of code. And that's especially sad since the alternative is probably a single 300 LOC python script calling PyTorch directly.