OpenArc – Lightweight Inference Server for OpenVINO

So is this meant to be used by end users to run models and provide an API like ollama? I don't entirely follow the readme, though I think that's a context problem.