I want to be able to just provide a Docker container or upload a shell script and then get a URL which I can expose along with API tokens I can hand out. My container can either return just text or a file after processing for a while. Examples would be pdf generation, calculations, running an LLM. The file would be uploaded to some object storage and give me a temporary URL. Queuing, rate limiting etc should be handled automatically. Is there something like this or do I need to build it myself?
You want a Docker container that runs a script and responds to requests it receives, and an address that it can receive data at, is that correct? That sounds like an HTTP server. You should configure a Docker container with the appropriate scripts, give it the ability to respond to HTTP requests, upload it to a container registry (AWS, DigitalOcean), and then run it on a container service (e.g. AWS ECS). You'll then be provided an IP address that you can issue requests to.