Elelem is a simple, opinionated, JSON-typed, and traced LLM framework in TypeScript.<p>It's a proof of concept but has some nice features:<p>1. Caching (with Redis)<p>2. Tracing (with OpenTelemetry)<p>3. Generated examples of JSON output (using FakerJS), which results in more stable output types.<p>4. Type-safe<p>5. Has retry logic baked-in<p>I'd appreciate any feedback on the interface and would be happy to answer questions for anyone interested in trying it out.<p>Thanks.
I like the integrated telemetry and caching. It looks like the prompt formatter adds text to the system instruction - have you tried using function calling to get json responses? Does the retry mechanism validate against the zod schema?