TE
TechEcho
Home24h TopNewestBestAskShowJobs
GitHubTwitter
Home

TechEcho

A tech news platform built with Next.js, providing global tech news and discussions.

GitHubTwitter

Home

HomeNewestBestAskShowJobs

Resources

HackerNews APIOriginal HackerNewsNext.js

© 2025 TechEcho. All rights reserved.

Ask HN: How can I get structured outputs from AWS Bedrock?

1 pointsby itskarad4 months ago
Just FYI — I&#x27;m not an ML person. I was trying out Bedrock and wanted a reliable way to get JSON responses from the Llama 3.3 model on AWS Bedrock. Is there a better way than just prompting?<p>I have previously tried running Llama on Ollama locally and it works great since it&#x27;s supported out of the box.<p>I have looked into outlines + vllm, but that requires a powerful machine + GPU to produce structured outputs, and that&#x27;s just wasteful, because I would be better off hosting my own Llama and using ollama.

no comments

no comments