TE
TechEcho
Home24h TopNewestBestAskShowJobs
GitHubTwitter
Home

TechEcho

A tech news platform built with Next.js, providing global tech news and discussions.

GitHubTwitter

Home

HomeNewestBestAskShowJobs

Resources

HackerNews APIOriginal HackerNewsNext.js

© 2025 TechEcho. All rights reserved.

Best LLM for simple code completion with large context window

4 pointsby jasontlouroabout 1 year ago
Here&#x27;s what I&#x27;m trying to do - this is _not_ for use in an IDE.<p>Imagine you have a SaaS and you want your users to be able to completely control the SaaS with natural language.<p>So you reduce all of the SaaS functionality into a set of typescript types (including function types), will documented, with every parameter accounted for. And then, when a user types a request in natural language, you ask an LLM to produce a set of function calls to be executed, and after confirming with the user, you run them.<p>To do this you need to pass the entire typescript definitions for the entire SaaS as well as all of the user&#x27;s data relevant to their query into the context window. And the LLM has to be particularly good at writing (simple) Typescript code.<p>What&#x27;s the best for this? Using GPT-4 Turbo for now, but really not up to date on the latest models and versions.

no comments

no comments