TE
科技回声
首页24小时热榜最新最佳问答展示工作
GitHubTwitter
首页

科技回声

基于 Next.js 构建的科技新闻平台,提供全球科技新闻和讨论内容。

GitHubTwitter

首页

首页最新最佳问答展示工作

资源链接

HackerNews API原版 HackerNewsNext.js

© 2025 科技回声. 版权所有。

Ask HN: Any existing Node.js frameworks that give basic LLMs access to tools?

1 点作者 punkpeye7 个月前
Basically what&#x27;s described here:<p>* https:&#x2F;&#x2F;github.com&#x2F;openai&#x2F;openai-node?tab=readme-ov-file#automated-function-calls<p>* https:&#x2F;&#x2F;jrmyphlmn.com&#x2F;posts&#x2F;sequential-function-calls<p>Suppose I have a model that does not natively support this.<p>Has anyone written&#x2F;came across a library that implements such logic?<p>Conceptually, I would imagine that it simply boils down to another LLM interpreting user&#x27;s question. The prompt for that LLM includes instructions that explain access to tools it has. That LLM then responds with a plan of execution. The plan is some JSON with instructions of what to execute. After the first cycle, the plan is re-evaluated. This repeats until LLM is happy with the response.<p>In practice, this feels like _a lot_ of edge cases to handle, so I am wondering if there are existing abstractions that I could use here.<p>For context, I am not using the native `tools` functionality provided by OpenAI SDK because it does not provide enough flexibility. It is a black box approach. I need to have more granular level control over when tools should be used&#x2F;which.

暂无评论

暂无评论