TE
科技回声
首页24小时热榜最新最佳问答展示工作
GitHubTwitter
首页

科技回声

基于 Next.js 构建的科技新闻平台,提供全球科技新闻和讨论内容。

GitHubTwitter

首页

首页最新最佳问答展示工作

资源链接

HackerNews API原版 HackerNewsNext.js

© 2025 科技回声. 版权所有。

I built a custom chat UI for llama3 on groq

4 点作者 rats大约 1 年前

2 条评论

rats大约 1 年前
I was tired of getting rate limited when using Anthropic models like Claude, so I decided to build my own custom chat UI. Not being a developer, what looked like a simple task quickly turned into a sisyphean endeavor, especially trying to fix CSS. But with the help of Claude and GPT-4, (almost) everything is possible now.<p>In my day-to-day use, I often use snippets of prompts that I have to copy-paste here and there, so I added them as variables (just clicking on a variable will insert it into the text field and it will expand during runtime).<p>Yesterday, I saw that Groq added llama3 support, and it is not only very good but also blazingly fast. You need to try it to believe it:<p><a href="https:&#x2F;&#x2F;customchat.vercel.app" rel="nofollow">https:&#x2F;&#x2F;customchat.vercel.app</a><p>(it uses my API key on a free tier, so the worst that can happen is the rate limit, which is generous on Groq).
cranberryturkey大约 1 年前
checkout open-webui its runs ontop of ollama