TE
TechEcho
Home24h TopNewestBestAskShowJobs
GitHubTwitter
Home

TechEcho

A tech news platform built with Next.js, providing global tech news and discussions.

GitHubTwitter

Home

HomeNewestBestAskShowJobs

Resources

HackerNews APIOriginal HackerNewsNext.js

© 2025 TechEcho. All rights reserved.

I built a custom chat UI for llama3 on groq

4 pointsby ratsabout 1 year ago

2 comments

ratsabout 1 year ago
I was tired of getting rate limited when using Anthropic models like Claude, so I decided to build my own custom chat UI. Not being a developer, what looked like a simple task quickly turned into a sisyphean endeavor, especially trying to fix CSS. But with the help of Claude and GPT-4, (almost) everything is possible now.<p>In my day-to-day use, I often use snippets of prompts that I have to copy-paste here and there, so I added them as variables (just clicking on a variable will insert it into the text field and it will expand during runtime).<p>Yesterday, I saw that Groq added llama3 support, and it is not only very good but also blazingly fast. You need to try it to believe it:<p><a href="https:&#x2F;&#x2F;customchat.vercel.app" rel="nofollow">https:&#x2F;&#x2F;customchat.vercel.app</a><p>(it uses my API key on a free tier, so the worst that can happen is the rate limit, which is generous on Groq).
cranberryturkeyabout 1 year ago
checkout open-webui its runs ontop of ollama