35 点作者 matanyall大约 1 年前

5 条评论

Oras大约 1 年前

That's impressive. I asked to summarise an article in 5 bullet points, and the output was 812.81 T/s on Llama 3 8B.

frozenport大约 1 年前

LLama3 looks particularly good at tool calling<p>Groq's low latency is particularly good for tool calling<p>Seems like two techs that will make coding obsolete :-)

Alifatisk大约 1 年前

Is the python lib open-source? I could only find the ja lib for Groq.

评论 #40096927 未加载

WhatsName大约 1 年前

What is tbe cost per Mio. Token for llama3 70b on groq?

评论 #40092411 未加载

jacooper大约 1 年前

When is Mixtral 8x22b coming?

Llama3 on Groq

5 条评论

Llama3 on Groq

5 条评论