TE
TechEcho
Home
24h Top
Newest
Best
Ask
Show
Jobs
English
GitHub
Twitter
Home
Jlama (Java) outperforms llama.cpp in F32 Llama 7B Model
7 points
by
tjake
almost 2 years ago
3 comments
syllogistic
almost 2 years ago
Collapse
Huh, yeah it repros. Java is faster 159s vs 203s for the 256 tokens on my intel i9 12 gen
评论 #37122594 未加载
version_five
almost 2 years ago
Collapse
Where does the performance difference come from? And in what kind of processor & gpu? I didn't even know llama.cpp had a 32 bit option. For now I'm pretty suspicious it's a fair comparison.
评论 #37121843 未加载
tjake
almost 2 years ago
GH: <a href="https://github.com/tjake/Jlama">https://github.com/tjake/Jlama</a>