TE
TechEcho
Home24h TopNewestBestAskShowJobs
GitHubTwitter
Home

TechEcho

A tech news platform built with Next.js, providing global tech news and discussions.

GitHubTwitter

Home

HomeNewestBestAskShowJobs

Resources

HackerNews APIOriginal HackerNewsNext.js

© 2025 TechEcho. All rights reserved.

2x faster Gemma 2 finetuning and 63% less VRAM

3 pointsby ricopags11 months ago

1 comment

ricopags11 months ago
Gemma 2 27B is currently the best performing &#x27;open&#x27; model [license is non-commercial].<p>The Unsloth team have a blog post up where they&#x27;ve made fine-tuning Gemma 2 require less VRAM, and also have extended the context window.<p>They&#x27;ve also updated their &#x27;mistralified&#x27; PHI-3 models to Microsoft&#x27;s June update of PHI-3 which sees some performance increases as well.