TE
TechEcho
Home24h TopNewestBestAskShowJobs
GitHubTwitter
Home

TechEcho

A tech news platform built with Next.js, providing global tech news and discussions.

GitHubTwitter

Home

HomeNewestBestAskShowJobs

Resources

HackerNews APIOriginal HackerNewsNext.js

© 2025 TechEcho. All rights reserved.

Ask HN: An Offline ChatGPT Alternative?

3 pointsby DBformoreabout 2 years ago

2 comments

pizzaabout 2 years ago
You can see here the most downloaded models from the Hugging Face transformers hub: <a href="https:&#x2F;&#x2F;huggingface.co&#x2F;spaces&#x2F;huggingface&#x2F;transformers-stats" rel="nofollow">https:&#x2F;&#x2F;huggingface.co&#x2F;spaces&#x2F;huggingface&#x2F;transformers-stats</a><p>If I&#x27;m not mistaken these will be some of the best sota language models to try:<p>- Flan-T5<p>- OPT<p>- Distilbert<p>- GPT-J<p>Look into PEFT to fit finetuning on a consumer-grade device. You&#x27;ll have to roll your own RLHF though.. :)
fl0psabout 2 years ago
Been asked here before, but this was interesting:<p><a href="https:&#x2F;&#x2F;old.reddit.com&#x2F;r&#x2F;programming&#x2F;comments&#x2F;szqq5m&#x2F;gptj_is_selfhosted_opensource_analog_of_gpt3_how&#x2F;" rel="nofollow">https:&#x2F;&#x2F;old.reddit.com&#x2F;r&#x2F;programming&#x2F;comments&#x2F;szqq5m&#x2F;gptj_is...</a>