Show HN: A fully open-source (Apache 2.0)implementation of llama

158 点作者 osurits大约 2 年前

We believe that AI should be fully open source and part of the collective knowledge.The original LLaMA code is GPL licensed which means any project using it must also be released under GPL.This "taints" any other code and prevents meaningful academic and commercial use.Lit-LLaMA solves that for good.

17 条评论

adeon大约 2 年前

I think implying that GPL is not "fully open source" is a hot take. It's specifically designed to ensure you and anyone you distribute your code gets the same freedoms. Maybe you don't agree that it's a good license but that is its intention. GPL vs BSD-type licenses I guess is decades long argument by now.Maybe I'm a naive idealist but IMO the GPL-family of licenses are underrated. You can use them to make sure you don't work for free for someone who won't share their improvements.I liked the choice of AGPL for AUTOMATIC1111 Stable Diffusion web UI. (<a href="https://github.com/AUTOMATIC1111/stable-diffusion-webui">https://github.com/AUTOMATIC1111/stable-diffusion-webui</a>)Commercial interests are very allergic to AGPL which ensures the project stays community-run and new features and fixes will prioritize the most ordinary user doing things for fun.

评论 #35346654 未加载

评论 #35352641 未加载

ipsum2大约 2 年前

FYI, there's something fishy going on in this thread. Multiple people from the LightningAI team theaniketmaurya (developer advocate for Lightning AI) and rasbt (developer at Lightning AI) are shilling for this post without disclosing their affiliations. The account that submitted this (osurits) also only has two comments, also with the same behavior.Having interacted with the Lightning AI team in the past, this is unsurprising behavior.

评论 #35347821 未加载

querez大约 2 年前

IANAL, but this seems very fishy to me: 1) I don't understand how this isn't a derivative work of the original code, as I very highly doubt you've done a clean room implementation. I doubt this would hold up in court.2) Doesn't the original FB license also apply to the weights? Just re-implementing the code would not change the license on the weights. So while THE CODE may now be re-licensed, the weights would still fall under the original license.I'd love if someone with more legal understanding could shed some light on this.

评论 #35347122 未加载

评论 #35346593 未加载

评论 #35350559 未加载

2Gkashmiri大约 2 年前

Bs.Prevents meaningful academic.....How the hell does agpl prevent academic use? Commercial use sure because agpl follows 4 freedoms and commercial often wants to take someone else's work, slap their brand without acknowledging the original work. That and the downstream is often closed source for "business reasons" which causes their users to not enjoy the fruits of the first party's licensing.Where does academia come into it? Are researchers now keeping everything under wraps for "shareholders interests"?Isn't academia supposed to be open culture from the start without any restrictions so what am I missing or are they mixing two unrelated things?Also, I think I might be wrong but isn't it merely converting llama into their version? Uh ...

评论 #35346391 未加载

alexb_大约 2 年前

>GPL...prevents meaningful academic and commercial useWTF are you talking about?

评论 #35346697 未加载

homarp大约 2 年前

llama.cpp is also MIT<a href="https://github.com/ggerganov/llama.cpp">https://github.com/ggerganov/llama.cpp</a>previously discussed here <a href="https://news.ycombinator.com/item?id=35100086" rel="nofollow">https://news.ycombinator.com/item?id=35100086</a>and one of the rust wrapper: <a href="https://news.ycombinator.com/item?id=35171527" rel="nofollow">https://news.ycombinator.com/item?id=35171527</a> (also MIT)

barefeg大约 2 年前

But aren’t the weights still not for commercial use?

评论 #35346212 未加载

ficiek大约 2 年前

If you hate GPL so much then I assume that you don't run any GPL licensed code on your machines then. I admire your resolve because I would think that is pretty hard!

javimh大约 2 年前

No, the GPL doesn't prevent meaningful academic or commercial use; rather, it seeks to prevent individuals from taking advantage of free software to limit the freedom of other users. It is important to note that if you live in a free country, there are laws that protect the liberties of all citizens and prevent actions that could restrict those freedoms.

blendergeek大约 2 年前

> We believe that AI should be fully open source and part of the collective knowledge.As do I.> The original LLaMA code is GPL licensed which means any project using it must also be released under GPL.Yep. This ensures that AI is "fully open source and part of the collective knowledge."> This "taints" any other code and prevents meaningful academic and commercial use.Taints? As in "makes fully open source"? Isn't that the goal?> Lit-LLaMA solves that for good.Lit-LLaMA helps people create proprietary closed-source AI instead of the fully open source AI required by Llama. Okay.

nynx大约 2 年前

There are already a million ways to run LLaMA. This doesn't change the issue at all, which is that the weights aren't commercially licensed.

评论 #35346744 未加载

评论 #35346706 未加载

nl大约 2 年前

Just noting that HuggingFace has a Llama code implementation[1]. It's also under an Apache 2 license.While this seems to be nice code I don't particularly see any reason to use that over HuggingFace transformers, where you can easily swap out alternative implementations.Also, going to legal restrictions on the Facebook LLama code when there are much stronger restrictions on the use of the model seems an odd thing to do. It's true that in some - not all - jurisdictions it is possible the model might not be copyrightable - but you'd have a bold legal department to rely on those arguments. It's also moderately likely that an instruction-tuned Llama (like Alpaca) would be copyrightable even in those jurisdictions.TL;DR: Use the HuggingFace transformers library. You can experiment with Llama and switch to truly free models like GPT-J or anything new that arrives very easily.[1] <a href="https://huggingface.co/docs/transformers/main/model_doc/llama" rel="nofollow">https://huggingface.co/docs/transformers/main/model_doc/llam...</a>

AmuVarma大约 2 年前

Llama by FB is under a non-commercial license not a GPL license, so I assume you are using a different base model, what model is that?

评论 #35351734 未加载

评论 #35345922 未加载

leke大约 2 年前

I'm still confused about this. Does it require you to have a chatGPT API key for it to work?

yewnork大约 2 年前

I see this as a win for the AI community. The key for LLMs is to enable people to train collaboratively and innovate more quickly in this space. Are there any examples or demos available that showcase the capabilities of "lit-llama"?

theaniketmaurya大约 2 年前

I am in love with this implementation considering the ability to run on 8 GB VRAM and Apache 2.0 license.

评论 #35344897 未加载

rasbt大约 2 年前

I guess that means time to fire up a few GPUs later today and get some weights! We should have a weight exchange platform for that maybe, haha.

评论 #35346491 未加载