top | item 36970504

(no title)

metiscus | 2 years ago

LLAMA 2 appears to require no cost because it can be run locally. The license does mention that if you are using facilitating than 700 million users that you have to negotiate for a different license or something like that but for most peoples uses, it would seem that LLAMA 2 is basically "free".

discuss

order

moffkalast|2 years ago

Well it's free as in free hops. You still gotta buy/rent the brewery to make the free beer.

metiscus|2 years ago

Exactly. It isn't free as in FSF definitional freedom, you still can't do certain things with it etc but it is unencumbered by external costs unless you exceed a certain usage threshold.

smallerfish|2 years ago

Right, but can you scale GPUs for cheaper than OpenAI charges to use their APIs? 3.5 is _cheap_, and perfectly good for many use cases.

LewisVerstappen|2 years ago

Thanks for elaborating. Yeah I was curious how much you'd pay running it on a cloud server in a production-type scenario. Thanks