The big deal here is releasing the model pre-trained. The training part would cost $1M in compute costs if you had to do it in-house.
The idea is that a company or developer downloads the model already trained on natural language. Then you add your additional documents and data and prompt it for answers internally, rather than through a service like OpenAI.
This is a common strategy - when you don't know what the product is, rather than wait until your competitor gets a strong lead- undercut them by releasing your own product in the "spirit" of giving something away. Stir up interest and hope the dust cloud is enough to obscure your competitor long enough until you figure out how to monetize it.
Yup, and also remember to scoop up any interesting ideas generated and produced by people working on your "open" thing, then monetize that. Harnessing crowdsourced free work...
Interesting that this is the approach advocated in the leaked Google memo.
One thing is that it has received a lot of attention. For example the llama.cop project has significantly made it easier to build and run on consumer hardware. In addition, there are a lot of fine tunings available for that model.
The model provided comes with enough legal strings attached that it's only really usable in the unofficial turn a blind eye to licenses context. i.e. Hobbyist, researches and casual use.
Guess no. That is the trick right? Let's see what people build. If it is good copycat it. If you build something very cool that makes money, be ready being sued by meta...
[+] [-] dtagames|2 years ago|reply
The idea is that a company or developer downloads the model already trained on natural language. Then you add your additional documents and data and prompt it for answers internally, rather than through a service like OpenAI.
[+] [-] aschearer|2 years ago|reply
PS I wish I could get the NYT to write marketing pieces for my stuff!
[+] [-] metadat|2 years ago|reply
[+] [-] dravigon|2 years ago|reply
[+] [-] deafpolygon|2 years ago|reply
[+] [-] toss1|2 years ago|reply
[+] [-] nylonstrung|2 years ago|reply
[+] [-] cyanydeez|2 years ago|reply
[+] [-] RcouF1uZ4gsC|2 years ago|reply
One thing is that it has received a lot of attention. For example the llama.cop project has significantly made it easier to build and run on consumer hardware. In addition, there are a lot of fine tunings available for that model.
[+] [-] Havoc|2 years ago|reply
More like handed out good replicas.
The model provided comes with enough legal strings attached that it's only really usable in the unofficial turn a blind eye to licenses context. i.e. Hobbyist, researches and casual use.
[+] [-] simmerup|2 years ago|reply
[+] [-] mungoman2|2 years ago|reply
[+] [-] barbariangrunge|2 years ago|reply
[+] [-] MichaelRazum|2 years ago|reply
PS: Not an expert just speculating.
[+] [-] Havoc|2 years ago|reply