This Falcon-40B royalty free license may force Meta ... that LLama-7B/13B may soon be fully open sourced as Meta wants open source LLM advancements and contributions on its own LLM architecture.
Why do people think that Meta released their model in order to get open source coders to improve their models? They will get absolutely no competitive advantage from this. Every other team developing a closed source LLM can easily copy the innovations that open source coders have applied to Llama on their own, closed source models.
There's no advantage here. Meta just spent $10 million on releasing fun chaos into the world and increasing their recruiting power.
Meta's most valuable asset is their users, not their technology, so giving away technology is incidental to them. It's not the UI or superior features that makes Meta, Instagram, etc such powerful platforms, it's the network effect.
ChatGPT was the fastest growing app in history, leaders at Meta (The ones who do M&A, strategy, etc) probably raised an eyebrow. They don't really give a crap about some stupid talking chatbot, but OpenAI getting smart and building a Social Network around millions of brand new users could be an existential problem for them. When Lecun wanted to OSS it they were probably like, sure, we can kill a few birds with one stone. If LLMs are a commodity that stops OpenAI and Google before they even get off the ground.
Yeah, but some of the innovations being made at OpenAI will be replicated by the open source community, and Meta can use those for free.
They aren't looking to create a technological edge themselves, they want to remove the edge that OpenAI has so that they can win using their user count/brand recognition/etc.
To be fair, they contributed Pytorch which has defined a whole industry and is responsible for creating hundreds of billions of dollars in value or more. Contributing a set of model weights is an extremely minor thing in the shadow of that, so wouldn't exactly be uncharacteristic.
convexstrictly|2 years ago
https://twitter.com/ylecun/status/1651782621540524032
jacooper|2 years ago
ntonozzi|2 years ago
There's no advantage here. Meta just spent $10 million on releasing fun chaos into the world and increasing their recruiting power.
oceanplexian|2 years ago
ChatGPT was the fastest growing app in history, leaders at Meta (The ones who do M&A, strategy, etc) probably raised an eyebrow. They don't really give a crap about some stupid talking chatbot, but OpenAI getting smart and building a Social Network around millions of brand new users could be an existential problem for them. When Lecun wanted to OSS it they were probably like, sure, we can kill a few birds with one stone. If LLMs are a commodity that stops OpenAI and Google before they even get off the ground.
sebzim4500|2 years ago
They aren't looking to create a technological edge themselves, they want to remove the edge that OpenAI has so that they can win using their user count/brand recognition/etc.
Zemtomo|2 years ago
I believe it's more to make sure that others also continue to share their research.
Or also a general genuine good mindset of people involved in those groups.
convexstrictly|2 years ago
brucethemoose2|2 years ago
Maybe I am cynical, but I dont see the incentive for Meta to contribute an open model.
version_five|2 years ago