(no title)
badloginagain | 2 years ago
I haven't thought too critically yet about Meta's strategy here, but I'd like to give it a shot now:
* The release/leak of Llama earlier this year shifted the battleground. Open source junkies took it and started optimizing to a point AI researchers thought impossible. (Or were unincentivized to try)
* That optimization push can be seen as an end-run on a Meta competitor being the ultimate tax authority. Just like getting DOOM to run on a calculator, someone will do the same with LLM inference.
Is Meta's hope here that the open source community will fight their FAANG competitors as some kind of proxy?
I can't see the open source community ever trusting Meta, the FOSS crowd knows how to hold a grudge and Meta is antithetical to their core ideals. They'll still use the stuff Meta releases though.
I just don't see a clear path to:
* How Meta AI strategy makes money for Meta
* How Meta AI strategy funnels devs/customers into its Meta-verse
MacsHeadroom|2 years ago
badloginagain|2 years ago
Actually biggest complaint is they don't continue supporting it half the time, but they OS a lot of things.
wes-k|2 years ago
https://gwern.net/complement
badloginagain|2 years ago
I just don't see Meta's role-- where is their monopoly in the stack?
MSFT seems to have a much clearer compliment. They own the servers OAI run on. They would loooove for OAI competitors to also run in Azure.
Where does Meta make its money re: AI?
Meta makes $ from ads. Targeted ads for consumers. Is the play more better targeting with AI somehow?
michaelt|2 years ago
Tech stocks trade at mad p/e ratios compared to other companies because investors are imagining a future where the company's revenue keeps going up and up.
One of the CEO's many jobs is to ensure investors keep fantasising. There doesn't have to be revenue today, you've just got to be at the forefront of the next big thing.
So I assume the strategy here is basically: Release models -> Lots of buzz in tech circles because unlike google's stuff people can actually use the things -> Investors see Facebook is at the forefront of the hottest current trend -> Stock price goes up.
At the same time, maybe they get a model that's good at content moderation. And maybe it helps them hire the top ML experts, and you can put 60% of them onto maximising ad revenue.
And assuming FB was training the model anyway, and isn't planning to become a cloud services provider selling the model - giving it away doesn't really cost them all that much.
> * How Meta AI strategy funnels devs/customers into its Meta-verse
The metaverse has failed to excite investors, it's dead. But in a great bit of luck for Zuck, something much better has shown up at just the right time - cutting edge ML results.
kevindamm|2 years ago
I think they realized that being a direct competitor to ChatGPT has very low chance of traction, but there are many adjacent fields worth pursuing. Think whatever you will about the business, hey my account has been abandoned for years, but there are still many intelligent and motivated people working there.
thierrydamiba|2 years ago
Meta makes a lot of money already and seems to be working on multiple moonshot projects as well.
As you mentioned the FOSS crowd knows how to hold a grudge. Could this be an attempt to win back that crowd and shift public opinion on Meta?
There is a non-zero chance that Llama is a brand rehabilitation campaign at the core.
The proxy war element could just be icing on the cake.
nzealand|2 years ago
LLMs will be important for Meta's AR/VR tech.
So perhaps they are using open source crowd to perfect their LLM tech?
They have all the data they need to train the LLM on, and hardware capacity to spare.
So perhaps this is their first foray into selling LLM as a PaaS?