top | item 40436625

Meta plans to not open the weights for its 400B model

32 points| ad8e | 1 year ago |twitter.com

7 comments

order

ErikBjare|1 year ago

I don't think this tweet is an authoritative source

ad8e|1 year ago

Agree, but I've seen other open-source ML people confirm it. For example:

Teknium: Okay and Ive had 4 high-ish level sources tell me they dont plan to release it ever though

asne11|1 year ago

I thought their whole point of opening the models in the first place was to undermine OpenAI, but this seems to invalidate that. Maybe their hand was forced?

blackeyeblitzar|1 year ago

I wonder if it has to do with Meta recently joining the “Frontier Model Forum” industry group alongside Microsoft and Google and OpenAI and Anthropic. AKA the group for regulatory capture by playing up “trust and safety”. They are the ones pushing for regulations which will potentially make it illegal to build models that are open or uncensored.

https://www.theguardian.com/technology/2023/jul/26/google-mi...

https://www.frontiermodelforum.org/updates/amazon-and-meta-j...

This whole group has a dystopian vibe to it, with forced assumptions for its members:

“Member firms must publicly acknowledge that frontier AI models pose both public safety and societal risks, and publicly disclose guidelines for evaluating and mitigating those risks.”

In other words, all the members must amplify the same safety tropes to force regulation on the rest of us.

jmpman|1 year ago

Disappointed. I’d planned to download the model, and build a system powerful enough to run it locally.