(no title)
salil999 | 1 year ago
I think they are pretty open about it?
- https://www.meta.ai/ requires no log in (for now at least)
- PyTorch is open source
- Various open models like LLama, Detectron, ELF, etc
- Various public datasets like FACET, MMCSG, etc
- A lot of research papers describing their findings
gnat|1 year ago
OP’s point was that Meta is being generous with other people’s business value (AI goodies), but not their own (content, graph, ads).
gorbypark|1 year ago
With Llama, they now have an army of people hacking on the llama architecture, so even if they don't explicitly use any of llama-adjacent projects, there are tons and tons of optimizations and other techniques being discovered. Just making up numbers, but if they spend x billions on interference per year and the open source community comes up with a way to make inference even just a few more percent efficient, the costs of their open source efforts might be a drop in comparison.
For example, Zuck was on the Dwarkesh podcast recently and mentioned that open sourcing OCP (server/rack design) has saved them billions because the industry standardized their designs, driving down the price for them.
infecto|1 year ago
pigpang|1 year ago
mewpmewp2|1 year ago