Yeah a lot of people here seem to not understand that PyTorch really does make model definitions that simple, and that has everything you need to resume back-propagation. Not to mention PyTorch itself being open-sourced by Meta.
That said the LLama-license doesn't meet strict definitions of OS, and I bet they have internal tooling for datacenter-scale training that's not represented here.
mkolodny|1 year ago
You can use that model with open data to train it from scratch yourself. Or you can load Meta’s open weights and have a working LLM.
causal|1 year ago
That said the LLama-license doesn't meet strict definitions of OS, and I bet they have internal tooling for datacenter-scale training that's not represented here.
yjftsjthsd-h|1 year ago
That makes it source available ( https://en.wikipedia.org/wiki/Source-available_software ), not open source