An open source project? How will it download github amd then the entire Internet? The model requires 10x20k cards to run. You are dreaming, this is a factor+ more complex than stable diffusion. Big players only
The model doesn't need all the knowledge encoded in its weights, just the ability to look things up effectively. I believe this will be available to the general public sooner rather than later.
It will fit on a desktop computer within a few years as researchers figure out how to reduce the size of the model. It could be sooner because the knowledge that it is popular to reduce the size of models and disseminate them drives a lot of people to try to accomplish it. Like when the four minute mile was first run, and then suddenly many runners could do it.
tiagod|3 years ago
knaik94|3 years ago
1123581321|3 years ago