[amy214]

Yup, that's a thing. Mostly along the lines of "CPU memory is cheap, GPU memory is expensive, if CPU performance is made good enough we can run really really big models for much less because of cheaper RAM"

[ai-christianson]

I'm all for it. It enables those really big models with a relatively small number of active parameters.