[rokizero]

i'm honestly surprised HF doesn't have this feature yet, very useful! will you publish the code on github?

any plans on adding more consumer-grade gpus?

[PieterBecking]

Hey I published the code here: https://github.com/NEBUL-AI/HF-VRAM-Extension

I've added the 4090 and 5090 as well now, make sure to get version 0.5 of the extension