[maille]

I have a Windows PC with a GTX 5070 (12GB) any chance to run it?

[simonw]

I expect that will run Qwen 3 8B quite happily, and I've found that to be a surprisingly capable model for its size.

[UK-Al05]

The 30B one requires 20 GB of memory for me. But some of the lower parameters one should be ok

[avetiszakharyan]

For me it was peaking at 35GB even when using