[PlatoIsADisease]

Go free stuff! But... no one is running 400B models on their computers.

You are just giving them data instead. Its not like China is known to protect IP. Your data is going to be used against you, and we cant use western laws to keep it safe.

[impulser_]

Yeah they do.

https://openrouter.ai/minimax/minimax-m2.5/providers https://openrouter.ai/z-ai/glm-5/providers https://openrouter.ai/moonshotai/kimi-k2.5/providers

[PlatoIsADisease]

This is not 'running it on our own computers'.

But I like the option to give my data to a rando rather than one of the big 5 US companies that can get sued. At least the rando probably has no idea what to do with 10M of my customer's IP.

Actually... thank you for the links. Unironically.

[SlavikCA]

So, only Americans can use data against others?

By the way, I'm running 400B model on my computer with 72GB VRAM: Qwen3.5-397B-A17B-GGUF/UD-Q4_K_XL getting 13 t/s. Subjectively, I feel it's runs at the level of Anthropic Claude, just slower.

[PlatoIsADisease]

Question for you, that 13t/s, is that pretty solid even with high context/tokens?

I know Apple marketing says 'look at our 20t/s' but they sent less than 40 tokens.

[Aerroon]

256 GB of RAM?

[bigyabai]

> we cant use western laws to keep it safe

Western laws didn't stop OpenAI from leaking PII, or Nest from getting hacked. I'll take my chances with the CCP.

[selfhoster11]

It doesn't take much hardware. I have run larger models.