top | item 43650673

(no title)

amiantos | 10 months ago

I agree with the other commenters, this post does not explain why you would not just run Ollama or Koboldcpp on Windows. What exactly makes running Ollama within virtualized NixOS in WSL in some way better than running natively?

If it's just the novelty aspect of it or some idealogical reason, that's fine, but it should be explained in the blog post before someone thinks this is a sane and logical way to run Ollama on a gaming PC.

discuss

order

neuroelectron|10 months ago

Reproducability and security. You're getting the managed security of a Windows install plus your isolating it from Windows telementry.

benterix|10 months ago

> your isolating it from Windows telementry

1. Maybe, 2. For now