top | item 47213671

(no title)

brokensegue | 13 hours ago

"classical ML" models typically have a more narrow range of applicability. in my mind the value of ollama is that you can easily download and swap-out different models with the same API. many of the models will be roughly interchangeable with tradeoffs you can compute.

if you're working on a fraud problem an open-source fraud model will probably be useless (if it even could exist). and if you own the entire training to inference pipeline i'm not sure what this offers? i guess you can easily swap the backends? maybe for ensembling?

discuss

order

eleventyseven|55 minutes ago

> if you own the entire training to inference pipeline i'm not sure what this offers

336x faster than Python, and swapping backends in a production environment can be far from trivial