top | item 43341727

(no title)

aravindputrevu | 11 months ago

I'm curious. Is there any value to do these OSS models?

Suddenly after reasoning models, it looks like OSS models have lost their charm

discuss

order

archerx|11 months ago

Thee are a lot of open source reasoning models. The true value to local models is privacy and the ability to have the models be uncensored.

lelag|11 months ago

OSS model do not have to be local models, and it's not just about privacy, imo.

DeepSeek R1 hosting is out of reach for most, but it being open is a game changer if you are a building a business that needs the SoTA capabilities of such a large model, not because you will necessarily host it yourself, but because you can't be locked out of using it.

If you build your business on top of OpenAI, and they decide they don't like you, they can shut you down. If you use an open model like R1, you always have the option to self host even if it can be costly, and not be at the mercy of a third party being able to just kill your business by shutting down your access to their service.

whiplash451|11 months ago

Uncensored at inference time does not imply uncensored at training time (not a specific comment about Gemma)