top | item 39884612

(no title)

meat_machine | 1 year ago

I think most custom fine-tunes and merges on HuggingFace will do this unless they specifically mention it being censored. Even the lower param models have been surprisingly good, with relatively fast progress being made in the 7b and 11b models.

My "daily driver" is Fimbulvetr v2 11b, surprisingly slapped together by an EMT. Kunoichi 7b seems to be a pretty popular model too. These can be run locally with as little as 8 GB free RAM (preferably VRAM) with an easy install solution like LMStudio or Faraday.

You can generally find a lot of recommendations in places like SillyTavernAI or LocalLLaMa on reddit:

https://old.reddit.com/r/SillyTavernAI/comments/1brig2n/whic...

discuss

order

No comments yet.