top | item 39474843

(no title)

airgapstopgap | 2 years ago

Since you're here: have you considered moving to other, better generalist base models in the future? Particularly Deepseek or Mixtrals. Natural language foundation is important for reasoning. Codellama is very much a compromise, it has lost some NLP abilities from continued pretraining on code.

discuss

order

No comments yet.