top | item 36090992

(no title)

ThorsBane | 2 years ago

Any recommended starting points for LORA training llama 30B on a specific niche? Books, tutorials, videos are all appreciated. Thanks for your time!

discuss

f_devd|2 years ago

Currently SOTA for specialization of LLMs is QLoRA: https://github.com/artidoro/qlora

ThorsBane|2 years ago

Thank you very much my friend. Be blessed in all that you do. <3