ZacWil | 9 months ago | on: Fine-tuning LLMs is a waste of time
Correct me if I am wrong, but I thought the point of fine-tuning was to get precise returns. We make it hyper specific to the task at hand.
Sure, we can get 90% of the way there without fine-tuning, but most of these models are vast.
I would argue that it potentially MAY be a waste of time right out the gate.