top | item 40206065

(no title)

harryp_peng | 1 year ago

This really is the fastest growing technology of all time. Do you feel the curve? I remember Mixtral8x7b dominating for months; I expected data bricks to do the same! but it was washed out of existence in days, with 8x22b, llama3, gemini1.5... WOW.

discuss

order

krainboltgreene|1 year ago

I must be missing something because the output from two years ago feels exactly the same as the output now. Any comment saying the output is significantly better can be equally pared with a comment saying the output is terrible/censored/"nerfed".

How do you see "fastest growing technology of all time" and I don't? I know that I keep very up to date with this stuff, so it's not that I'm unaware of things.

HeatrayEnjoyer|1 year ago

The best we had two years ago was GPT-3, which was not even instruction tuned and hallucinated wildly.

hehdhdjehehegwv|1 year ago

I do massive amounts of zero shot document classification tasks, the performance keeps getting better. It’s also a domain where there is less of a hallucination issue as it’s not open ended requests.

cma|1 year ago

Are you trying the paid gpt or just free 3.5 chatgpt?

hehdhdjehehegwv|1 year ago

Funny thing is I’m still in love with Mistral 7B as it absolutely shreds on a nice GPU. For simple tasks it’s totally sufficient.

qeternity|1 year ago

Llama3 8B is for all intents and purposes just as fast.