(no title)
jzig
|
6 months ago
I'm confused by how Opus is presented to be superior in nearly every way for coding purposes yet the general consensus and my own experience seem to be that Sonnet is much much better. Has anyone switched to entirely using Opus from Sonnet? Or maybe switching to Opus for certain things while using Sonnet for others?
SkyPuncher|6 months ago
It's still pretty much impossible to have any LLM one-shot a complex implementation. There's just too many details to figure out and too much to explain for it to get correct. Often, there's uncertainty and ambiguity that I only understand the correct answer (or rather less bad answer) after I've spent time deep in the code. Having Opus spit out a possibly correct solution just isn't useful to me. I need to understand _why_ we got to that solution and _why_ it's a correct solution for the context I'm working in.
For me, this means that I largely have an iteratively driven implementation approach where any particular task just isn't that complex. Therefore, Sonnet is completely sufficient for my day-to-day needs.
bdamm|6 months ago
ssk42|6 months ago
adastra22|6 months ago
gpm|6 months ago
monatron|6 months ago
HarHarVeryFunny|6 months ago
j45|6 months ago
aghilmort|6 months ago
can look at primal check the mean or dual get out of local minima
in all cases, model, tokenizer, etc is just enough different that will generally pay off in spaces quickly
anonzzzies|6 months ago
Uehreka|6 months ago
Given that there’s nothing close to scientific analysis going on, I find it hard to tell how big the “Sonnet is overall better, not just sometimes” crowd is. I think part of the problem is that “The bigger model is better” feels obvious to say, so why say it? Whereas “the smaller model is better actually” feels both like unobvious advice and also the kind of thing that feels smart to say, both of which would lead to more people who believe it saying it, possibly creating the illusion of consensus.
I was trying to dig into this yesterday, but every time I come across a new thread the things people are saying and the proportions saying what are different.
I suppose one useful takeaway is this: If you’re using Claude Max and get downgraded from Opus to Sonnet for a few hours, you don’t have to worry too much about it being a harsh downgrade in quality.
MostlyStable|6 months ago
I stick with Sonnet for most things because it's generally good enough and I hit my token limits with it far less often.
unshavedyak|6 months ago
Opus gives you a bit more rope to hang yourself with imo. Yes, it "thinks" slightly better, but still not good enough to me. But it can be good enough to convince you that it can do the job.. so i dunno, i almost dislike it in this regard. I find Sonnet just easier to predict in this regard.
Could i use Opus like i do Sonnet? Yes definitely, and generally i do. But then i don't really see much difference since i'm hand-holding so much.
jm4|6 months ago
biinjo|6 months ago
furyofantares|6 months ago
I use Opus exclusively and don't hit limits. ccusage reports I'm using the API-equivalent of $2000/mo
Aeolun|6 months ago
epolanski|6 months ago
dsrtslnd23|6 months ago
dested|6 months ago
jzig|6 months ago
datameta|6 months ago
astrostl|6 months ago
sothatsit|6 months ago
I don't believe anyone saying Sonnet yields better results than Opus though, as my experience has been exactly the opposite. But trade-off wise, I can definitely see it being a better experience when used interactively because of its speed and lower cost.
cmrdporcupine|6 months ago
E.g. prompt to read a paper, read some source, then write out a terse document meant to be read by machine not human.
Then switch to Sonnet, have it read that document, and do the actual implementation work.
chisleu|6 months ago
It's my experience that Opus is better at solving architectural challenges where sonnet struggles.
gpm|6 months ago
So this release might change that consensus? If you believe the benchmarks are reflective of reality anyways.
jimbo808|6 months ago
That's a big "if." But yeah, I can't tell a difference subjectively between Opus and Sonnet, other than maybe a sort of placebo effect. I'm more careful to write quality prompts when using Opus, because I don't want to waste the 5x more expensive tokens.
Aeolun|6 months ago
sky2224|6 months ago
brenoRibeiro706|6 months ago
tkz1312|6 months ago
rtfeldman|6 months ago
j45|6 months ago
Sonnet is great at banging it out.
seunosewa|6 months ago
taormina|6 months ago
ssss11|6 months ago