[Dan_-]

> LLM's are notoriously bad at this. The noise to signal ratio is unacceptably high…

I keep seeing this statement in threads about AI, and maybe it’s just from you, but high SNR is a good thing.

See https://en.wikipedia.org/wiki/Signal-to-noise_ratio

I think the rest of your post is very valid. It’s the mental equivalent of this article https://news.ycombinator.com/item?id=47049088

[tremon]

Except they didn't say signal-to-noise, they said noise-to-signal. And if the NSR is unacceptably high, that means the SNR is unacceptably low.

Two inverses do make a right, it seems.

[kombookcha]

Hah, you got me there! I'll try to keep the ratio flipped correctly next time ;)

I read that article recently, so the similarities might not be entirely coincidental. 'JPEG of thought' is gonna stay in my vocabulary for a while.

[jorvi]

Hehe, yeah there's some terms that just are linguistically unintuitive.

"Skill floor" is another one. People generally interpret that one as "must be at least this tall to ride", but it actually means "amount of effort that translates to result". Something that has a high skill floor (if you write "high floor of skill" it makes more sense) means that with very little input you can gain a lot of result. Whereas a low skill floor means something behaves more linearly, where very little input only gains very little result.

Even though its just the antonym, "skill ceiling" is much more intuitive in that regard.

[Gracana]

Are you sure about skill floor? I've only ever heard it used to describe the skill required to get into something, and skill ceiling describes the highest level of mastery. I've never heard your interpretation, and it doesn't make sense to me.