top | item 45428679

(no title)

verbify | 5 months ago

I thought "The Bitter Lesson" was that whole a specialised system will outperform in the short term, generalized systems with lots of data win in the long term.

http://www.incompleteideas.net/IncIdeas/BitterLesson.html

discuss

order

jvanderbot|5 months ago

Over time. But for a given instant, specialization will always win. That message is for researchers, who seek to have long term impact and it's bitter because it goes against their desire to provide long term impact from their own clever abstraction or insights.

But it's informative for the engineers that need something right now, because it means taking the best general purpose tool and specializing it will outperform the general tool, and you can sustain that if you are willing to always hop tools and respecialize. As we may.

jvanderbot|5 months ago

Unbeknownst to me, parent edited to incorporate my comment. Move along.

lemonlearnings|5 months ago

I think there is a bitter lesson to the bitter lesson.

Sure you can throw more compute at it. But it cost a lot of money and you hit resource limits.

We have been doing an end run around the bitter lesson with prompt engineering. Also by using different models for vision vs. text. By getting (human coding) agents to "think" and run code.

The bitter lesson might be that you cant predict what the thing is that will be most optimal tomorrow and any player in the AI game can be innovated out of existence at any time.

Maybe anyone except TMSC.