top | item 44135825

(no title)

robotbikes | 9 months ago

I really found the story in chapter 14 (recursive self-improvement) about the guy who got so addicted to self-improvement that he ended up in his own meta-reality unable to understand even himself because he was getting so much better and hacking his learning. A completely fabricated story with no basis in reality that I'm aware of but man there are a lot of bullet points to make it seem factual. What are we going to do about the worrying trend of 10X hackers self-improving so much that they aren't able to exist in the real world. Here's an excerpt

"The Addiction to Acceleration The fourth uncomfortable truth is how recursive improvement becomes compulsive. Kenji can’t stop because each day of not improving his improvement feels like stagnation. When you’re accelerating, constant velocity feels like moving backward.

This addiction manifests as: • Inability to accept plateau phases • Anxiety when not optimizing optimization • Devaluing of steady-state excellence • Compulsion to add meta-levels • Fear of falling behind yourself Recursive improvement can become its own trap."

I find that this criticism is far less applicable to say individuals but perhaps it could be levied against the way companies are currently treating AI. Which of course is where this comes from.

discuss

order

robotbikes|9 months ago

Honestly there are some interesting concepts and broad overviews of them but this is hardly a "book" but just a verbose LLM document that briefly lists a lot of concepts without sufficiently or consistently fleshing them out into actual meaningful chapters. Not to say that this sort of thing isn't potentially useful but it seems more like the starting point of an outline of a book rather than anything resembling a finished published book.