top | item 45442218

(no title)

top256 | 5 months ago

Thanks for engaging. I think you meant it's obvious rather than shallow? If so, yes I agree but a lot of my friends disagree so I wrote this as rigorously as possible to explain why this is obvious.

That being said, regarding game theory and coordination: Wars DO end when people change the game's parameters. WWI's Christmas Truce happened despite every incentive against it. Catalonia chose not to pursue independence despite having voted for it. The Montreal Protocol solved ozone depletion despite classic tragedy of the commons dynamics.

My point isn't that coordination is easy - it's that treating it as impossible becomes self-fulfilling. When tech leaders invoke inevitability via game theory, they're choosing to accept those constraints rather than working to change them.

discuss

order

lbrandy|5 months ago

> My point isn't that coordination is easy - it's that treating it as impossible becomes self-fulfilling.

While I see what you are getting at, and I think its super important we come up with philosophical frameworks to push back on the central idea in question (ie, the moral hazard of "its gonna happen anyway so why not pour a little more into the river").... I think your writing/responses miss the central point.

As I see it, the fundamental issue with this essay, and your responses, is you keep conflating impossible with probability zero. People are saying "this is inevitable" to mean this has probability 1 of occurring, with basic game theory reasoning (its a giant iterative prisoners dilemna), and your response "but it's possible". Yes, with measure zero.

Telling us that such a path surely exists isn't useful. If you want to push back on "inevitability" you need to find a credible path with probability > 0 (which is not the same as impossible).

top256|5 months ago

Thanks for your thoughtful response. I think there's a misunderstanding (maybe my text wasn't clear. If so please point out where so I can fix it).

We actually agree: even if the probability of successful coordination is only 10%, accepting inevitability makes it 0%. That difference matters enormously given the stakes. My argument isn't "coordination is definitely possible" but rather "believing it's impossible guarantees failure." When tech leaders say "AGI is inevitable," they're not describing reality; they're shaping it by discouraging attempts to coordinate. Human cloning hasn't happened because we maintain active resistance despite technical feasibility.

You're asking for credible paths with P > 0. I'm saying: knowing P with certainty is impossible, so accepting P = 1 narratives makes alternative paths invisible. The path emerges through trial and error, not before it.