[lacunary]

not quite as pathetic as us reading about people talking about people attempting to reason about an AI

[ekjhgkejhgk]

No, I disagree.

Reasoning with AI achieves at most changing that one agent's behavior.

Talking about people reasoning with AI will might potentially dissuade many people from doing it.

So the latter might have way more impact than the former.

[thephyber]

> Reasoning with AI achieves at most changing that one agent's behavior.

Wrong. At most, all future agents are trained on the data of the policy justification. Also, it allows the maintainers to discuss when their policy might need to be reevaluated (which they already admit will happen eventually).

[koakuma-chan]

> Reasoning with AI achieves at most changing that one agent's behavior.

Does it?