[ForHackernews]

Some might argue "sensitivity to framing and distributional priors" is a fancy way to say "absence of reasoning capability".

[keeda]

Actually, no those are separate things, and you can see for yourself with this simple experiment. Just adding "Check your assumptions" to the prompt -- note, without specifying what assumptions! -- leads them to reason to the right answer.

You can try it with the free version of ChatGPT yourself (remember to ask the original question in a separate session to verify it hasn't been "patched" yet.)

[keeganpoppen]

that's what the cultivators of these examples are preying on. but in practice what people care about is "can i get it to do <X>", not "is it a decider on every possible token sequence that humans perceive to be about <X>".

[w4der]

But what is being pitched as "AGI" hype is the latter.