[exoji2e]

I mean, that GPT solves problem 1,3,4 of AoC this year does not translate into it solving all problems, not even close.

For example, try giving ChatGPT the problem statement of https://adventofcode.com/2021/day/19. What comes out is basically gibberish. It seems to completely miss that the scanners report their coordinates in their own coordinate system.

But if nothing changes in the rules/community the leaderboards of early and more straight forward problems will probably be filled with GPT solutions.

[zppln]

I could see it be pretty demotivating not standing a chance against AIs for the first couple of days though (and since you don't know beforehand which day they'll break down you still have to put in the work everyday).

[exoji2e]

Yeah, definately. I would like the leaderboard to be for only humans. But it seems futile to try to ban it and enforce it in any meaningful way, without changing the concept. An honorsystem just stating "if you wish to use a languagemodel like gpt, then please wait before the leaderboard is filled" might work, but I'm not sure.