[dwmbt]

slight nit: this is true amongst all chess players. amongst professionals and amateurs, 1400 is technically Class C - which is on the lower end of amateurs.

nonetheless, it's cool to see a model 'generally intelligent' enough to beat most players. what's more interesting to me is that according to OP's analysis, GPT4 is worse at Chess than GPT3.5...

source: https://en.wikipedia.org/wiki/Chess_rating_system

[qwytw]

It would depend how often did this happen:

> Occasionally it does make an illegal move

Since it would lose every game in which it made more than a single illegal move.

[sebzim4500]

Well it can't have happened more than 6 times since illegal moves counted as a forfeit and it only lost 6 games.