[cecilpl2]

I tried several times to play chess against it. It made reasonable if poor moves for the first 10 moves of the game. It also gave plausible-sounding if entirely incorrect explanations of why the moves were good, such as "I'm playing Nf6-g8, which is a good move because it defends my pawn on f7 [it doesn't] and controls the center, allowing me to set up an attack on your king".

At some point though, it always got stuck and insisted on making illegal moves, even when I corrected it by providing the current board position in FEN.

[Calzifer]

I'm not a chess expert but I would expect there is a lot of information available about chess openings but not so much about midgame (it sometimes appears as if you just play a bunch of standard moves before the actual game begins).

One source even mentions that a chess opening consists of 10 to 15 moves which would match your observation that the AI gets worse after that.

Maybe the AI would appear more competent again in the endgame since I assume there is more training material for that again.

A bit surprising that it provides illegal moves since it should have enough training material not "understand" the rules but apparently prefers to produce sentences which appear like chess moves from the training material without any connection to the rules.

[sireat]

ChatGPT has no knowledge on how to play chess. It can't even get the basics of openings or even colors right.

Prompt: What are the moves that characterize Latvian Gambit in chess?

ChatGPT response:

  The Latvian Gambit is characterized by the following opening moves:

  White moves the pawn in front of their king two squares forward, from e2 to e4. This is the pawn sacrifice that gives the opening its name.

  Black responds by moving their pawn in front of their king two squares forward as well, from e7 to e5. This move is known as the "gambit pawn" because Black is offering a pawn to White in exchange for a lead in development and control of the center of the board.

  White follows up with the development of their light-squared bishop, moving it from f1 to b5. This move attacks Black's gambit pawn and puts additional pressure on Black's position.

  Black can respond to this move in a variety of ways, depending on their playing style and preferences. Some possible options include moving their knight from g8 to f6 (defending the gambit pawn and preparing for a counter-attack), moving their knight from b8 to c6 (developing a piece and preparing to castle), or moving their f-pawn from f7 to f5 (solidifying their control of the center of the board).

  These are the moves that typically characterize the Latvian Gambit in chess. It's important to note, however, that not all games that begin with these moves will necessarily follow the same path, and the specific sequence of moves can vary depending on the choices made by the players.

PSS For the record all of the above is hilariously wrong and obvious to most chess players :) The real Latvian gambit is 1. e4 e5 2.Nf3 f5 (and only f5 is sacrificing the pawn).