[pvab3]

because it doesn't have any skin in the game and can't be punished, and can't be rewarded for succeeding. Its reputation, career, and dignity are nonexistent.

[taylorius]

On the contrary - the LLM has had it's own version of "skin in the game" through the whole of it's training. Reinforcement learning is nothing but that. Why is that less real than putting a person in prison. Is it because of the LLM itself, or because you don't trust the people selling it to you?

[oblio]

Are you claiming that LLMs are... sentient? Bold claim, Taylor.

[direwolf20]

This doesn't seem to have stopped anyone before.

[pvab3]

Stopped anyone from doing what? Assigning responsibility to someone with nothing to lose, no dignity or pride, and immune from financial or social injury?