[drno123]

Still gives incorrect code to the following prompt - the description is correct but not the code. I have yet to find one LLM that gives the correct code. This is the prompt:

“Write C code to calculate the sum of matrix elements below the secondary diagonal.“

[Sebguer]

This feels as much likely to be a prompt problem as a 'bad answer from a model' problem.

[sebzim4500]

I wouldn't know what "secondary diagonal" refers to myself, but if the model correctly describes the problem and then follows it up with incorrect code I would still say that's an issue with the model not the prompt.