[aurareturn]

1. When do you want to wash your car? Tomorrow? Next year? In 50 years?

2. Where is the car now? Is it already at the car wash waiting for you to arrive?

I can see why an LLM might miss this. I think any good software engineer would ask clarifying questions before giving an answer.

The next step for an LLM is to either ask questions before giving a definitive answer for uncertain things or to provide multiple answers addressing the uncertainty.

[kklisura]

3. Is the car broken somewhere? Does it have wheels on?

4. Does the car have enough fuel?

Jokes asides, all of those questions are unnecessary. There's no more context to this.

[aurareturn]

If you ask a human that in person, they'd wonder why you'd ask such as stupid question.

I think LLMs should ask clarifying questions if it thinks it's a trick question.