[rbavocadotree]

It's funny reading all the debate about different wordings because it totally misses the point. The wording doesn't matter, only the delivery does. The recipients's interpretation of the question depends on who is saying it and how they say it. Whether or not they include the word "just" is irrelevant. Any single one of the phrases mentioned can be delivered in a way that causes offense or doesn't.

[sampleinajar]

Came here to say a similar thing. The reaction can say a lot about the person's opinion/impression of you. It might be too much to try to correct for other people's insecurities; however, if you find that a large portion of people get upset by your phrasing, then it might be worth it to consider how you present yourself in general to others. It might just be you.

[lukevdp]

Totally agree. Words only make up part of communication. There are >300 comments on this thread because everyone has their own way of saying this phrase based on how they would be received if they said it at their workplace.