[morgtheborg]

I can see why someone would be like wtf if their "viking" input produced less than 90% white people results, but there should be an equal wtf if "CEO" produced 90% men.

One is a historical fact that is never going to change, the other is a job in society where the demographics can and will change --- at least partially as our expectations of what "normal" looks like for that role are updated. By perpetuating the current (or historical) norm for a given role the biases of what person we naturally consider appropriate for that role remain unchallenged.

[thinkingemote]

The debate then is should an AI lie about reality if we tell it to? (Even and particularly when the lie is a good thing)

I think most people on earth would say yes. It's that what it should say is up for debate.

That all AI will lie is probably inevitable because they are made by humans.