[oxalo]

I'd like to see the data on this, or a variation.

First variation is with the candidates ability to solve the problem. Like you said, Microsoft and Google seem to have determined there's no correlation between that and job performance.

Second variation is with a panel of interviewers who propose the problem. Based on how the candidate responds, the panel chooses whether to 'hire' the candidate, based on their ability to reason about the problem and communicate, rather than on their ability to solve it.

I wonder if there's a correlation between the yes/no of the interviewers and the candidate's job performance.