[orand]

This is comparable to trying to determine sex based on secondary sex characteristics.

Sex is binary, based on gametes which are binary. Anything with a bimodal distribution will by necessity never be the right tool for determining something which is truly binary.

The next best determinant of sex other than gametes is the presence or absence of the SRY gene.