[thelamest]

>This makes me think that our formal [definitions] of "intelligence" […] and what we intuitively look out for, are really two different things.

Just two? You can name so many more terms in this concept cloud, e.g.: personhood, moral agency, consciousness, self-awareness, processing power, wit, autonomy, feeling-and-experiencing capacity, and so on… We don’t seem to agree on what’s separate from what, and yes, it would be useful.