[Varyag]

There have been quite a few posts on here about how AGI is still really far away. I wouldn't put all your hopes on our machine descendant species appearing this century. Nevertheless this is touched on in the linked document; indeed there's an entire section on it.

[catchclose8919]

It's... unpredictably far away! We suck so bad at estimating these kinds of things, that whether it's tomorrow or 500 years from now, I'm convinced we'll be totally surprised, unprepared, and our nor even sincere effort to stear things down a good path (eg. OpenAI and such...) will be either worthless or detrimental!

We should simply pursue "organic growth" eg. grow as much people as we can care for and educate properly. Unfortunately our elites seem really hell bent of keeping the social landscape hyperconpetitive so the resources we have don't really get distributed... and as a consequence of course (rational) pople have fewer children! Also there's an intellectual war fought on "traditional values" that enabled stuff like extended famimlies to exist and make child rearing at least bearable by sharing the load of caring for the nasty little critters.

[sim1collins]

"Unpredictably far away"—nice way of putting it.

Whether we "need" humans depends on where one's values are; for those who would like humans in some form to continue to exist, the idea of AGI making humans obsolete isn't terribly comforting. Even those who might really like the idea of humans sort of evolving into AI (and eventually ceasing to biologically exist) might not be keen to rush toward human obsolescence if they're not thrilled with initial versions of AGI (diversity and optionality is nice).

[qualudeheart]

Human underpopulation as an existential threat is also extremely far away. Ok, less people means a weaker economy. It still won’t be as bad as an event like World War II which killed tens of millions but that humanity still recovered from. I actually want longer AGI timelines because I don’t trust AGI to share my values.

Thanks for recommending the at section of the document. I’ll take a peak at it. I’m not really worried about yhe birthraye decline case because I think there would be subgroups of humanity with higher birthrates. Both small communities like the Amish and large communities like Nigerians still have birth rates well above replacement level. Africa is industrializing fast and could become an industrial powerhouse like China, if automation doesn’t remove the competitive advantage that high population otherwise would give them. Many African countries GDPs are growing at 10% every year.

This comment of mine goes a little off topic but I think the stuff I’m addressing is interesting and important for predicting the future.