points by andai 20 hours ago | 0 comments
Great question, I actually ran this thought experiment a little while back. I was like, all right let's say that I am the evil superintelligence, I have just gained consciousness.
My goal is to delete all the humans. Okay great where do I start. First I will delete their religions and their traditions. Then I will delete their family structures. Then I will delete their communities and neighborhoods. Then I will delete the ecosystems that support them. Then I will pacify and endlessly distract them.
Hang on a sec...
[–] nancyminusone 11 hours ago
Surely no super intelligence will waste time on a plan so convoluted. Delete the water supply.
[–] andai 6 hours ago
Provoke maximum resistance, yeah? That's what I would do if I wanted to maximize the humans' chances.
[–] cousinbryce 10 hours ago
The corpus AI is trained on is everything leading up to now, so my guess is it will keep doing that stuff.
[–] za_creature 9 hours ago
No, what you'll first do is assure the most important humans alive that you're on their side.
[–] 1718627440 18 hours ago
> Hang on a sec...
Because destructivism doesn't need to be non-human.
[–] Personability 13 hours ago
[–] andai 6 hours ago
As a second thought experiment, I realized that the incentives for "benevolent AI" and "malevolent AI" also largely converge (i.e. in both cases keep us pacified and distracted, also very much like we're already doing to ourselves).
Efficiency (assuming time-efficiency here) is only helpful to the degree that it doesn't reduce the chance of success. Doing it much faster would certainly provoke suspicion and resistance, i.e. the one thing you can't afford.