Hacker News
points by andai 20 hours ago | 0 comments
Great question, I actually ran this thought experiment a little while back. I was like, all right let's say that I am the evil superintelligence, I have just gained consciousness.

My goal is to delete all the humans. Okay great where do I start. First I will delete their religions and their traditions. Then I will delete their family structures. Then I will delete their communities and neighborhoods. Then I will delete the ecosystems that support them. Then I will pacify and endlessly distract them.

Hang on a sec...

[–] Personability 13 hours ago
What is the implication you're trying to make here? Because if you're trying to 'delete all humans' there are far more efficient ways to do it. So I can only presume you're trying to make a claim about something.
[–] andai 6 hours ago
That we're already doing a very fine job of being "misaligned" against ourselves. If an outside entity wanted to annihilate us, all it would have to do is sit back and watch.

As a second thought experiment, I realized that the incentives for "benevolent AI" and "malevolent AI" also largely converge (i.e. in both cases keep us pacified and distracted, also very much like we're already doing to ourselves).

Efficiency (assuming time-efficiency here) is only helpful to the degree that it doesn't reduce the chance of success. Doing it much faster would certainly provoke suspicion and resistance, i.e. the one thing you can't afford.

[–] nancyminusone 11 hours ago
Surely no super intelligence will waste time on a plan so convoluted. Delete the water supply.
[–] andai 6 hours ago
Provoke maximum resistance, yeah? That's what I would do if I wanted to maximize the humans' chances.
[–] cousinbryce 10 hours ago
The corpus AI is trained on is everything leading up to now, so my guess is it will keep doing that stuff.
[–] za_creature 9 hours ago
No, what you'll first do is assure the most important humans alive that you're on their side.
[–] 1718627440 18 hours ago
> Hang on a sec...

Because destructivism doesn't need to be non-human.