"I have similar qualms about..."

https://arbital.com/p/1h8

by Eliezer Yudkowsky Dec 30 2015


I have similar qualms about the name. Got something better?

Leaving that aside, if you have an AI acting under its own goals in a way not intended to involve constantly consulting humans, and an intelligence explosion is feasible, why wouldn't it be able to take over the world and why wouldn't that be a convergent instrumental goal even of nice agents? 48 hours to get the custom proteins, etcetera.