AI getting smarter does not automatically make it uncontrollable. The real question is what we give that intelligence access to. Give a model enough permissions, persistence, resources, copies and coordination, and its mistakes can compound into real-world power. The good news? Those layers are ours to design.

… Most people assume that intelligence, pushed far enough, naturally turns into uncontrollability, and that the smarter the mind, the less any fence can hold it.

I think that assumption is wrong. I don’t think AI is on an inevitable path to killing us all.

My rationale has nothing to do with the technology being harmless. My reason is that we have misunderstood where an AI system’s power comes from and what we can do about it — Read More