Skip to content

What happens when our computers get smarter than we are?

Published:
May 26, 2015
Author:
Peter Haas

Contents

The author of Superintelligence: Paths, Dangers, Strategies ,Nick Bostrom gave a talk at TED 2015 about artificial superintelligence (ASI):

“What happens when our computers get smarter than we are?”

From his polls of researchers he posits we will hit ASI by 2040 or 2050, this may be a dramatic change. To quote Nick:

“Now most people, when they think about what is smart and what is dumb, I think have in mind a picture roughly like this. So at one end we have the village idiot, and then far over at the other side we have Ed Witten, or Albert Einstein, or whoever your favorite guru is. But I think that from the point of view of artificial intelligence, the true picture is actually probably more like this: AI starts out at this point here, at zero intelligence, and then, after many, many years of really hard work, maybe eventually we get to mouse-level artificial intelligence, something that can navigate cluttered environments as well as a mouse can. And then, after many, many more years of really hard work, lots of investment, maybe eventually we get to chimpanzee-level artificial intelligence. And then, after even more years of really, really hard work, we get to village idiot artificial intelligence. And a few moments later, we are beyond Ed Witten. The train doesn’t stop at Humanville Station. It’s likely, rather, to swoosh right by.”

For those who are unfamiliar with the subject he breaks the problem down in a very straightforward fashion. He lays out many of the concerns about diverging interests with the human race, and limitations in our ability to control an ASI once it has been developed. His final prescription in the talk is an optimistic one, but looking at human advances weaponizing code in the past few years, it may fall short of assuaging concerns. It is definitely worth a look, over at ted.com

This content was first published at futureoflife.org on May 26, 2015.

About the Future of Life Institute

The Future of Life Institute (FLI) is a global non-profit with a team of 20+ full-time staff operating across the US and Europe. FLI has been working to steer the development of transformative technologies towards benefitting life and away from extreme large-scale risks since its founding in 2014. Find out more about our mission or explore our work.

Our content

Related content

Other posts about 

If you enjoyed this content, you also might also be interested in:

The Pause Letter: One year later

It has been one year since our 'Pause AI' open letter sparked a global debate on whether we should temporarily halt giant AI experiments.
March 22, 2024

Catastrophic AI Scenarios

Concrete examples of how AI could go wrong
February 1, 2024

Gradual AI Disempowerment

Could an AI takeover happen gradually?
February 1, 2024

Sign up for the Future of Life Institute newsletter

Join 40,000+ others receiving periodic updates on our work and cause areas.
cloudmagnifiercrossarrow-up linkedin facebook pinterest youtube rss twitter instagram facebook-blank rss-blank linkedin-blank pinterest youtube twitter instagram