Entries by

Can We Properly Prepare for the Risks of Superintelligent AI?

Risks Principle: Risks posed by AI systems, especially catastrophic or existential risks, must be subject to planning and mitigation efforts commensurate with their expected impact. We don’t know what the future of artificial intelligence will look like. Though some may make educated guesses, the future is unclear. AI could keep developing like all other technologies,

Artificial Intelligence and Income Inequality

Click here to see this page in other languages: Chinese   Shared Prosperity Principle: The economic prosperity created by AI should be shared broadly, to benefit all of humanity. Income inequality is a well recognized problem. The gap between the rich and poor has grown over the last few decades, but it became increasingly pronounced after the

Is an AI Arms Race Inevitable?

Click here to see this page in other languages:  Russian  AI Arms Race Principle: An arms race in lethal autonomous weapons should be avoided.* Perhaps the scariest aspect of the Cold War was the nuclear arms race. At its peak, the US and Russia held over 70,000 nuclear weapons, only a fraction of which could

Preparing for the Biggest Change in Human History

Click here to see this page in other languages: Chinese   Importance Principle: Advanced AI could represent a profound change in the history of life on Earth, and should be planned for and managed with commensurate care and resources. In the history of human progress, a few events have stood out as especially revolutionary: the intentional

Bart Selman Interview

The following is an interview with Bart Selman about the Beneficial AI 2017 conference and The Asilomar Principles that it produced. Selman is a Professor of Computer Science at Cornell University, a Fellow of the American Association for Artificial Intelligence (AAAI) and a Fellow of the American Association for the Advancement of Science (AAAS). Q: From

How Smart Can AI Get?

Click here to see this page in other languages : Chinese    Russian  Capability Caution Principle: There being no consensus, we should avoid strong assumptions regarding upper limits on future AI capabilities. A major change is coming, over unknown timescales but across every segment of society, and the people playing a part in that transition have

MIRI February 2017 Newsletter

Following up on a post outlining some of the reasons MIRI researchers and OpenAI researcher Paul Christiano are pursuing different research directions, Jessica Taylor has written up the key motivations for MIRI’s highly reliable agent design research. Research updates A new paper: “Toward Negotiable Reinforcement Learning: Shifting Priorities in Pareto Optimal Sequential Decision-Making“ New at

Can We Ensure Privacy in the Era of Big Data?

Personal Privacy Principle: People should have the right to access, manage and control the data they generate, given AI systems’ power to analyze and utilize that data. A major change is coming, over unknown timescales but across every segment of society, and the people playing a part in that transition have a huge responsibility and

How Do We Align Artificial Intelligence with Human Values?

Click here to see this page in other languages: Chinese    German Japanese     Russian  A major change is coming, over unknown timescales but across every segment of society, and the people playing a part in that transition have a huge responsibility and opportunity to shape it for the best. What will trigger this change? Artificial intelligence. Recently,

Dan Weld Interview

The following is an interview with Dan Weld about the Beneficial AI 2017 conference and The Asilomar Principles that it produced. Weld is Professor of Computer Science & Engineering and Entrepreneurial Faculty Fellow at the University of Washington. Q: From your perspective what were the highlights of the conference? “One of the highlights was having

Toby Walsh Interview

The following is an interview with Toby Walsh about the Beneficial AI 2017 conference and The Asilomar Principles that it produced. Walsh is Guest Professor at Technical University of Berlin, Professor of Artificial Intelligence at the University of New South Wales, and leads the Algorithmic Decision Theory group at Data61, Australia’s Centre of Excellence for

Stefano Ermon Interview

The following is an interview with Stefano Ermon about the Beneficial AI 2017 conference and The Asilomar Principles that it produced. Ermon is an Assistant Professor in the Department of Computer Science at Stanford University, where he is affiliated with the Artificial Intelligence Laboratory. Q: From your perspective what were highlights of the conference? “I

Kay Firth-Butterfield Interview

The following is an interview with Kay Firth-Butterfield about the Beneficial AI 2017 conference and The Asilomar Principles that it produced. Firth-Butterfield is the Executive Director of AI-Austin.org, and an adjunct Professor of Law at the University of Texas at Austin. Q. From your perspective what were the highlights of the conference? “The opportunity to

Francesca Rossi Interview

The following is an interview with Francesca Rossi about the Beneficial AI 2017 conference and The Asilomar Principles that it produced. Rossi is a research scientist at the IBM T.J. Watson Research Centre, and a professor of computer science at the University of Padova, Italy, currently on leave. Q: From your perspective, what were the

Roman Yampolskiy Interview

The following is an interview with Roman Yampolskiy about the Beneficial AI 2017 conference and The Asilomar Principles that it produced. Yampolskiy is an Associate Professor of Computer Engineering & Computer Science at the University of Louisville and the Founding Director of the Cyber Security Lab. Q. From your perspective what were the highlights of

Guruduth Banavar Interview

The following is an interview with Guruduth Banavar about the Beneficial AI 2017 conference and The Asilomar Principles that it produced. Banavar works for IBM as the VP of IBM Research and the Chief Science Officer of Cognitive Computing. Q. From your perspective what were the highlights of the conference? “Absolutely the best thing was

Yoshua Bengio Interview

The following is an interview with Yoshua Bengio about the Beneficial AI 2017 conference and The Asilomar Principles that it produced. Bengio is a Professor of Computer Science and Operations Research at the University of Montreal and Head of the Montreal Institute for Learning Algorithms (MILA). Q. From your perspective what were the highlights of

Anca Dragan Interview

The following is an interview with Anca Dragan about the Beneficial AI 2017 conference and The Asilomar Principles that it produced. Dragan is an Assistant Professor in the Electrical Engineering & Computer Sciences Department at UC Berkeley and co-PI for the Center for Human Compatible AI. Q. From your perspective what were the highlights of