Entries by Ariel Conn

Can We Properly Prepare for the Risks of Superintelligent AI?

Risks Principle: Risks posed by AI systems, especially catastrophic or existential risks, must be subject to planning and mitigation efforts commensurate with their expected impact. We don’t know what the future of artificial intelligence will look like. Though some may make educated guesses, the future is unclear. AI could keep developing like all other technologies, […]

Artificial Intelligence and Income Inequality

Shared Prosperity Principle: The economic prosperity created by AI should be shared broadly, to benefit all of humanity. Income inequality is a well recognized problem. The gap between the rich and poor has grown over the last few decades, but it became increasingly pronounced after the 2008 financial crisis. While economists debate the extent to […]

Is an AI Arms Race Inevitable?

AI Arms Race Principle: An arms race in lethal autonomous weapons should be avoided.* Perhaps the scariest aspect of the Cold War was the nuclear arms race. At its peak, the US and Russia held over 70,000 nuclear weapons, only a fraction of which could have killed every person on earth. As the race to […]

Podcast: UN Nuclear Weapons Ban with Beatrice Fihn and Susi Snyder

Last October, the United Nations passed a historic resolution to begin negotiations on a treaty to ban nuclear weapons. Previous nuclear treaties have included the Test Ban Treaty, and the Non-Proliferation Treaty. But in the 70 plus years of the United Nations, the countries have yet to agree on a treaty to completely ban nuclear […]

Transcript: UN Nuclear Weapons Ban with Beatrice Fihn and Susi Snyder

ARIEL: I’m Ariel Conn with the Future of Life Institute. Last October, the United Nations passed a historic resolution to begin negotiations on a treaty to ban nuclear weapons. Previous nuclear treaties have included the Test Ban Treaty, and the Non-Proliferation Treaty. But in the 70 plus years of the United Nations, the countries have […]

Preparing for the Biggest Change in Human History

Importance Principle: Advanced AI could represent a profound change in the history of life on Earth, and should be planned for and managed with commensurate care and resources. In the history of human progress, a few events have stood out as especially revolutionary: the intentional use of fire, the invention of agriculture, the industrial revolution, […]

Bart Selman Interview

The following is an interview with Bart Selman about the Beneficial AI 2017 conference and The Asilomar Principles that it produced. Selman is a Professor of Computer Science at Cornell University, a Fellow of the American Association for Artificial Intelligence (AAAI) and a Fellow of the American Association for the Advancement of Science (AAAS). Q: From […]

How Smart Can AI Get?

Capability Caution Principle: There being no consensus, we should avoid strong assumptions regarding upper limits on future AI capabilities. A major change is coming, over unknown timescales but across every segment of society, and the people playing a part in that transition have a huge responsibility and opportunity to shape it for the best. What […]

MIRI February 2017 Newsletter

Following up on a post outlining some of the reasons MIRI researchers and OpenAI researcher Paul Christiano are pursuing different research directions, Jessica Taylor has written up the key motivations for MIRI’s highly reliable agent design research. Research updates A new paper: “Toward Negotiable Reinforcement Learning: Shifting Priorities in Pareto Optimal Sequential Decision-Making“ New at […]

Can We Ensure Privacy in the Era of Big Data?

Personal Privacy Principle: People should have the right to access, manage and control the data they generate, given AI systems’ power to analyze and utilize that data. A major change is coming, over unknown timescales but across every segment of society, and the people playing a part in that transition have a huge responsibility and […]

Podcast: Top AI Breakthroughs, with Ian Goodfellow and Richard Mallah

2016 saw some significant AI developments. To talk about the AI progress of the last year, we turned to Richard Mallah and Ian Goodfellow. Richard is the director of AI projects at FLI, he’s the Senior Advisor to multiple AI companies, and he created the highest-rated enterprise text analytics platform. Ian is a research scientist […]

Transcript: AI Breakthroughs with Ian Goodfellow and Richard Mallah

[beginning of recorded material] Ariel: I’m Ariel Conn with the Future of Life Institute. If you’ve been following FLI at all, you know that we’re both very concerned but also very excited about the potential impact artificial intelligence will have on our future. Naturally, we’ve been following the big breakthroughs that occur in the field […]

Dan Weld Interview

The following is an interview with Dan Weld about the Beneficial AI 2017 conference and The Asilomar Principles that it produced. Weld is Professor of Computer Science & Engineering and Entrepreneurial Faculty Fellow at the University of Washington. Q: From your perspective what were the highlights of the conference? “One of the highlights was having […]

Toby Walsh Interview

The following is an interview with Toby Walsh about the Beneficial AI 2017 conference and The Asilomar Principles that it produced. Walsh is Guest Professor at Technical University of Berlin, Professor of Artificial Intelligence at the University of New South Wales, and leads the Algorithmic Decision Theory group at Data61, Australia’s Centre of Excellence for […]

Stefano Ermon Interview

The following is an interview with Stefano Ermon about the Beneficial AI 2017 conference and The Asilomar Principles that it produced. Ermon is an Assistant Professor in the Department of Computer Science at Stanford University, where he is affiliated with the Artificial Intelligence Laboratory. Q: From your perspective what were highlights of the conference? “I […]

Kay Firth-Butterfield Interview

The following is an interview with Kay Firth-Butterfield about the Beneficial AI 2017 conference and The Asilomar Principles that it produced. Firth-Butterfield is the Executive Director of AI-Austin.org, and an adjunct Professor of Law at the University of Texas at Austin. Q. From your perspective what were the highlights of the conference? “The opportunity to […]

Francesca Rossi Interview

The following is an interview with Francesca Rossi about the Beneficial AI 2017 conference and The Asilomar Principles that it produced. Rossi is a research scientist at the IBM T.J. Watson Research Centre, and a professor of computer science at the University of Padova, Italy, currently on leave. Q: From your perspective, what were the […]

Roman Yampolskiy Interview

The following is an interview with Roman Yampolskiy about the Beneficial AI 2017 conference and The Asilomar Principles that it produced. Yampolskiy is an Associate Professor of Computer Engineering & Computer Science at the University of Louisville and the Founding Director of the Cyber Security Lab. Q. From your perspective what were the highlights of […]

Guruduth Banavar Interview

The following is an interview with Guruduth Banavar about the Beneficial AI 2017 conference and The Asilomar Principles that it produced. Banavar works for IBM as the VP of IBM Research and the Chief Science Officer of Cognitive Computing. Q. From your perspective what were the highlights of the conference? “Absolutely the best thing was […]