9. The Ethics of Artificial Intelligence (2011)

By Nick Bostrom and Eliezer Yudkowsky




Abstract:
The possibility of creating thinking machines raises a host of ethical issues. These questions relate both to ensuring that such machines do not harm humans and other morally relevant beings, and to the moral status of the machines themselves. The first section discusses issues that may arise in the near future of AI. The second section outlines challenges for ensuring that AI operates safely as it approaches humans in its intelligence. The third section outlines how we might assess whether, and in what circumstances, AIs themselves have moral status. In the fourth section, we consider how AIs might differ from humans in certain basic respects relevant to our ethical assessment of them. The final section addresses the issues of creating AIs more intelligent than human, and ensuring that they use their advanced intelligence for good rather than ill.

Read the full paper:
https://nickbostrom.com/ethics/artificial-intelligence.pdf

More episodes at:
https://radiobostrom.com/

---

Outline:

(01:19) Ethics in Machine Learning and Other Domain‐Specific AI Algorithms

(07:23) Artificial General Intelligence

(17:01) Machines with Moral Status

(28:32) Minds with Exotic Properties

(42:45) Superintelligence

(56:39) Conclusion

(57:59) Author biographies

Subscribe to Radio Bostrom

New to Bostrom? Subscribe to the Introduction as well, and start there.

An Introduction to Nick Bostrom

Start here for a deep dive into his ideas, including: existential risk, the ethics of AI, transhumanism, and wise philanthropy.

Listen and subscribe →