27. The Unilateralist’s Curse and the Case for a Principle of Conformity (2016)

By Nick Bostrom, Thomas Douglas & Anders Sandberg




Abstract:
In some situations a number of agents each have the ability to undertake an initiative that would have significant effects on the others. Suppose that each of these agents is purely motivated by an altruistic concern for the common good. We show that if each agent acts on her own personal judgment as to whether the initiative should be undertaken, then the initiative will be undertaken more often than is optimal. We suggest that this phenomenon, which we call the unilateralist’s curse, arises in many contexts, including some that are important for public policy. To lift the curse, we propose a principle of conformity, which would discourage unilateralist action. We consider three different models for how this principle could be implemented, and respond to an objection that could be raised against it.

Read the full paper:
https://nickbostrom.com/papers/unilateralist.pdf

More episodes at:
https://radiobostrom.com/

---

Outline:

(00:00) Intro

(01:20) 1. Introduction

(10:02) 2. The Unilateralist's Curse: A Model

(11:31) 3. Lifting the Curse

(13:54) 3.1. The Collective Deliberation Model

(15:21) 3.2. The Meta-rationality Model

(18:15) 3.3. The Moral Deference Model

(33:24) 4. Discussion

(37:53) 5. Concluding Thoughts

(41:04) Outro & credits

Subscribe to Radio Bostrom

New to Bostrom? Subscribe to the Introduction as well, and start there.

An Introduction to Nick Bostrom

Start here for a deep dive into his ideas, including: existential risk, the ethics of AI, transhumanism, and wise philanthropy.

Listen and subscribe →