12. Crucial Considerations and Wise Philanthropy (2014)

By Nick Bostrom

Within a utilitarian context, one can perhaps try to explicate [crucial considerations] as follows: a crucial consideration is a consideration that radically changes the expected value of pursuing some high-level subgoal. The idea here is that you have some evaluation standard that is fixed, and you form some overall plan to achieve some high-level subgoal. This is your idea of how to maximize this evaluation standard. A crucial consideration, then, would be a consideration that radically changes the expected value of achieving this subgoal, and we will see some examples of this. Now if you stop limiting your view to some utilitarian context, then you might want to retreat to these earlier more informal formulations, because one of the things that could be questioned is utilitarianism itself. But for most of this talk we will be thinking about that component.

Read the full paper:

More episodes at:



(00:14) What is a crucial consideration?

(04:27) Should I vote in the national election?

(08:18) Should we favor more funding for x-risk tech research?

(14:32) Crucial considerations and utilitarianism

(18:52) Evaluation Functions

(19:03) Some tentative signposts

(20:35) (Text resumes)

(27:28) Possible areas with additional crucial considerations

(30:03) Some partial remedies

Subscribe to Radio Bostrom

New to Bostrom? Subscribe to the Introduction as well, and start there.

An Introduction to Nick Bostrom

Start here for a deep dive into his ideas, including: existential risk, the ethics of AI, transhumanism, and wise philanthropy.

Listen and subscribe →