AI ALIGNMENT FORUM
AF

Wikitags

Functional Decision Theory

Written by Yoav Ravid, Heighn, Mikhail Samin, et al. last updated 21st Mar 2025

Functional Decision Theory is a described by Eliezer Yudkowsky and Nate Soares which says that agents should treat one’s decision as the output of a fixed mathematical function that answers the question, “Which output of this very function would yield the best outcome?”. It is a replacement of , and it outperforms other decision theories such as (CDT) and (EDT). For example, it does better than CDT on , better than EDT on the , and better than both in .

In Newcomb's Problem, an FDT agent reasons that Omega must have used some kind of model of her decision procedure in order to make an accurate prediction of her behavior. Omega's model and the agent are therefore both calculating the same function (the agent's decision procedure): they are subjunctively dependent on that function. Given perfect prediction by Omega, there are therefore only two outcomes in Newcomb's Problem: either the agent one-boxes and Omega predicted it (because its model also one-boxed), or the agent two-boxes and Omega predicted that. Because one-boxing then results in a million and two-boxing only in a thousand dollars, the FDT agent one-boxes.

External links:

  • Functional decision theory: A new theory of instrumental rationality
  • Cheating Death in Damascus
  • Decisions are for making bad outcomes inconsistent
  • On Functional Decision Theory by Wolfgang Schwarz

See Also:

Subscribe
1
Subscribe
1
Timeless Decision Theory
Timeless Decision Theory
Parfit’s hitchhiker problem
Superrationality
Causal Decision Theory
decision theory
smoking lesion problem
Updateless Decision Theory
Evidential Decision Theory
Newcomb's Problem
Posts tagged Functional Decision Theory
21MIRI/OP exchange about decision theory
Rob Bensinger
4y
5
30A Critique of Functional Decision Theory
wdmacaskill
6y
26
17AXRP Episode 5 - Infra-Bayesianism with Vanessa Kosoy
DanielFilan
4y
2
11Let's Discuss Functional Decision Theory
Chris_Leong
7y
0
6Deconfusing Logical Counterfactuals
Chris_Leong
6y
0
Add Posts
An Introduction to Logical Decision Theory for Everyone Else
Introduction to Logical Decision Theory for Computer Scientists
Introduction to Logical Decision Theory for Analytic Philosophers
Introduction to Logical Decision Theory for Economists
Discussion0
Discussion0