Guide to Logical Decision Theory

https://arbital.com/p/ldt_guide

by Eliezer Yudkowsky Jul 8 2016 updated Jul 8 2016

The entry point for learning about logical decision theory.


"Logical decision theory" is a new family of decision theories, of varying levels of formalization, which are argued to have key implications for theories of economic rationality, the design of sufficiently advanced machine intelligence algorithms, and of course the philosophy of rational decision. Logical decision theories impinge on whether it's rational to vote in elections, or rational to give in to blackmail, or how computational agents should play in dilemmas if the agents have common knowledge of each others' source code.

The new idea in logical decision theories can glossed as "choose as though you were choosing the logical output of your decision algorithm".

Before continuing, please help this page adapt to you by telling it a couple of things about yourself!

[multiple-choice(q_dt_background): What's your primary background with respect to decision theory? How should we initially approach this subject? a: An economic standpoint. Please start by telling me how this is relevant to economically rational agents deciding whether to vote in elections. knows: [dt_economics] wants: [dt_economics_intro] -wants: [dt_compsci_intro], [dt_newcomblike_intro], [dt_normal_intro], [dt_altruist_intro] b: A computer science or Artificial Intelligence standpoint. Start by talking to me about programs and code. knows: [dt_compsci] wants: [dt_compsci_intro] -wants: [dt_economics_intro], [dt_newcomblike_intro], [dt_normal_intro], [dt_altruist_intro] c: The standpoint of analytic philosophy. Talk to me about Newcomblike problems and why this new decision theory is better than a dozen other contenders. knows: [dt_philosophy] wants: [dt_newcomblike_intro] -wants: [dt_compsci_intro], [dt_newcomblike_intro], [dt_normal_intro], [dt_altruist_intro] d: I'm just somebody off the Internet. Can you explain to me from scratch what's going on? wants: [dt_normal_intro] -wants: [dt_economics_intro], [dt_compsci_intro], [dt_newcomblike_intro], [dt_altruist_intro] e: I'm an effective altruist or philanthropic grantmaker. I'm mainly wondering how this mysterious work relates to humanity's big picture and why it was worth whatever funding it received. wants: [dt_altruist_intro] -wants: [dt_economics_intro], [dt_compsci_intro], [dt_newcomblike_intro], [dt_normal_intro] ]

[multiple-choice(q_dt_math): What level of math should we throw at you? a: As little math as possible, please. -knows: [1r5], Math 2, Math 3 b: Normal algebra is fine. Please be careful about how you toss around large formulas full of Greek letters. knows: Math 1, Ability to read algebra -knows: Math 3 c: I'm confident in my ability to deal with formulas, and you can go through them quickly. knows: Math 1, Math 2, Ability to read algebra ]

%%knows-requisite([dt_philosophy]): [multiple-choice(q_dt_newcomblike): How much of the prior debate on decision theory are you familiar with? a: None, I just have a general background in analytic philosophy. -knows: [dt_prisonersdilemma], [dt_newcomb], [dt_newcomblike] b: I'm familiar with the Prisoner's Dilemma. knows: [dt_prisonersdilemma] -knows: [dt_newcomb], [dt_newcomblike] c: I'm familiar with Newcomb's Problem and I understand its relation to the Prisoner's Dilemma. knows: [dt_prisonersdilemma], [dt_newcomb] -knows: [dt_newcomblike] d: I'm familiar with a significant portion of the prior debate on causal decision theory versus evidential decision theory. knows: [dt_prisonersdilemma], [dt_newcomb], [dt_newcomblike] ] %%

%%knows-requisite([dt_compsci]): [multiple-choice(q_dt_compsci): Are you already familiar with game theory and the Prisoner's Dilemma? a: Nope. -knows: [dt_prisonersdilemma], [dt_gametheory] b: I'm familiar with the Prisoner's Dilemma. knows: [dt_prisonersdilemma] -knows: [dt_gametheory] c: I'm familiar with Nash equilibria. knows: [dt_prisonersdilemma], [dt_gametheory] ] %%

%%knows-requisite([dt_economics]): [multiple-choice(q_dt_compsci): Are you already familiar with game theory and the Prisoner's Dilemma? a: Nope. -knows: [dt_prisonersdilemma], [dt_gametheory] b: I'm familiar with the Prisoner's Dilemma. knows: [dt_prisonersdilemma] -knows: [dt_gametheory] c: I understand Nash equilibria and Pareto optima, and how the Prisoner's Dilemma contrasts them. knows: [dt_prisonersdilemma], [dt_gametheory] ] %%