Prior probability

https://arbital.com/p/prior_probability

by Eliezer Yudkowsky Jan 27 2016 updated Aug 4 2016

What we believed before seeing the evidence.


"Prior probability", "prior odds", or just "prior" refers to a state of belief that obtained before seeing a piece of new evidence. Suppose there are two suspects in a murder, Colonel Mustard and Miss Scarlet. After determining that the victim was poisoned, you think Mustard and Scarlet are respectively 25% and 75% likely to have committed the murder. Before determining that the victim was poisoned, perhaps, you thought Mustard and Scarlet were equally likely to have committed the murder (50% and 50%). In this case, your "prior probability" of Miss Scarlet committing the murder was 50%, and your "posterior probability" after seeing the evidence was 75%.

The prior probability of a hypothesis is often being written with the unconditioned notation , while the posterior after seeing the evidence is often being denoted by the conditional probability %%note: E. T. Jaynes was known to insist on using the explicit notation to denote the prior probability of , with denoting the prior, and never trying to write any entirely unconditional probability . Since, said Jaynes, we always have some prior information.%% %%knows-requisite(Math 2): This however is a heuristic rather than a law, and might be false inside some complicated problems. If we've already seen and are now updating on , then in this new problem the new prior will be and the new posterior will be %%

For questions about how priors are "ultimately" determined, see Solomonoff induction.