{
  localUrl: '../page/bayes_extraordinary_claims.html',
  arbitalUrl: 'https://arbital.com/p/bayes_extraordinary_claims',
  rawJsonUrl: '../raw/21v.json',
  likeableId: 'GeneSmith',
  likeableType: 'page',
  myLikeValue: '0',
  likeCount: '10',
  dislikeCount: '0',
  likeScore: '10',
  individualLikes: [
    'EricBruylant',
    'NateSoares',
    'CamSpiers',
    'AaronIemma',
    'SzymonWilczyski',
    'SzymonSlawinski',
    'StanisawSzczeniak',
    'NadeemMohsin',
    'KamilaS',
    'GregvandeKrol'
  ],
  pageId: 'bayes_extraordinary_claims',
  edit: '26',
  editSummary: '',
  prevEdit: '25',
  currentEdit: '26',
  wasPublished: 'true',
  type: 'wiki',
  title: 'Extraordinary claims require extraordinary evidence',
  clickbait: 'The people who adamantly claim they were abducted by aliens do provide some evidence for aliens. They just don't provide quantitatively enough evidence.',
  textLength: '12454',
  alias: 'bayes_extraordinary_claims',
  externalUrl: '',
  sortChildrenBy: 'likes',
  hasVote: 'false',
  voteType: '',
  votesAnonymous: 'false',
  editCreatorId: 'EliezerYudkowsky',
  editCreatedAt: '2016-10-08 04:52:18',
  pageCreatorId: 'EliezerYudkowsky',
  pageCreatedAt: '2016-02-18 21:39:52',
  seeDomainId: '0',
  editDomainId: 'AlexeiAndreev',
  submitToDomainId: '0',
  isAutosave: 'false',
  isSnapshot: 'false',
  isLiveEdit: 'true',
  isMinorEdit: 'false',
  indirectTeacher: 'false',
  todoCount: '0',
  isEditorComment: 'false',
  isApprovedComment: 'true',
  isResolved: 'false',
  snapshotText: '',
  anchorContext: '',
  anchorText: '',
  anchorOffset: '0',
  mergedInto: '',
  isDeleted: 'false',
  viewCount: '8431',
  text: '[1lz Bayes' rule] tells us how strong a piece of evidence has to be in order to support a given hypothesis.  This lets us see whether a piece of evidence is sufficient, or insufficient, to drive the probability of a hypothesis to over 50%.\n\nFor example, consider the [559 sparking widgets] problem:\n\n> 10% of widgets are bad and 90% are good. 4% of good widgets emit sparks, and 12% of bad widgets emit sparks. Can you calculate in your head what percentage of sparking widgets are bad?\n\nThe prior odds are 1 : 9 for bad widgets vs. good widgets.\n\n12% of bad widgets and 4% of good widgets emit sparks, so that's a likelihood ratio of 3 : 1 for sparking (bad widgets are three times as likely to emit sparks).\n\n$(1 : 9 ) \\times (3 : 1)  \\ = \\ (3 : 9) \\ \\cong \\ (1 : 3)$ posterior odds for bad vs. good sparking widgets.  So 1/4 of sparking widgets are bad.  \n\nBad widgets started out relatively rare:  1 in 10.  We applied a test — looking for sparks — that was only 3 times more likely to identify bad widgets as opposed to good ones. *The evidence was weaker than the prior improbability of the claim.*\n\nThis doesn't mean we toss out the evidence and ignore it.  It does mean that, after updating on the observation of sparkiness, we only gave 25% posterior probability to the widget being bad — the probability didn't go over 50%.\n\nWhat would need to change to drive the probability of widget badness to over 50%?  We would need evidence with a more extreme likelihood ratio, more extreme than the (9 : 1) prior odds.  For example, if instead bad widgets were 50% likely to spark and good widgets were 5% likely to spark, the posterior odds would go to (10 : 9) or 53%.\n\nIn other words:  For a previously implausible proposition $X$ to end up with a high posterior probability, the likelihood ratio for the new evidence favoring $X$ over its alternatives, needs to be *more extreme* than the prior odds against $X.$\n\nThis is the quantitative argument behind the qualitative statement that "extraordinary claims require extraordinary evidence" (a claim popularized by Carl Sagan, which dates back to at least Pierre-Simon Laplace).\n\nThat is: an "[26y extraordinary claim]" is one with a low [1rm prior probability] in advance of considering the evidence, and "extraordinary evidence" is evidence with an extreme [1rq likelihood ratio] favoring the claim over its alternatives.\n\n# What makes evidence extraordinary?\n\nThe likelihood ratio is defined as:\n\n$$\\text{Likelihood ratio} = \\dfrac{\\text{Probability of seeing the evidence, assuming the claim is true}}{\\text{Probability of seeing the evidence, assuming the claim is false}}$$\n\nTo obtain an extreme likelihood ratio, the bottom of the fraction has to be very low.  The top of the fraction being very high doesn't help much.  If the top of the fraction is 99% and the bottom is 70%, that's still not a very extreme ratio, and it doesn't help much if the top is 99.9999% instead.\n\nSo to get extremely strong evidence, we need to see an observation which is very _improbable,_ given "business as usual," but fairly likely according to the extraordinary claim. This observation would be deserving of the title, "extraordinary evidence".\n\n# Example of an extraordinary claim and ordinary evidence: Bookcase aliens.\n\nConsider the following hypothesis:  What if there are Bookcase Aliens who teleport into our houses at night and drop off bookcases?\n\nBob offers the following evidence for this claim:  "Last week, I visited my friend's house, and there was a new bookcase there. If there were no bookcase aliens, I wouldn't have expected that my friend would get a new bookcase. But if there are Bookcase Aliens, then the probability of my finding a new bookcase there was much higher. Therefore, my observation, 'There is a new bookcase in my friend's house,' is strong evidence supporting the existence of Bookcase Aliens."\n\nIn an intuitive sense, we have a notion that Bob's evidence "There is a new bookcase in my friend's house" is not as extraordinary as the claim "There are bookcase aliens" - that the evidence fails to lift the claim.  Bayes's Rule makes this statement precise.\n\nBob is, in fact, correct that his observation, "There's a new bookcase in my friend's house", is indeed evidence favoring the Bookcase Aliens.  Depending on how long it's been since Bob last visited that house, there might ceteris paribus be, say, a 1% chance that there would be a new bookcase there.  On the other hand, the Bookcase Aliens hypothesis might assign, say, 50% probability that the Bookcase Aliens would target this particular house among others.  If so, that's a [1rq likelihood ratio] of 50:1 favoring the Bookcase Aliens hypothesis.\n\nHowever, a reasonable prior on Bookcase Aliens would assign this a very *low* [1rm prior probability] given our other, previous observations of the world.  Let's be conservative and assign odds of just 1 : 1,000,000,000 against Bookcase Aliens.  Then to raise our [1rp posterior belief] in Bookcase Aliens to somewhere in the "pragmatically noticeable" range of 1 : 100, we'd need to see evidence with a cumulative likelihood ratio of 10,000,000 : 1 favoring the Bookcase Aliens.  50 : 1 won't cut it.\n\nWhat would need to change for the observation "There's a new bookcase in my friend's house" to be convincing evidence of Bookcase Aliens, compared to the alternative hypothesis of "business as usual"?\n\nAs suggested by the Bayesian interpretation of [22x strength of evidence], what we need to see is an observation which is nigh-impossible if there are *not* bookcase aliens.  We would have to believe that, [1rj conditional] on "business as usual" being true, the [1rq likelihood] of seeing a bookcase was on the order of 0.00000001%.  That would then take the [1rq likelihood ratio], aka strength of evidence, into the rough vicinity of a billion to one favoring Bookcase Aliens over "business as usual".\n\nWe would still need to consider whether there might be *other* alternative hypotheses besides Bookcase Aliens and "business as usual", such as a human-operated Bookcase Conspiracy.  But at least we wouldn't be dealing with an observation that was so unsurprising (conditional on business as usual) as to be unable to support *any* kind of extraordinary claim.\n\nHowever, if instead we suppose that Bookcase Aliens are allegedly 99.999999% probable to add a bookcase to Bob's friend's house, very little changes - the likelihood ratio is 99.99999% : 1% or 100 : 1 instead of 50 : 1.  To obtain an extreme likelihood ratio, we mainly need a tiny denominator rather than a big numerator.  In other words, "extraordinary evidence".\n\n# What makes claims extraordinary?\n\nAn obvious next question is what makes a claim 'extraordinary' or 'ordinary'.  This is a [26y deep separate topic], but as an example, consider the claim that the Earth is becoming warmer due to carbon dioxide being added to its atmosphere.\n\nTo evaluate the ordinariness or extraordinariness of this claim:\n\n- We _don't_ ask whether the future consequences of this claim seem extreme or important.\n- We _don't_ ask whether the policies that would be required to address the claim are very costly.\n- We ask whether "carbon dioxide warms the atmosphere" or "carbon dioxide fails to warm the atmosphere" seems to conform better to the *deep, causal* generalizations we already have about carbon dioxide and heat.\n- *If* we've already considered the deep causal generalizations like those, we don't ask about generalizations *causally downstream* of the deep causal ones we've already considered.  (E.g., we don't say, "But on every observed day for the last 200 years, the global temperature has stayed inside the following range; it would be 'extraordinary' to leave that range.")\n\nThese tests suggest that "Large amounts of added carbon dioxide will incrementally warm Earth's atmosphere" would have been an 'ordinary' claim in advance of trying to find any evidence for or against it - it's just how you would expect a greenhouse gas to work, more or less.  Thus, one is not entitled to demand a prediction made by this hypothesis that is wildly unlikely under any other hypothesis before believing it.\n\n# Incremental updating\n\nA key feature of the Bookcase Aliens example is that the followers of Bayes' rule acknowledges the observation of a new bookcase as being, locally, a single piece of evidence with a 50 : 1 likelihood ratio favoring Bookcase Aliens.  The Bayesian doesn't toss the observation out the window because it's *insufficient* evidence; it just gets accumulated into the pool.  If you visit house after house, and see new bookcase after new bookcase, the Bayesian slowly, incrementally, begins to wonder if something strange is going on, rather than dismissing each observation as 'insufficient evidence' and then forgetting it.\n\nThis stands in contrast to the instinctive way humans often behave, where, having concluded that they should not believe in Bookcase Aliens on the basis of the evidence in front of them, they discard that evidence entirely, denounce it, and say that it was never any evidence at all. (This is "[https://wiki.lesswrong.com/wiki/Arguments_as_soldiers treating arguments like soldiers]" and acting like any evidence in favor of a proposition has to be "defeated.")\n\nThe Bayesian just says "yes, that is evidence in favor of the claim, but it's not quantitatively enough evidence." This idiom also stands in contrast to the practice of treating any concession an opponent makes as a victory.  If true claims are supposed to have all their arguments upheld and false claims are supposed to have all their enemy arguments defeated, then a single undefeated claim of *support* stands as a proof of victory, no matter how strong or weak the evidence that it provides. Not so with Bayesians — a Bayesian considers the bookcase observation to be locally a piece of evidence favoring Bookcase Aliens, just massively insufficient evidence.\n\n# Overriding evidence\n\nIf you think that a proposition has prior odds of 1 to a $10^{100}$, and then somebody presents evidence with a likelihood ratio of $10^{94}$ to one favoring the proposition, you shouldn't say, "Oh, I guess the posterior odds are 1 to a million." You should instead question whether either (a) you were wrong about the prior odds or (b) the evidence isn't as strong as you assessed.\n\nIt's not that hard to end up believing a hypothesis that had very low prior odds. For example, whenever you look at the exact pattern of 10 digits generated by a random number generator, you're coming to believe a hypothesis that had prior odds on the order of ten billion to 1 against it.\n\nBut this should only happen with _true_ hypotheses. It's much rarer to find strong support for false hypotheses. Indeed, "strong evidence" is precisely "that sort of evidence we almost *never* see, when the proposition turns out to be false".\n\nImagine tossing a fair coin at most 300 times, and asking how often the sequence of heads and tails that it generates along the way, ever supports the false hypothesis "this coin comes up heads 3/4ths of the time" strongly over the true hypothesis "this coin is fair". As you can verify using [https://gist.github.com/Soares/941bdb13233fd0838f1882d148c9ac14 this code], the sequence of coinflips will at some point support the false hypothesis at the 10 : 1 level on about 8% of runs; it will at some point support the false hypothesis at the 100 : 1 level on about 0.8% of runs, and it will at some point support the false hypothesis at the 1000 : 1 level on about 0.08% of runs. (Note that we are less and less likely to be more and more deceived.)\n\nSeeing evidence with a strength of $(10^{94} : 1)$ / 94 orders of magnitude / 312 [1zh bits of evidence] supporting a false hypothesis should only happen to you, on average, once every IT DIDN'T HAPPEN.\n\nWitnessing an observation that truly has a $10^{-94}$ probability of occurring if the hypothesis is false, in a case where the hypothesis *is in fact false,* is something that will not happen to anyone even once over the expected lifetime of this universe.\n\nSo if you think that the prior odds for a coin being unfair are $(1 : 10^{100})$ against, and then you see the coin flipped 312 times and coming up heads each time... you do not say, "Well, my new posterior odds are $(1 : 10^6)$ against the coin being unfair."  You say, "I guess I was wrong about the prior odds being that low."',
  metaText: '',
  isTextLoaded: 'true',
  isSubscribedToDiscussion: 'false',
  isSubscribedToUser: 'false',
  isSubscribedAsMaintainer: 'false',
  discussionSubscriberCount: '2',
  maintainerCount: '2',
  userSubscriberCount: '0',
  lastVisit: '2016-02-21 11:47:27',
  hasDraft: 'false',
  votes: [],
  voteSummary: [
    '0',
    '0',
    '0',
    '0',
    '0',
    '0',
    '0',
    '0',
    '0',
    '0'
  ],
  muVoteSummary: '0',
  voteScaling: '0',
  currentUserVote: '-2',
  voteCount: '0',
  lockedVoteType: '',
  maxEditEver: '0',
  redLinkCount: '0',
  lockedBy: '',
  lockedUntil: '',
  nextPageId: '',
  prevPageId: '',
  usedAsMastery: 'true',
  proposalEditNum: '29',
  permissions: {
    edit: {
      has: 'false',
      reason: 'You don't have domain permission to edit this page'
    },
    proposeEdit: {
      has: 'true',
      reason: ''
    },
    delete: {
      has: 'false',
      reason: 'You don't have domain permission to delete this page'
    },
    comment: {
      has: 'false',
      reason: 'You can't comment in this domain because you are not a member'
    },
    proposeComment: {
      has: 'true',
      reason: ''
    }
  },
  summaries: {
    Summary: '[1lz Bayes' rule] tells us how strong a piece of evidence has to be in order to support a given hypothesis.  This lets us see whether a piece of evidence is sufficient, or insufficient, to drive the probability of a hypothesis to over 50%.'
  },
  creatorIds: [
    'EliezerYudkowsky',
    'NateSoares',
    'GradySimon',
    'AlexeiAndreev',
    'EricBruylant',
    'sdfsdfsdfsdf'
  ],
  childIds: [
    'extraordinary_claims'
  ],
  parentIds: [
    'bayes_update'
  ],
  commentIds: [
    '26v',
    '3rd',
    '3rf',
    '6r3',
    '6tc',
    '983',
    '989',
    '9h7'
  ],
  questionIds: [],
  tagIds: [
    'extraordinary_claims',
    'needs_summary_meta_tag',
    'b_class_meta_tag'
  ],
  relatedIds: [],
  markIds: [],
  explanations: [
    {
      id: '2446',
      parentId: 'bayes_extraordinary_claims',
      childId: 'bayes_extraordinary_claims',
      type: 'subject',
      creatorId: 'AlexeiAndreev',
      createdAt: '2016-06-17 21:58:56',
      level: '2',
      isStrong: 'true',
      everPublished: 'true'
    }
  ],
  learnMore: [
    {
      id: '5304',
      parentId: 'bayes_extraordinary_claims',
      childId: 'bayes_ordinary_claims',
      type: 'subject',
      creatorId: 'AlexeiAndreev',
      createdAt: '2016-07-16 16:22:38',
      level: '2',
      isStrong: 'false',
      everPublished: 'true'
    }
  ],
  requirements: [
    {
      id: '2266',
      parentId: 'bayes_rule_odds',
      childId: 'bayes_extraordinary_claims',
      type: 'requirement',
      creatorId: 'AlexeiAndreev',
      createdAt: '2016-06-17 21:58:56',
      level: '2',
      isStrong: 'false',
      everPublished: 'true'
    },
    {
      id: '5305',
      parentId: 'likelihood_ratio',
      childId: 'bayes_extraordinary_claims',
      type: 'requirement',
      creatorId: 'AlexeiAndreev',
      createdAt: '2016-07-16 16:25:44',
      level: '2',
      isStrong: 'false',
      everPublished: 'true'
    },
    {
      id: '5306',
      parentId: 'bayes_rule',
      childId: 'bayes_extraordinary_claims',
      type: 'requirement',
      creatorId: 'AlexeiAndreev',
      createdAt: '2016-07-16 16:25:59',
      level: '2',
      isStrong: 'true',
      everPublished: 'true'
    },
    {
      id: '5307',
      parentId: 'math1',
      childId: 'bayes_extraordinary_claims',
      type: 'requirement',
      creatorId: 'AlexeiAndreev',
      createdAt: '2016-07-16 16:26:32',
      level: '2',
      isStrong: 'true',
      everPublished: 'true'
    }
  ],
  subjects: [
    {
      id: '2446',
      parentId: 'bayes_extraordinary_claims',
      childId: 'bayes_extraordinary_claims',
      type: 'subject',
      creatorId: 'AlexeiAndreev',
      createdAt: '2016-06-17 21:58:56',
      level: '2',
      isStrong: 'true',
      everPublished: 'true'
    },
    {
      id: '6505',
      parentId: 'extraordinary_claims',
      childId: 'bayes_extraordinary_claims',
      type: 'subject',
      creatorId: 'EliezerYudkowsky',
      createdAt: '2016-09-29 22:26:21',
      level: '1',
      isStrong: 'true',
      everPublished: 'true'
    }
  ],
  lenses: [],
  lensParentId: '',
  pathPages: [
    {
      id: '21',
      guideId: 'bayes_extraordinary_claims',
      pathPageId: 'bayes_ordinary_claims',
      pathIndex: '0',
      createdBy: '32',
      createdAt: '2016-07-06 15:02:03',
      updatedBy: '32',
      updatedAt: '2016-07-06 15:02:03'
    }
  ],
  learnMoreTaughtMap: {
    '21v': [
      '55c'
    ]
  },
  learnMoreCoveredMap: {},
  learnMoreRequiredMap: {
    '21v': [
      '25y'
    ]
  },
  editHistory: {},
  domainSubmissions: {},
  answers: [],
  answerCount: '0',
  commentCount: '0',
  newCommentCount: '0',
  linkedMarkCount: '0',
  changeLogs: [
    {
      likeableId: '0',
      likeableType: 'changeLog',
      myLikeValue: '0',
      likeCount: '0',
      dislikeCount: '0',
      likeScore: '0',
      individualLikes: [],
      id: '23043',
      pageId: 'bayes_extraordinary_claims',
      userId: 'GradySimon',
      edit: '29',
      type: 'newEditProposal',
      createdAt: '2018-07-12 16:40:49',
      auxPageId: '',
      oldSettingsValue: '',
      newSettingsValue: ''
    },
    {
      likeableId: '0',
      likeableType: 'changeLog',
      myLikeValue: '0',
      likeCount: '0',
      dislikeCount: '0',
      likeScore: '0',
      individualLikes: [],
      id: '23042',
      pageId: 'bayes_extraordinary_claims',
      userId: 'GradySimon',
      edit: '28',
      type: 'newEditProposal',
      createdAt: '2018-07-12 16:30:17',
      auxPageId: '',
      oldSettingsValue: '',
      newSettingsValue: ''
    },
    {
      likeableId: '0',
      likeableType: 'changeLog',
      myLikeValue: '0',
      likeCount: '0',
      dislikeCount: '0',
      likeScore: '0',
      individualLikes: [],
      id: '22606',
      pageId: 'bayes_extraordinary_claims',
      userId: 'sdfsdfsdfsdf',
      edit: '27',
      type: 'newEditProposal',
      createdAt: '2017-06-07 06:25:48',
      auxPageId: '',
      oldSettingsValue: '',
      newSettingsValue: ''
    },
    {
      likeableId: '0',
      likeableType: 'changeLog',
      myLikeValue: '0',
      likeCount: '0',
      dislikeCount: '0',
      likeScore: '0',
      individualLikes: [],
      id: '19929',
      pageId: 'bayes_extraordinary_claims',
      userId: 'EliezerYudkowsky',
      edit: '26',
      type: 'newEdit',
      createdAt: '2016-10-08 04:52:18',
      auxPageId: '',
      oldSettingsValue: '',
      newSettingsValue: ''
    },
    {
      likeableId: '0',
      likeableType: 'changeLog',
      myLikeValue: '0',
      likeCount: '0',
      dislikeCount: '0',
      likeScore: '0',
      individualLikes: [],
      id: '19928',
      pageId: 'bayes_extraordinary_claims',
      userId: 'EliezerYudkowsky',
      edit: '25',
      type: 'newEdit',
      createdAt: '2016-10-08 04:49:51',
      auxPageId: '',
      oldSettingsValue: '',
      newSettingsValue: ''
    },
    {
      likeableId: '0',
      likeableType: 'changeLog',
      myLikeValue: '0',
      likeCount: '0',
      dislikeCount: '0',
      likeScore: '0',
      individualLikes: [],
      id: '19916',
      pageId: 'bayes_extraordinary_claims',
      userId: 'EliezerYudkowsky',
      edit: '24',
      type: 'newEdit',
      createdAt: '2016-10-08 00:03:54',
      auxPageId: '',
      oldSettingsValue: '',
      newSettingsValue: ''
    },
    {
      likeableId: '0',
      likeableType: 'changeLog',
      myLikeValue: '0',
      likeCount: '0',
      dislikeCount: '0',
      likeScore: '0',
      individualLikes: [],
      id: '19911',
      pageId: 'bayes_extraordinary_claims',
      userId: 'EliezerYudkowsky',
      edit: '23',
      type: 'newEdit',
      createdAt: '2016-10-07 23:42:31',
      auxPageId: '',
      oldSettingsValue: '',
      newSettingsValue: ''
    },
    {
      likeableId: '0',
      likeableType: 'changeLog',
      myLikeValue: '0',
      likeCount: '0',
      dislikeCount: '0',
      likeScore: '0',
      individualLikes: [],
      id: '19778',
      pageId: 'bayes_extraordinary_claims',
      userId: 'EliezerYudkowsky',
      edit: '0',
      type: 'deleteUsedAsTag',
      createdAt: '2016-09-29 22:28:07',
      auxPageId: 'extraordinary_claims',
      oldSettingsValue: '',
      newSettingsValue: ''
    },
    {
      likeableId: '0',
      likeableType: 'changeLog',
      myLikeValue: '0',
      likeCount: '0',
      dislikeCount: '0',
      likeScore: '0',
      individualLikes: [],
      id: '19776',
      pageId: 'bayes_extraordinary_claims',
      userId: 'EliezerYudkowsky',
      edit: '0',
      type: 'newChild',
      createdAt: '2016-09-29 22:28:04',
      auxPageId: 'extraordinary_claims',
      oldSettingsValue: '',
      newSettingsValue: ''
    },
    {
      likeableId: '0',
      likeableType: 'changeLog',
      myLikeValue: '0',
      likeCount: '0',
      dislikeCount: '0',
      likeScore: '0',
      individualLikes: [],
      id: '19773',
      pageId: 'bayes_extraordinary_claims',
      userId: 'EliezerYudkowsky',
      edit: '0',
      type: 'newSubject',
      createdAt: '2016-09-29 22:26:21',
      auxPageId: 'extraordinary_claims',
      oldSettingsValue: '',
      newSettingsValue: ''
    },
    {
      likeableId: '0',
      likeableType: 'changeLog',
      myLikeValue: '0',
      likeCount: '0',
      dislikeCount: '0',
      likeScore: '0',
      individualLikes: [],
      id: '19771',
      pageId: 'bayes_extraordinary_claims',
      userId: 'EliezerYudkowsky',
      edit: '0',
      type: 'deleteRequirement',
      createdAt: '2016-09-29 22:26:12',
      auxPageId: 'extraordinary_claims',
      oldSettingsValue: '',
      newSettingsValue: ''
    },
    {
      likeableId: '0',
      likeableType: 'changeLog',
      myLikeValue: '0',
      likeCount: '0',
      dislikeCount: '0',
      likeScore: '0',
      individualLikes: [],
      id: '19769',
      pageId: 'bayes_extraordinary_claims',
      userId: 'EliezerYudkowsky',
      edit: '22',
      type: 'newEdit',
      createdAt: '2016-09-29 22:25:23',
      auxPageId: '',
      oldSettingsValue: '',
      newSettingsValue: ''
    },
    {
      likeableId: '0',
      likeableType: 'changeLog',
      myLikeValue: '0',
      likeCount: '0',
      dislikeCount: '0',
      likeScore: '0',
      individualLikes: [],
      id: '18250',
      pageId: 'bayes_extraordinary_claims',
      userId: 'EricBruylant',
      edit: '0',
      type: 'newTag',
      createdAt: '2016-08-03 17:26:24',
      auxPageId: 'needs_summary_meta_tag',
      oldSettingsValue: '',
      newSettingsValue: ''
    },
    {
      likeableId: '0',
      likeableType: 'changeLog',
      myLikeValue: '0',
      likeCount: '0',
      dislikeCount: '0',
      likeScore: '0',
      individualLikes: [],
      id: '18056',
      pageId: 'bayes_extraordinary_claims',
      userId: 'AlexeiAndreev',
      edit: '0',
      type: 'deleteRequirement',
      createdAt: '2016-08-02 01:11:31',
      auxPageId: 'bayes_rule_elimination',
      oldSettingsValue: '',
      newSettingsValue: ''
    },
    {
      likeableId: '0',
      likeableType: 'changeLog',
      myLikeValue: '0',
      likeCount: '0',
      dislikeCount: '0',
      likeScore: '0',
      individualLikes: [],
      id: '16954',
      pageId: 'bayes_extraordinary_claims',
      userId: 'EricBruylant',
      edit: '20',
      type: 'newEdit',
      createdAt: '2016-07-16 21:01:48',
      auxPageId: '',
      oldSettingsValue: '',
      newSettingsValue: ''
    },
    {
      likeableId: '0',
      likeableType: 'changeLog',
      myLikeValue: '0',
      likeCount: '0',
      dislikeCount: '0',
      likeScore: '0',
      individualLikes: [],
      id: '16953',
      pageId: 'bayes_extraordinary_claims',
      userId: 'EricBruylant',
      edit: '0',
      type: 'newTag',
      createdAt: '2016-07-16 20:59:01',
      auxPageId: 'b_class_meta_tag',
      oldSettingsValue: '',
      newSettingsValue: ''
    },
    {
      likeableId: '0',
      likeableType: 'changeLog',
      myLikeValue: '0',
      likeCount: '0',
      dislikeCount: '0',
      likeScore: '0',
      individualLikes: [],
      id: '16940',
      pageId: 'bayes_extraordinary_claims',
      userId: 'AlexeiAndreev',
      edit: '18',
      type: 'newEdit',
      createdAt: '2016-07-16 20:51:06',
      auxPageId: '',
      oldSettingsValue: '',
      newSettingsValue: ''
    },
    {
      likeableId: '0',
      likeableType: 'changeLog',
      myLikeValue: '0',
      likeCount: '0',
      dislikeCount: '0',
      likeScore: '0',
      individualLikes: [],
      id: '16876',
      pageId: 'bayes_extraordinary_claims',
      userId: 'AlexeiAndreev',
      edit: '0',
      type: 'newRequirement',
      createdAt: '2016-07-16 16:34:10',
      auxPageId: 'bayes_rule_elimination',
      oldSettingsValue: '',
      newSettingsValue: ''
    },
    {
      likeableId: '0',
      likeableType: 'changeLog',
      myLikeValue: '0',
      likeCount: '0',
      dislikeCount: '0',
      likeScore: '0',
      individualLikes: [],
      id: '16870',
      pageId: 'bayes_extraordinary_claims',
      userId: 'AlexeiAndreev',
      edit: '0',
      type: 'newRequirement',
      createdAt: '2016-07-16 16:27:09',
      auxPageId: 'extraordinary_claims',
      oldSettingsValue: '',
      newSettingsValue: ''
    },
    {
      likeableId: '0',
      likeableType: 'changeLog',
      myLikeValue: '0',
      likeCount: '0',
      dislikeCount: '0',
      likeScore: '0',
      individualLikes: [],
      id: '16869',
      pageId: 'bayes_extraordinary_claims',
      userId: 'AlexeiAndreev',
      edit: '0',
      type: 'newRequirement',
      createdAt: '2016-07-16 16:26:33',
      auxPageId: 'math1',
      oldSettingsValue: '',
      newSettingsValue: ''
    },
    {
      likeableId: '0',
      likeableType: 'changeLog',
      myLikeValue: '0',
      likeCount: '0',
      dislikeCount: '0',
      likeScore: '0',
      individualLikes: [],
      id: '16868',
      pageId: 'bayes_extraordinary_claims',
      userId: 'AlexeiAndreev',
      edit: '0',
      type: 'newRequirement',
      createdAt: '2016-07-16 16:25:59',
      auxPageId: 'bayes_rule',
      oldSettingsValue: '',
      newSettingsValue: ''
    },
    {
      likeableId: '0',
      likeableType: 'changeLog',
      myLikeValue: '0',
      likeCount: '0',
      dislikeCount: '0',
      likeScore: '0',
      individualLikes: [],
      id: '16867',
      pageId: 'bayes_extraordinary_claims',
      userId: 'AlexeiAndreev',
      edit: '0',
      type: 'newRequirement',
      createdAt: '2016-07-16 16:25:44',
      auxPageId: 'likelihood_ratio',
      oldSettingsValue: '',
      newSettingsValue: ''
    },
    {
      likeableId: '0',
      likeableType: 'changeLog',
      myLikeValue: '0',
      likeCount: '0',
      dislikeCount: '0',
      likeScore: '0',
      individualLikes: [],
      id: '16864',
      pageId: 'bayes_extraordinary_claims',
      userId: 'AlexeiAndreev',
      edit: '0',
      type: 'newTeacher',
      createdAt: '2016-07-16 16:22:39',
      auxPageId: 'bayes_ordinary_claims',
      oldSettingsValue: '',
      newSettingsValue: ''
    },
    {
      likeableId: '0',
      likeableType: 'changeLog',
      myLikeValue: '0',
      likeCount: '0',
      dislikeCount: '0',
      likeScore: '0',
      individualLikes: [],
      id: '15689',
      pageId: 'bayes_extraordinary_claims',
      userId: 'NateSoares',
      edit: '17',
      type: 'newEdit',
      createdAt: '2016-07-06 15:02:14',
      auxPageId: '',
      oldSettingsValue: '',
      newSettingsValue: ''
    },
    {
      likeableId: '0',
      likeableType: 'changeLog',
      myLikeValue: '0',
      likeCount: '0',
      dislikeCount: '0',
      likeScore: '0',
      individualLikes: [],
      id: '15688',
      pageId: 'bayes_extraordinary_claims',
      userId: 'NateSoares',
      edit: '0',
      type: 'newAlias',
      createdAt: '2016-07-06 15:02:12',
      auxPageId: '',
      oldSettingsValue: 'bayes_claims_and_evidence',
      newSettingsValue: 'bayes_extraordinary_claims'
    },
    {
      likeableId: '0',
      likeableType: 'changeLog',
      myLikeValue: '0',
      likeCount: '0',
      dislikeCount: '0',
      likeScore: '0',
      individualLikes: [],
      id: '15686',
      pageId: 'bayes_extraordinary_claims',
      userId: 'NateSoares',
      edit: '0',
      type: 'deleteChild',
      createdAt: '2016-07-06 15:01:58',
      auxPageId: 'bayes_ordinary_claims',
      oldSettingsValue: '',
      newSettingsValue: ''
    },
    {
      likeableId: '0',
      likeableType: 'changeLog',
      myLikeValue: '0',
      likeCount: '0',
      dislikeCount: '0',
      likeScore: '0',
      individualLikes: [],
      id: '15684',
      pageId: 'bayes_extraordinary_claims',
      userId: 'NateSoares',
      edit: '0',
      type: 'newChild',
      createdAt: '2016-07-06 15:01:55',
      auxPageId: 'bayes_ordinary_claims',
      oldSettingsValue: '',
      newSettingsValue: ''
    },
    {
      likeableId: '0',
      likeableType: 'changeLog',
      myLikeValue: '0',
      likeCount: '0',
      dislikeCount: '0',
      likeScore: '0',
      individualLikes: [],
      id: '14275',
      pageId: 'bayes_extraordinary_claims',
      userId: 'NateSoares',
      edit: '16',
      type: 'newEdit',
      createdAt: '2016-06-21 19:17:40',
      auxPageId: '',
      oldSettingsValue: '',
      newSettingsValue: ''
    },
    {
      likeableId: '0',
      likeableType: 'changeLog',
      myLikeValue: '0',
      likeCount: '0',
      dislikeCount: '0',
      likeScore: '0',
      individualLikes: [],
      id: '8319',
      pageId: 'bayes_extraordinary_claims',
      userId: 'EliezerYudkowsky',
      edit: '15',
      type: 'newEdit',
      createdAt: '2016-03-04 05:57:23',
      auxPageId: '',
      oldSettingsValue: '',
      newSettingsValue: ''
    },
    {
      likeableId: '0',
      likeableType: 'changeLog',
      myLikeValue: '0',
      likeCount: '0',
      dislikeCount: '0',
      likeScore: '0',
      individualLikes: [],
      id: '8318',
      pageId: 'bayes_extraordinary_claims',
      userId: 'EliezerYudkowsky',
      edit: '12',
      type: 'newTag',
      createdAt: '2016-03-04 05:56:35',
      auxPageId: 'extraordinary_claims',
      oldSettingsValue: '',
      newSettingsValue: ''
    },
    {
      likeableId: '0',
      likeableType: 'changeLog',
      myLikeValue: '0',
      likeCount: '0',
      dislikeCount: '0',
      likeScore: '0',
      individualLikes: [],
      id: '8249',
      pageId: 'bayes_extraordinary_claims',
      userId: 'EliezerYudkowsky',
      edit: '12',
      type: 'newUsedAsTag',
      createdAt: '2016-03-03 23:53:41',
      auxPageId: 'extraordinary_claims',
      oldSettingsValue: '',
      newSettingsValue: ''
    },
    {
      likeableId: '0',
      likeableType: 'changeLog',
      myLikeValue: '0',
      likeCount: '0',
      dislikeCount: '0',
      likeScore: '0',
      individualLikes: [],
      id: '8193',
      pageId: 'bayes_extraordinary_claims',
      userId: 'EliezerYudkowsky',
      edit: '12',
      type: 'newTeacher',
      createdAt: '2016-03-03 20:27:52',
      auxPageId: 'bayes_extraordinary_claims',
      oldSettingsValue: '',
      newSettingsValue: ''
    },
    {
      likeableId: '0',
      likeableType: 'changeLog',
      myLikeValue: '0',
      likeCount: '0',
      dislikeCount: '0',
      likeScore: '0',
      individualLikes: [],
      id: '8194',
      pageId: 'bayes_extraordinary_claims',
      userId: 'EliezerYudkowsky',
      edit: '12',
      type: 'newSubject',
      createdAt: '2016-03-03 20:27:52',
      auxPageId: 'bayes_extraordinary_claims',
      oldSettingsValue: '',
      newSettingsValue: ''
    },
    {
      likeableId: '0',
      likeableType: 'changeLog',
      myLikeValue: '0',
      likeCount: '0',
      dislikeCount: '0',
      likeScore: '0',
      individualLikes: [],
      id: '8171',
      pageId: 'bayes_extraordinary_claims',
      userId: 'EliezerYudkowsky',
      edit: '12',
      type: 'newRequiredBy',
      createdAt: '2016-03-03 19:30:00',
      auxPageId: 'bayes_update_details',
      oldSettingsValue: '',
      newSettingsValue: ''
    },
    {
      likeableId: '0',
      likeableType: 'changeLog',
      myLikeValue: '0',
      likeCount: '0',
      dislikeCount: '0',
      likeScore: '0',
      individualLikes: [],
      id: '7701',
      pageId: 'bayes_extraordinary_claims',
      userId: 'EliezerYudkowsky',
      edit: '12',
      type: 'newEdit',
      createdAt: '2016-02-23 01:33:26',
      auxPageId: '',
      oldSettingsValue: '',
      newSettingsValue: ''
    },
    {
      likeableId: '0',
      likeableType: 'changeLog',
      myLikeValue: '0',
      likeCount: '0',
      dislikeCount: '0',
      likeScore: '0',
      individualLikes: [],
      id: '7699',
      pageId: 'bayes_extraordinary_claims',
      userId: 'EliezerYudkowsky',
      edit: '11',
      type: 'newEdit',
      createdAt: '2016-02-23 01:25:10',
      auxPageId: '',
      oldSettingsValue: '',
      newSettingsValue: ''
    },
    {
      likeableId: '0',
      likeableType: 'changeLog',
      myLikeValue: '0',
      likeCount: '0',
      dislikeCount: '0',
      likeScore: '0',
      individualLikes: [],
      id: '7676',
      pageId: 'bayes_extraordinary_claims',
      userId: 'EliezerYudkowsky',
      edit: '10',
      type: 'newEdit',
      createdAt: '2016-02-23 00:44:33',
      auxPageId: '',
      oldSettingsValue: '',
      newSettingsValue: ''
    },
    {
      likeableId: '0',
      likeableType: 'changeLog',
      myLikeValue: '0',
      likeCount: '0',
      dislikeCount: '0',
      likeScore: '0',
      individualLikes: [],
      id: '7675',
      pageId: 'bayes_extraordinary_claims',
      userId: 'EliezerYudkowsky',
      edit: '9',
      type: 'newEdit',
      createdAt: '2016-02-23 00:44:21',
      auxPageId: '',
      oldSettingsValue: '',
      newSettingsValue: ''
    },
    {
      likeableId: '0',
      likeableType: 'changeLog',
      myLikeValue: '0',
      likeCount: '0',
      dislikeCount: '0',
      likeScore: '0',
      individualLikes: [],
      id: '7419',
      pageId: 'bayes_extraordinary_claims',
      userId: 'EliezerYudkowsky',
      edit: '8',
      type: 'newEdit',
      createdAt: '2016-02-19 01:49:54',
      auxPageId: '',
      oldSettingsValue: '',
      newSettingsValue: ''
    },
    {
      likeableId: '0',
      likeableType: 'changeLog',
      myLikeValue: '0',
      likeCount: '0',
      dislikeCount: '0',
      likeScore: '0',
      individualLikes: [],
      id: '7418',
      pageId: 'bayes_extraordinary_claims',
      userId: 'EliezerYudkowsky',
      edit: '7',
      type: 'newEdit',
      createdAt: '2016-02-19 01:48:34',
      auxPageId: '',
      oldSettingsValue: '',
      newSettingsValue: ''
    },
    {
      likeableId: '0',
      likeableType: 'changeLog',
      myLikeValue: '0',
      likeCount: '0',
      dislikeCount: '0',
      likeScore: '0',
      individualLikes: [],
      id: '7417',
      pageId: 'bayes_extraordinary_claims',
      userId: 'EliezerYudkowsky',
      edit: '6',
      type: 'newEdit',
      createdAt: '2016-02-19 01:47:57',
      auxPageId: '',
      oldSettingsValue: '',
      newSettingsValue: ''
    },
    {
      likeableId: '0',
      likeableType: 'changeLog',
      myLikeValue: '0',
      likeCount: '0',
      dislikeCount: '0',
      likeScore: '0',
      individualLikes: [],
      id: '7416',
      pageId: 'bayes_extraordinary_claims',
      userId: 'EliezerYudkowsky',
      edit: '5',
      type: 'newEdit',
      createdAt: '2016-02-19 01:31:08',
      auxPageId: '',
      oldSettingsValue: '',
      newSettingsValue: ''
    },
    {
      likeableId: '0',
      likeableType: 'changeLog',
      myLikeValue: '0',
      likeCount: '0',
      dislikeCount: '0',
      likeScore: '0',
      individualLikes: [],
      id: '7415',
      pageId: 'bayes_extraordinary_claims',
      userId: 'EliezerYudkowsky',
      edit: '4',
      type: 'newEdit',
      createdAt: '2016-02-19 00:43:46',
      auxPageId: '',
      oldSettingsValue: '',
      newSettingsValue: ''
    },
    {
      likeableId: '0',
      likeableType: 'changeLog',
      myLikeValue: '0',
      likeCount: '0',
      dislikeCount: '0',
      likeScore: '0',
      individualLikes: [],
      id: '7414',
      pageId: 'bayes_extraordinary_claims',
      userId: 'EliezerYudkowsky',
      edit: '3',
      type: 'newEdit',
      createdAt: '2016-02-19 00:42:55',
      auxPageId: '',
      oldSettingsValue: '',
      newSettingsValue: ''
    },
    {
      likeableId: '0',
      likeableType: 'changeLog',
      myLikeValue: '0',
      likeCount: '0',
      dislikeCount: '0',
      likeScore: '0',
      individualLikes: [],
      id: '7413',
      pageId: 'bayes_extraordinary_claims',
      userId: 'EliezerYudkowsky',
      edit: '0',
      type: 'deleteTag',
      createdAt: '2016-02-19 00:27:42',
      auxPageId: 'work_in_progress_meta_tag',
      oldSettingsValue: '',
      newSettingsValue: ''
    },
    {
      likeableId: '0',
      likeableType: 'changeLog',
      myLikeValue: '0',
      likeCount: '0',
      dislikeCount: '0',
      likeScore: '0',
      individualLikes: [],
      id: '7411',
      pageId: 'bayes_extraordinary_claims',
      userId: 'EliezerYudkowsky',
      edit: '2',
      type: 'newTag',
      createdAt: '2016-02-19 00:24:32',
      auxPageId: 'work_in_progress_meta_tag',
      oldSettingsValue: '',
      newSettingsValue: ''
    },
    {
      likeableId: '0',
      likeableType: 'changeLog',
      myLikeValue: '0',
      likeCount: '0',
      dislikeCount: '0',
      likeScore: '0',
      individualLikes: [],
      id: '7409',
      pageId: 'bayes_extraordinary_claims',
      userId: 'EliezerYudkowsky',
      edit: '2',
      type: 'newEdit',
      createdAt: '2016-02-18 23:41:31',
      auxPageId: '',
      oldSettingsValue: '',
      newSettingsValue: ''
    },
    {
      likeableId: '0',
      likeableType: 'changeLog',
      myLikeValue: '0',
      likeCount: '0',
      dislikeCount: '0',
      likeScore: '0',
      individualLikes: [],
      id: '7404',
      pageId: 'bayes_extraordinary_claims',
      userId: 'EliezerYudkowsky',
      edit: '1',
      type: 'newEdit',
      createdAt: '2016-02-18 21:39:52',
      auxPageId: '',
      oldSettingsValue: '',
      newSettingsValue: ''
    },
    {
      likeableId: '0',
      likeableType: 'changeLog',
      myLikeValue: '0',
      likeCount: '0',
      dislikeCount: '0',
      likeScore: '0',
      individualLikes: [],
      id: '7402',
      pageId: 'bayes_extraordinary_claims',
      userId: 'EliezerYudkowsky',
      edit: '0',
      type: 'deleteRequirement',
      createdAt: '2016-02-18 21:13:41',
      auxPageId: 'bayes_rule_proportional',
      oldSettingsValue: '',
      newSettingsValue: ''
    },
    {
      likeableId: '0',
      likeableType: 'changeLog',
      myLikeValue: '0',
      likeCount: '0',
      dislikeCount: '0',
      likeScore: '0',
      individualLikes: [],
      id: '7400',
      pageId: 'bayes_extraordinary_claims',
      userId: 'EliezerYudkowsky',
      edit: '0',
      type: 'newRequirement',
      createdAt: '2016-02-18 20:45:47',
      auxPageId: 'bayes_rule_proportional',
      oldSettingsValue: '',
      newSettingsValue: ''
    },
    {
      likeableId: '0',
      likeableType: 'changeLog',
      myLikeValue: '0',
      likeCount: '0',
      dislikeCount: '0',
      likeScore: '0',
      individualLikes: [],
      id: '7398',
      pageId: 'bayes_extraordinary_claims',
      userId: 'EliezerYudkowsky',
      edit: '0',
      type: 'newRequirement',
      createdAt: '2016-02-18 20:44:51',
      auxPageId: 'bayes_rule_odds',
      oldSettingsValue: '',
      newSettingsValue: ''
    },
    {
      likeableId: '0',
      likeableType: 'changeLog',
      myLikeValue: '0',
      likeCount: '0',
      dislikeCount: '0',
      likeScore: '0',
      individualLikes: [],
      id: '7396',
      pageId: 'bayes_extraordinary_claims',
      userId: 'EliezerYudkowsky',
      edit: '0',
      type: 'newParent',
      createdAt: '2016-02-18 20:37:42',
      auxPageId: 'bayes_update',
      oldSettingsValue: '',
      newSettingsValue: ''
    }
  ],
  feedSubmissions: [],
  searchStrings: {},
  hasChildren: 'true',
  hasParents: 'true',
  redAliases: {},
  improvementTagIds: [],
  nonMetaTagIds: [],
  todos: [],
  slowDownMap: 'null',
  speedUpMap: 'null',
  arcPageIds: 'null',
  contentRequests: {
    fewerWords: {
      likeableId: '4026',
      likeableType: 'contentRequest',
      myLikeValue: '0',
      likeCount: '5',
      dislikeCount: '0',
      likeScore: '5',
      individualLikes: [],
      id: '181',
      pageId: 'bayes_extraordinary_claims',
      requestType: 'fewerWords',
      createdAt: '2017-04-04 00:27:19'
    },
    lessTechnical: {
      likeableId: '3994',
      likeableType: 'contentRequest',
      myLikeValue: '0',
      likeCount: '2',
      dislikeCount: '0',
      likeScore: '2',
      individualLikes: [],
      id: '174',
      pageId: 'bayes_extraordinary_claims',
      requestType: 'lessTechnical',
      createdAt: '2017-02-28 05:19:08'
    },
    moreTechnical: {
      likeableId: '4036',
      likeableType: 'contentRequest',
      myLikeValue: '0',
      likeCount: '5',
      dislikeCount: '0',
      likeScore: '5',
      individualLikes: [],
      id: '185',
      pageId: 'bayes_extraordinary_claims',
      requestType: 'moreTechnical',
      createdAt: '2017-04-15 18:27:42'
    },
    moreWords: {
      likeableId: '4108',
      likeableType: 'contentRequest',
      myLikeValue: '0',
      likeCount: '1',
      dislikeCount: '0',
      likeScore: '1',
      individualLikes: [],
      id: '200',
      pageId: 'bayes_extraordinary_claims',
      requestType: 'moreWords',
      createdAt: '2018-01-23 19:55:32'
    }
  }
}