{
localUrl: '../page/likelihoods_not_pvalues.html',
arbitalUrl: 'https://arbital.com/p/likelihoods_not_pvalues',
rawJsonUrl: '../raw/4zd.json',
likeableId: '2908',
likeableType: 'page',
myLikeValue: '0',
likeCount: '10',
dislikeCount: '0',
likeScore: '10',
individualLikes: [
'AndrewMcKnight',
'TravisRivera',
'MathieuRoy',
'JaimeSevillaMolina',
'NateSoares',
'RobBensinger2',
'RyanBlough',
'JoeZeng',
'KatherineSavoie2',
'RichardWundrack'
],
pageId: 'likelihoods_not_pvalues',
edit: '23',
editSummary: '',
prevEdit: '22',
currentEdit: '23',
wasPublished: 'true',
type: 'wiki',
title: 'Report likelihoods, not p-values',
clickbait: '',
textLength: '16927',
alias: 'likelihoods_not_pvalues',
externalUrl: '',
sortChildrenBy: 'likes',
hasVote: 'false',
voteType: '',
votesAnonymous: 'false',
editCreatorId: 'NateSoares',
editCreatedAt: '2017-04-29 05:00:59',
pageCreatorId: 'NateSoares',
pageCreatedAt: '2016-07-01 01:52:54',
seeDomainId: '0',
editDomainId: 'AlexeiAndreev',
submitToDomainId: '0',
isAutosave: 'false',
isSnapshot: 'false',
isLiveEdit: 'true',
isMinorEdit: 'false',
indirectTeacher: 'false',
todoCount: '0',
isEditorComment: 'false',
isApprovedComment: 'true',
isResolved: 'false',
snapshotText: '',
anchorContext: '',
anchorText: '',
anchorOffset: '0',
mergedInto: '',
isDeleted: 'false',
viewCount: '4765',
text: '[summary: If scientists reported likelihood functions instead of p-values, this could help science avoid [https://en.wikipedia.org/wiki/Data_dredging p-hacking], [https://en.wikipedia.org/wiki/Publication_bias publication bias], [https://en.wikipedia.org/wiki/Decline_effect the decline effect], and other hazards of standard statistical techniques. Furthermore, it could help make it easier to combine results from multiple studies and perfrom meta-analyses, while making statistics intuitively easier to understand. (This is a bold claim, but a claim which is largely supported by [-1bv].)]\n\nThis page advocates for a change in the way that statistics is done in standard scientific journals. The key idea is to report [56s likelihood functions] instead of p-values, and this could have many benefits.\n\n_(Note: This page is a personal [60p opinion page].)_\n\n[toc:]\n\n## What's the difference?\n\nThe status quo across scientific journals is to test data for "[statistically_significant statistical significance]" using functions such as [p_value p-values]. A p-value is a number calculated from a hypothesis (called the "null hypothesis"), an experiment, a result, and a [-summary_statistic]. For example, if the null hypothesis is "this coin is fair," and the experiment is "flip it 6 times", and the result is HHHHHT, and the summary statistic is "the sequence has at least five H values," then the p-value is 0.11, which means "if the coin were fair, and we did this experiment a lot, then only 11% of the sequences generated would have at least five H values."%%note:This does _not_ mean that the coin is 89% likely to be biased! For example, if the only alternative is that the coin is biased towards tails, then HHHHHT is evidence that it's fair. This is a common source of confusion with p-values.%% If the p-value is lower than an arbitrary threshold (usually $p < 0.05$) then the result is called "statistically significant" and the null hypothesis is "rejected."\n\nThis page advocates that scientific articles should report _likelihood functions_ instead of p-values. A likelihood function for a piece of evidence $e$ is a function $\\mathcal L$ which says, for each hypothesis $H$ in some set of hypotheses, the probability that $H$ assigned to $e$, written [51n $\\mathcal L_e(H)$].%%note: Many authors write $\\mathcal L(H \\mid e)$ instead. We think this is confusing, as then $\\mathcal L(H \\mid e) = \\mathbb P(e \\mid H),$ and it's hard enough for students of statistics to keep "probability of $H$ given $e$" and "probability of $e$ given $H$" straight as it is if the notation _isn't_ swapped around every so often.%% For example, if $e$ is "this coin, flipped 6 times, generated HHHHHT", and the set of hypotheses are $H_{0.25} =$ "the coin only produces heads 25% of the time" and $H_{0.5}$ = "the coin is fair", then $\\mathcal L_e(H_{0.25})$ $=$ $0.25^5 \\cdot 0.75$ $\\approx 0.07\\%$ and $\\mathcal L_e(H_{0.5})$ $=$ $0.5^6$ $\\approx 1.56\\%,$ for a [1rq likelihood ratio] of about $21 : 1$ in favor of the coin being fair (as opposed to biased 75% towards tails).\n\nIn fact, with a single likelihood function, we can report the amount of support $e$ gives to _every_ hypothesis $H_b$ of the form "the coin has bias $b$ towards heads":%note:To learn how this graph was generated, see [1zj Bayes' rule: Functional form].%\n\n\n\nNote that this likelihood function is _not_ telling us the probability that the coin is actually biased, it is _only_ telling us how much the evidence supports each hypothesis. For example, this graph says that HHHHHT provides about 3.8 times as much evidence for $H_{0.75}$ over $H_{0.5}$, and about 81 times as much evidence for $H_{0.75}$ over $H_{0.25}.$\n\nNote also that the likelihood function doesn't necessarily contain the _right_ hypothesis; for example, the function above shows the support of $e$ for every possible bias on the coin, but it doesn't consider hypotheses like "the coin alternates between H and T". Likelihood functions, like p-values, are essentially a mere summary of the raw data — there is no substitute for the raw data when it comes to allowing people to test hypotheses that the original researchers did not consider. (In other words, even if you report likelihoods instead of p-values, it's still virtuous to share your raw data.)\n\nWhere p-values let you measure (roughly) how well the data supports a _single_ "null hypothesis", with an arbitrary 0.05 "not well enough" cutoff, the likelihood function shows the support of the evidence for lots and lots of different hypotheses at once, without any need for an arbitrary cutoff.\n\n## Why report likelihoods instead of p-values?\n\n__1. Likelihood functions are less arbitrary than p-values.__ To report a likelihood function, all you have to do is pick which hypothesis class to generate the likelihood function for. That's your only degree of freedom. This introduces one source of arbitrariness, and if someone wants to check some other hypothesis they still need access to the raw data, but it is better than the p-value case, where you only report a number for a single "null" hypothesis.\n\nFurthermore, in the p-value case, you have to pick not only a null hypothesis but also an experiment and a summary statistic, and these degrees of freedom can have a huge impact on the final report. These extra degrees of freedom are both unnecessary ([1lz to carry out a probabilistic update, all you need are your own personal beliefs and a likelihood function]) and exploitable, and empirically, they're actively harming scientific research.\n\n__2. Reporting likelihoods would solve p-hacking.__ If you're using p-values, then you can game the statistics via your choice of experiment and summary statistics. In the example with the coin above, if you say your experiment and summary statistic are "flip the coin 6 times and count the number of heads" then the p-value of HHHHHT with respect to $H_{0.5}$ is 0.11, whereas if you say your experiment and summary statistic are "flip the coin until it comes up tails and count the number of heads" then the p-value of HHHHHT with respect to $H_{0.5}$ is 0.03, which is "significant." This is called "[https://en.wikipedia.org/wiki/Data_dredging p-hacking]", and it's a serious problem in modern science.\n\nIn a likelihood function, _the amount of support an evidence gives to a hypothesis does not depend on which experiment the researcher had in mind._ Likelihood functions depend only on the data you actually saw, and the hypotheses you chose to report. The only way to cheat a likelihood function is to lie about the data you collected, or refuse to report likelihoods for a particular hypothesis.\n\nIf your paper fails to report likelihoods for some obvious hypotheses, then (a) that's precisely analogous to you choosing the wrong null hypothesis to consider; (b) it's just as easily noticeable as when your paper considers the wrong null hypothesis; and (c) it can be easily rectified given access to the raw data. By contrast, p-hacking can be subtle and hard to detect after the fact.\n\n__3. Likelihood functions are very difficult to game.__ There is no analog of p-hacking for likelihood functions. This is a theorem of probability theory known as [-conservation_of_expected_evidence], which says that likelihood functions can't be gamed unless you're falsifying or omitting data (or screwing up the likelihood calculations).%note:Disclaimer: the theorem says likelihood functions can't be gamed, but we still shouldn't underestimate the guile of dishonest researchers struggling to make their results look important. Likelihood functions have not been put through the gauntlet of real scientific practice; p-values have. That said, when p-values were put through that gauntlet, they [https://en.wikipedia.org/wiki/Data_dredging failed] in a [https://en.wikipedia.org/wiki/Replication_crisis spectacular fashion]. When rebuilding, it's probably better to start from foundations that provably cannot be gamed.%\n\n\n__4. Likelihood functions would help stop the "vanishing effect sizes" phenomenon.__ The [https://en.wikipedia.org/wiki/Decline_effect decline effect] occurs when studies which reject a null hypothesis $H_0$ have effect sizes that get smaller and smaller and smaller over time (the more someone tries to replicate the result). This is [http://slatestarcodex.com/2014/04/28/the-control-group-is-out-of-control/ usually evidence] that there is no actual effect, and that the initial "large effects" were a result of publication bias.\n\nLikelihood functions help avoid the decline effect by _treating different effect sizes differently._ The likelihood function for coins of different biases shows that the evidence HHHHHT gives a different amount of support to $H_{0.52},$ $H_{0.61}$, and $H_{0.8}$ (which correspond to small, medium, and large effect sizes, respectively). If three different studies find low support for $H_{0.5},$ and one of them gives all of its support to the large effect, another gives all its support to the medium effect, and the third gives all of its support to the smallest effect, then likelihood functions reveal that something fishy is going on (because they're all peaked in different places).\n\nIf instead we only use p-values, and always decide whether or not to "keep" or "reject" the null hypothesis (without specifying how much support goes to different alternatives), then it's hard to notice that the studies are actually contradictory (and that something very fishy is going on). Instead, it's very tempting to exclaim "3 out of 3 studies reject $H_{0.5}$!" and move on.\n\n__5. Likelihood functions would help stop publication bias.__ When using p-values, if the data yields a p-value of 0.11 using a null hypothesis $H_0$, the study is considered "insignificant," and many journals have a strong bias towards positive results. When reporting likelihood functions, there is no arbitrary "significance" threshold. A study that reports a relative likelihoods of $21 : 1$ in favor of $H_a$ vs $H_0,$ that's exactly the same _strength of evidence_ as a study that reports $21 : 1$ odds against $H_a$ vs $H_0.$ It's all just evidence, and it can all be added to the corpus, there's no arbitrary "significance" threshold.\n\n__6. Likelihood functions make it trivially easy to combine studies.__ When combining studies that used p-values, researchers have to perform complex meta-analyses with dozens of parameters to tune, and they often find [https://en.wikipedia.org/wiki/Confirmation_bias exactly what they were expecting to find]. By contrast, the way you combine multiple studies that reported likelihood functions is... (drumroll)\n...you just multiply the likelihood functions together. If study A reports that $H_{0.75}$ was favored over $H_{0.5}$ with a [-1rq] of $3.8 : 1$, and study B reports that $H_{0.75}$ was favored over $H_{0.5}$ at $5 : 1$, then the combined likelihood functions of both studies favors $H_{0.75}$ over $H_{0.5}$ at $(3.8 \\cdot 5) : 1$ $=$ $19 : 1.$\n\nWant to combine a hundred studies on the same subject? Multiply a hundred functions together. Done. No parameter tuning, no degrees of freedom through which bias can be introduced — just multiply.\n\n__7. Likelihood functions make it obvious when something has gone wrong.__ If, when you multiply all the likelihood functions together, _all_ hypotheses have extraordinarily low likelihoods, then something has gone wrong. Either a mistake has been made somewhere, or fraud has been committed, or the true hypothesis wasn't in the hypothesis class you're considering.\n\nThe actual hypothesis that explains all the data will have decently high likelihood across all the data. If none of the hypotheses fit that description, then either you aren't considering the right hypothesis yet, or some of the studies went wrong. (Try looking for one study that has a likelihood function _very very different_ from all the other studies, and investigate that one.)\n\nLikelihood functions won't do your science for you — you still have to generate good hypotheses, and be honest in your data reporting — but they _do_ make it obvious when something went wrong. (Specifically, [227 each hypothesis can tell you how low its likelihood is expected to be on the data], and if _every_ hypothesis has a likelihood far lower than expected, then something's fishy.)\n\n---\n\nA scientific community using likelihood functions would produce scientific research that's easier to use. If everyone's reporting likelihood functions, then all you personally need to do in order to figure out what to believe is take your own personal (subjective) prior probabilities and multiply them by all the likelihood functions in order to get your own personal (subjective) posterior probabilities.\n\nFor example, let's say you personally think the coin is probably fair, with $10 : 1$ odds of being fair as opposed to 75% biased in favor of heads. Now let's say that study A reports a likelihood function which favors $H_{0.75}$ over $H_{0.5}$ with a likelihood ratio of $3.8 : 1.$, and study B reports a $5 : 1$ likelihood ratio in the same direction. Multiplying all these together, your personal posterior beliefs should be $19 : 10$ in favor of $H_{0.75}$ over $H_{0.5}$. This is simply [1lz Bayes' rule]. Reporting likelihoods instead of p-values lets science remain objective, while allowing everyone to find their own personal posterior probabilities via a simple application of Bayes' theorem.\n\n## Why should we think this would work?\n\nThis may all sound too good to be true. Can one simple change really solve that many problems in modern science?\n\nFirst of all, you can be assured that reporting likelihoods instead of p-values would not "solve" all the problems above, and it would surely not solve all problems with modern experimental science. Open access to raw data, preregistration of studies, a culture that rewards replication, and many other ideas are also crucial ingredients to a scientific community that zeroes in on truth.\n\nHowever, reporting likelihoods would _help_ solve lots of different problems in modern experimental science. This may come as a surprise. Aren't likelihood functions just one more statistical technique, just another tool for the toolbox? Why should we think that one single tool can solve that many problems?\n\nThe reason lies in [-1bv]. According to the axioms of probability theory, there is only one good way to account for evidence when updating your beliefs, and that way is via likelihood functions. Any other method is subject to inconsistencies and pathologies, as per the [probability_coherence_theorems coherence theorems of probability theory].\n\nIf you're manipulating equations like $2 + 2 = 4,$ and you're using methods that may or may not let you throw in an extra 3 on the right hand side (depending on the arithmetician's state of mind), then it's no surprise that you'll occasionally get yourself into trouble and deduce that $2 + 2 = 7.$ The laws of arithmetic show that there is only one correct set of tools for manipulating equations if you want to avoid inconsistency.\n\nSimilarly, the laws of probability theory show that there is only one correct set of tools for manipulating _uncertainty_ if you want to avoid inconsistency. According to [1lz those rules], the right way to represent evidence is through likelihood functions.\n\nThese laws (and a solid understanding of them) are younger than the experimental science community, and the statistical tools of that community predate a modern understanding of probability theory. Thus, it makes a lot of sense that the existing literature uses different tools. However, now that humanity _does_ possess a solid understanding of probability theory, it should come as no surprise that many diverse pathologies in statistics can be cleaned up by switching to a policy of reporting likelihoods instead of p-values.\n\n## What are the drawbacks?\n\nThe main drawback is inertia. Experimental science today reports p-values almost entirely across the board. Modern statistical toolsets have built-in support for p-values (and other related statistical tools) but very little support for reporting likelihood functions. Experimental scientists are trained mainly in [-frequentist_statistics], and thus most are much more familiar with p-value-type tools than likelihood-function-type tools. Making the switch would be painful.\n\nBarring the switching costs, though, making the switch could well be a strict improvement over modern techniques, and would help solve some of the biggest [http://slatestarcodex.com/2014/04/28/the-control-group-is-out-of-control/ problems] [http://www.stat.columbia.edu/~gelman/research/published/asa_pvalues.pdf facing] [https://en.wikipedia.org/wiki/Data_dredging science] [https://en.wikipedia.org/wiki/Publication_bias today].\n\nSee also the [505 Likelihoods not p-values FAQ] and [4xx].',
metaText: '',
isTextLoaded: 'true',
isSubscribedToDiscussion: 'false',
isSubscribedToUser: 'false',
isSubscribedAsMaintainer: 'false',
discussionSubscriberCount: '2',
maintainerCount: '1',
userSubscriberCount: '0',
lastVisit: '',
hasDraft: 'false',
votes: [],
voteSummary: 'null',
muVoteSummary: '0',
voteScaling: '0',
currentUserVote: '-2',
voteCount: '0',
lockedVoteType: '',
maxEditEver: '0',
redLinkCount: '0',
lockedBy: '',
lockedUntil: '',
nextPageId: '',
prevPageId: '',
usedAsMastery: 'false',
proposalEditNum: '0',
permissions: {
edit: {
has: 'false',
reason: 'You don't have domain permission to edit this page'
},
proposeEdit: {
has: 'true',
reason: ''
},
delete: {
has: 'false',
reason: 'You don't have domain permission to delete this page'
},
comment: {
has: 'false',
reason: 'You can't comment in this domain because you are not a member'
},
proposeComment: {
has: 'true',
reason: ''
}
},
summaries: {},
creatorIds: [
'NateSoares',
'EricRogstad',
'EricBruylant'
],
childIds: [
'likelihood_vs_pvalue',
'likelihood_not_pvalue_faq'
],
parentIds: [
'probability'
],
commentIds: [
'4zs'
],
questionIds: [],
tagIds: [
'opinion_meta_tag'
],
relatedIds: [],
markIds: [],
explanations: [],
learnMore: [],
requirements: [],
subjects: [],
lenses: [
{
id: '63',
pageId: 'likelihoods_not_pvalues',
lensId: 'likelihood_not_pvalue_faq',
lensIndex: '0',
lensName: 'FAQ',
lensSubtitle: '',
createdBy: '32',
createdAt: '2016-07-04 05:31:10',
updatedBy: '32',
updatedAt: '2016-07-04 05:31:16'
},
{
id: '56',
pageId: 'likelihoods_not_pvalues',
lensId: 'likelihood_vs_pvalue',
lensIndex: '1',
lensName: 'Dialog',
lensSubtitle: '',
createdBy: '32',
createdAt: '2016-07-01 01:52:48',
updatedBy: '32',
updatedAt: '2016-07-04 05:31:16'
}
],
lensParentId: '',
pathPages: [],
learnMoreTaughtMap: {},
learnMoreCoveredMap: {},
learnMoreRequiredMap: {},
editHistory: {},
domainSubmissions: {},
answers: [],
answerCount: '0',
commentCount: '0',
newCommentCount: '0',
linkedMarkCount: '0',
changeLogs: [
{
likeableId: '0',
likeableType: 'changeLog',
myLikeValue: '0',
likeCount: '0',
dislikeCount: '0',
likeScore: '0',
individualLikes: [],
id: '22511',
pageId: 'likelihoods_not_pvalues',
userId: 'NateSoares',
edit: '23',
type: 'newEdit',
createdAt: '2017-04-29 05:00:59',
auxPageId: '',
oldSettingsValue: '',
newSettingsValue: ''
},
{
likeableId: '0',
likeableType: 'changeLog',
myLikeValue: '0',
likeCount: '0',
dislikeCount: '0',
likeScore: '0',
individualLikes: [],
id: '22510',
pageId: 'likelihoods_not_pvalues',
userId: 'NateSoares',
edit: '22',
type: 'newEdit',
createdAt: '2017-04-29 04:59:52',
auxPageId: '',
oldSettingsValue: '',
newSettingsValue: ''
},
{
likeableId: '0',
likeableType: 'changeLog',
myLikeValue: '0',
likeCount: '0',
dislikeCount: '0',
likeScore: '0',
individualLikes: [],
id: '20040',
pageId: 'likelihoods_not_pvalues',
userId: 'NateSoares',
edit: '21',
type: 'newEdit',
createdAt: '2016-10-11 05:46:26',
auxPageId: '',
oldSettingsValue: '',
newSettingsValue: ''
},
{
likeableId: '0',
likeableType: 'changeLog',
myLikeValue: '0',
likeCount: '0',
dislikeCount: '0',
likeScore: '0',
individualLikes: [],
id: '20039',
pageId: 'likelihoods_not_pvalues',
userId: 'NateSoares',
edit: '20',
type: 'newEdit',
createdAt: '2016-10-11 05:36:03',
auxPageId: '',
oldSettingsValue: '',
newSettingsValue: ''
},
{
likeableId: '0',
likeableType: 'changeLog',
myLikeValue: '0',
likeCount: '0',
dislikeCount: '0',
likeScore: '0',
individualLikes: [],
id: '20038',
pageId: 'likelihoods_not_pvalues',
userId: 'NateSoares',
edit: '19',
type: 'newEdit',
createdAt: '2016-10-11 05:33:34',
auxPageId: '',
oldSettingsValue: '',
newSettingsValue: ''
},
{
likeableId: '0',
likeableType: 'changeLog',
myLikeValue: '0',
likeCount: '0',
dislikeCount: '0',
likeScore: '0',
individualLikes: [],
id: '20037',
pageId: 'likelihoods_not_pvalues',
userId: 'NateSoares',
edit: '18',
type: 'newEdit',
createdAt: '2016-10-11 05:32:21',
auxPageId: '',
oldSettingsValue: '',
newSettingsValue: ''
},
{
likeableId: '0',
likeableType: 'changeLog',
myLikeValue: '0',
likeCount: '0',
dislikeCount: '0',
likeScore: '0',
individualLikes: [],
id: '19336',
pageId: 'likelihoods_not_pvalues',
userId: 'EricBruylant',
edit: '17',
type: 'newEdit',
createdAt: '2016-08-27 22:36:22',
auxPageId: '',
oldSettingsValue: '',
newSettingsValue: 'added TOC and link to opinion page tag'
},
{
likeableId: '0',
likeableType: 'changeLog',
myLikeValue: '0',
likeCount: '0',
dislikeCount: '0',
likeScore: '0',
individualLikes: [],
id: '19335',
pageId: 'likelihoods_not_pvalues',
userId: 'EricBruylant',
edit: '0',
type: 'newTag',
createdAt: '2016-08-27 22:35:56',
auxPageId: 'opinion_meta_tag',
oldSettingsValue: '',
newSettingsValue: ''
},
{
likeableId: '0',
likeableType: 'changeLog',
myLikeValue: '0',
likeCount: '0',
dislikeCount: '0',
likeScore: '0',
individualLikes: [],
id: '16365',
pageId: 'likelihoods_not_pvalues',
userId: 'NateSoares',
edit: '16',
type: 'newEdit',
createdAt: '2016-07-10 12:56:32',
auxPageId: '',
oldSettingsValue: '',
newSettingsValue: ''
},
{
likeableId: '0',
likeableType: 'changeLog',
myLikeValue: '0',
likeCount: '0',
dislikeCount: '0',
likeScore: '0',
individualLikes: [],
id: '16344',
pageId: 'likelihoods_not_pvalues',
userId: 'EricRogstad',
edit: '15',
type: 'newEdit',
createdAt: '2016-07-10 05:53:26',
auxPageId: '',
oldSettingsValue: '',
newSettingsValue: ''
},
{
likeableId: '0',
likeableType: 'changeLog',
myLikeValue: '0',
likeCount: '0',
dislikeCount: '0',
likeScore: '0',
individualLikes: [],
id: '15920',
pageId: 'likelihoods_not_pvalues',
userId: 'NateSoares',
edit: '14',
type: 'newEdit',
createdAt: '2016-07-07 04:56:02',
auxPageId: '',
oldSettingsValue: '',
newSettingsValue: ''
},
{
likeableId: '0',
likeableType: 'changeLog',
myLikeValue: '0',
likeCount: '0',
dislikeCount: '0',
likeScore: '0',
individualLikes: [],
id: '15909',
pageId: 'likelihoods_not_pvalues',
userId: 'NateSoares',
edit: '13',
type: 'newEdit',
createdAt: '2016-07-07 03:56:21',
auxPageId: '',
oldSettingsValue: '',
newSettingsValue: ''
},
{
likeableId: '0',
likeableType: 'changeLog',
myLikeValue: '0',
likeCount: '0',
dislikeCount: '0',
likeScore: '0',
individualLikes: [],
id: '15788',
pageId: 'likelihoods_not_pvalues',
userId: 'NateSoares',
edit: '12',
type: 'newEdit',
createdAt: '2016-07-06 21:03:22',
auxPageId: '',
oldSettingsValue: '',
newSettingsValue: ''
},
{
likeableId: '0',
likeableType: 'changeLog',
myLikeValue: '0',
likeCount: '0',
dislikeCount: '0',
likeScore: '0',
individualLikes: [],
id: '15787',
pageId: 'likelihoods_not_pvalues',
userId: 'NateSoares',
edit: '11',
type: 'newEdit',
createdAt: '2016-07-06 21:00:04',
auxPageId: '',
oldSettingsValue: '',
newSettingsValue: ''
},
{
likeableId: '0',
likeableType: 'changeLog',
myLikeValue: '0',
likeCount: '0',
dislikeCount: '0',
likeScore: '0',
individualLikes: [],
id: '15785',
pageId: 'likelihoods_not_pvalues',
userId: 'NateSoares',
edit: '10',
type: 'newEdit',
createdAt: '2016-07-06 20:59:01',
auxPageId: '',
oldSettingsValue: '',
newSettingsValue: ''
},
{
likeableId: '0',
likeableType: 'changeLog',
myLikeValue: '0',
likeCount: '0',
dislikeCount: '0',
likeScore: '0',
individualLikes: [],
id: '15784',
pageId: 'likelihoods_not_pvalues',
userId: 'NateSoares',
edit: '9',
type: 'newEdit',
createdAt: '2016-07-06 20:57:45',
auxPageId: '',
oldSettingsValue: '',
newSettingsValue: ''
},
{
likeableId: '0',
likeableType: 'changeLog',
myLikeValue: '0',
likeCount: '0',
dislikeCount: '0',
likeScore: '0',
individualLikes: [],
id: '15253',
pageId: 'likelihoods_not_pvalues',
userId: 'NateSoares',
edit: '8',
type: 'newEdit',
createdAt: '2016-07-04 16:07:31',
auxPageId: '',
oldSettingsValue: '',
newSettingsValue: ''
},
{
likeableId: '0',
likeableType: 'changeLog',
myLikeValue: '0',
likeCount: '0',
dislikeCount: '0',
likeScore: '0',
individualLikes: [],
id: '15209',
pageId: 'likelihoods_not_pvalues',
userId: 'NateSoares',
edit: '0',
type: 'lensOrderChanged',
createdAt: '2016-07-04 05:31:16',
auxPageId: '',
oldSettingsValue: '',
newSettingsValue: ''
},
{
likeableId: '0',
likeableType: 'changeLog',
myLikeValue: '0',
likeCount: '0',
dislikeCount: '0',
likeScore: '0',
individualLikes: [],
id: '15207',
pageId: 'likelihoods_not_pvalues',
userId: 'NateSoares',
edit: '0',
type: 'newChild',
createdAt: '2016-07-04 05:31:06',
auxPageId: 'likelihood_not_pvalue_faq',
oldSettingsValue: '',
newSettingsValue: ''
},
{
likeableId: '0',
likeableType: 'changeLog',
myLikeValue: '0',
likeCount: '0',
dislikeCount: '0',
likeScore: '0',
individualLikes: [],
id: '15205',
pageId: 'likelihoods_not_pvalues',
userId: 'NateSoares',
edit: '7',
type: 'newEdit',
createdAt: '2016-07-04 05:25:17',
auxPageId: '',
oldSettingsValue: '',
newSettingsValue: ''
},
{
likeableId: '0',
likeableType: 'changeLog',
myLikeValue: '0',
likeCount: '0',
dislikeCount: '0',
likeScore: '0',
individualLikes: [],
id: '15204',
pageId: 'likelihoods_not_pvalues',
userId: 'NateSoares',
edit: '6',
type: 'newEdit',
createdAt: '2016-07-04 05:14:06',
auxPageId: '',
oldSettingsValue: '',
newSettingsValue: ''
},
{
likeableId: '0',
likeableType: 'changeLog',
myLikeValue: '0',
likeCount: '0',
dislikeCount: '0',
likeScore: '0',
individualLikes: [],
id: '15198',
pageId: 'likelihoods_not_pvalues',
userId: 'EricRogstad',
edit: '5',
type: 'newEdit',
createdAt: '2016-07-03 17:49:32',
auxPageId: '',
oldSettingsValue: '',
newSettingsValue: 'builtin -> built-in'
},
{
likeableId: '0',
likeableType: 'changeLog',
myLikeValue: '0',
likeCount: '0',
dislikeCount: '0',
likeScore: '0',
individualLikes: [],
id: '15163',
pageId: 'likelihoods_not_pvalues',
userId: 'EricRogstad',
edit: '4',
type: 'newEdit',
createdAt: '2016-07-03 09:22:17',
auxPageId: '',
oldSettingsValue: '',
newSettingsValue: ''
},
{
likeableId: '0',
likeableType: 'changeLog',
myLikeValue: '0',
likeCount: '0',
dislikeCount: '0',
likeScore: '0',
individualLikes: [],
id: '15071',
pageId: 'likelihoods_not_pvalues',
userId: 'NateSoares',
edit: '3',
type: 'newEdit',
createdAt: '2016-07-01 16:59:38',
auxPageId: '',
oldSettingsValue: '',
newSettingsValue: ''
},
{
likeableId: '0',
likeableType: 'changeLog',
myLikeValue: '0',
likeCount: '0',
dislikeCount: '0',
likeScore: '0',
individualLikes: [],
id: '15042',
pageId: 'likelihoods_not_pvalues',
userId: 'NateSoares',
edit: '2',
type: 'newEdit',
createdAt: '2016-07-01 07:31:12',
auxPageId: '',
oldSettingsValue: '',
newSettingsValue: ''
},
{
likeableId: '0',
likeableType: 'changeLog',
myLikeValue: '0',
likeCount: '0',
dislikeCount: '0',
likeScore: '0',
individualLikes: [],
id: '15007',
pageId: 'likelihoods_not_pvalues',
userId: 'NateSoares',
edit: '0',
type: 'newChild',
createdAt: '2016-07-01 01:52:56',
auxPageId: 'likelihood_vs_pvalue',
oldSettingsValue: '',
newSettingsValue: ''
},
{
likeableId: '0',
likeableType: 'changeLog',
myLikeValue: '0',
likeCount: '0',
dislikeCount: '0',
likeScore: '0',
individualLikes: [],
id: '15006',
pageId: 'likelihoods_not_pvalues',
userId: 'NateSoares',
edit: '0',
type: 'newParent',
createdAt: '2016-07-01 01:52:55',
auxPageId: 'probability',
oldSettingsValue: '',
newSettingsValue: ''
},
{
likeableId: '0',
likeableType: 'changeLog',
myLikeValue: '0',
likeCount: '0',
dislikeCount: '0',
likeScore: '0',
individualLikes: [],
id: '15004',
pageId: 'likelihoods_not_pvalues',
userId: 'NateSoares',
edit: '1',
type: 'newEdit',
createdAt: '2016-07-01 01:52:54',
auxPageId: '',
oldSettingsValue: '',
newSettingsValue: ''
}
],
feedSubmissions: [],
searchStrings: {},
hasChildren: 'true',
hasParents: 'true',
redAliases: {},
improvementTagIds: [],
nonMetaTagIds: [],
todos: [],
slowDownMap: 'null',
speedUpMap: 'null',
arcPageIds: 'null',
contentRequests: {
improveStub: {
likeableId: '3744',
likeableType: 'contentRequest',
myLikeValue: '0',
likeCount: '1',
dislikeCount: '0',
likeScore: '1',
individualLikes: [],
id: '164',
pageId: 'likelihoods_not_pvalues',
requestType: 'improveStub',
createdAt: '2016-12-04 02:09:17'
}
}
}