For decades, statisticians and clinicians have debated the meaning of statistical and clinical significance. In general, most journals remain married to the frequentist approach to statistical testing and using the term statistical significance. A recent proposal to ban statistical significance gained campaign-level momentum in a commentary with 854 recruited signatories.1 The petition proposes retaining P values but abandoning dichotomous statements (significant/nonsignificant), suggests discussing “compatible” effect sizes, denounces “proofs of the null,” and points out that “crucial effects” are dismissed on discovery or refuted on replication because of nonsignificance. The proposal also indicates that “we should never conclude there is ‘no difference’ or ‘no association’ just because a P value is larger than a threshold such as 0.05 or, equivalently, because a confidence interval includes zero,”1 and that categorization based on other statistical measures (eg, Bayes factors) should be discouraged. Other recent articles have also addressed similar topics, with an entire supplemental issue of a statistics journal devoted to issues related to P values.2
Identify all potential conflicts of interest that might be relevant to your comment.
Conflicts of interest comprise financial interests, activities, and relationships within the past 3 years including but not limited to employment, affiliation, grants or funding, consultancies, honoraria or payment, speaker's bureaus, stock ownership or options, expert testimony, royalties, donation of medical equipment, or patents planned, pending, or issued.
Err on the side of full disclosure.
If you have no conflicts of interest, check "No potential conflicts of interest" in the box below. The information will be posted with your response.
Not all submitted comments are published. Please see our commenting policy for details.
Ioannidis JPA. The Importance of Predefined Rules and Prespecified Statistical Analyses: Do Not Abandon Significance. JAMA. Published online April 04, 2019321(21):2067–2068. doi:10.1001/jama.2019.4582
Customize your JAMA Network experience by selecting one or more topics from the list below.
Create a personal account or sign in to: