The p-value ritual

The p-value and its implicit symbolism

***
The Aristotelian syllogistic logic behind the Fisherian p-value is ubiquitously misunderstood. This can lead to various fallacious logical inferences. The p-value resembles a Kantian paralogism, i.e., the metric appears objective and logically valid, even though it is not. The reliance on the p-value is an irrational social ritual (cf. Gigerenzer, 2004). Social conformity, obedience to authority, groupthink, and other aspects of Social Identity Theory (SIT) play an important role in this context.

Given the well-documented paralogisms associated with classical Fisherian null hypothesis significance testing (cf. Cohen, 1994) I advocate alternative inferential research methods. For the statistical analyses of the experimental data I collected during my PhD I utilised Bayesian bootstrapping, Bayes Factor analysis, and Bayesian parameter estimation via Markov chain Monte Carlo simulations (in addition to classical NHST).

“Few researchers are aware that their own heroes rejected what they practice routinely. Awareness of the origins of the ritual and of its rejection could cause a virulent cognitive dissonance, in addition to dissonance with editors, reviewers, and dear colleagues. Suppression of conflicts and contradicting information is in the very nature of this social ritual.”
(Gerd Gigerenzer, 2004, p. 592; Director Emeritus of the Center for Adaptive Behavior and Cognition at the Max Planck Institute for Human Development, inter alia)

Statistical Research Methods workshop at the University of Plymouth in 2014:
The pitfalls of hypothesis testing


***
Fullscreen: https://christopher-germann.de/papers/pitfalls-of-nhst/

handout-nhst
See also: https://christopher-germann.de/the-paralogisms-of-null-hypothesis-significance-testing-in-science/
Related Posts
Immortality – A dialogue between Thrasymachos and Philalethes (Arthur Schopenhauer – Studies in Pessimism)
Immortality – A dialogue between Thrasymachos and Philalethes (Arthur Schopenhauer – Studies in Pessimism)
Dual-Aspect monism
Dual-Aspect monism
Jala Netī
Jala Netī
NHST: Type 1 error (α) inflation
NHST: Type 1 error (α) inflation
Einstein and the Quantum:  The Quest of the Valiant Swabian
Einstein and the Quantum: The Quest of the Valiant Swabian
NHST: P-hacking
NHST: P-hacking
Shavāsana
Shavāsana
Markov chain Monte Carlo (MCMC) simulations
Markov chain Monte Carlo (MCMC) simulations
The Möbius Band: A peculiar geometrical figure
The Möbius Band: A peculiar geometrical figure
95% Confidence Intervals
95% Confidence Intervals
previous arrow
next arrow
Immortality – A dialogue between Thrasymachos and Philalethes (Arthur Schopenhauer – Studies in Pessimism)
Immortality – A dialogue between Thrasymachos and Philalethes (Arthur Schopenhauer – Studies in Pessimism)
Dual-Aspect monism
Dual-Aspect monism
Jala Netī
Jala Netī
NHST: Type 1 error (α) inflation
NHST: Type 1 error (α) inflation
Einstein and the Quantum:  The Quest of the Valiant Swabian
Einstein and the Quantum:  The Quest of the Valiant Swabian
NHST: P-hacking
NHST: P-hacking
Shavāsana
Shavāsana
Markov chain Monte Carlo (MCMC) simulations
Markov chain Monte Carlo (MCMC) simulations
The Möbius Band: A peculiar geometrical figure
The Möbius Band: A peculiar geometrical figure
95% Confidence Intervals
95% Confidence Intervals
Immortality – A dialogue between Thrasymachos and Philalethes (Arthur Schopenhauer – Studies in Pessimism)

/*!
* Base CSS for pdf2htmlEX
* Copyright 2012,2013 Lu Wang
* https://github.com/coolwanglu/pdf2htmlEX/blob/master/share/LICENSE
*/#sidebar{position:absolute;top:0;left:0;bottom:0;width:250px;padding:0;margin:0;overflow:auto}#page-container{position:absolute;top:0;left:0;margin:0;padding:0;border:0}@media screen{#sidebar.opened+#page-container{left:250px}#page-container{bottom:0;right:0;overflow:auto}.loading-indicator{display:none}.loading-indicator.active{display:block;position:absolute;width:64px;height:64px;top:50%;left:50%;margin-top:-32px;margin-left:-32px}.loading-indicator img{position:absolute;top:0;left:0;bottom:0;right:0}}@media print{@page{margin:0}html{margin:0}body{margin:0;-webkit-print-color-adjust:exact}#sidebar{display:none}#page-container{width:auto;height:auto;overflow:visible;background-color:transparent}.d{display:none}}.pf{position:relative;background-color:white;overflow:hidden;margin:0;border:0}.pc{position:absolute;border:0;padding:0;margin:0;top:0;left:0;width:100%;height:100%;overflow:hidden;display:block;transform-origin:0 (...)

Immortality – A dialogue between Thrasymachos and Philalethes (Arthur Schopenhauer – Studies in Pessimism)
Dual-Aspect monism

Visit: http://dual-aspect-monism.cf

Abstract

It is argued that the Möbius band provides a readily communicable conceptual visual metaphor for dual-aspect Monism à la Pauli-Jung. The Pauli-Jung conjecture is particularly relevant in the context of modern neuroscience as most contemporary neuroscientists stipulate prima facie that the brain produces consciousness. However, this perspective is not conclusively supported by empirical evidence. the monistic dual-aspect perspective provides a parsimonious & elegant solution for the mind-body problem and the hard problem of consciousness (viz., the production problem). The symbolism of the Möbius band is particularly interesting from an embodied and grounded cognition perspective.  Specifically, Lakoff’s “conceptual metaphor theory” provides (...)

Dual-Aspect monism
Jala Netī

A CT scan providing evidence of the nasal cycle. The more patent airway is on the right of the image; the swollen turbinates congesting the left.

The nasal cycle is unknown to many people. It refers to the alternating partial congestion and decongestion of the nasal cavities in primates. It is a visible physiological congestion of the nasal conchae (nasal turbinates) due to selective lateralised activation of one half of the autonomic nervous system by the hypothalamus (cf. hemispheric lateralisation). It completly unrelated to pathological nasal congestion and is comparable to the circadian rhythm (in the broadest sense). The ancient yoga literature describes the nasal cycle in detail and it is the focus of several pranayama (breathing) techniques which have the goal to balance the nervous (...)

Jala Netī
NHST: Type 1 error (α) inflation

Definition of Type I error:
Probability of rejecting null hypothesis when it is TRUE.

Definition of Type II error:
Probability of not rejecting null hypothesis when it is False.

Imagine tests on 1000 hypotheses 100 of which are true.

The tests have a false positive rate of 5%. That means they produce 45 false positives (5% of 900). They have a power of .8, so they can confirm only 80 of the true hypotheses, producing 20 negatives.

Not knowing what is false and what is not the researcher sees 125 hypotheses as true, 45 of which are not. The negative results are much more reliable but less likely to be published.

A parable concerning editorial policies

There's this desert prison, see, with an old prisoner, resigned to his life, and a young one (...)

NHST: Type 1 error (α) inflation
Einstein and the Quantum: The Quest of the Valiant Swabian

/*!
* Base CSS for pdf2htmlEX
* Copyright 2012,2013 Lu Wang
* https://github.com/coolwanglu/pdf2htmlEX/blob/master/share/LICENSE
*/#sidebar{position:absolute;top:0;left:0;bottom:0;width:250px;padding:0;margin:0;overflow:auto}#page-container{position:absolute;top:0;left:0;margin:0;padding:0;border:0}@media screen{#sidebar.opened+#page-container{left:250px}#page-container{bottom:0;right:0;overflow:auto}.loading-indicator{display:none}.loading-indicator.active{display:block;position:absolute;width:64px;height:64px;top:50%;left:50%;margin-top:-32px;margin-left:-32px}.loading-indicator img{position:absolute;top:0;left:0;bottom:0;right:0}}@media print{@page{margin:0}html{margin:0}body{margin:0;-webkit-print-color-adjust:exact}#sidebar{display:none}#page-container{width:auto;height:auto;overflow:visible;background-color:transparent}.d{display:none}}.pf{position:relative;background-color:white;overflow:hidden;margin:0;border:0}.pc{position:absolute;border:0;padding:0;margin:0;top:0;left:0;width:100%;height:100%;overflow:hidden;display:block;transform-origin:0 (...)

Einstein and the Quantum:  The Quest of the Valiant Swabian
NHST: P-hacking
NHST: P-hacking
Shavāsana

"...lying full length on the back like a corpse is called Savasana. With this asana, tiredness caused by other asanas is eliminated; it also promotes calmness of the mind."
~ Hatha Yoga Pradipika 1.32
Shavasāna (Sanskrit: शवासन; transl. "corpse pose") is an asana in hatha yoga which is often used at the end of a series of asanas for deep relaxation and meditation.
References

Thönes, S., & Wittmann, M.. (2016). Time perception in yogic mindfulness meditation—Effects on retrospective duration judgments and time passage.. Psychology of Consciousness: Theory, Research, and Practice, 3(4), 316–325.
Plain numerical DOI: 10.1037/cns0000088

“Over the last few years, several studies investigated possible effects of mindfulness meditation on the perception of time. however, these effects (...)

Shavāsana
Markov chain Monte Carlo (MCMC) simulations

/*!
* Base CSS for pdf2htmlEX
* Copyright 2012,2013 Lu Wang
* https://github.com/coolwanglu/pdf2htmlEX/blob/master/share/LICENSE
*/#sidebar{position:absolute;top:0;left:0;bottom:0;width:250px;padding:0;margin:0;overflow:auto}#page-container{position:absolute;top:0;left:0;margin:0;padding:0;border:0}@media screen{#sidebar.opened+#page-container{left:250px}#page-container{bottom:0;right:0;overflow:auto}.loading-indicator{display:none}.loading-indicator.active{display:block;position:absolute;width:64px;height:64px;top:50%;left:50%;margin-top:-32px;margin-left:-32px}.loading-indicator img{position:absolute;top:0;left:0;bottom:0;right:0}}@media print{@page{margin:0}html{margin:0}body{margin:0;-webkit-print-color-adjust:exact}#sidebar{display:none}#page-container{width:auto;height:auto;overflow:visible;background-color:transparent}.d{display:none}}.pf{position:relative;background-color:white;overflow:hidden;margin:0;border:0}.pc{position:absolute;border:0;padding:0;margin:0;top:0;left:0;width:100%;height:100%;overflow:hidden;display:block;transform-origin:0 (...)

Markov chain Monte Carlo (MCMC) simulations
The Möbius Band: A peculiar geometrical figure

Visit: http://moebius-band.ga

Code for generating an interactive Möbius band in R (using OpenGL)
library(rgl) # (Murdoch, 2001)
library(plot3D) # (Soetaert, 2014)
# Define parameters
R <- 3
u <- seq(0, 2 * pi, length.out = 100)
v <- seq(-1, 1, length.out = 100)
m <- mesh(u, v)
u <- m$x
v <- m$y
# Möbius strip parametric equations
x <- (R + v/2 * cos(u /2)) * cos(u)
y <- (R + v/2 * cos(u /2)) * sin(u)
# Visualise in 3-dimensional Euclidean space
bg3d(color = "white")
surface3d(x, y, z, color= "red")

icon-file https://christopher-germann.de/wp-content/uploads/A-non-dual-cognitive-neuroscience-perspective1.pdf
(...)

The Möbius Band: A peculiar geometrical figure
95% Confidence Intervals

In inferential statistics, a confidence interval (CI) is a type of interval estimate, computed from the statistics of the observed data, that might contain the true value of an unknown population parameter. The interval has an associated confidence level that, loosely speaking, quantifies the level of confidence that the parameter lies in the interval. More strictly speaking, the confidence level represents the frequency (i.e. the proportion) of possible confidence intervals that contain the true value of the unknown population parameter. In other words, if confidence intervals are constructed using a given confidence level from an infinite number of independent sample statistics, the proportion of those intervals that contain the true value of the parameter will be equal to the confidence (...)

95% Confidence Intervals
previous arrow
next arrow
Shadow

Leave a Reply