Frank Zenker, 12 March 2019, 16h

March 12, 2019

ArgLab Research Colloquium

Av. de Berna 26, I&D Building, ground floor, room 0.06


Why replication is your problem, too

Frank Zenker, Lund University, Sweden


Scholars, as opposed to scientists, do normally not conduct empirical studies. But their own work regularly cites—and thus fully relies on—published results that others provide. In the social and behavioral sciences, the main strategy to generate such empirical results has remained null-hypothesis significance testing (NHST). Recent attempts, however, broadly failed to replicate allegedly well-established result, giving rise to an ongoing “replication crisis.” The crisis entails that NHST retains too many errors; otherwise many more such effects should have replicated successfully. This makes trusting and citing even results that top-tier journals publish a true difficulty. On this background, we advocate the research program strategy (RPS)—employing both Frequentist NHST-elements and elements of Bayesian hypothesis-testing (BHT)—as superior to NHST. Data-simulation shows that RPS’s six steps (leading from a discovery against a random model to a statistically verified hypothesis) retain far fewer errors, and thus deserve far greater trust, than NHST- or BHT-results. We also show how to estimate the expectable error proportion among published results. A background in inferential statistics is helpful, but not necessary to profit from this talk. It is based, among others, on these publications:

Witte, E.H., and Zenker, F. (2017b). From discovery to justification. Outline of an ideal research program in empirical psychology. Frontiers in Psychology, 8, 1847 (ISSN 1664-1078). https://www.frontiersin.org/articles/10.3389/fpsyg.2017.01847/full

Krefeld-Schwalb, A; Witte, E.H., and Zenker, F. (2018). Hypothesis-testing demands trustworthy data—a simulation approach to statistical inference advocating the research program strategy. Frontiers in Psychology, 9, 460 (ISSN 1664-1078). https://www.frontiersin.org/articles/10.3389/fpsyg.2018.00460/full

Witte, E.H., and Zenker, F. (2018). Data replication matters, replicated hypothesis-corroboration counts. (Commentary on “Making Replication Mainstream” by Rolf A. Zwaan, Alexander Etz, Richard E., Lucas, and M. Brent Donnellan). Behavioral and Brain Sciences, 41, e120 (ISSN: 0140-525X). https://www.cambridge.org/core/journals/behavioral-and-brain-sciences/article/data-replication-matters-to-an-underpowered-study-but-replicated-hypothesis-corroboration-counts/90E7D8EFF04C42E0857CAA943DCBBBAC

Back to previous page


All Events

Klaus Gaertner, September 30, 2020

Lisbon Mind & Reasoning RIP Seminar | The Untold Story…

September 30, 2020

2nd ERB Project Workshop: Wittgenstein, Nature, and Religion

2nd ERB Project Workshop

July 29, 2020

Dina Mendonça 8 July, 2020

Lisbon Mind & Reasoning RIP Seminar | Why the Situated…

July 08, 2020

Dave Ward, 12 June 2020, 11h

ArgLab Research Colloquium | Friendly Sensorimotor Generalists

June 12, 2020

Gloria Andrada (w/Robert Clowes), 3 June, 2020, 15.00h to 16.00h

Lisbon Mind & Reasoning RIP Seminar | Transparency in Extended…

June 02, 2020

Alice Crary, 8 May 2020, 11h

ArgLab Research Colloquium | Dehumanization and the Question of Animals

May 08, 2020

Alan Cienki, 17 April 2020, 11h

ArgLab Research Colloquium | Pragmatic functions of gesture on different…

April 17, 2020

Catarina Dutilh Novaes, 13 March 2020, 11h

ArgLab Research Colloquium | The role of trust in argumentation

March 13, 2020

Two-day Masterclass on Wittgenstein’s Epistemology of Religion

ERB Masterclass 2020

February 26, 2020

Fabrizia Garavaglia, 19 February, 2020, 12.00h to 13.00h

Lisbon Mind & Reasoning RIP Seminar | A situated approach…

February 19, 2020

Florian Franken Figueiredo, 14 Feb 2020, 11h

ArgLab Research Colloquium | Philosophy for Children and the Socratic…

February 14, 2020

Abraham Sapién, 22 January, 2020, 12.00h to 13.00

Lisbon Mind & Reasoning RIP Seminar | The Structure of…

January 22, 2020

DISARGUE Workshop 19-20 Dec 2019


December 19, 2019

Hili Razinsky, 11 December, 2019, 12.00h to 13.00h

Lisbon Mind & Reasoning RIP Seminar | Interpersonal communication and…

December 11, 2019

Herman Cappelen, 6 December 2019, 11h

ArgLab Research Colloquium | Conceptual Engineering: Under our Control?

December 06, 2019

Dima Mohammed, 15 Nov 2019, 11h

ArgLab Research Colloquium | "Discursive depoliticisation: From argumentation to explanation"

November 15, 2019

Rob Vinten, 6 Nov, 2019, 12.00h to 13.00h

Lisbon Mind & Reasoning RIP Seminar | Wittgenstein, Buddhism, and…

November 06, 2019

Vito Evola, 11 October 2019, 11h

ArgLab Research Colloquium | "More than words: Worldmaking and stancetaking…

October 11, 2019


Faculdade de Direito Universidade Nova de Lisboa