PhilSci Archive

Rubin (2023) - Questionable Metascience Practices

Rubin, Mark (2023) Rubin (2023) - Questionable Metascience Practices. Journal of Trial and Error.

[img]
Preview
Text
Rubin (2023) - QMPs.pdf - Published Version
Available under License Creative Commons Attribution.

Download (339kB) | Preview

Abstract

Metascientists have studied questionable research practices in science. The present article considers the parallel concept of questionable metascience practices (QMPs). A QMP is a research practice, assumption, or perspective that has been questioned by several commentators as being potentially problematic for metascience and/or the science reform movement. The present article reviews ten QMPs that relate to criticism, replication, bias, generalization, and the characterization of science. Specifically, the following QMPs are considered: (1) rejecting or ignoring self criticism; (2) a fast ‘n’ bropen scientific criticism style; (3) overplaying the role of replication in science; (4) assuming a replication rate is “too low” without specifying an “acceptable” rate; (5) an unacknowledged metabias towards explaining the replication crisis in terms of researcher bias; (6) assuming that researcher bias can be reduced; (7) devaluing exploratory results as being more “tentative” than confirmatory results; (8) presuming that questionable research practices are problematic research practices; (9) focusing on knowledge accumulation; and (10) focusing on specific scientific methods. It is stressed that only some metascientists engage in some QMPs some of the time, and that these QMPs may not always be problematic. Research is required to estimate the prevalence and impact of QMPs. In the meantime, QMPs should be viewed as invitations to ask questions about how we go about doing better metascience.


Export/Citation: EndNote | BibTeX | Dublin Core | ASCII/Text Citation (Chicago) | HTML Citation | OpenURL
Social Networking:
Share |

Item Type: Published Article or Volume
Creators:
CreatorsEmailORCID
Rubin, MarkMark-Rubin@outlook.com0000-0002-6483-8561
Keywords: metascience; open science; questionable research practices; replication crisis; science reform
Subjects: General Issues > Explanation
Specific Sciences > Psychology
General Issues > Science and Policy
General Issues > Social Epistemology of Science
Depositing User: Dr Mark Rubin
Date Deposited: 30 Aug 2023 07:44
Last Modified: 30 Aug 2023 07:44
Item ID: 22465
Journal or Publication Title: Journal of Trial and Error
Official URL: https://doi.org/10.36850/mr4
DOI or Unique Handle: https://doi.org/10.36850/mr4
Subjects: General Issues > Explanation
Specific Sciences > Psychology
General Issues > Science and Policy
General Issues > Social Epistemology of Science
Date: 24 April 2023
URI: https://philsci-archive-dev.library.pitt.edu/id/eprint/22465

Monthly Views for the past 3 years

Monthly Downloads for the past 3 years

Plum Analytics

Altmetric.com

Actions (login required)

View Item View Item