The nature of our literature

  • Scientists rely upon an accurate scientific literature in order to build and test new theories about the natural world. In the past decade, observational studies of the scientific literature have indicated that numerous questionable research practices and poor reporting practices may be hindering scientific progress. In particular, 3 recent studies have indicated an implausibly high rate of studies with positive (i.e., hypothesis confirming) results. In sports medicine, a field closely related to kinesiology, studies that tested a hypothesis indicated support for their primary hypothesis ~70% of the time. However, a study of journals that cover the entire field of kinesiology has yet to be completed, and the quality of other reporting practices, such as clinical trial registration, has not been evaluated. In this study we retrospectively evaluated 300 original research articles from the flagship journals of North America (Medicine and Science in Sports and Exercise), Europe (European Journal of Sport Science), and Australia (Journal of Science and Medicine in Sport). The hypothesis testing rate (~64%) and positive result rate (~81%) were much lower than what has been reported in other fields (e.g., psychology), and there was only weak evidence for our hypothesis that the positive result rate exceeded 80%. However, the positive result rate is still considered unreasonably high. Additionally, most studies did not report trial registration, and rarely included accessible data indicating rather poor reporting practices. The majority of studies relied upon significance testing (~92%), but it was more concerning that a majority of studies (~82%) without a stated hypothesis still relied upon significance testing. Overall, the positive result rate in kinesiology is unacceptably high, despite being lower than other fields such as psychology, and most published manuscripts demonstrated subpar reporting practices.

Download full text files

Export metadata

Additional Services

Share in Twitter Search Google Scholar
Metadaten
Author:Rosie TwomeyORCiDGND, Vanessa R. YinglingORCiDGND, Joe P. WarneORCiDGND, Christoph SchneiderORCiDGND, Christopher McCrumORCiDGND, Whitley C. AtkinsGND, Jennifer MurphyGND, Claudia Romero MedinaGND, Sena HarlleyGND, Aaron R. CaldwellORCiDGND
URN:urn:nbn:de:hbz:294-84494
DOI:https://doi.org/10.51224/cik.v1i3.43
Parent Title (English):Communications in kinesiology
Subtitle (German):A registered report on the positive result rate and reporting practices in kinesiology
Publisher:Society of Transparency, Openness, and Replication in Kinesiology (STORK)
Document Type:Article
Language:English
Date of Publication (online):2021/12/09
Date of first Publication:2021/12/02
Publishing Institution:Ruhr-Universität Bochum, Universitätsbibliothek
Tag:kinesiology; metaresearch; metascience; sport and exercise science
Volume:1
Issue:3
Pagenumber:17
Institutes/Facilities:Lehr- und Forschungsbereich Trainingswissenschaft
Dewey Decimal Classification:Technik, Medizin, angewandte Wissenschaften / Medizin, Gesundheit
Künste und Unterhaltung / Sport
faculties:Fakultät für Sportwissenschaft
Licence (English):License LogoCreative Commons - CC BY 4.0 - Attribution 4.0 International