Download PDF
CC BY-NC-ND 4.0 · Sports Med Int Open 2024; 08: a21816798
DOI: 10.1055/a-2181-6798
Training & Testing

Unveiling Bias: Examining the Influence of Positive Results on Ergogenic Aids in Published Sports Science Studies

Moacir Marocolo 
1   Department of Physiology, Institute of Biological Sciences, Federal University of Juiz de Fora, Juiz de Fora, Brazil
,
Gustavo R. Mota 
2   Department of Sports Science, Institute of Health Sciences, Federal University of Triângulo Mineiro, Uberaba, Brazil
,
Alex Batista Rodrigues
3   Department of Physical Education and Sports, Federal University of Juiz de Fora, Juiz de Fora, Brazil
,
Roberto C. de Matos Leite
3   Department of Physical Education and Sports, Federal University of Juiz de Fora, Juiz de Fora, Brazil
,
Rodrigo Hohl
1   Department of Physiology, Institute of Biological Sciences, Federal University of Juiz de Fora, Juiz de Fora, Brazil
,
Rodney Coelho da Paixão
1   Department of Physiology, Institute of Biological Sciences, Federal University of Juiz de Fora, Juiz de Fora, Brazil
4   Department of Physical Education and Physiotherapy, Federal University of Uberlândia, Uberlândia, Brazil
,
Hiago L. R. Souza 
1   Department of Physiology, Institute of Biological Sciences, Federal University of Juiz de Fora, Juiz de Fora, Brazil
,
Anderson Meireles
1   Department of Physiology, Institute of Biological Sciences, Federal University of Juiz de Fora, Juiz de Fora, Brazil
,
Rhai Arriel
1   Department of Physiology, Institute of Biological Sciences, Federal University of Juiz de Fora, Juiz de Fora, Brazil
› Author Affiliations Fundings Conselho Nacional de Desenvolvimento Científico e Tecnológico — http://dx.doi.org/10.13039/501100003593; 308138/2022–8 Fundação de Amparo à Pesquisa do Estado de Minas Gerais — http://dx.doi.org/10.13039/501100004901; BPD-00905–22
› Further Information
   Permissions and Reprints

Abstract

We investigated the potential for publication bias in the field of sports science regarding studies on ergogenic aids and their effects on exercise performance. We found evidence to suggest that journals tend to prioritize studies with positive results (76%) while neglecting those with negative outcomes (2.7%). Worryingly, this could lead to a discrepancy between reported conclusions and actual study outcomes. We also identified inconsistencies between reported outcomes and actual performance variable outcomes. Taken together, these data highlight the need for future research to reduce bias and encourage the publication of studies with both positive and negative results to improve the reliability of scientific evidence in this field.

Key words

bias - exercise - scientific evidence - human performance - physiological data


Publication History

Received: 22 May 2023

Accepted: 15 September 2023

Accepted Manuscript online:
25 October 2023

Article published online:
08 January 2024

© 2024. The Author(s). This is an open access article published by Thieme under the terms of the Creative Commons Attribution-NonDerivative-NonCommercial-License, permitting copying and reproduction so long as the original work is given appropriate credit. Contents may not be used for commercial purposes, or adapted, remixed, transformed or built upon. (https://creativecommons.org/licenses/by-nc-nd/4.0/).

Georg Thieme Verlag KG
Rüdigerstraße 14, 70469 Stuttgart, Germany

Bibliographical Record
Moacir Marocolo, Gustavo R. Mota, Alex Batista Rodrigues, Roberto C. de Matos Leite, Rodrigo Hohl, Rodney Coelho da Paixão, Hiago L. R. Souza, Anderson Meireles, Rhai Arriel. Unveiling Bias: Examining the Influence of Positive Results on Ergogenic Aids in Published Sports Science Studies. Sports Med Int Open 2024; 08: a21816798.
DOI: 10.1055/a-2181-6798
 

  • References

  • 1 Kim J, Kim E-K. Nutritional strategies to optimize performance and recovery in rowing athletes. Nutrients 2020; 12: 1685 DOI: 10.3390/nu12061685.
    Google Scholar
  • 2 Šimundić A-M. Bias in research. Biochem Med (Zagreb) 2013; 23: 12-15 DOI: 10.11613/BM.2013.003.
    Google Scholar
  • 3 Yarborough M. Moving towards less biased research. BMJ Open Sci 2021; 5: e100116 DOI: 10.1136/bmjos-2020-100116.
    Google Scholar
  • 4 Vassar M, Roberts W, Cooper CM. et al. Evaluation of selective outcome reporting and trial registration practices among addiction clinical trials. Addiction 2020; 115: 1172-1179 DOI: 10.1111/add.14902.
    Google Scholar
  • 5 Souza NV, Nicolini AC, Dos Reis INR. et al. Selective outcome reporting bias is highly prevalent in randomized clinical trials of nonsurgical periodontal therapy. J Periodontal Res 2023; 58: 1-11 DOI: 10.1111/jre.13066.
    Google Scholar
  • 6 Dwan K, Gamble C, Williamson PR. et al. Systematic review of the empirical evidence of study publication bias and outcome reporting bias - an updated review. PLoS One 2013; 8: e66844 DOI: 10.1371/journal.pone.0066844.
    Google Scholar
  • 7 Teixeira Da Silva JA. Negative results: negative perceptions limit their potential for increasing reproducibility. J Negat Results Biomed 2015; 14: 12 DOI: 10.1186/s12952-015-0033-9.
    Google Scholar
  • 8 Chan A-W, Altman DG. Identifying outcome reporting bias in randomised trials on PubMed: review of publications and survey of authors. BMJ 2005; 330: 753 DOI: 10.1136/bmj.38356.424606.8f.
    Google Scholar
  • 9 MacDonald PL, Gardner RC. Type I error rate comparisons of post hoc procedures for I j chi-square tables. Educ Psychol Meas 2000; 60: 735-754 DOI: 10.1177/00131640021970871.
    Google Scholar
  • 10 Sharpe D. Chi-square test is statistically significant: now what?. Pract Assess Res Evaluation 2015; 20 DOI: 10.7275/tbfa-x148.
    Google Scholar
  • 11 Adami PE, Koutlianos N, Baggish A. et al. Cardiovascular effects of doping substances, commonly prescribed medications and ergogenic aids in relation to sports: a position statement of the sport cardiology and exercise nucleus of the European Association of Preventive Cardiology. Eur J Prev Cardiol 2022; 29: 559-575 DOI: 10.1093/eurjpc/zwab198.
    Google Scholar
  • 12 Turner EH, Matthews AM, Linardatos E. et al. Selective publication of antidepressant trials and its influence on apparent efficacy. N Engl J Med 2008; 358: 252-260 DOI: 10.1056/nejmsa065779.
    Google Scholar
  • 13 Grgic J. Are there non-responders to the ergogenic effects of caffeine ingestion on exercise performance?. Nutrients 2018; 10: 1736 DOI: 10.3390/nu10111736.
    Google Scholar
  • 14 Marocolo M, Marocolo IC, Da Mota GR. et al. Beneficial effects of ischemic preconditioning in resistance exercise fade over time. Int J Sports Med 2016; 37: 819-824 DOI: 10.1055/s-0042-109066.
    Google Scholar
  • 15 Duyx B, Urlings MJE, Swaen GMH. et al. Scientific citations favor positive results: a systematic review and meta-analysis. J Clin Epidemiol 2017; 88: 92-101 DOI: 10.1016/j.jclinepi.2017.06.002.
    Google Scholar