Overstatement of results in the nutrition and obesity peer-reviewed literature

Nir Menachemi, Gabriel Tajeu, Bisakha Sen, Alva O. Ferdinand, Chelsea Singleton, Janice Utley, Olivia Affuso, David B. Allison

Research output: Contribution to journalArticle

6 Citations (Scopus)

Abstract

Background Scientific authors who overreach in presenting results can potentially, without intending to, distort the state of knowledge and inappropriately influence clinicians, decision makers, the media, and the public. Purpose The goal of the study was to determine the extent to which authors present overreaching statements in the obesity and nutrition literature, and whether journal, author, or study characteristics are associated with this practice. Methods A total of 937 papers on nutrition or obesity published in 2001 and 2011 in leading specialty, medical, and public health journals were systematically studied to estimate the extent to which authors overstate the results of their study in the published abstract. Focus was placed on overreaching statements that may include (1) reporting an associative relationship as causal; (2) making policy recommendations based on observational data that show associations only (e.g., not cause and effect); and (3) generalizing to a population not represented by their sample. Data were compiled in 2012 and analyzed in 2013. Results Results indicate that 8.9% of studies have overreaching conclusions with a higher percentage in 2011 compared to 2001 (OR=2.14, risk difference=+3.9%, p=0.020). Unfunded studies (OR=2.41, p=0.039) were more likely to have an overstatement of results of the type described here. In contrast, those with a greater number of coauthors were significantly less likely than those with four or fewer authors (the reference group) to have overstated results (seven or eight authors: OR=0.30, risk difference=-6.1%, p=0.008; ≥9 authors: OR=0.41, risk difference= -4.0%, p=0.037). Conclusions Overreaching in presenting results in studies focused on nutrition and obesity topics is common in articles published in leading journals. Testable strategies are proposed to reduce the prevalence of such instances in the literature.

Original languageEnglish (US)
Pages (from-to)615-621
Number of pages7
JournalAmerican Journal of Preventive Medicine
Volume45
Issue number5
DOIs
StatePublished - Nov 1 2013
Externally publishedYes

Fingerprint

Obesity
Policy Making
Public Health
Medicine
Population

ASJC Scopus subject areas

  • Epidemiology
  • Public Health, Environmental and Occupational Health

Cite this

Overstatement of results in the nutrition and obesity peer-reviewed literature. / Menachemi, Nir; Tajeu, Gabriel; Sen, Bisakha; Ferdinand, Alva O.; Singleton, Chelsea; Utley, Janice; Affuso, Olivia; Allison, David B.

In: American Journal of Preventive Medicine, Vol. 45, No. 5, 01.11.2013, p. 615-621.

Research output: Contribution to journalArticle

Menachemi, N, Tajeu, G, Sen, B, Ferdinand, AO, Singleton, C, Utley, J, Affuso, O & Allison, DB 2013, 'Overstatement of results in the nutrition and obesity peer-reviewed literature', American Journal of Preventive Medicine, vol. 45, no. 5, pp. 615-621. https://doi.org/10.1016/j.amepre.2013.06.019
Menachemi, Nir ; Tajeu, Gabriel ; Sen, Bisakha ; Ferdinand, Alva O. ; Singleton, Chelsea ; Utley, Janice ; Affuso, Olivia ; Allison, David B. / Overstatement of results in the nutrition and obesity peer-reviewed literature. In: American Journal of Preventive Medicine. 2013 ; Vol. 45, No. 5. pp. 615-621.
@article{13f86f774dc74791b6ceb20c4b6b8be1,
title = "Overstatement of results in the nutrition and obesity peer-reviewed literature",
abstract = "Background Scientific authors who overreach in presenting results can potentially, without intending to, distort the state of knowledge and inappropriately influence clinicians, decision makers, the media, and the public. Purpose The goal of the study was to determine the extent to which authors present overreaching statements in the obesity and nutrition literature, and whether journal, author, or study characteristics are associated with this practice. Methods A total of 937 papers on nutrition or obesity published in 2001 and 2011 in leading specialty, medical, and public health journals were systematically studied to estimate the extent to which authors overstate the results of their study in the published abstract. Focus was placed on overreaching statements that may include (1) reporting an associative relationship as causal; (2) making policy recommendations based on observational data that show associations only (e.g., not cause and effect); and (3) generalizing to a population not represented by their sample. Data were compiled in 2012 and analyzed in 2013. Results Results indicate that 8.9{\%} of studies have overreaching conclusions with a higher percentage in 2011 compared to 2001 (OR=2.14, risk difference=+3.9{\%}, p=0.020). Unfunded studies (OR=2.41, p=0.039) were more likely to have an overstatement of results of the type described here. In contrast, those with a greater number of coauthors were significantly less likely than those with four or fewer authors (the reference group) to have overstated results (seven or eight authors: OR=0.30, risk difference=-6.1{\%}, p=0.008; ≥9 authors: OR=0.41, risk difference= -4.0{\%}, p=0.037). Conclusions Overreaching in presenting results in studies focused on nutrition and obesity topics is common in articles published in leading journals. Testable strategies are proposed to reduce the prevalence of such instances in the literature.",
author = "Nir Menachemi and Gabriel Tajeu and Bisakha Sen and Ferdinand, {Alva O.} and Chelsea Singleton and Janice Utley and Olivia Affuso and Allison, {David B.}",
year = "2013",
month = "11",
day = "1",
doi = "10.1016/j.amepre.2013.06.019",
language = "English (US)",
volume = "45",
pages = "615--621",
journal = "American Journal of Preventive Medicine",
issn = "0749-3797",
publisher = "Elsevier Inc.",
number = "5",

}

TY - JOUR

T1 - Overstatement of results in the nutrition and obesity peer-reviewed literature

AU - Menachemi, Nir

AU - Tajeu, Gabriel

AU - Sen, Bisakha

AU - Ferdinand, Alva O.

AU - Singleton, Chelsea

AU - Utley, Janice

AU - Affuso, Olivia

AU - Allison, David B.

PY - 2013/11/1

Y1 - 2013/11/1

N2 - Background Scientific authors who overreach in presenting results can potentially, without intending to, distort the state of knowledge and inappropriately influence clinicians, decision makers, the media, and the public. Purpose The goal of the study was to determine the extent to which authors present overreaching statements in the obesity and nutrition literature, and whether journal, author, or study characteristics are associated with this practice. Methods A total of 937 papers on nutrition or obesity published in 2001 and 2011 in leading specialty, medical, and public health journals were systematically studied to estimate the extent to which authors overstate the results of their study in the published abstract. Focus was placed on overreaching statements that may include (1) reporting an associative relationship as causal; (2) making policy recommendations based on observational data that show associations only (e.g., not cause and effect); and (3) generalizing to a population not represented by their sample. Data were compiled in 2012 and analyzed in 2013. Results Results indicate that 8.9% of studies have overreaching conclusions with a higher percentage in 2011 compared to 2001 (OR=2.14, risk difference=+3.9%, p=0.020). Unfunded studies (OR=2.41, p=0.039) were more likely to have an overstatement of results of the type described here. In contrast, those with a greater number of coauthors were significantly less likely than those with four or fewer authors (the reference group) to have overstated results (seven or eight authors: OR=0.30, risk difference=-6.1%, p=0.008; ≥9 authors: OR=0.41, risk difference= -4.0%, p=0.037). Conclusions Overreaching in presenting results in studies focused on nutrition and obesity topics is common in articles published in leading journals. Testable strategies are proposed to reduce the prevalence of such instances in the literature.

AB - Background Scientific authors who overreach in presenting results can potentially, without intending to, distort the state of knowledge and inappropriately influence clinicians, decision makers, the media, and the public. Purpose The goal of the study was to determine the extent to which authors present overreaching statements in the obesity and nutrition literature, and whether journal, author, or study characteristics are associated with this practice. Methods A total of 937 papers on nutrition or obesity published in 2001 and 2011 in leading specialty, medical, and public health journals were systematically studied to estimate the extent to which authors overstate the results of their study in the published abstract. Focus was placed on overreaching statements that may include (1) reporting an associative relationship as causal; (2) making policy recommendations based on observational data that show associations only (e.g., not cause and effect); and (3) generalizing to a population not represented by their sample. Data were compiled in 2012 and analyzed in 2013. Results Results indicate that 8.9% of studies have overreaching conclusions with a higher percentage in 2011 compared to 2001 (OR=2.14, risk difference=+3.9%, p=0.020). Unfunded studies (OR=2.41, p=0.039) were more likely to have an overstatement of results of the type described here. In contrast, those with a greater number of coauthors were significantly less likely than those with four or fewer authors (the reference group) to have overstated results (seven or eight authors: OR=0.30, risk difference=-6.1%, p=0.008; ≥9 authors: OR=0.41, risk difference= -4.0%, p=0.037). Conclusions Overreaching in presenting results in studies focused on nutrition and obesity topics is common in articles published in leading journals. Testable strategies are proposed to reduce the prevalence of such instances in the literature.

UR - http://www.scopus.com/inward/record.url?scp=84885995925&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84885995925&partnerID=8YFLogxK

U2 - 10.1016/j.amepre.2013.06.019

DO - 10.1016/j.amepre.2013.06.019

M3 - Article

C2 - 24139775

AN - SCOPUS:84885995925

VL - 45

SP - 615

EP - 621

JO - American Journal of Preventive Medicine

JF - American Journal of Preventive Medicine

SN - 0749-3797

IS - 5

ER -