March 9, 2014
Reference Type: Journal Article
Record Number: 795Author: Fox, K. A., Simpson, I. A. and Luscher, T. F.
Title: The Year in Cardiology series: the most recent advances in a nutshell for the readers of the European Heart Journal
Journal: Eur Heart J
Short Title: The Year in Cardiology series: the most recent advances in a nutshell for the readers of the European Heart Journal
Alternate Journal: European heart journal
ISSN: 1522-9645 (Electronic)
Accession Number: 23284093
Periodicals as Topic
Notes: Fox, Keith A A
Simpson, Iain A
Luscher, Thomas F
Eur Heart J. 2013 Jan;34(4):307. doi: 10.1093/eurheartj/ehs404. Epub 2013 Jan 2.
Author Address: Centre for Cardiovascular Science, University of Edinburgh, UK.
Reference Type: Journal Article
Record Number: 851Author: Francis, D. P.
Title: How easily can omission of patients, or selection amongst poorly-reproducible measurements, create artificial correlations? Methods for detection and implications for observational research design in cardiology
Journal: Int J Cardiol
Date: Jul 15
Short Title: How easily can omission of patients, or selection amongst poorly-reproducible measurements, create artificial correlations? Methods for detection and implications for observational research design in cardiology
Alternate Journal: International journal of cardiology
ISSN: 1874-1754 (Electronic)
Accession Number: 22285446
*Reproducibility of Results
Abstract: BACKGROUND: When reported correlation coefficients seem too high to be true, does investigative verification of source data provide suitable reassurance? This study tests how easily omission of patients or selection amongst irreproducible measurements generate fictitious strong correlations, without data fabrication. METHOD AND RESULTS: Two forms of manipulation are applied to a pair of normally-distributed, uncorrelated variables: first, exclusion of patients least favourable to a hypothesised association and, second, making multiple poorly-reproducible measurements per patient and choosing the most supportive. Excluding patients raises correlations powerfully, from 0.0 +/- 0.11 (no patients omitted) to 0.40 +/- 0.11 (one-fifth omitted), 0.59 +/- 0.08 (one-third omitted) and 0.78 +/- 0.05 (half omitted). Study size offers no protection: omitting just one-fifth of 75 patients (i.e. publishing 60) makes 92% of correlations statistically significant. Worse, simply selecting the most favourable amongst several measurements raises correlations from 0.0 +/- 0.12 (single measurement of each variable) to 0.73 +/- 0.06 (best of 2), and 0.90 +/- 0.03 (best of 4). 100% of correlation coefficients become statistically significant. Scatterplots may reveal a telltale “shave sign” or “bite sign”. Simple statistical tests are presented for these suspicious signatures in single or multiple studies. CONCLUSION: Correlations are vulnerable to data manipulation. Cardiology is especially vulnerable to patient deletion (because cardiologists ourselves might completely control enrolment and measurement), and selection of “best” measurements (because alternative heartbeats are numerous, and some modalities poorly reproducible). Source data verification cannot detect these but tests might highlight suspicious data and–aggregating across studies–unreliable laboratories or research fields. Cardiological correlation research needs adequately-informed planning and guarantees of integrity, with teeth.