Published ahead of print on January 26, 2006, doi:10.1164/rccm.200508-1338PP
Am. J. Respir. Crit. Care Med., Volume 173, Number 8, April 2006, 842-846
A more recent version of this article appeared on April 15, 2006
Submitted on August 29, 2005
Accepted on January 25, 2006
Statistical Treatment of Exacerbations in Therapeutic Trials of COPD
Samy Suissa1*
1 Division of Clinical Epidemiology, McGill University, Montreal, Quebec, Canada
* To whom correspondence should be addressed. E-mail: samy.suissa{at}clinepi.mcgill.ca.
Randomized trials and a meta-analysis suggesting that inhaled corticosteroids reduce exacerbation rates in patients with COPD show major discrepancies that may be due to different approaches to data analysis. These trials used statistical techniques that were either weighted or unweighted for follow-up time, with P-values and confidence intervals estimated with or without accounting for between-patient variability in exacerbation rates. We illustrate the validity of these methods using data from a cohort of 5,454 COPD patients structured to emulate a randomised trial. The "reference" group was defined as patients with a history of exacerbations prior to cohort entry (n=1,137) while the "treated" group included an equal number (n=1,137) of patients with no prior exacerbation. Random samples of 100 and 200 subjects were selected three times from each of two groups to further illustrate the variability in the findings. Exacerbations during follow-up were identified from prescriptions for systemic antibiotics. The correct rate ratio of 0.75 estimated by the weighted approach was underestimated as 0.57 by the unweighted approach. When the weighted approach did not, however, also account for between-patient variability, the P-value was greatly underestimated (example: rate ratio 0.79; P=0.0007 instead of P=0.12) and confidence intervals were much narrower than after properly accounting for this variability. In conclusion, the reports from randomized trials and the meta-analysis that inhaled corticosteroids reduce COPD exacerbation rates are the result of improper statistical analysis techniques. The only two studies that used the correct statistical approach found insignificant effects with these drugs.
Key words: Data analysis; biases; drug effectiveness; databases; methods;
This article has been cited by other articles:

|
 |

|
 |
 
O. N. Keene, P. M. A. Calverley, P. W. Jones, J. Vestbo, and J. A. Anderson
Statistical analysis of exacerbation rates in COPD: TRISTAN and ISOLDE revisited
Eur. Respir. J.,
July 1, 2008;
32(1):
17 - 24.
[Abstract]
[Full Text]
[PDF]
|
 |
|

|
 |

|
 |
 
P. Albert and P. M. A. Calverley
Drugs (including oxygen) in severe COPD
Eur. Respir. J.,
May 1, 2008;
31(5):
1114 - 1124.
[Abstract]
[Full Text]
[PDF]
|
 |
|

|
 |

|
 |
 
S. Suissa, P. Ernst, K. L. Vandemheen, and S. D. Aaron
Methodological issues in therapeutic trials of COPD
Eur. Respir. J.,
May 1, 2008;
31(5):
927 - 933.
[Abstract]
[Full Text]
[PDF]
|
 |
|

|
 |

|
 |
 
M. Cazzola, W. MacNee, F. J. Martinez, K. F. Rabe, L. G. Franciosi, P. J. Barnes, V. Brusasco, P. S. Burge, P. M. A. Calverley, B. R. Celli, et al.
Outcomes for COPD pharmacological trials: from lung function to biomarkers
Eur. Respir. J.,
February 1, 2008;
31(2):
416 - 469.
[Abstract]
[Full Text]
[PDF]
|
 |
|

|
 |

|
 |
 
S D Aaron, D Fergusson, G B Marks, S Suissa, K L Vandemheen, S Doucette, F Maltais, J F Bourbeau, R S Goldstein, M Balter, et al.
Counting, analysing and reporting exacerbations of COPD in randomised controlled trials
Thorax,
February 1, 2008;
63(2):
122 - 128.
[Abstract]
[Full Text]
[PDF]
|
 |
|

|
 |

|
 |
 
G. R. Washko, V. S. Fan, S. D. Ramsey, Z. Mohsenifar, F. Martinez, B. J. Make, F. C. Sciurba, G. J. Criner, O. Minai, M. M. DeCamp, et al.
The Effect of Lung Volume Reduction Surgery on Chronic Obstructive Pulmonary Disease Exacerbations
Am. J. Respir. Crit. Care Med.,
January 15, 2008;
177(2):
164 - 169.
[Abstract]
[Full Text]
[PDF]
|
 |
|

|
 |

|
 |
 
J. A. Wedzicha, P. M. A. Calverley, T. A. Seemungal, G. Hagan, Z. Ansari, R. A. Stockley, and for the INSPIRE Investigators
The Prevention of Chronic Obstructive Pulmonary Disease Exacerbations by Salmeterol/Fluticasone Propionate or Tiotropium Bromide
Am. J. Respir. Crit. Care Med.,
January 1, 2008;
177(1):
19 - 26.
[Abstract]
[Full Text]
[PDF]
|
 |
|

|
 |

|
 |
 
S. Suissa, R. McGhan, D. Niewoehner, and B. Make
Inhaled Corticosteroids in Chronic Obstructive Pulmonary Disease
Proceedings of the ATS,
October 1, 2007;
4(7):
535 - 542.
[Abstract]
[Full Text]
[PDF]
|
 |
|

|
 |

|
 |
 
S. Suissa
On the Correct Statistical Analysis of Exacerbation Rates in Clinical Trials
Am. J. Respir. Crit. Care Med.,
September 1, 2007;
176(5):
522 - 522.
[Full Text]
[PDF]
|
 |
|

|
 |

|
 |
 
P. Kardos, M. Wencker, T. Glaab, and C. Vogelmeier
Am. J. Respir. Crit. Care Med.,
September 1, 2007;
176(5):
522 - 522.
[Full Text]
[PDF]
|
 |
|

|
 |

|
 |
 
P. Ernst, A. V. Gonzalez, P. Brassard, and S. Suissa
Inhaled Corticosteroid Use in Chronic Obstructive Pulmonary Disease and the Risk of Hospitalization for Pneumonia
Am. J. Respir. Crit. Care Med.,
July 15, 2007;
176(2):
162 - 166.
[Abstract]
[Full Text]
[PDF]
|
 |
|

|
 |

|
 |
 
K. F. Rabe, B. Beghe, F. Luppi, and L. M. Fabbri
Update in Chronic Obstructive Pulmonary Disease 2006
Am. J. Respir. Crit. Care Med.,
June 15, 2007;
175(12):
1222 - 1232.
[Full Text]
[PDF]
|
 |
|

|
 |

|
 |
 
S. D. Aaron, K. L. Vandemheen, D. Fergusson, F. Maltais, J. Bourbeau, R. Goldstein, M. Balter, D. O'Donnell, A. McIvor, S. Sharma, et al.
Tiotropium in Combination with Placebo, Salmeterol, or Fluticasone Salmeterol for Treatment of Chronic Obstructive Pulmonary Disease: A Randomized Trial
Ann Intern Med,
April 17, 2007;
146(8):
545 - 555.
[Abstract]
[Full Text]
[PDF]
|
 |
|

|
 |

|
 |
 
K. F. Rabe
Treating COPD -- The TORCH Trial, P Values, and the Dodo
N. Engl. J. Med.,
February 22, 2007;
356(8):
851 - 854.
[Full Text]
[PDF]
|
 |
|

|
 |

|
 |
 
D. E. Niewoehner and T. J. Wilt
Inhaled Corticosteroids for Chronic Obstructive Pulmonary Disease: A Status Report
Am. J. Respir. Crit. Care Med.,
January 15, 2007;
175(2):
103 - 104.
[Full Text]
[PDF]
|
 |
|

|
 |

|
 |
 
P. Kardos, M. Wencker, T. Glaab, and C. Vogelmeier
Impact of Salmeterol/Fluticasone Propionate versus Salmeterol on Exacerbations in Severe Chronic Obstructive Pulmonary Disease
Am. J. Respir. Crit. Care Med.,
January 15, 2007;
175(2):
144 - 149.
[Abstract]
[Full Text]
[PDF]
|
 |
|
Copyright © 2006 American Thoracic Society
|
|
|