Published ahead of print on February 8, 2008, doi:10.1164/rccm.200706-813OC
© 2008 American Thoracic Society doi: 10.1164/rccm.200706-813OC
Physician's Case Volume of Intensive Care Unit Pneumonia Admissions and In-Hospital Mortality1 School of Health Care Administration, Taipei Medical University, Taipei, Taiwan; 2 Arnold School of Public Health, Department of Health Services Policy and Management, University of South Carolina, Columbia, South Carolina; 3 Intensive Care Unit, Taipei Medical University Hospital, Taipei, Taiwan; and 4 Department of Statistics, National Taipei University, Taipei, Taiwan Correspondence and requests for reprints should be addressed to Herng-Ching Lin, Ph.D., School of Health Care Administration, Taipei Medical University, 250 Wu-Hsing Street, Taipei 110, Taiwan. E-mail: henry11111{at}tmu.edu.tw
Rationale: Although several studies have investigated volume–outcome relationships for surgical procedures, there has been no such study of intensive care unit (ICU) patients admitted for pneumonia. Objectives: This study examines associations between in-hospital mortality of ICU-admitted pneumonia patients and their attending physician's case volume.
Methods: We used 2002–2004 claims data from Taiwan's National Health Insurance for all 87,479 adult ICU admissions for pneumonia. Patients were assigned to one of four groups, on the basis of their physician's ICU pneumonia case volume (low volume, <36 cases; medium volume, 37–114 cases; high volume, 118–314 cases; and very high volume, Measurements and Main Results: In-hospital mortality systematically declined with increasing physician case volume: 14.7, 14.3, 11.4, and 8.1% from low-volume to very-high-volume groups. Adjusted unconditional odds of mortality among low-volume physicians' patients were 2.04 times those of very-high-volume physicians, 1.35 times that of high-volume physicians, and 1.09 times those of medium-volume physicians (all P < 0.001). The relationship is sustained when the odds are estimated conditional on hospital, when initial 5-day mortality is separated from 30-day mortality, and when pulmonologists' and critical care specialists' patients are studied separately. Conclusions: Physician volume significantly predicts inpatient mortality among ICU patients with pneumonia. Detailed study of clinical approaches, decision algorithms, and treatment plans of high-volume physicians is recommended to identify possible mediating factors in this phenomenon.
Key Words: intensive care unit pneumonia outcome assessment
Worldwide, pneumonia is the most frequent cause of communicable disease admissions and inpatient deaths. An estimated 5.6 million cases of community-acquired pneumonia occur annually in the United States (1), with 1.2 million patients hospitalized, and with an inpatient mortality rate of 5.8% (2). Attending physicians' case volume as a predictor of care outcomes is widely documented, particularly for complex medical conditions and surgical procedures, such as cancer care, coronary artery bypass surgery, and others (3–5). Little documentation on pneumonia case volumes and outcomes is available. Such studies could enable provider-driven and payer-driven strategies to reduce unwarranted variations in outcomes. Durairaj and colleagues reported that medical intensive care units (ICUs) with high respiratory patient volumes had lower risk-adjusted mortality for sicker patients, based on a 29-hospital study in Ohio (6). Respiratory diagnoses could span a heterogeneous range of conditions of diverse origins (e.g., infectious, malignant, degenerative). Therefore, there could be considerable confounding, yielding limited policy and practice implications. Our study uses inpatient claims data from Taiwan with a primary diagnosis of pneumonia and an ICU stay. In Taiwan, all teaching (and many nonteaching) hospitals have state-of-the-art clinical practice guidelines and standard orders set in place for pneumonia (7). We used nationwide, 3-year, population-based (de-identified) data from Taiwan's National Health Insurance (NHI) claims database, released for research purposes, to examined whether physicians with higher case volumes offer ICU patients with pneumonia better outcomes.
Database We used inpatient claims data for 2002–2004, which include data on every inpatient admission among NHI beneficiaries, more than 21 million citizens (96% of Taiwan's population). The database has ICD-9CM (International Classification of Diseases, Ninth Revision, Clinical Modification) codes for the principal diagnosis, and up to four secondary diagnoses. The NHI Bureau implements routine sample crosschecks of each hospital's claims with medical charts, followed by punitive measures for coding infractions, which deters diagnosis up-coding. This deterrent is counterbalanced by the NHI's reimbursement system, which ties a hospital's reimbursement level to its patient severity profile. As a result, hospitals' interests are best served by accurate coding of diagnoses and care items. Although there are no documented sensitivity and specificity studies of coding accuracy, it is generally believed that the NHI's checks and balances foster accurate coding. Taiwan's NHI provides universal coverage to all citizens, a single plan with generous benefits, low copayments, and free choice of a widely dispersed network of public, private, and not-for-profit providers. These features make these population-based data a valuable resource to examine risk-adjusted outcome variations across a variety of provider characteristics, with minimal confounding.
Study Sample
Classification of Patients by Their Physician's Case Volume
Statistical Analysis We adjusted for the following: physician's sex, age, and specialty (pulmonology or critical care medicine vs. another specialty); the hospital's ICU bed strength, its teaching status, and ownership (public, for-profit, and not-for-profit); patient demographics (age and sex); and patient severity. Patient severity was measured by clinical severity of the pneumonia and presence of comorbidities. The proxy for pneumonia severity was twofold: duration of mechanical ventilation use when it was used, as shown in Table 1, and presence of acute respiratory failure (ARF) without significant duration of mechanical ventilation (3,111 patients either rapidly succumbed to the respiratory failure or responded to other medical treatment). Clinical comorbidity was captured using the Charlson Comorbidity Index (CCI) (12), which is used to capture mortality risk in administrative claims data analyses. The CCI is the sum of the patient's weighted scores of the relative mortality risk of 19 conditions (e.g., congestive heart failure, myocardial infarction, liver disease, cancer, dementia) with a score of zero if no comorbid conditions exist.
To verify the role of physician specialty in the volume–outcome relationship, we performed GEE analysis on the subset of patients treated by pulmonologists and critical care specialists. To further clarify whether the relationship is sustained when early (5 d) mortality is separated from delayed mortality (6–30 d), we linked our data to Taiwan's Department of Health cause-of-death data to include postdischarge death. Separate GEE regressions were conducted using each mortality indicator as the dependent variable. Finally, to verify the volume–mortality association among the most severe pneumonia cases, we applied similar GEE analyses to the subsample with ARF. A two-sided P value of 0.05 was used.
The study sample distribution by patient variables is shown in Table 1: 63.5% were male, 62.8% were 74 years or older, 65.7% had pneumonia complicated with ARF, and 62.1% received mechanical ventilation during hospitalization. Mean length of stay and hospitalization costs were 24.8 days (± 18.1 d) and Taiwan New Dollars (TWD $) 281,508 (±TWD $228,772; US $1 = TWD $33 in 2004), respectively. The bivariate sample distribution by physician volume and physician characteristics is shown in Table 2. For the total 3,667 attending physicians of the sample patients, the mean case volume was 25.8 patients. Very-high-volume physicians were more likely to be male and specialize in pulmonary or critical care medicine (both P < 0.001), and have older patients, with lower average CCI scores and higher incidence of ARF and mechanical ventilation use, compared with physicians in other volume groups (all P < 0.001).
Table 3 shows the crude and GEE-adjusted odds of in-hospital mortality by physician volume. Low-volume physicians' patients had significantly higher crude mortality likelihood than high- and very-high-volume physicians (14.7 vs. 11.4 and 8.1%, respectively; both P < 0.001). GEE estimates adjusting for patient characteristics (sex, age, duration of mechanical ventilation, ARF without mechanical ventilation, and CCI score), attending physician characteristics (age, sex, and specialty), hospital characteristics (ownership, teaching status, and ICU bed strength), and physician-level random effect (patient clustering by physician) show that the odds of in-hospital death among low-volume physicians' patients were over twice the mortality odds among very-high-volume physicians' patients (odds ratio [OR], 2.04; reciprocal of 0.49; P < 0.001), and ORs were 1.35 and 1.09, respectively, relative to high-volume and medium-volume physicians' patients (both P < 0.001). Sensitivity analysis showed that the results are robust to changes in the volume cutoff points (data not shown).
Table 3 also presents the regression results of conditional logistic regression modeling, showing that the physician volume–outcome relationship is sustained after conditioning on hospital. This confirms an independent effect of physicians' experience on mortality, regardless of the hospital in which they practice, although the odds show a drop in magnitude. Table 3 also shows that patients of pulmonologists and critical care specialists have lower mortality odds (OR, 0.66; P < 0.001) relative to other specialties. Table 4 shows the association of physician volume with in-hospital mortality among the subsample (50,064 patients) treated by pulmonologists and critical care specialists. The relationship is sustained: low-volume specialists' patients have about twice the risk-adjusted mortality odds as those of very-high-volume and high-volume physicians (OR, 1.89 and 2.13, respectively).
The volume–outcome relationship is sustained on examining 30-day mortality, shown in Appendix 1. The relationship is also sustained on separating early mortality (5 d) and delayed mortality (6–30 d), although the magnitude of mortality odds by volume groups are smaller for 5-day mortality compared with delayed mortality (presented in Appendix 1). The volume–outcome relationship is also sustained on GEE modeling of the subsample with the highest clinical severity (those with ARF), using the same control variables, shown in Appendix 2.
This article reports on the volume–mortality relationship for adult ICU pneumonia cases on the basis of nationwide, population-based data, covering 87,479 patients treated by 3,667 physicians. Adjusted for relevant confounders, and robust to a sensitivity analysis, low-volume physicians' patients have twice the mortality odds of patients of very-high-volume physicians. Importantly, the finding holds even among the subsample of patients treated by pulmonologists and critical care specialists. (However, within the total sample, these specialists have clearly lower adjusted mortality odds [0.66] relative to other specialties.) Conditional logistic regression analysis eliminates potential confounding by unmeasured hospital variables on many counts. First, high-volume physicians likely practice at better equipped and/or teaching hospitals, which could potentially account for the superior outcomes of high-volume physicians, due to these hospitals' infrastructure and staffing advantages. Conditional logistic regression essentially evaluates the volume–outcome association among physicians within each hospital and then averages these effects across hospitals. We found that the physician volume–outcome association is sustained in the conditional logistic regression model, although some mitigation of the ORs is observed. The latter suggests that intrahospital variables do mediate part of the physician volume–outcome relationship, but the magnitude of the drop also shows that most of the mortality differentials are driven by the independent effect of the physicians' case volume (experience), regardless of the hospital in which they practice. Our findings suggest that previously documented associations between hospital volume and mortality (13–15) may have been confounded by more experienced physicians practicing in larger volume hospitals. Durairaj and coworkers reported lower risk-adjusted mortality among ICU patients with a respiratory diagnosis who were admitted to high-volume hospitals compared with those admitted to low-volume hospitals (6), and many studies show that higher ICU patient volumes are associated with superior outcomes among critically ill patients (13–18), all consistent with our findings. Our study contributes to the literature by demonstrating that, after isolating the effect of most institutional and patient confounders, the attending physician's volume independently predicts mortality in severely ill patients with pneumonia. The adequacy of our adjustments for patient severity could be questioned. Several study attributes mitigate this concern. First, we restricted our study sample to inpatients with an admission diagnosis of pneumonia and who needed ICU care, itself an indictor of significantly higher severity. Second, we adjusted for ARF, which significantly drives mortality in pneumonia cases. We used specific operational variables that mediate the role of ARF in mortality outcomes: whether the patient survived the initial onset of ARF, and the duration for which mechanical ventilation had to be used. We have accounted for both these variables, captured as ARF without mechanical ventilation, and duration of continuous use of mechanical ventilation among survivors. These two variables, together with our sample selection criterion of an ICU stay should capture most of the significant impact of pneumonia severity, and may have mitigated the utility of the Pneumonia Severity Scale in this study. In our sample, patients of high-volume physicians had higher incidence of ARF, and received longer durations of mechanical ventilation, indicating higher critical severity. Therefore, differential case severity should have aggravated high-volume physicians' outcomes, not improved them. Our adjustment for these variables emphasizes the superior outcomes of high-volume physicians. Another source of confounding could be unmeasured differences in clinical severity between the volume groups, such as pre-pneumonia conditions, hemodynamic status, hyperglycemia, and others. It is highly implausible that these factors were systematically higher among low-volume physicians' patients. Moreover, because patients with pneumonia are admitted to an ICU when their condition is clinically severe enough, it is unlikely that systematic unmeasured differences in severity exist between low-volume and high-volume physicians' patients in our sample. Three explanations could be hypothesized for the volume–outcome relationship (each having different policy implications):
If hypothesis 1 is empirically sustained, then smaller hospitals should be required to adopt the systems-based practices of larger hospitals. If hypothesis 2 is supported, payers should consider reimbursing consultations with an experienced physician until each physician completes a threshold number of ICU pneumonia cases, regardless of specialty status. Our study confirms that, regardless of the hospital in which they practice, high-volume physicians perform better. Disproportionately higher severity among high-volume physicians' panels (age, ARF, and duration of mechanical ventilation) argues against selection bias due to selective self-referral. Overall, our results suggest that practice makes perfect, supporting the latter policy implication. Cost of care differences alone may justify such expense, apart from being potentially life-saving. At the same time, a statistically significant contribution by the hospital effect (reduction in mortality odds in the conditional model) implies that payers should consider requiring all hospitals to implement the systems-based practices of larger hospitals, as well as regionalization of care for severe pneumonia cases. Finally, the consistency of the volume–outcome relationship among the subsample of respiratory specialists' patients and among the subsample with ARF, and on separating early 5-day mortality from delayed, 6–30-day mortality, all suggest strong support for the "practice makes perfect" hypothesis. Other studies concerning volume–outcome relationships for other diagnoses/procedures in Taiwan also consistently demonstrate that physician volume is a more critical factor for patient outcome than hospital volume (19–21). It has been suggested that high-volume physicians can better manage unexpected problems and medical situations (7). This study has several strengths. Because it used a nationwide population-based dataset from a single-payer insurance system, its findings are noteworthy for clinicians and policy makers, who often have to contend with indeterminate findings from studies using data from pluralistic health systems with multiple insurers, and limited patient panels. Second, its large sample size has provided ample statistical power to detect differences between study groups, after adjusting for many confounding variables. There are some study limitations. The accuracy of comorbidity documentation is generally questioned when claims data are used for research. As indicated earlier, there are built-in checks and balances in the NHI's oversight and reimbursement system. Measures such as routine sampling of patient charts to crosscheck with claims, detailed audits for outlier hospitals, and punitive fines for fraudulent claims deter diagnoses and care up-coding. Concurrently, the reimbursement system favors accuracy in the opposite direction. Because each hospital's reimbursement rate is tied to its patient severity profile, the incentive is to ensure accurate and complete coding of comorbidities to realize a severity-appropriate reimbursement rate. Therefore, it is generally believed that coding is largely accurate, although the lack of systematic sensitivity analyses documentation makes this issue a potential study limitation.
There are several policy implications. First, similar studies need to be replicated in other countries and settings, examining diagnosis-specific volume–outcome relationships in ICUs for pneumonia. Second, policy makers should consider routinely paying for second-opinion consultations with experienced physicians until each physician crosses a critical threshold of case volume. This should save considerable costs as well as lives. Third, our supplementary analysis showed higher costs incurred toward aggressive treatment procedures among patients of high-volume physicians, and higher drug and lab diagnostic costs (results not presented). This finding suggests that much will be gained from clinician-led peer reviews of the differences in clinical approaches and care processes between high-volume and low-volume physicians. This should enable more detailed explication of decision algorithms for use by all providers.
Originally Published in Press as DOI: 10.1164/rccm.200706-813OC on February 8, 2008 Conflict of Interest Statement: None of the authors has a financial relationship with a commercial entity that has an interest in the subject of this manuscript. Received in original form June 4, 2007; accepted in final form January 31, 2008
This article has been cited by other articles:
|
|||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||