Author Affiliations: Michael Pine and Associates (Drs Fry, Pine, and Meimban, and Ms Jones); Department of Surgery, Northwestern University Feinberg School of Medicine (Dr Fry); and Department of Medicine, University of Chicago School of Medicine, Chicago, Illinois (Dr Pine).
To determine whether the occurrence of “never events” after major surgical procedures is affected by patient and disease characteristics and by the type of operation performed.
Derivation and assessment of predictive equations for postoperative infectious events and decubitus ulcers using Healthcare Cost and Utilization Project Nationwide Inpatient Sample administrative claims data for patients hospitalized between 2002 and 2005.
Main Outcome Measures
C statistics for each predictive equation with and without hospital dummy variables.
Predictive equations for 6 of 8 complications had C statistics greater than 0.65 without hospital variables, while 2 had C statistics of less than 0.55. All equations had C statistics greater than 0.75 when hospital dummy variables were included.
Patient characteristics and type of operative procedure are important predictors of complications of surgical care evaluated in this study, undermining the rationale for their current classification as “never events.” Variations in risk-adjusted complication rates among hospitals support the influence of quality of care on their occurrence. Development and use of warranties to cover costs associated with caring for the unavoidable components of potentially avoidable complications is proposed as a means of rewarding high-quality providers without creating unrealistic expectations or perverse financial incentives.
The Deficit Reduction Act of 2005 required the Secretary of Health and Human Services to eliminate Medicare payments for complications of patient care deemed to be “never events.”1 Accordingly, on October 1, 2008, the Centers for Medicare & Medicaid Services (CMS) began denying payment for costs associated with treatment of select complications of hospital care.2 Many commercial insurers also have stated their intention to deny payment for these complications.3,4 Additional complications have been proposed as never events to be added to CMS's list of complications for which payment is denied.5
Use of the term never event and denial of payment for all such events imply that these complications result entirely from avoidable clinical errors. This clearly is true for rare complications such as wrong-site surgery or retained surgical sponges. However, CMS's list of current and proposed never events includes medical and surgical complications that may occur even when the highest current standards of care are met. Occurrence of these complications is related, in part, to external factors beyond a provider's control such as the complexity and severity of a patient's current medical conditions and the nature of required interventions.
If recognizable external factors influence the occurrence of never events, denial of payment for treatment of these complications will create an incentive to avoid treating high-risk patients. This study explores the effect of recognizable external factors on the occurrence after major surgery of 8 infection-related complications, each of which has been designated as a never event by CMS.
Healthcare Cost and Utilization Project (HCUP) Nationwide Inpatient Sample administrative claims data6 from 2002 through 2005 were screened to identify hospitalized patients aged 18 years and older who had 1 of 5 operations included in the Surgical Infection Prevention Project.7Patients who had colon resection, coronary artery bypass graft (CABG) surgery, total hip replacement, abdominal hysterectomy, or aortofemoral bypass surgery at hospitals that performed at least 100 of these procedures during the 4-year study period were included in the analytic database.
The 7 postoperative infectious complications studied were Clostridium difficile enterocolitis, methicillin-resistant Staphylococcus aureus infection, mediastinitis after CABG surgery, surgical site infection, postoperative pneumonia, intravascular device infections, and catheter-associated urinary tract infection. An eighth never-event complication, decubitus ulcer, was added as a potentially infection-associated event.
As described previously,8 a predictive equation for the occurrence of each adverse outcome was derived using stepwise logistic regression9 to select independent variables and the Schwarz criterion10 combined with clinical judgment to determine which variables to retain. Equations were derived using all patients who had CABG surgery for mediastinitis and all study cases for catheter-associated urinary tract infection because the index events were few in number (n = 280). Twenty-five percent of random samples of cases with and without each of the other 6 never-event complications were used for the design of predictive equations because the large number of cases made analysis problematic with the entire data set. Potential predictive variables for the development of a postoperative complication included age, sex, emergency admission, chronic conditions coded as secondary diagnoses, type of operation, and dummy variables for each hospital included in the study. Because implantation of internal thoracic arteries is associated with sternal infections after CABG surgery,11 this procedure was included among potential risk factors for mediastinitis. Present-on-admission codes, admission laboratory data, and other clinical data (eg, timing of antibiotics) were not in the HCUP database. Final predictive equations were created by removing hospital variables and recalibrating intercepts without changing the coefficients of predictive variables so that the total numbers of observed and predicted complications were equal.
To determine the discriminatory power of predictive equations, C statistics12 were computed for predictive equations for each never-event complication with and without hospital variables included. The SAS software (version 9.1.3; SAS Institute, Cary, North Carolina)13 was used for all analyses.
A total of 887 189 cases from 1368 hospitals met the criteria for inclusion in the analytic database (Table 1). Numbers of operations ranged from 18 734 aortofemoral bypass procedures to 295 077 abdominal hysterectomies. Complication rates ranged from 0.03% for catheter-associated urinary tract infections to 2.35% for postoperative pneumonias (Table 2). Significant predictive variables and their odds ratios are shown in Table 3 for each of the 8 never-event complications.
C statistics for equations with and without hospital variables are shown in Table 2. All of the never-event complications had C statistics greater than 0.75 when hospital variables were included in predictive equations. Removal of hospital variables from predictive equations resulted in substantial decreases in C statistics, but 6 of the 8 predictive equations had C statistics greater than 0.65 when hospital variables were removed. Only urinary tract infection and mediastinitis had C statistics of less than 0.55 when hospital variables were removed.
This study demonstrates that patient characteristics and procedural interventions are important predictors of the occurrence of 6 of the 8 never-event complications analyzed. Because predictive equations for these postoperative complications have substantial discriminatory power (ie, have C statistics substantially greater than 0.50), risk factors beyond the control of providers affect the occurrence of these adverse events. Calling these complications never events and refusing to pay for their treatment may advantage high-quality caregivers, but it also will penalize providers that care for the most vulnerable patients or that perform procedures with higher-than-average risk. On the other hand, predictive equations for catheter-associated urinary tract infection and for mediastinitis after CABG surgery had only marginal discriminatory power after hospital variables were removed. But because important information about potential risk factors beyond the control of providers was not available in the administrative claims data used in this study, further analyses are needed to establish that patient and procedural factors do not influence the rates at which these 2 complications occur.
The discriminatory power of predictive equations for all 8 never-event complications increased substantially when hospital variables were included in predictive equations. This finding supports the contention that achievable improvements in quality of care can reduce the incidence of these complications and that creating financial incentives to reward hospitals with better outcomes is good public policy.
Our findings suggest that CMS's policy of denying payment for a wide variety of never events will be counterproductive in many cases because most hospital-acquired complications cannot be eliminated entirely by adherence to current best practices. To recognize this fact, payment to cover the cost of caring for potentially avoidable complications should be based on empirically derived rates and costs of complications for providers who deliver documented high-quality care. To avoid denial of care to high-risk patients, payments should be adjusted to reflect the predicted incidence and cost of complications based on patient and disease characteristics and on planned procedural interventions. Both of these goals can be achieved readily through the use of risk-adjusted warranties that link financial rewards and penalties to the degree of control providers have over the occurrence and cost of potentially avoidable complications.
Using analytic techniques such as those in this study, and with the use of refined data sets that include present-on-admission coding and available clinical information,14 providers with low risk-adjusted complication rates can be identified. Predictive equations for potentially avoidable complications can be standardized using only data from these high-quality providers. The price of a warranty to cover the cost of caring for designated complications in a hospitalized patient can be derived by multiplying the probability that a complication will occur by the predicted average cost of treating this complication. This fee will cover the costs of treating complications that occur when a high standard of care is provided, eliminating financial incentives for cherry-picking patients.
In return for these warranty payments, providers will take responsibility for the cost of caring for all designated complications. Providers who have fewer, less costly complications than predicted will profit from these warranties; providers with high rates of expensive-to-treat complications will have complication-related costs in excess of their warranty payments. Successful investments in reducing the incidence and cost of complications will be rewarded financially without incorrectly labeling these complications as never events or placing blame for any single adverse event.
In contrast to denial of payment for never events, properly calibrated risk-adjusted warranties will not create financial incentives to deny care to high-risk patients and to specialize in low-risk procedures. Properly administered, these warranties can reward high-quality providers while protecting safety-net institutions that care for the most vulnerable patients and centers of excellence that perform high-risk interventions.
Correspondence: Donald E. Fry, MD, Michael Pine and Associates, 5020 S Lake Shore Dr, Ste 304, Chicago, IL 60615 (firstname.lastname@example.org).
Accepted for Publication: March 5, 2009.
Author Contributions: Dr Fry had access to all of the data in the study and takes responsibility for the integrity of the data and accuracy of the data analysis. Study concept and design: Fry, Pine, and Meimban. Acquisition of data: Fry, Pine, Jones, and Meimban. Analysis and interpretation of data: Fry, Pine, Jones, and Meimban. Drafting of the manuscript: Fry and Pine. Critical revision of the manuscript for important intellectual content: Fry, Pine, Jones, and Meimban. Statistical analysis: Pine and Meimban. Administrative, technical, and material support: Pine and Jones.
Financial Disclosure: None reported.
Thank you for submitting a comment on this article. It will be reviewed by JAMA Surgery editors. You will be notified when your comment has been published. Comments should not exceed 500 words of text and 10 references.
Do not submit personal medical questions or information that could identify a specific patient, questions about a particular case, or general inquiries to an author. Only content that has not been published, posted, or submitted elsewhere should be submitted. By submitting this Comment, you and any coauthors transfer copyright to the journal if your Comment is posted.
* = Required Field
Disclosure of Any Conflicts of Interest*
Indicate all relevant conflicts of interest of each author below, including all relevant financial interests, activities, and relationships within the past 3 years including, but not limited to, employment, affiliation, grants or funding, consultancies, honoraria or payment, speakers’ bureaus, stock ownership or options, expert testimony, royalties, donation of medical equipment, or patents planned, pending, or issued. If all authors have none, check "No potential conflicts or relevant financial interests" in the box below. Please also indicate any funding received in support of this work. The information will be posted with your response.
Some tools below are only available to our subscribers or users with an online account.
Download citation file:
Web of Science® Times Cited: 41
Customize your page view by dragging & repositioning the boxes below.
Users' Guides to the Medical Literature
All results at
Enter your username and email address. We'll send you a link to reset your password.
Enter your username and email address. We'll send instructions on how to reset your password to the email address we have on record.
Athens and Shibboleth are access management services that provide single sign-on to protected resources. They replace the multiple user names and passwords necessary to access subscription-based content with a single user name and password that can be entered once per session. It operates independently of a user's location or IP address. If your institution uses Athens or Shibboleth authentication, please contact your site administrator to receive your user name and password.