Overview
Nonprofit hospitals in the United States collectively spend billions of dollars annually on management consultants, but the return on this massive investment remains unclear. A landmark study from researchers at the University of Chicago Booth School of Business and UChicago Medicine examined 380 nonprofit hospitals between 2009 and 2021, revealing that consultant spending—averaging $50 million per hospital over five years—showed no consistent link to improved financial health, patient outcomes, or operational efficiency. This guide walks you through the study's methodology, key findings, and practical steps to evaluate consultant engagement in your own healthcare organization. By the end, you'll understand how to apply evidence-based scrutiny to consultant contracts and avoid common pitfalls.
Prerequisites
Before diving into the analysis, ensure you have a basic understanding of the following:
- Financial statements of nonprofit hospitals: Know how to read income statements, balance sheets, and cash flow reports.
- Key performance indicators (KPIs) in healthcare: Familiarity with metrics like operating margin, patient satisfaction scores, readmission rates, and length of stay.
- Basic statistical concepts: Correlation vs. causation, regression analysis, and significance testing.
This guide is designed for hospital administrators, board members, healthcare analysts, and anyone interested in evidence-based resource allocation.
Step-by-Step: Evaluating Consultant Impact Like the Researchers
Step 1: Gather Longitudinal Consultant Spending Data
The original study leveraged a proprietary database from a major consulting firm, which included detailed invoices for 380 nonprofit hospitals over a 12-year period. To replicate this analysis for your own organization:
- Collect all consultant invoices from the past 5 years. Categorize them by service type (e.g., strategy, operations, IT).
- Normalize spending by hospital size (e.g., per bed, per patient day) to allow fair comparisons.
- Track spending over time to identify trends and spikes.
Example code snippet (Python with pandas) to aggregate spending:
import pandas as pd
df = pd.read_csv('consultant_invoices.csv')
df['date'] = pd.to_datetime(df['date'])
df['year'] = df['date'].dt.year
yearly_spending = df.groupby(['hospital_id', 'year'])['amount'].sum().reset_index()
yearly_spending['spending_per_bed'] = yearly_spending['amount'] / hospital_bedsStep 2: Define Outcome Metrics of Interest
The researchers examined three categories of outcomes:
- Financial health: Operating margin, days cash on hand, debt service coverage ratio.
- Operational efficiency: Length of stay, cost per adjusted discharge, staff turnover.
- Patient outcomes: Risk-adjusted mortality rate, readmission rate, HCAHPS patient satisfaction scores.
For your own institutional analysis, choose metrics that align with your strategic goals. Ensure data consistency across years—account for coding changes or new reimbursement models.
Step 3: Conduct Correlational Analysis
Using a linear regression model, test whether consultant spending is associated with changes in your chosen outcomes. Control for confounding variables such as hospital size, teaching status, and geographic region.
import statsmodels.api as sm
X = df[['spending_per_bed', 'beds', 'teaching_dummy', 'region']]
y = df['operating_margin']
X = sm.add_constant(X)
model = sm.OLS(y, X).fit()
print(model.summary())Look at the coefficient for spending_per_bed. A statistically significant positive coefficient would suggest a beneficial association; the study found no such relationship.
Step 4: Analyze Timing and Lag Effects
Consultant interventions may take years to produce results. The researchers introduced lagged variables (e.g., spending in year t with outcome in year t+1, t+2). You can do the same:
df['spending_lag1'] = df.groupby('hospital_id')['spending_per_bed'].shift(1)
df['spending_lag2'] = df.groupby('hospital_id')['spending_per_bed'].shift(2)
# Repeat for lags of 1,2,3 yearsRun separate regressions for each lag to see if delayed effects appear.
Step 5: Distinguish Between Types of Consulting
Not all consultant engagements are created equal. The study broke down spending into categories: strategy, revenue cycle management, IT systems, operations. Repeat your analysis for each category. Perhaps IT consultants show a positive effect after 3 years, while strategy consultants show none.
Step 6: Check for Selection Bias – Do Better Hospitals Hire Consultants?
Hospitals that hire consultants may already be on a performance trajectory. Use propensity score matching to compare hospitals with similar pre-consulting trends. Alternatively, use instrumental variables (e.g., proximity to consultant firm headquarters) to isolate causal impact.
Common Mistakes
Mistake 1: Cherry-Picking Positive Results
If you test 20 outcome metrics, by chance you'll likely find a few statistically significant results. Correct for multiple comparisons using Bonferroni or FDR adjustments.
Mistake 2: Ignoring Consultant Selection as a Variable
Hospitals in financial distress may be more likely to hire consultants—this creates a negative correlation that isn't causal. Always include hospital fixed effects in your model to account for time-invariant unobserved factors.
Mistake 3: Overlooking Implementation Fidelity
Consultants might provide excellent recommendations, but if hospital staff don't implement them fully, you won't see results. Track implementation completion rates as a covariate.
Mistake 4: Relying on Anecdotal Evidence
A single success story does not prove ROI. The large-scale study found no aggregate effect, suggesting that most consultant engagements fail to deliver consistent value. Use systematic data, not anecdotes.
Summary
This guide has walked you through the methodology of a pivotal study that found no clear association between billions spent on management consultants and improved hospital performance. By following the six-step analysis—aggregating spending data, defining outcomes, running regressions, testing lags, categorizing consulting types, and addressing selection bias—you can conduct a similar evaluation for your own institution. Beware of common pitfalls like cherry-picking results and ignoring implementation gaps. The takeaway: before renewing a consultant contract, demand rigorous evidence that the engagement will produce measurable, verifiable improvements.