Author Affiliations: Department of Medicine and Division of Respiratory Medicine (Drs Ayas, FitzGerald, Fleetham, and Ryan), Applied Research and Evaluation Services (Dr Mercer), and Faculty of Pharmaceutical Sciences (Dr Marra), University of British Columbia, Vancouver; Sleep Disorders Program, Vancouver Acute Hospitals, Vancouver (Drs Ayas, Fleetham, and Ryan); Centre for Clinical Epidemiology and Evaluation, Vancouver Coastal Health Research Institute, Vancouver (Drs Ayas, FitzGerald, Schulzer, and Marra and Mr Tan); Insurance Corporation of British Columbia, Vancouver (Dr Ghaeli and Mr Cooper); and Division of Sleep Medicine, Brigham and Women's Hospital, Boston, Mass (Dr White).
Obstructive sleep apnea/hypopnea (OSAH) is a common disorder characterized by recurrent collapse of the upper airway during sleep, and is associated with an increased risk of motor vehicle crashes (MVCs). Common first-line therapy for OSAH is continuous positive airway pressure (CPAP). We assessed the cost-effectiveness of CPAP therapy vs none for the treatment of OSAH.
We used a 5-year Markov model that considers the costs and quality-of-life improvements of CPAP therapy, accounting for the gains from reduced MVC rates. Utility values were obtained from published studies. The MVC rates under the CPAP and no-CPAP scenarios were calculated from National Highway Traffic Safety Administration data and a systematic review of published studies. Costs of MVCs, equipment, and physicians were obtained from US Medicare and the National Highway Traffic Safety Administration. The target population included male and female patients aged 25 to 54 years and newly diagnosed as having moderate to severe OSAH. We examined the findings from the perspectives of a third-party payer and society.
From a third-party payer or a societal perspective, CPAP therapy was more effective but more costly than no CPAP, with incremental cost-effectiveness ratios of $3354 or $314 per quality-adjusted life-year gained, respectively. The incremental cost-effectiveness ratio estimate was most dependent on viewpoint (varying more than 10-fold between societal and third-party payer perspectives) and choice of utility measurement method (varying more than 5-fold between the use of standard gamble and EuroQol 5D utility assessment values).
When quality of life, costs of therapy, and MVC outcomes are considered, CPAP therapy for patients with OSAH is economically attractive.
Obstructive sleep apnea/hypopnea (OSAH) is a common disorder1 characterized by recurrent collapse of the upper airway during sleep. This leads to sleep fragmentation, daytime sleepiness, reduced quality of life,2 and an increased rate of motor vehicle crashes (MVCs).3
The primary therapy for OSAH is continuous positive airway pressure (CPAP), which is delivered with a device that consists of a mask, or a mask alternative, worn on the face and connected with plastic tubing to a flow generator. By preventing upper airway collapse during sleep, CPAP relieves daytime sleepiness, improves quality of life,4,5 and reduces the risks of MVCs.6
Despite these benefits, it is unclear whether CPAP is a cost-effective use of limited health care resources. The cost-effectiveness of medical therapies is usually assessed by the incremental cost-effectiveness ratio (ICER), the ratio of the incremental cost and the incremental change in quality-adjusted life-years (QALYs), which follow from the adoption of one treatment vs another strategy (eg, no treatment). An ICER of less than $50 000 per QALY gained is generally considered cost-effective, but some evidence suggests this value should be higher.7,8
The purpose of this study was to assess the cost-effectiveness of CPAP therapy, compared with no CPAP, in patients with moderate-to-severe OSAH.
The base-case analysis considered US drivers (aged 25-55 years) with newly diagnosed moderate-to-severe OSAH. A state-transition Markov model compared the costs and outcomes of OSAH treated with CPAP with no therapy for 5 years (Markov cycle length, 1 year) (Figure 1 and Figure 2).
Markov model of patients not prescribed continuous positive airway pressure therapy. MAIS indicates Modified Abbreviated Injury Scale; MVC, motor vehicle crash. MAIS scores are described in the “Decision Model Structure” subsection of the “Methods” section.
Markov model of patients prescribed continuous positive airway pressure (CPAP) therapy. MAIS indicates Modified Abbreviated Injury Scale; MVC, motor vehicle crash. MAIS scores are described in the “Decision Model Structure” subsection of the “Methods” section.
With each year in the model, patients could have an MVC resulting in property damage, injury, or death; could die of natural causes; or could survive incident free. Injuries were subclassified into severity categories according to the Maximum Abbreviated Injury Scale (MAIS), with scores ranging from 1 (minimal injury) to 5 (most severely injured). The MVC survivors with the most severe injuries were assumed to be unable to drive afterward and were at no risk of a subsequent MVC (ie, they were confined to a tunnel state). All other survivors were at risk of a subsequent MVC. Transition probabilities depended on whether patients were effectively treated with CPAP. Decision analyses were performed with Data Pro for HealthCare software (TreeAge Software Inc, Williamston, Mass); statistical analyses were performed with SAS software (version 8; SAS Institute Inc, Cary, NC).
This analysis may be thought of as a weighted average of the findings for 6 patient groups defined by age (25-34, 35-44, and 45-54 years) and sex. The weights used in this calculation (Table 1) were obtained from the primary referral center for OSAH in Vancouver, British Columbia. Data from patients diagnosed as having moderate-to-severe OSAH (apnea-hypopnea index, ≥15 events per hour) from 2003 to 2004 were used (n = 99 patients). The distribution is comparable to that in the United States.20,21
The annual MVC probability in individuals without OSAH was determined using MVC data for 2003 (115 million licensed motorists aged 25-55 years) from the National Highway Traffic Safety Administration.22 Probabilities of MVC were stratified by the relevant patient groups and further classified by the following MVC types: property damage only, injury related, or fatal. Severity of MVC injury was assumed to have the following distribution: 85.6% for MAIS 1, 10.5% for MAIS 2, 3.3% for MAIS 3, 0.4% for MAIS 4, and 0.2% for MAIS 5.23
To determine the impact of CPAP on rates of MVC, we performed a meta-analysis of all studies that examined MVC rates in patients with OSAH before and after CPAP. A comprehensive search of MEDLINE (1966 to March 2005) using Ovid was conducted using the following exploded MESH terms: sleep apnea syndromes AND positive pressure respiration OR continuous positive airway pressure AND automobile driving OR accident. A total of 38 studies were identified. Studies were included if they compared rates of MVC (by self-report or by more objective measures such as insurance databases) in patients with OSAH before and after the initiation of CPAP therapy. Review articles and studies that reported changes in driving performance by simulator rather than actual MVC rates were excluded. The remaining studies were reviewed by one of us (N.T.A.), and 7 were appropriate for the meta-analysis.6,13- 18 After review of bibliographies and consultation with experts, we identified an additional study published in abstract form.19 These 8 studies examined a total of 1227 patients6,13- 19 (Table 2). To calculate the pooled reduction in MVC risk with CPAP, we used random-effects meta-analysis using the inverse variance of the logarithm of the odds ratio.
We assumed that the MVC crash rate in patients with OSAH receiving CPAP treatment equaled that in the general population,6 as reported in annual data from the US Federal Highway Administration. The MVC rates in patients without CPAP were obtained by dividing MVC rates by the percentage reduction in MVCs associated with CPAP therapy.
Transition probability to death was calculated by adding the yearly, sex-specific probability of death in an MVC to the rate of death due to natural causes as obtained from US life tables.24
Quality-adjusted life-years are the sum of the durations of health states multiplied by the mean utility of each of the health states.11 The base-case analysis used utility results obtained by the standard gamble, which is often considered the standard.25,26 We used data from a prospective study that demonstrated an increase in utility value from 0.32 to 0.55 (difference, 0.23) in those receiving CPAP9; this is an increase similar to that documented in a retrospective study by Tousignant et al.27
Utilities have also been assessed by the EuroQol 5D (EQ-5D). In 1 study,28 utility values assessed by the EQ-5D before and after CPAP were 0.738 and 0.811, respectively (increase, 0.073). Jenkinson and coworkers29 used the EQ-5D and found an improvement in utility of 0.05 with CPAP (from 0.78 to 0.83). The EQ-5D figures were used in subsequent sensitivity analyses to determine their impact on the ICER.
Quality weights for the various MAIS injury levels were obtained from the literature using the Functional Capacity Index (FCI).30 The FCI weights represent rating scale pREFERENCES elicited from a sample of people who have sustained injuries that resulted in functional limitations for longer than 1 year. These FCI weights were applied using methods similar to those of other investigators.10
The base-case analysis used the third-party payer perspective and only considered direct medical costs. In the first year of the model, the total cost of using CPAP was derived from the 2004 US Medicare fee schedule. Cost components included the CPAP device, mask, tubing, headgear, and heated humidifier. In keeping with Medicare guidelines, after 15 months of rental fees, patients incurred a rental fee equivalent to 1 month's rent every 6 months. Additional first-year costs included 1 specialist consultation and 2 physician follow-up visits. We assumed that a standard CPAP machine would last 5 years. For years 2 through 5, ongoing annual CPAP cost components included 1 mask, tubing, headgear, CPAP rental, and 2 physician visits (Table 3).
Direct medical and indirect costs of MVC stratified by the MAIS were obtained from a technical report from the National Highway Traffic Safety Administration.23 This comprehensive report used American public sources to attach lifetime costs to MVC outcomes and services (Table 3). All costs were updated to the year 2003 using the medical component of the US Consumer Price Index and prorated to suit the 5-year time frame of the analysis under the conservative assumption that all MVC-related costs would be (in present-value terms) uniformly distributed over a future of 40 years for all patient groups. The MVC costs consist of direct medical costs (medical and emergency services), indirect costs (losses in household and market productivity and associated workplace costs), legal costs, and insurance administration costs. Market productivity was valued in terms of lost wages and benefits. Lost household activity was valued at the market price for hiring a person to accomplish the same tasks.
We assumed a compliance rate of 70% as reported in the literature.12 Noncompliant patients were assumed to use the CPAP machine for 3 months, incurring rental costs of the machine and humidifier and costs associated with the mask, tubing, headgear, and 1 physician visit. Patients were assumed not to benefit from CPAP for this period of 3 months.
We performed a probabilistic cost-effectiveness analysis using second-order Monte Carlo simulations. We specified distributions for model variables to represent the uncertainty in these estimates. Beta distributions were given to all conditional probabilities (eg, the probability of a severe injury with a MAIS score of 5, given the occurrence of an MCV injury) and utilities generated by the standard gamble and FCI. For costs, triangular distributions were used, with upper and lower limits determined by adding and subtracting 25% from the point estimates. A log-normal distribution was given to the odds ratio associated with an MVC in patients with OSAH who were receiving CPAP treatment vs no CPAP (Table 1). We randomly sampled from these distributions in second-order Monte Carlo simulations to generate 1000 incremental cost and effectiveness pairs.
To assess the robustness of our model, we performed deterministic sensitivity analyses. Analyses were repeated after modifying a number of variables to assess their impact on the ICER (Table 4). Variables of interest were the probability of compliance with CPAP, utility values, the discount rate for costs and QALYs, the cost-scaling factor for adjusting lifetime costs to the 5-year time horizon, and the reduction in the rates of MVC according to the 95% confidence limits determined in the meta-analysis.
Results of the meta-analysis are shown in Table 2. The mean apnea-hypopnea index of the patients in the studies ranged from 37 to 60 events per hour. There was no significant heterogeneity among the studies (Q6 = 4.34; P = .50). Treatment with CPAP reduced the rate of MVC by a factor of approximately 7 (odds ratio of MVC with CPAP compared with no CPAP, 0.15 [95% confidence interval (CI), 0.10-0.22]).
A CPAP strategy was more effective but more costly than the no-CPAP strategy from the perspective of a third-party payer. Specifically, the CPAP strategy, compared with the no-CPAP strategy, was associated with a mean gain of 0.75 QALY (2.22 QALYs [95% CI, 0.86-3.89] vs 1.47 QALYs [95% CI, 0.28-3.08] in the CPAP and no-CPAP groups, respectively). The incremental cost for the CPAP strategy was $2519 ($4177 [95% CI, $2804-$6057] vs $1659 [95% CI, $283-$3936] in the CPAP and no-CPAP groups, respectively) resulting in an ICER of $3354 per QALY (95% CI, $1062 per QALY to $9715 per QALY). From the perspective of society, the CPAP strategy was more costly ($7123 [95% CI, $4324-$11 906] vs $6887 [95% CI, $3113-$14 843] for the no-CPAP strategy) as well as more effective, implying an incremental cost-effectiveness of $314 (95% CI, cost saving to $6114).
Results of the probabilistic analysis from the third-party payer and societal perspectives can be viewed as a joint distribution of cost differences and QALY differences (Figure 3). Adopting the commonly cited value of society's willingness to pay for a QALY of $50 000, 100% of the Monte Carlo simulations favored the cost-effectiveness of CPAP therapy. This is reflected by the points in the upper and lower right quadrants of Figure 3 falling below the line with the slope of $50 000 per QALY gained. The probability that CPAP is cost-effective, measurable as the proportion of Monte Carlo simulations that favor the therapy's cost-effectiveness, can be plotted as a function of the willingness to pay per QALY gained, generating a cost-effectiveness acceptability curve (Figure 4). From the societal perspective, 42% of the ICERs from the simulations fell within the lower right quadrant, indicating that CPAP was dominant (more effective and less costly).
Scatterplot displaying, on the incremental cost-effectiveness plane, the incremental cost and effectiveness pairs resulting from 1000 iterations of the model comparing continuous positive airway pressure (CPAP) with no CPAP. The slope of the line drawn from each point to the origin is the incremental cost-effectiveness ratio of CPAP to no CPAP as estimated from 1 iteration of the model. Points in the right upper quadrant represent iterations for which CPAP was more costly and more effective than no CPAP, whereas points in the right lower quadrant represent simulations where CPAP was the dominant strategy (ie, more effective but less costly). QALYs indicates quality-adjusted life-years.
The cost-effectiveness acceptability curve plots the estimated probability that continuous positive airway pressure (CPAP) is cost-effective vs society's willingness to pay for a quality-adjusted life-year (QALY). The probability of cost-effectiveness is calculated as the proportion of Monte Carlo simulations indicating that either CPAP therapy leads to greater health outcomes at a price that is acceptable to society or (in the present context, only a theoretical possibility) that no CPAP therapy leads to improved health outcomes but at a price that is too high.
One-way sensitivity analyses showed that the ICER estimates were robust to many alternative assumptions pertaining to discount rate, compliance rate, time horizon, lifetime distribution of costs, and strength of association between OSAH and MVC incidence. The most influential factor was analytical perspective (ie, third-party payer vs societal), leading to a more than 10-fold difference in ICER estimates. The second most influential factor was choice of utilities values. When EQ-5D utilities were used instead of standard gamble utilities, the ICER estimate increased more than 5 times (Table 4).
Continuous positive airway pressure therapy for OSAH is an efficient use of health care resources. When both indirect and direct costs were considered (under the societal perspective), CPAP was cost-effective with an ICER of $314 per QALY gained. When the third-party payer perspective was used, CPAP therapy was still cost-effective, with an ICER of $3354 per QALY. These values compare very favorably with other publicly funded therapies such as primary prevention of cardiovascular events using cholesterol-lowering therapy ($54 000 per QALY to $1 400 000 per QALY gained)31 and biological agents for the treatment of rheumatoid arthritis ($30 500 per QALY).32 They are substantially less than the ICER of lung volume reduction surgery in the treatment of chronic obstructive pulmonary disease ($190 000 per QALY).33
Our results are conservative, and the benefits of CPAP are likely greater, as we did not include a number of potential benefits in our model. These include improvements in work productivity,34 reduction in occupational injuries,35 reduced use of antihypertensive medications,36 and improvements in bed-partner quality of life.37
In particular, although there is growing evidence that CPAP may lead to a reduction in cardiovascular disease such as hypertension, strokes, and heart attacks, there is considerable controversy surrounding this issue.38,39 Long-term studies describing potential reductions in cardiovascular events with CPAP have been observational in nature40,41 and thus are subject to confounding by indication/compliance. Others have used surrogate short-term (usually ≤1 month) end points such as endothelial function,42 C-reactive protein level,43 or blood pressure.44 Some of these studies conflict, with one study that demonstrated a reduction in C-reactive protein level with CPAP43 and another that demonstrated no significant effect.45 Some studies have also shown no significant effect of CPAP on blood pressure.39 Although we suspect that CPAP may reduce rates of cardiovascular disease, we did not feel comfortable putting this in the model because the data concerning this issue are not robust. We thus made the conservative decision not to include potential cardiovascular benefits in our analysis. Even with our conservative model, CPAP was still cost-effective.
Our data confirm and extend the findings of previous investigators. Other studies have demonstrated that CPAP offers excellent value for money.46 Tousignant and colleagues27 reported ICERs of $3400 per QALY to $9800 per QALY (in Canadian dollars). Because these values were based only on quality-of-life data and did not assess the impact of CPAP on MVC, these values were higher than what we found.
Similarly, Mar and coworkers28 reported a cost-effectiveness analysis of CPAP therapy in patients with moderate-to-severe OSAH in Spain. Although the ICER was well within the range of what would be considered cost-effective (€7861 per QALY saved), it was greater than our base-case ICER estimate. The impact of MVC was included in the study by Mar et al,28 but only fatalities were considered. Other costs associated with these MVC costs were not. Therefore, we believe our model more accurately represents the costs and benefits of CPAP therapy with respect to MVC.
We acknowledge that our study has limitations. First, much of the benefit that we have attributed to CPAP therapy is based on its effectiveness in reducing rates of MVC and its improvement in quality of life. We have based our estimate of the reduction in MVC rates on 8 studies. A major limitation of these studies is their reliance on a before-after design (ie, rates of crashes before and after CPAP therapy were compared). It is thus possible that some patients may have been sent for assessment of suspected sleep-disordered breathing because of an MVC (referral bias), falsely inflating rates prior to using CPAP. However, we doubt this is a significant factor because, when the odds ratio was decreased to the lower end of the confidence interval, the ICER was still close to $3530 per QALY.
Second, much of the data used to construct the transition probabilities were based on studies of patients with severe OSAH. Our analysis was also limited to patients aged 25 to 55 years. Therefore, our model may not be applicable to mild-to-moderate OSAH or to older and younger patients.
Finally, utilities in our base-case analysis were based on the standard gamble given directly to patients. Thus, these values represent patient pREFERENCES and not those of society. We tested the impact of using societal pREFERENCES (as captured through the EQ-5D) and found that the incremental cost-effectiveness ratio was still within the range of what is considered cost-effective. It is not clear whether there is a difference in responsiveness between the standard gamble and the EQ-5D in this disease state or a difference between societal and patient pREFERENCES.
In conclusion, previous studies4,6 have demonstrated that CPAP is effective in improving daytime sleepiness and reducing rates of MVC in patients with OSAH. We have shown that, when quality of life and costs of therapy and MVCs are considered, CPAP therapy in patients with OSAH is an excellent use of health care resources.
Correspondence: Carlo A. Marra, PharmD, PhD, Health Economics Program, Centre for Clinical Epidemiology and Evaluation, Vancouver General Hospital, 717 W 10th Ave, Vancouver, British Columbia, Canada V5Z 1L8 (email@example.com).
Accepted for Publication: November 23, 2005.
Author Contributions: Drs Ayas and Marra had full access to all the data in the study and take responsibility for the integrity of the data and the accuracy of the data analysis.
Financial Disclosure: None.
Funding/Support: This study was supported by a Scholar Award (Drs Ayas and Marra), a Distinguished Scholar Award (Dr Fitzgerald), and a Unit Award (Respiratory Sleep Disorders Research Unit) from the Michael Smith Foundation for Health Research; a New Investigator Award (Dr Ayas) and an Investigator Award (Dr FitzGerald) from the Canadian Institutes of Health Research and the British Columbia Lung Association; a Departmental Scholar Award from the University of British Columbia (Dr Ayas); and an operating grant from the British Columbia Lung Association.
Thank you for submitting a comment on this article. It will be reviewed by JAMA Internal Medicine editors. You will be notified when your comment has been published. Comments should not exceed 500 words of text and 10 references.
Do not submit personal medical questions or information that could identify a specific patient, questions about a particular case, or general inquiries to an author. Only content that has not been published, posted, or submitted elsewhere should be submitted. By submitting this Comment, you and any coauthors transfer copyright to the journal if your Comment is posted.
* = Required Field
Disclosure of Any Conflicts of Interest*
Indicate all relevant conflicts of interest of each author below, including all relevant financial interests, activities, and relationships within the past 3 years including, but not limited to, employment, affiliation, grants or funding, consultancies, honoraria or payment, speakers’ bureaus, stock ownership or options, expert testimony, royalties, donation of medical equipment, or patents planned, pending, or issued. If all authors have none, check "No potential conflicts or relevant financial interests" in the box below. Please also indicate any funding received in support of this work. The information will be posted with your response.
Some tools below are only available to our subscribers or users with an online account.
Download citation file:
Web of Science® Times Cited: 53
Customize your page view by dragging & repositioning the boxes below.
Enter your username and email address. We'll send you a link to reset your password.
Enter your username and email address. We'll send instructions on how to reset your password to the email address we have on record.
Athens and Shibboleth are access management services that provide single sign-on to protected resources. They replace the multiple user names and passwords necessary to access subscription-based content with a single user name and password that can be entered once per session. It operates independently of a user's location or IP address. If your institution uses Athens or Shibboleth authentication, please contact your site administrator to receive your user name and password.