Author Affiliations: Institute for Safe Medication Practices, Huntingdon Valley, Pennsylvania (Mr Moore and Dr Cohen); and Division of Public Health Sciences, Wake Forest University School of Medicine, Winston-Salem, North Carolina (Dr Furberg).
The US Food and Drug Administration has operated the Adverse Event Reporting System since 1998. It collects all voluntary reports of adverse drug events submitted directly to the agency or through drug manufacturers.
Using extracts published for research use, we analyzed all serious adverse drug events and medication errors in the United States reported to the Food and Drug Administration from 1998 through 2005.
From 1998 through 2005, reported serious adverse drug events increased 2.6-fold from 34 966 to 89 842, and fatal adverse drug events increased 2.7-fold from 5519 to 15 107. Reported serious events increased 4 times faster than the total number of outpatient prescriptions during the period. In a subset of drugs with 500 or more cases reported in any year, drugs related to safety withdrawals accounted for 26% of reported events in that group in 1999, declining to less than 1% in 2005. For 13 new biotechnology products, reported serious events grew 15.8-fold, from 580 reported in 1998 to 9181 in 2005. The increase was influenced by relatively few drugs: 298 of the 1489 drugs identified (20%) accounted for 407 394 of the 467 809 events (87%).
These data show a marked increase in reported deaths and serious injuries associated with drug therapy over the study period. The results highlight the importance of this public health problem and illustrate the need for improved systems to manage the risks of prescription drugs.
Serious adverse drug events (ADEs) are an important public health problem whose dimensions have been imprecisely defined. Serious ADEs have been estimated to account for 3.1% to 6.2% of admissions to hospitals studied.1 Among hospital inpatients, serious ADEs have been reported to occur at a rate of 1.9 per 100 admissions.2 In hospital emergency departments, ADEs of all levels of severity were estimated to account for 2.5% of all visits for unintentional injury in 2005-2006, of which 16.7% were severe enough to require hospitalization.3 A meta-analysis of inpatient hospital and hospital admission studies conducted over several decades estimated that ADEs were associated with 106 000 deaths in 1994.1
Most of these studies had methodological limitations that were substantial enough that 2 federal government reviews concluded that insufficient data existed to estimate reliably deaths or serious events associated with drug therapy at any point or over time.4,5 Among the problems identified were making population estimates from studies of 1 or 2 hospitals, differing definitions of ADEs, and varied protocols, study periods, and source information. Even less certain are trends over time.
The Adverse Event Reporting System (AERS) of the US Food and Drug Administration (FDA) is the world's largest database of voluntary, spontaneous reports of adverse drug reactions and medication errors.6 It has been in operation since 1998 under the same database system, with consistent regulatory requirements for drug manufacturers. Adverse drug events reported to this system are better known to health professionals as “MedWatch” reports, named after the FDA's promotional program to provide safety information to health professionals and encourage reporting of adverse events for drugs and other medical products. The objectives of this study were to measure any changes in the annual number of reported serious ADEs since 1998, identify drugs frequently implicated, and explore potential reasons for the changes observed.
The FDA publishes for research use quarterly extracts of all AERS reports after removing personal identifiers and narrative text.7 The data are in 7 linked files that include fields describing the report itself, patient characteristics, the health outcome of the event, and details about the drugs administered.
The data for this analysis consist of excerpts of reports of serious ADEs in the United States that were received by the FDA from January 1998 through December 2005 for prescription drugs, biological products (except vaccines), and over-the-counter drugs. The voluntary reports are submitted either directly to the FDA through the MedWatch program or to drug manufacturers. The manufacturers, in turn, are required by federal regulation to forward to the FDA reports of new, serious, and unexpected adverse events within 15 days and other serious events on a quarterly basis.8 A serious event, in the FDA's regulatory definition, means an adverse event that resulted in a health outcome of death, a birth defect, disability, hospitalization, or was life threatening or required intervention to prevent harm.8 In the event that multiple reports about the same adverse event were identified in the FDA system by a common case number, only the safety report with the most recent date was used.
We excluded cases specifically identified as occurring in drug manufacturers' clinical studies, both before and after approval. These reports differ from spontaneous reports in that clinical investigators are required to report all serious events that occur whether or not a connection with the drug was suspected.9 In addition, reports for thalidomide were excluded because, as a condition of approval, the manufacturer agreed to maintain a 100% patient registry and therefore would learn of events through active surveillance without regard to whether drug involvement was suspected.10 Reports for events occurring in foreign countries were also excluded. This was not only to focus this analysis on events in the United States but also to exclude additional variation caused by different FDA requirements for foreign reporting and different national systems for postmarket surveillance.
In the original data, suspect drugs were identified variously by brand name, ingredient name, or chemical name without standardization. For this study, suspect drug names were recoded according to the following rules: FDA Orange Book, National Drug Code Directory, or World Health Organization ingredient names were used, except that drug products that differed only by salt or ester were grouped together (eg, amoxicillin trihydrate and amoxicillin sodium), as were certain other closely related compounds. We excluded reports that identified medical devices, vaccines, dietary supplements, or illegal drugs such as heroin as the primary suspect as well as reports that were vague. The drug identification did not distinguish between dosage forms or routes of administration. While wholly illegal drugs were excluded, these data include drugs that are abused as well as cases reported as accidental or intentional overdoses. The FDA MedWatch Forms 3500 and 3500A allow identification of a primary suspect drug, a secondary suspect drug, and additional drugs used in concomitant therapy. In this study, only the principal suspect drug was used.
To minimize the effect of reports connected to legal claims, we excluded cases in which the report was received by the FDA more than 14 days after a drug was withdrawn for safety reasons. We did not exclude reports for phenylpropanolamine as an ingredient in over-the-counter drugs because it was impossible to determine when various manufacturers chose to remove the ingredient or for trovafloxacin, which was initially restricted and then later discontinued.
The FDA classifies serious reports into the following 3 types: (1) direct reports submitted to the FDA rather than through a manufacturer, (2) expedited reports from manufacturers that describe a serious and unexpected ADE that is not in the product labeling, and (3) periodic reports from manufacturers that involve a serious ADE that is already described in the product labeling.
The FDA permits the individual observing the event to identify several different serious health outcomes on the same case report. To prevent double counting, the health outcome was recoded into the following mutually exclusive categories in the following order of priority: death, disability (disability or congenital anomaly), and all other serious outcomes (hospitalization, required intervention, or life-threatening or other serious outcomes). Reports without serious outcomes were excluded.
The reported age, which can be described in days, weeks, years, or even decades on the FDA MedWatch Form 3500, was recoded into 4 categories and compared with the standard year 2000 US population.11 Medication use for the age groups was measured as the proportion reporting prescription drug use in the previous month for the years 1999 to 2002.12 Total outpatient prescription volume was based on published estimates for all US outpatient prescriptions for the years 1998 to 2005.13,14
One feature of the study period was the introduction or increased use of biotechnology products, notably immunomodulators created through genetic engineering. To measure the impact of this change, we examined the reports associated with 13 biotechnology products of 3 types: anti–tumor necrosis factor immunomodulators, interferon alfa products, and interferon beta products.
We created a subset of all drugs that accounted for 500 or more cases in any calendar year. The subset was further divided into the following categories: drugs associated with a safety withdrawal or restriction or discontinuation, new drugs first approved in 1998 or later, and drugs available throughout the study period.
We analyzed these data as a population, which permits direct comparison between categories without calculation of confidence intervals or other estimates of sampling error. The excerpts of FDA data were maintained in a Microsoft Access relational database (Microsoft Corp, Redmond, Washington) in accord with agency documentation. The data were analyzed with R language and environment for statistical computing software (version 2.3.1, http://www.r-project.org).
In the 8-year period, 467 809 serious events met the study criteria for inclusion in this analysis. Serious ADEs reported to the FDA increased from 34 966 in 1998 to 89 842 in 2005, a 2.6-fold increase (Table 1). Reported deaths increased 2.7-fold, from 5519 in 1998 to 15 107 in 2005. The overall relative increase was 4 times faster than the growth in total US outpatient prescriptions, which grew in the same period from 2.7 billion to 3.8 billion (Figure 1).
Reported serious events vs outpatient prescriptions, 1998-2005.
A total of 89 312 reports (19.1%) were submitted directly to the FDA; 314 145 (67.2%) were expedited reports from manufacturers about new, serious adverse events not already included in the product labeling, and 64 352 (13.8%) were periodic reports from manufacturers about serious adverse events already reflected in the product label (Table 2). The increase over time was largely explained by increases in just 1 type of report—expedited reports from manufacturers of new, serious events not on the product label. Of the increase of 54 876 additional events in 2005 compared with 1998, expedited reports accounted for 48 080 (87.6%) of these events.
Health professionals were predominantly the original source of the report (whether sent directly to the FDA or through manufacturers). Health professional accounted for 70.4% of all serious reports, including 82% of reported deaths (Table 2).
In total, 80 880 cases (17.3%) reported a death outcome; 32 922 (7%) indicated permanent disability or birth defect; and the remainder (354 007 [75.7%]) had 1 or more of the other serious outcomes (Table 1). The proportion of serious events with a death outcome was relatively consistent over time, accounting for 15.8% of events in 1998 and 16.8% in 2005. The disability category included 3385 cases of a reported birth defect (0.7% of all cases).
The patients were more frequently female (55.5%) than male (45.5%), and the sex imbalance was stable over time. A disproportionate share of adverse events occurred among elderly patients, while fewer than expected were reported among children younger than 18 years (Table 3). Children younger than 18 years accounted for 25.8% of the total US population but accounted for 7.4% of the reported serious adverse events. After adjusting for a lower likelihood of taking prescription drugs, the 7.4% of events reported in children remained lower than the 13.8% expected, based on the population size adjusted for medication use. Among the persons 65 years and older, the opposite occurred. This age group constituted 12.6% of the total US population but accounted for 33.6% of the reported serious adverse events. After adjustment for more intensive medication use, the 33.6% of reported cases still exceeded the 23.6% expected.
While a total of 1489 drug products were identified as principal suspects, relatively few accounted for most of the events. The 298 drugs (20%) with the highest event totals accounted for 407 394 of all reported study events (87.1%). On the other extreme, the 298 drugs (20%) with the lowest event totals accounted for 1459 of the reported events (<0.01%). The 15 drugs most frequently identified in fatal and nonfatal serious events are listed in Table 4.
Among the 15 drugs most frequently named in fatal events, 7 were pain medications and 4 had primary effects on the immune system. Among nonfatal serious events, the most frequently identified drugs were of more varied classes. The number of serious adverse events associated with 13 prominent biotechnology products grew 15.8-fold during the period, from 580 in 1998 to 9181 in 2005 (Figure 2).
Reported serious events for 15 biological products, 1998-2005. Anti-TNF indicates anti–tumor necrosis factor.
Fifty-one drugs were identified through the criteria of having accounted for 500 or more reports in any study year (Table 5). Together, this subset accounted for 203 957 cases (43.6% of the study total). As Figure 3 illustrates, there were markedly different patterns among selected agents, suggesting that the long-term trend was not apparently a result of a single common factor but rather a combination of many different upward and downward changes. However, 2 general changes over time could be identified in this subset. Drugs that were related to safety withdrawals or restrictions played a declining role in this subset during the period, accounting for 26.4% of all reported events in 1999 and declining steadily to less than 1% in 2005. Overall, drugs related to safety withdrawal accounted for 9.8% of the events in this subset total. In addition, reports identifying drugs available for the entire period increased from 9767 in 1998 to 29 164 in 2005, a 3-fold increase.
Long-term trends in selected drug products, 1998-2005. A, Phentermine; B, insulin; C, fentanyl; D, warfarin; E, estrogens; F, sildenafil.
These data show that a nearly 3-fold increase has occurred in reported serious injuries, disability, and death associated with drug therapy in the 8-year study period. The change and overall risks can be primarily attributed to a minority of important drugs—an example of the quality assurance rule of thumb that holds that 80% of the consequences spring from 20% of the causes. We estimate that increasing population and more intensive use of drug therapy—as measured by prescription volume—might account for 25% of the observed increase, as illustrated in Figure 1. An additional 15% of the increase is accounted for by 13 prominent new biotechnology products shown in Figure 2. Contrary to our expectations, drugs related to safety withdrawals were a modest share of all reported events and declined in importance over time. Among the most frequently reported drugs associated with fatal events, we observed a disproportionate contribution of pain medications and drugs that modify the immune system.
While the AERS data are the primary data source for monitoring the postmarket safety of approved drug products, it has many known limitations. It is a collection of voluntary reports rather than the systematic observation of any defined patient group. The submission of an adverse event report does not establish causality—only that the reporters suspected a relationship might exist. Also, this analysis focused on only the primary suspect drug even though a median of 2 drugs per case were named and one quarter of the cases identified 5 or more drugs. Reported events include adverse drug reactions, medication errors, accidental and intentional overdoses, and product problems. The reporting rate for adverse events may vary among drugs and for the same drug over time.15 Estimates of what fraction of serious events were reported to the AERS vary between 0.3% and 33%,4,16 depending on event, period, and drug. However, the reporting requirements, definitions of serious events, and other fundamentals of the system were unchanged throughout the study period.
We also explored whether the results were influenced by external factors such as highly publicized scientific discoveries, safety withdrawals, or legal claims. Our 8-year study period featured several such episodes. Examples include cyclooxygenase 2 inhibitors and thrombotic cardiovascular events,17 estrogen therapy and breast cancer and thrombotic cardiovascular events,18 and atypical antipsychotics and the risk of hyperglycemia and diabetes.19 It seemed possible that increased reporting could have been stimulated through media publicity and lawyers seeking injured clients through radio, television, and Internet advertising. We limited the impact of this phenomenon by excluding reports received more than 14 days after a drug was withdrawn for safety reasons. Even if all cases associated with withdrawn drugs involved legal claims, the subset data showed that such claims accounted for less than 10% of all events and declined since 1999. Nevertheless, the influence of publicity and legal claims can be seen in specific drugs listed in Table 5. Phentermine was administered in combination with fenfluramine and dexfenfluramine, which were withdrawn in September 1997.20 We speculate that the initial upsurge and then decline in phentermine reports was related to the diet drug litigation that focused primarily on the fenfluramines. Similarly, reports for estrogen increased sharply after the Women's Health Initiative Trial documented increased risks of cancer and thrombotic cardiovascular events for hormone therapy.18 However, overall, the increased reporting effect from these events was partially adjusted for, was limited to relatively few drugs, and may have declined over time.
An additional question was whether all or part of the increase could be explained by some broad-based increase in adverse event reporting rate in the medical community, perhaps spurred by expert panel proceedings such as the 1999 report on medication error by the Institute of Medicine.21 However, as illustrated in Figure 3, the data showed markedly different patterns among specific drugs, with numerous increases and decreases observed. Also, if some broad increase had occurred in the propensity to report ADEs, then one would expect to observe an equal or greater increase in the volume of direct reports to the FDA rather than through manufacturers. This did not occur. While insufficient data exist to either rule in or rule out this possibility, we concluded that such a broad change in spontaneous reporting was unlikely.
This study shows that substantially growing numbers of patients are experiencing serious injuries from drug therapy, although the exact magnitude of the population increase cannot be estimated from these data. Future initiatives to improve drug safety require more accurate and capable systems to monitor postmarketing ADEs. This growing toll of serious injury shows that the existing system is not adequately protecting patients and underscores the importance of recent reports urging far-reaching legislative, policy, and institutional changes.22,23
Correspondence: Thomas J. Moore, AB, Institute for Safe Medication Practices, 1800 Byberry Rd, Ste 810, Huntingdon Valley, PA 19006 (email@example.com).
Accepted for Publication: April 20, 2007.
Author Contributions: Mr Moore had full access to all of the data in the study and takes responsibility for the integrity of the data and the accuracy of the data analysis. Study concept and design: Moore, Cohen, and Furberg. Acquisition of data: Moore. Analysis and interpretation of data: Moore, Cohen, and Furberg. Drafting of the manuscript: Moore. Critical revision of the manuscript for important intellectual content: Moore, Cohen, and Furberg. Statistical analysis: Moore. Administrative, technical, and material support: Cohen. Study supervision: Cohen.
Financial Disclosure: None reported.
Additional Information: The FDA encourages health professionals and consumers to report serious adverse events and product problems using the secure online form at: https://www.accessdata.fda.gov/scripts/medwatch/medwatch-online.htm. Actual and potential medication errors may be reported to the USP-ISMP Medication Errors Reporting Program at https://www.ismp.org/orderForms/reporterrortoISMP.asp.
Thank you for submitting a comment on this article. It will be reviewed by JAMA Internal Medicine editors. You will be notified when your comment has been published. Comments should not exceed 500 words of text and 10 references.
Do not submit personal medical questions or information that could identify a specific patient, questions about a particular case, or general inquiries to an author. Only content that has not been published, posted, or submitted elsewhere should be submitted. By submitting this Comment, you and any coauthors transfer copyright to the journal if your Comment is posted.
* = Required Field
Disclosure of Any Conflicts of Interest*
Indicate all relevant conflicts of interest of each author below, including all relevant financial interests, activities, and relationships within the past 3 years including, but not limited to, employment, affiliation, grants or funding, consultancies, honoraria or payment, speakers’ bureaus, stock ownership or options, expert testimony, royalties, donation of medical equipment, or patents planned, pending, or issued. If all authors have none, check "No potential conflicts or relevant financial interests" in the box below. Please also indicate any funding received in support of this work. The information will be posted with your response.
Some tools below are only available to our subscribers or users with an online account.
Download citation file:
Web of Science® Times Cited: 149
Customize your page view by dragging & repositioning the boxes below.
Enter your username and email address. We'll send you a link to reset your password.
Enter your username and email address. We'll send instructions on how to reset your password to the email address we have on record.
Athens and Shibboleth are access management services that provide single sign-on to protected resources. They replace the multiple user names and passwords necessary to access subscription-based content with a single user name and password that can be entered once per session. It operates independently of a user's location or IP address. If your institution uses Athens or Shibboleth authentication, please contact your site administrator to receive your user name and password.