IN THE SETTING of increasing concern about drug safety and a burgeoning literature on the subject, the objective of this article is to provide readers with a practical guide to critically appraising reviews and meta-analyses of source studies of drug-related adverse events. A critique of a recent highly publicized meta-analysis of adverse drug reactions is used as a case study here to highlight several contentious issues. The published literature on drug-related adverse events is fraught with problems, starting with the original reports and extending to systematic reviews and meta-analyses thereof. A fundamental and universal taxonomy does not exist. For original reports, prospective protocols are missing; event ascertainment is poorly described and executed; and analytic methods are questionable and lead to problems of imprecise estimates, multiple correlations, and generalizability of results. It is recommended that for reviews and syntheses of original reports, explicit search methods and study selection criteria are needed. Special attention must be paid to choice of analytic methods; to approaches to inconsistent reporting formats and heterogeneity and bias in the selected studies; and to problems of imprecise estimates, multiple correlations, and interpretation and generalizablility of results. In conclusion, systematic reviews and meta-analyses of reports of drug-related adverse events must be considered, with special attention to source materials and methods. It is well worth the effort to do so, since, on balance, systematic review and meta-analytic techniques hold great promise for pharmacovigilance efforts.
Register and get free email Table of Contents alerts, saved searches, PowerPoint downloads, CME quizzes, and more
Subscribe for full-text access to content from 1998 forward and a host of useful features
Activate your current subscription (AMA members and current subscribers)
Purchase Online Access to this article for 24 hours
MEDLINE citation counts.
Thank you for submitting a comment on this article. It will be reviewed by JAMA Internal Medicine editors. You will be notified when your comment has been published. Comments should not exceed 500 words of text and 10 references.
Do not submit personal medical questions or information that could identify a specific patient, questions about a particular case, or general inquiries to an author. Only content that has not been published, posted, or submitted elsewhere should be submitted. By submitting this Comment, you and any coauthors transfer copyright to the journal if your Comment is posted.
* = Required Field
Disclosure of Any Conflicts of Interest*
Indicate all relevant conflicts of interest of each author below, including all relevant financial interests, activities, and relationships within the past 3 years including, but not limited to, employment, affiliation, grants or funding, consultancies, honoraria or payment, speakers’ bureaus, stock ownership or options, expert testimony, royalties, donation of medical equipment, or patents planned, pending, or issued. If all authors have none, check "No potential conflicts or relevant financial interests" in the box below. Please also indicate any funding received in support of this work. The information will be posted with your response.
Some tools below are only available to our subscribers or users with an online account.
Download citation file:
Web of Science® Times Cited: 24
Customize your page view by dragging & repositioning the boxes below.
More Listings atJAMACareerCenter.com >
and access these and other features:
Enter your username and email address. We'll send you a link to reset your password.
Enter your username and email address. We'll send instructions on how to reset your password to the email address we have on record.
Athens and Shibboleth are access management services that provide single sign-on to protected resources. They replace the multiple user names and passwords necessary to access subscription-based content with a single user name and password that can be entered once per session. It operates independently of a user's location or IP address. If your institution uses Athens or Shibboleth authentication, please contact your site administrator to receive your user name and password.