We're unable to sign you in at this time. Please try again in a few minutes.
We were able to sign you in, but your subscription(s) could not be found. Please try again in a few minutes.
There may be a problem with your account. Please contact the AMA Service Center to resolve this issue.
Contact the AMA Service Center:
Telephone: 1 (800) 262-2350 or 1 (312) 670-7827  *   Email: subscriptions@jamanetwork.com
Error Message ......
Special Article |

Rigorous New Approach to Constructing a Gold Standard for Validating New Diagnostic Criteria, as Exemplified by the Eosinophilia-Myalgia Syndrome

Phillip A. Hertzman, MD; Daniel J. Clauw, MD; Joseph Duffy, MD; Thomas A. Medsger, Jr, MD; Alvan R. Feinstein, MD
Arch Intern Med. 2001;161(19):2301-2306. doi:10.1001/archinte.161.19.2301.
Text Size: A A A
Published online

Background  Constructing diagnostic criteria, a common problem in clinical medicine, is particularly difficult for diseases that lack a pathognomonic "gold standard." To develop an improved strategy for constructing such criteria, we used the eosinophilia-myalgia syndrome as an example. The goal, for research classifications, was to construct validated clinically sensible criteria and to develop improved methods that can be used for other disorders.

Methods  Using a "pattern-based" approach with data from several separate sources, a committee of investigators first prepared and informally tested criteria for the diagnosis of eosinophilia-myalgia syndrome. A gold standard challenge set of reports of cases and noncases was independently generated and separately validated by an external panel of clinical experts. The criteria were then tested using the gold standard set, and interobserver variability and diagnostic accuracy were determined.

Results  Interobserver variability showed the following mean proportionate agreements: 98.7% for the presence of specific criteria elements, 99% to 100% for diagnosis, and 97% to 98% for diagnostic pattern. κ Values were correspondingly high. Diagnostic accuracy showed sensitivity at 88%, specificity at 97%, and overall accuracy at 92%.

Conclusions  The proposed criteria are accurate and reproducible, and can be used in future clinical investigations of the eosinophilia-myalgia syndrome. The new strategy and methods developed for this challenge can be valuable for solving analogous problems in constructing criteria for other clinical disorders.

Figures in this Article

Sign in

Purchase Options

• Buy this article
• Subscribe to the journal
• Rent this article ?


Place holder to copy figure label and caption

The stages of construction for the criteria.

Graphic Jump Location




Also Meets CME requirements for:
Browse CME for all U.S. States
Accreditation Information
The American Medical Association is accredited by the Accreditation Council for Continuing Medical Education to provide continuing medical education for physicians. The AMA designates this journal-based CME activity for a maximum of 1 AMA PRA Category 1 CreditTM per course. Physicians should claim only the credit commensurate with the extent of their participation in the activity. Physicians who complete the CME course and score at least 80% correct on the quiz are eligible for AMA PRA Category 1 CreditTM.
Note: You must get at least of the answers correct to pass this quiz.
Please click the checkbox indicating that you have read the full article in order to submit your answers.
Your answers have been saved for later.
You have not filled in all the answers to complete this quiz
The following questions were not answered:
Sorry, you have unsuccessfully completed this CME quiz with a score of
The following questions were not answered correctly:
Commitment to Change (optional):
Indicate what change(s) you will implement in your practice, if any, based on this CME course.
Your quiz results:
The filled radio buttons indicate your responses. The preferred responses are highlighted
For CME Course: A Proposed Model for Initial Assessment and Management of Acute Heart Failure Syndromes
Indicate what changes(s) you will implement in your practice, if any, based on this CME course.


Some tools below are only available to our subscribers or users with an online account.

4 Citations

Sign in

Purchase Options

• Buy this article
• Subscribe to the journal
• Rent this article ?

Related Content

Customize your page view by dragging & repositioning the boxes below.

Articles Related By Topic
Related Collections
PubMed Articles