Reliability and Validity of an Objective Structured Clinical Examination for Assessing the Clinical Performance of Residents

Emil R. Petrusa, PhD; Thomas A. Blackwell, MD; Michael A. Ainsworth, MD
Arch Intern Med. 1990;150(3):573-577. doi:10.1001/archinte.1990.00390150069014.
Text Size: A A A
Published online

• Clinical performance of residents should be assessed as reliably and validly as possible. This study investigated the reliability and validity of an objective structured clinical examination (OSCE) for assessing clinical performance of internal medicine residents. Residents were required to take a 17-patient OSCE in their first and second year. Reliability of the OSCE was 0.40. Validity studies indicated second-year students were significantly better than third-year students for five of six OSCE skill scores; first-year students were significantly better for three scores. Resident's scores for diagnosis, plan, and total significantly increased on their second OSCE. Generally faculty overall ratings of residents' clinical performance did not correlate with OSCE scores. American Board of Internal Medicine certifying examination scores were consistently positively correlated only with diagnosis. This 17-case OSCE is a feasible method for obtaining moderately reliable, valid data not available from other sources about the clinical performance of residents. More cases should be added to increase its reliability.

(Arch Intern Med. 1990;150:573-577)


Sign In to Access Full Content

Don't have Access?

Register and get free email Table of Contents alerts, saved searches, PowerPoint downloads, CME quizzes, and more

Subscribe for full-text access to content from 1998 forward and a host of useful features

Activate your current subscription (AMA members and current subscribers)

Purchase Online Access to this article for 24 hours





Meets CME requirements for:
Browse CME for all U.S. States
Accreditation Information
The American Medical Association is accredited by the Accreditation Council for Continuing Medical Education to provide continuing medical education for physicians. The AMA designates this journal-based CME activity for a maximum of 1 AMA PRA Category 1 CreditTM per course. Physicians should claim only the credit commensurate with the extent of their participation in the activity. Physicians who complete the CME course and score at least 80% correct on the quiz are eligible for AMA PRA Category 1 CreditTM.
Note: You must get at least of the answers correct to pass this quiz.
You have not filled in all the answers to complete this quiz
The following questions were not answered:
Sorry, you have unsuccessfully completed this CME quiz with a score of
The following questions were not answered correctly:
Commitment to Change (optional):
Indicate what change(s) you will implement in your practice, if any, based on this CME course.
Your quiz results:
The filled radio buttons indicate your responses. The preferred responses are highlighted
For CME Course: A Proposed Model for Initial Assessment and Management of Acute Heart Failure Syndromes
Indicate what changes(s) you will implement in your practice, if any, based on this CME course.
Citing articles are presented as examples only. In non-demo SCM6 implementation, integration with CrossRef’s "Cited By" API will populate this tab (http://www.crossref.org/citedby.html).
Submit a Comment


Some tools below are only available to our subscribers or users with an online account.

Web of Science® Times Cited: 88

Sign In to Access Full Content

Related Content

Customize your page view by dragging & repositioning the boxes below.