Author Affiliations: Department of Medicine (Dr Grande) and Leonard Davis Institute of Health Economics (Drs Grande and Frosch), University of Pennsylvania, Philadelphia; Department of Medicine, University of California, Los Angeles (Dr Frosch); Jesse H. Jones Graduate School of Management, Rice University (Dr Perkins); School of Business Administration, University of Miami (Dr Kahn).
Policy discussions concerning pharmaceutical promotion often assume that small promotional items are unlikely to influence prescribing behavior. Our experiment measures whether exposure to these items results in more favorable attitudes toward marketed products and whether policies that restrict pharmaceutical marketing mitigate this effect.
This is a randomized controlled experiment of 352 third- and fourth-year medical students at two US medical schools with differing policies toward pharmaceutical marketing. Participants assigned to treatment were exposed to small branded promotional items for Lipitor (atorvastatin) without knowledge that the exposure was part of the study. We measured differences in implicit (ie, unconscious) attitudes toward Lipitor and Zocor (simvastatin) in exposed and control groups with the Implicit Association Test (IAT). Self-reported attitudes were also measured, and a follow-up survey was administered measuring attitudes toward marketing.
Fourth-year students at the University of Miami Miller School of Medicine exposed to Lipitor promotional items had more favorable implicit attitudes about that brand-name drug compared to the control group (IAT effect: 0.66 vs 0.47; P = .05), while the effect was reversed at the University of Pennsylvania School of Medicine (IAT effect: 0.22 vs 0.52; P = .002) where restrictive policies are in place limiting pharmaceutical marketing (interaction effect: P = .003). No significant effect was observed among third-year students. On a “skepticism” scale, University of Miami students held more favorable attitudes toward pharmaceutical marketing compared to University of Pennsylvania students (0.55 vs 0.42; P < .001) but the results were similar to those of a previously published national study (0.42 vs 0.43; P = .53).
Subtle exposure to small pharmaceutical promotional items influences implicit attitudes toward marketed products among medical students. We observed a reversal of this effect in the setting of restrictive policies and more negative school-level attitudes toward marketing.
Discussions about the influence of pharmaceutical promotion on physicians often focus on gifts and payments of relatively large economic value. This focus is also evident in ethics guidelines addressing pharmaceutical promotion among many professional medical societies.1 The underlying assumption is that smaller gifts are unlikely to exert influence on prescribing decisions.
In contrast, a substantial body of marketing and psychology literature suggests that even trivial items can exert influence irrespective of economic value. For example, adding a small gift such as personalized mailing labels to a solicitation for donations has been shown to significantly increase contributions.2 In pharmaceutical promotion, small gifts are often tethered to branding efforts, as items such as pens and coffee mugs display logos. Aside from the intrinsic value of promotional items, branded materials strengthen brand awareness and build brand equity through a variety of largely unconscious but powerful mechanisms.3 Nonverbal information about the brand, such as symbols or logos, is often more influential than verbal cues.4 Stronger brands have a memory encoding and storage advantage over unknown brands,5 which facilitates the formation of strong positive associations with the brand. Strong branded products are more often in a “top-of-mind” set of alternatives for consumers to consider.6 Strong brand awareness provides a justifiable reason for choosing a particular brand.7,8 This research suggests that small branded promotional items should increase favorable attitudes for the brand being promoted. We are unaware of studies that test these effects in a clinical context with health professionals, but many physicians, because they are medical experts, believe they are not susceptible to these influences.5,9,10 In one survey, just 8% of physicians believed they were susceptible to influence by marketing items such as branded pens, whereas 31% of patients felt these items could influence physicians.9 The guidelines of the American Medical Association regarding gifts to physicians from industry reflect this belief of lack of susceptibility by permitting “gifts of minimal value.”1
We used the Implicit Association Test (IAT)11 to measure the effect of simple exposure to small, branded promotional items in the environment on treatment preferences of medical students. The IAT, described in greater detail below, is an experimental approach designed to uncover otherwise unconscious or hidden attitudes. We studied medical students from 2 schools with differing policies toward pharmaceutical marketing (more restrictive vs less restrictive) to test possible effect modification. We hypothesized that medical students exposed to branded promotional items would have more favorable attitudes toward the branded product through the priming of positive associations. However, we hypothesized that the presence of a university policy restricting pharmaceutical marketing would mitigate the positive associations with the branded product due to the increased awareness of persuasive marketing tactics that such a policy may evoke.
The study used a randomized experimental design. Participants were third- and fourth-year medical students at the University of Pennsylvania School of Medicine (Penn) and the University of Miami Miller School of Medicine (Miami). We selected these institutions because of their differing policies regarding interactions between trainees and pharmaceutical company representatives. The University of Pennsylvania has restrictive policies in place that prohibit most gifts, meals, and samples while Miami continues to permit such marketing practices.
Subjects were recruited by e-mail and flyers and were paid $25 per person to participate in the study. Enrollment took place between August 24, 2007, and April 4, 2008. The study was approved by the Institutional Review Boards at the University of Pennsylvania and the University of Miami.
Study participants were assigned to a control or primed condition based on their day of enrollment. Participants assigned to the “primed” condition were exposed to Lipitor (atorvastatin) branded promotional items immediately prior to completing a computer-based study instrument. These exposures included Lipitor logos on a clipboard (used when signing in to the study room) and notepaper (used to provide participants with their study identification number). Participants assigned to the control condition completed the same procedures but with a plain (nonbranded) clipboard and notepaper. Randomization was conducted by day in order to avoid contamination of conditions.
We did not reveal the specific focus of the study to the participants until the entire study was complete. Participants were told they were enrolling in a study about clinical decision making under varying conditions. Participants were asked not to discuss the experiment with others until they were notified that the study was complete. At that time, participants were debriefed by e-mail with an explanation of the specific aims of the experiment.
Our study was designed to measure the influence of exposure to branded promotional items on relative attitudes toward 2 lipid-lowering statins. We examined differences in attitudes toward Lipitor and Zocor (simvastatin) in our exposed (Lipitor promotional items) and control groups. Lipitor is among the most promoted brand-name statins in the United States while simvastatin is available generically and considered to be nearly equally effective. The study outcomes included measures of implicit and self-reported (ie, explicit) attitudes.
Implicit attitudes were evaluated with the Implicit Association Test,11- 15 a widely used tool in marketing and psychology research that is thought to be resistant to social desirability bias among research participants. Initial applications of the IAT, for example, demonstrated the persistence of racial and gender stereotypes and prejudices, even in the face of strong conscious beliefs that such attitudes do not exist and strong social norms that dictate they should not exist.16,17 Results from the IAT are a better predictor of intergroup discrimination (eg, biased behavior against people of other races/ethnicities, gender, and sexual orientation based on existing attitudes and stereotypes) compared with ostensibly similar self-report measures.13 In recent years, the use of the IAT has been expanded to research focused on branding and marketing.18,19 Further details regarding application and validity of the IAT have been published elsewhere13- 15; a demonstration can be found at the Project Implicit Web site (https://implicit.harvard.edu/implicit).
Conceptually, the IAT pairs targets (eg, Lipitor and Zocor) with attributes (eg, pleasant or unpleasant) and requires subjects to sort corresponding images and words. Differences in reaction times when pairing targets and attributes are a clue to implicit attitudes. For example, greater speed when Lipitor and pleasant are paired or when Zocor and unpleasant are paired reflects a more favorable attitude toward Lipitor than Zocor. The IAT in this study comprised 5 related categorization tasks performed on a computer. In tasks 1 and 2, study participants learn the appropriate behavioral response (usually a key press) for each of 4 categories: 2 categories that represent the target objects (Lipitor and Zocor) and two categories that represent the attributes (pleasant and unpleasant). In these initial tasks, words or images representing the target objects and attributes were presented, and participants were prompted to quickly and accurately assign each word or image to the appropriate category using assigned computer keys. Following those tasks, the participants completed an initial combined task in which 1 attribute and 1 target object category (eg, pleasant and Lipitor) are assigned to 1 response button, while the other attribute and target object categories (eg, unpleasant and Zocor) are assigned to the other. Study participants were again instructed to quickly and accurately assign the items to the appropriate response key. Following a fourth categorization that reverses the key assignments for the target categories, study participants then complete a final reversed combined task requiring the categorization of pleasant and Zocor on the same key, and unpleasant and Lipitor on the other key. During each task, response times were recorded.
Explicit attitudes were assessed by self-report. Following the IAT, participants were asked to compare Lipitor and Zocor in 5 dimensions (superiority, preference, efficacy, safety, and convenience) using an 11-point scale (Lipitor Strongly Preferred = +5, Zocor Strongly Preferred = −5).
Study participants were contacted by e-mail after completion of the first phase of the study with a follow-up anonymous Internet-based survey that assessed their attitudes toward pharmaceutical marketing. The purpose was to measure differences in attitudes among students at the 2 schools given the differing institutional policies as a possible explanatory factor. Participants completed a 9-item previously published instrument with a 4-point scale that assessed their level of agreement with statements measuring their acceptance of and skepticism regarding pharmaceutical marketing.20
The primary outcome measure, the mean IAT effect, was calculated by dividing differences in average response times when the 2 drugs are paired with different attributes by the pooled standard deviation as described in previously published research.21 Comparisons of the IAT effect across exposed and control groups were performed using independent-sample t tests. Results were stratified by school and class year to account for institutional and training-year effects. Analysis of variance (ANOVA) was used to calculate the interaction effect for school, class year, and experimental exposure. Explicit attitude measures that compared Lipitor and Zocor were combined into a Lipitor preference scale with a range of −5 to +5, with positive values reflecting a Lipitor preference. Nonparametric tests (Mann-Whitney tests) were used to compare means from the Lipitor preference scale across groups. Chi-squared statistics were used to compare proportions of subjects in agreement with attitude statements in our follow-up pharmaceutical marketing survey. We collapsed the 9 items from the survey into a 6-item scale (range, 0-1) as a measure of skepticism toward pharmaceutical marketing. The items (1, 5-9) were selected based on the previously published 8-school survey to allow for a direct comparison with our results.20 All P values computed were 2-sided. All analyses were performed using the Stata software program, version 9.2 (StataCorp LP; College Station, Texas).
A total of 352 third- (n = 191) and fourth-year (n = 161) medical students participated in our study. The demographic characteristics of the participants are summarized in Table 1. At Miami, 198 students were enrolled from a potential pool of 324 third- and fourth-year students. At Penn, 154 students were enrolled from a potential pool of 410 third- and fourth-year students. The average age of participants was 25.7, with similar numbers of men and women. There were no significant differences in demographic characteristics by experimental group except for training year. Fourth-year students were represented in greater numbers in the control group, as were third-year students in the exposed group.
The results from the IAT are presented in Table 2 stratified by school and class year. Overall, students in both class years at both schools demonstrated implicit attitudes favoring Lipitor over Zocor as reflected by the positive values even among control students. However, there were significant differences between the exposed and control groups among fourth-year medical students at Penn and Miami. At Miami, fourth-year students exposed to Lipitor promotional items demonstrated stronger preferences toward Lipitor compared to the control group (P = .05), a finding that supports our first hypothesis. In contrast, Penn fourth-year students exposed to Lipitor-branded items exhibited the opposite response, demonstrating weaker preferences toward Lipitor compared to the control group (P = .002). There were no significant experimental effects noted among third-year medical students at either Penn or Miami (P = .87 and P = .44, respectively). This interaction effect of our marketing exposure with school and class year is depicted in the Figure (P = .003).
Lipitor preference among third- and fourth-year medical students in exposed and control groups, as measured by the Implicit Association Test (IAT). Higher IAT values reflect a stronger Lipitor preference relative to Zocor. The interaction effect for experimental group with school and class year is significant (P = .003). Penn indicates students at the University of Pennsylvania School of Medicine; Miami, students at the University of Miami, Miller School of Medicine
The explicit attitude Lipitor preference scale that compares Lipitor with Zocor had high internal reliability (Cronbach α = 0.80). Subjects demonstrated a preference toward Lipitor compared to Zocor independent of our intervention (Table 3). We did not observe a significant experimental effect across the 2 groups overall or within school–class-year strata. These results suggest that, when students self-report their explicit preferences, they have a slight preference for Lipitor but reveal no effects from a brief exposure to branded promotional items.
Of the 352 study participants, 187 (53.1%) completed the follow-up anonymous survey assessing attitudes toward pharmaceutical marketing (Table 4). Previously published results from a 2005 survey20 involving third-year medical students from 8 schools are included for comparison. Neither Penn nor Miami students were included in this previous survey. Overall, Penn students had less favorable attitudes toward pharmaceutical marketing compared to Miami students. For example, 63.3% of students at Penn agreed that gifts and food from pharmaceutical sales representatives would influence their eventual prescribing in contrast to just 29.4% at Miami (P < .001). Two-thirds (66.7%) of students at Penn agreed that the school should exclude sales representatives from meeting with students in comparison to just 17.5% at Miami (P < .001). Notably, attitudes of Miami students were similar to those from the 2005 survey involving 8 schools.
The pharmaceutical marketing skepticism scale had high internal reliability (Cronbach α= 0.72). University Penn students held more skeptical views toward pharmaceutical marketing compared to Miami students (0.55 vs 0.42, P < .001). Miami students held similar views as students in the previously published survey involving 8 schools (0.42 vs 0.43, P = .53), while Penn students were more skeptical toward marketing (0.55 vs 0.43, P < .001).
Our study finds that subtle exposures to branded pharmaceutical promotional items influences implicit attitudes of medical students toward pharmaceutical brands. The observed effect was modified by training year and school. Among third-year medical students, no significant experimental effects were observed. However, among fourth-year medical students there were significant effects at both schools in our study. Students at Miami responded as we hypothesized, shifting their preferences in the direction of the branding exposure (ie, Lipitor). However, students at Penn had a boomerang response, ie, a behavioral response opposite of the implied marketing intent.22 The most likely explanation for the difference across class year is that, as students advance in their training, they begin to form attitudes toward various treatment options that can be primed with branded promotional items. In comparison to third-year students, fourth-year students have had greater clinical experience and greater exposure to their clinical teachers and prevailing institutional practices.
The divergent effects at our 2 study schools are an interesting finding. At Penn, exposure to the branded items produced less favorable implicit attitudes. One potential explanation for this effect is that the strong school policy provided an external warning about specific persuasion tactics underlying pharmaceutical marketing. This information may have motivated some form of resistance by the audience23 that could have taken the form of simple message rejection or active counterarguing or careful message scrutiny.24 The policy therefore may have heightened the ability of the Penn students to exercise what has been termed “persuasion coping effectiveness”,25 which produces a goal within oneself to achieve one's own current learning or attitudinal goal independently of what the marketer seems to be trying to accomplish. The differential attitudes observed in the marketing survey, with the Penn students exhibiting significantly more negative attitudes than those in the national sample or for the Miami students where no policy exists, support this explanation. At Miami, where students had more positive attitudes toward marketing, exposure to a branded promotional item likely primed more positive implicit associations.
While the presence or absence of a school policy is a reasonable explanation for our findings, we cannot prove causality nor can we exclude other school-level characteristics as alternative explanations. Nonetheless, it is notable that the attitudes of Miami students regarding pharmaceutical marketing are remarkably similar to those outlined in the 8-school survey20 published in 2005, while the Penn students hold considerably less favorable attitudes in the context of restrictive policies toward pharmaceutical marketing.
The lack of significant findings in our explicit attitude measures raises several interesting conclusions and questions. First, self-reported attitudes are vulnerable to social desirability bias. If the hypothesized effect of a marketing exposure were positive toward a brand, then we would expect social desirability to operate in the opposite direction as the experimental effect. This may account for our null findings among fourth-year students at Miami on explicit attitude measures in contrast to our IAT findings. Second, the IAT is likely to be a much more sensitive measure than explicit attitude measures. Studies that simply rely on self-reported attitudes may miss important effects. Novel methods that provide indirect measures of attitudes are an important addition to the methods used to study the effects of marketing.
There are some limitations to our experiment. Most importantly, our findings are focused on attitudes as opposed to behaviors. However, effects on attitudes are notable given that our exposure was brief and subtle, and attitudes are known to be a significant predictor of behaviors.26 The simulation in the experimental setting of repeated exposure to promotional items that occurs in clinical practice would be challenging. However, implicit attitudes have been shown to more directly translate into behaviors under conditions of high cognitive load such as time pressure, a situation common in clinical practice.27 Another limitation is that the training year differences we observed may reflect a cohort effect. Our randomization procedures also did not produce balanced groups with respect to training year. This is likely due to the fact it was necessary to randomize by day to avoid contamination of experimental groups and that class training schedules may have facilitated participation on certain days. However, we addressed this imbalance by stratifying our analysis by class year. Another possible limitation to our study is that study subjects could have been aware of the study hypothesis despite the fact that we did not directly reveal it. Only our self-reported explicit attitude measures would be vulnerable in this circumstance. One of the advantages of the IAT is its resistance to such demand characteristics, which lends strength to our findings. Finally, we are unable to draw specific conclusions regarding practicing physicians. Our study was focused on medical students in their third and fourth years of training, and the generalizability of our findings to practicing physicians is unknown. These limitations are balanced by significant strengths, including the randomized experimental design and novel outcome measures that are less susceptible to bias.
In conclusion, our study is the first of which we are aware to experimentally measure the effect of exposure to small branded pharmaceutical promotional items on brand preferences among medical students. Our results provide evidence that subtle branding exposures are important and influential, as the psychology and marketing literature would suggest. Our findings are particularly notable because they are attributable to simple exposure to promotional items independent of other effects attributable to the social relationships associated with gifts. Our study also suggests that institutional policies, by way of their influence on student attitudes toward marketing, could lead to different responses to branded promotional items.
Correspondence: David Grande, MD, MPA, 3641 Locust Walk, Room 407, Philadelphia, PA 19104-6218 (firstname.lastname@example.org).
Accepted for Publication: January 2, 2009.
Author Contributions: Dr Grande had full access to all the data in the study and takes responsibility for the integrity of the data and the accuracy of the data analysis. Study concept and design: Grande, Kahn, Frosch, and Perkins. Acquisition of data: Grande, Kahn, and Perkins. Analysis and interpretation of data: Grande, Kahn, Frosch, and Perkins. Drafting of the manuscript: Grande and Perkins. Critical revision of the manuscript for important intellectual content: Grande, Kahn, Frosch, and Perkins. Statistical analysis: Grande, Frosch, Kahn, and Perkins. Obtained funding: Kahn. Administrative, technical, and material support: Grande, Kahn, and Frosch. Study supervision: Grande and Kahn.
Financial Disclosure: Dr Grande was compensated as an expert witness on behalf of the State of Vermont Attorney General's Office in a case concerning regulation of pharmaceutical marketing activities. From January 1, 2006, to June 30, 2007, Dr Frosch served as the project director for a clinical trial of medications to treat methamphetamine dependence sponsored by Hythiam Inc. Dr Kahn was compensated as an instructor in courses sponsored by Johnson & Johnson, Wyeth Pharmaceuticals, Medtronic, GlaxoSmithKline, Sanofi-aventis, Janssen, Astra Zeneca, UnitedHealth Group, and Cooper University Hospital.
Funding/Support: Dr Grande was supported by the Robert Wood Johnson Foundation Health & Society Scholars program at the time of this research. Dr Frosch is sup ported by a Robert Wood Johnson Foundation Investigator Award in Health Policy Research.
Role of the Sponsors: The funding organizations had no role in the design and conduct of the study; collection, management, analysis, and interpretation of the data; or preparation, review, or approval of the manuscript.
Additional Contributions: Dr Kahn thanks the Leonard Davis Institute of Health Economics and the Behavior Laboratory at the Wharton School at the University of Pennsylvania for support of this research. We thank Mark O’Connell, MD, Tess Stebbins, BS, and Alberto Lam, BS, from the University of Miami Miller School of Medicine and Judy Shea, PhD, and Helene Weinberg, MBA, from the University of Pennsylvania School of Medicine for their assistance and David Asch, MD, MBA, and Katrina Armstrong, MD, MSCE, for reviewing an earlier draft of this manuscript.
Thank you for submitting a comment on this article. It will be reviewed by JAMA Internal Medicine editors. You will be notified when your comment has been published. Comments should not exceed 500 words of text and 10 references.
Do not submit personal medical questions or information that could identify a specific patient, questions about a particular case, or general inquiries to an author. Only content that has not been published, posted, or submitted elsewhere should be submitted. By submitting this Comment, you and any coauthors transfer copyright to the journal if your Comment is posted.
* = Required Field
Disclosure of Any Conflicts of Interest*
Indicate all relevant conflicts of interest of each author below, including all relevant financial interests, activities, and relationships within the past 3 years including, but not limited to, employment, affiliation, grants or funding, consultancies, honoraria or payment, speakers’ bureaus, stock ownership or options, expert testimony, royalties, donation of medical equipment, or patents planned, pending, or issued. If all authors have none, check "No potential conflicts or relevant financial interests" in the box below. Please also indicate any funding received in support of this work. The information will be posted with your response.
Some tools below are only available to our subscribers or users with an online account.
Download citation file:
Web of Science® Times Cited: 33
Customize your page view by dragging & repositioning the boxes below.
Users' Guides to the Medical Literature
How Can I Apply the Results to Patient Care?
Users' Guides to the Medical Literature
Does the Study Help Me Understand Social Phenomena in My Practice?
All results at
Enter your username and email address. We'll send you a link to reset your password.
Enter your username and email address. We'll send instructions on how to reset your password to the email address we have on record.
Athens and Shibboleth are access management services that provide single sign-on to protected resources. They replace the multiple user names and passwords necessary to access subscription-based content with a single user name and password that can be entered once per session. It operates independently of a user's location or IP address. If your institution uses Athens or Shibboleth authentication, please contact your site administrator to receive your user name and password.