From the Departments of Social Medicine (Dr Paltiel and Ms Gordon), Hematology (Dr Paltiel), and Information Systems (Mr Berg), Hadassah Medical Center, and School of Public Health (Drs Paltiel and Israeli and Ms Gordon), Hadassah-Hebrew University, Jerusalem, Israel.
Electrolyte abnormalities, including hypokalemia, are frequently encountered among hospitalized patients. Their management, when carefully audited, reveals major shortcomings.
To evaluate the effect of a computerized alert on the management of severe hypokalemia in hospitalized patients.
All patients who experienced severe hypokalemia (serum potassium levels <3.0 mEq/L) during their hospitalization at Hadassah Medical Center (a 1000-bed teaching institution on 2 campuses in Jerusalem, Israel) were included in the study. The study intervention was a computerized alert consisting of a flashing screen or printed warning for patients with serum potassium levels below 3.0 mEq/L, visible whenever an individual patient's or entire ward's results were accessed on any hospital computer. Using a previously validated computerized audit technique, we analyzed the management of hypokalemia 6 months before and 6 months after implementation of the alert intervention.
Comparing outcomes before and after the intervention, nonmeasurement of a subsequent serum potassium level after an initial low value decreased by 36.1% (P = .08). Failure to correct the serum potassium level to above 3.5 mEq/L during the hospitalization decreased by 28.6% (P = .02). Discharge from the hospital with a subnormal serum potassium level decreased by 17.2% (P = .06).
A computerized alert system improved the management of hypokalemia in a tertiary care hospital. This was achieved at minimal cost and with no evidence of harm. The computerized audit based on a laboratory information system is an efficient tool for evaluating this intervention.
ELECTROLYTE DISORDERS are among the most common laboratory abnormalities in hospitalized patients. Systematic scrutiny has revealed deficiencies in the management of these disorders, including intensive care units1 and general hospital wards.2- 4 In light of these deficiencies, several corrective strategies have been implemented, including telephone notification of critical values to the ward secretary, nurse, or physician; fax reminders regarding appropriate management4; and computerized reminders.5 The latter have been shown to be effective in influencing physician behavior since they were first instituted 25 years ago.6
Despite some controversy on the appropriate management of hypokalemia,7 there is a general consensus that very low levels of serum potassium (<3.0 mEq/L) are undesirable and should be corrected.8,9 It has previously been shown that a computerized laboratory database is a valid and efficient source of information reflecting the clinical management of hypokalemia.10 We hypothesized that the computer could be used as a tool for quality improvement and not merely quality assessment. In this study, we report the effect of a computerized alert on the management and correction of hypokalemia as assessed by the computerized laboratory database.
Hadassah Medical Center is a 1000-bed tertiary teaching institution located on 2 campuses in Jerusalem, Israel. In most wards, house officers (residents and fellows) were responsible for ordering tests and drawing blood. In the intensive care units, nurses drew the blood after receiving physician orders. No explicit protocols were in place for the management of hypokalemia during the study. The hospital computers were used for administrative information, laboratory results, and discharge summaries. Laboratory results were not sent to the ordering physician, but could be accessed on-screen or printed by nurses and physicians who had appropriate access passwords.
The study group included all inpatients who experienced a serum potassium level below 3.0 mEq/L during their hospitalization. We excluded hospitalizations in the short-stay unit and the hospice. If a patient experienced severe hypokalemia in more than 1 hospitalization during the study, we included only the last such admission in the study.
On April 1, 2000, a system of computerized alerts for patients with severe hypokalemia (serum potassium levels <3.0 mEq/L) was instituted. Whenever a physician accessed the computer to obtain results on a particular patient or concentrated results for an entire ward, a warning concerning patients whose serum potassium levels were below 3.0 mEq/L would flash on the screen. The alert was nondirected because in many cases the physician who ordered the blood test or drew the blood was not the same person who would later check the result. When the individual patient's result or summary of all results for the ward was printed for that day, a printed warning would appear with the words: "Attention: serum potassium <3.0 mEq/L [patient's name and identification number]." This warning would persist until a subsequent laboratory result for that patient showed a serum potassium level above 3.0 mEq/L. The warning would reappear if a subsequent drop occurred. During the study, no other change in hospital procedures was made. A policy of telephone notification from the laboratory regarding serum potassium levels (if <3.0 or >5.5 mEq/L) was not altered.
We performed a before and after comparison using the laboratory computerized database and the demographic and administrative database. For the 6 months before April 1, 2000, and 6 months after April 30, 2000 (1 month was allowed to debug the computer program), we identified all hospitalized patients who had at least 1 serum potassium level below 3.0 mEq/L. To exclude secular trends in the prevalence of hypokalemia and its management, we compared the baseline data with results of the previous study10 evaluating the computerized database that took place in 1997. Statistical analysis was performed using SPSS for Windows, version 10 (SPSS Inc, Chicago, Ill).
Patient characteristics before and after the intervention were analyzed using the χ2 test for differences in proportions and the t test for differences in means.
Three outcome variables were assessed: (1) whether a subsequent serum potassium level was measured after an initial extremely low level, (2) whether normokalemia (serum potassium level >3.5 mEq/L) was achieved during the hospitalization, and (3) whether the last recorded serum potassium level before discharge was normal. We assessed the effect of the intervention associated with these 3 outcomes using the χ2 test. A logistic regression analysis was performed to assess the effects of the intervention, controlling for other factors. Variables associated with the 3 outcomes on univariate analysis were included as covariates in the logistic models. In the original study, the severity of hypokalemia (2.5-2.9 mEq/L vs <2.5 mEq/L) and the timing of onset (hypokalemia present at admission vs occurring during the hospitalization) were associated with the appropriateness of the management of hypokalemia. We, therefore, tested whether these factors modified the effect of the intervention. First-order interactions between these baseline variables and the intervention were entered into logistic models. For all analyses, a 2-sided P = .05 was considered statistically significant.
During the study, 636 admissions were included before the intervention and 519 after the intervention. Table 1 shows the analysis of patient characteristics before and after the intervention. For comparison purposes, we have also included the characteristics of patients in the first study (1997).10 The analysis indicated that there were no systematic differences in age, sex, admission department, and initial level or timing of hypokalemia between the study intervals. Minor differences in the distribution of discharge diagnoses were noted.
Table 2 presents the outcome variables comparing hospitalizations before and after the intervention (columns 2 and 3). For all outcomes, there was improvement in the management of hypokalemia after the intervention, but the change was statistically significant only for achievement of normokalemia (correction of serum potassium levels) (P = .02).
The effect of the intervention after adjustment for baseline variables is given in the last column of Table 2. The multivariate models included age, admission department, transfer between departments during the hospitalization, hospital campus, initial level of serum potassium, and whether severe hypokalemia was present on admission or developed in the hospital. A significant effect of the intervention was observed on the correction of hypokalemia, and borderline associations were seen with remeasurement of serum potassium levels and discharge from the hospital with normokalemia (although for the 2 latter outcomes, the 95% confidence intervals are also compatible with no effect). A significant interaction was observed between the intervention and the time of onset of hypokalemia. After the intervention, there was an odds reduction of 82% in the nonmeasurement of serum potassium levels after an initial low result in patients whose level on the day of admission was below 3.0 mEq/L, as opposed to those who developed severe hypokalemia during their hospitalization (odds ratio for interaction term, 0.18; 95% confidence interval, 0.04-0.75; P<.02). There were no other significant interactions.
No significant reduction in the mean time to remeasurement of the serum potassium levels (18.4 vs 17.9 hours) or in the mean time to correction of serum potassium levels (107 vs 95 hours) was observed after the intervention. Furthermore, the mortality before (16.8%) and after (18.3%) the intervention in this hypokalemic population did not change significantly (P = .51).
A flowchart showing the outcomes of all study subjects is shown in Figure 1.
Flowchart of test ordering and results as assessed by a computerized laboratory database (analyzing patients' last admissions) before and after initiation of alerts. All percentages are percentages of the totals: before (n = 636) and after (n = 519).
This study demonstrates that modest improvements in the management of a severe electrolyte disturbance in hospitalized patients can be achieved using a simple computerized alert. The intervention was associated with an increase in the proportion of patients whose serum potassium levels were corrected during their hospitalization, as well as an improvement in the proportion of patients with severe hypokalemia who left the hospital with normal serum potassium values. Patients who presented to the hospital with severe hypokalemia were also more likely to have their serum potassium levels remeasured after the intervention.
Using a computerized audit method that had been previously validated and shown to reflect the actual clinical management of hypokalemia,10 we demonstrated a quantifiable improvement in the physicians' response to this serious electrolyte disorder. Thus, an audit and reaudit cycle was completed. Although we did not use a randomized design (because of logistical concerns), the before and after comparison showed a trend to improvement in all outcome measures assessed. The baseline characteristics and outcomes in the preintervention periods were virtually identical to those in the previous study, suggesting that the improvement was not due to a secular trend or change in case mix.
Our study had some limitations. Because data collection after the intervention was for 6 months only, it is possible that our study had insufficient power to detect a significant effect of the intervention on remeasurement of serum potassium levels and hospital discharge with normokalemia. However, if we combine the results of the baseline analysis in 1997 and data from the 6 months before the intervention (columns 1 and 2 of Table 2), a statistically significant improvement after the intervention in the rate of discharge with subnormal serum potassium values was achieved (P = .03).
The intervention produced a modest effect, possibly because it was nondirected. Furthermore, because the alert drew attention to extreme levels of hypokalemia (<3.0 mEq/L) and a positive assessment of response was correction of hypokalemia, our analysis was, by definition, insensitive to improvements in the serum potassium levels that did not cross the threshold of 3.5 mEq/L.
The use of computerized alerts has been shown to increase the proportion of patients with electrolyte abnormalities receiving appropriate care, decrease the time spent in a life-threatening situation, and reduce the length of hospitalization.5 Computerized alerts regarding rising serum creatinine levels among patients receiving nephrotoxic drugs resulted in a significant decrease in the risk of renal impairment.11 Furthermore, computerized alerts have been used to prevent adverse drug events12 and to improve appropriate drug prescription.13 In some systems, computerized alerts are transmitted directly to the physician,11 and in others, another evaluator (eg, a pharmacist) receives the alert and notifies the physician.12,14 The alert in our study was widely accessible, appearing on all hospital computer terminals when the individual patient's or entire ward's laboratory results were sought.
We had no immediate feedback mechanism to inform us whether the alerts had been seen or noted by the staff, nor do we have information on which staff members saw the alert. Bradshaw and colleagues15 have shown that the effectiveness of computerized alerts can be improved by adding a flashing light to terminals. Some systems include an interactive option whereby the treating physician acknowledges that he or she has seen the alert and taken care of the problem.11
Not all authors agree that computerized display of laboratory results improves medical practice. Kilpatrick and Holding,16 in a retrospective audit of providing emergency laboratory test results via computer screen, found that in 83% of cases of hypokalemia (<3.0 mEq/L) or hyperkalemia (>6.0 mEq/L) the results were not seen by the physician before a final report was printed. Their conclusion was that the appearance of these results on the computer terminal without a concomitant telephone call could actually delay the transfer of information. Our intervention took place without changing the laboratory policy of telephoning extreme values to the ward and was therefore an addition to the protocol already in place. We did not verify whether these telephone calls were actually made.
It would seem fair to infer that this simple and inexpensive computerized intervention did not harm patients and probably improved the response of physicians to severe hypokalemia. No effect of the intervention on mortality rates was observed, and in light of growing concern about the potential dangers of treatment with intravenous potassium chloride,17 this is an important observation. McDonald6 noted in 1976 that many errors in medicine may be caused by clinician sensory overload or faults in information processing. Computerized reminders can assist the busy physician or nurse to notice abnormalities that may otherwise blend into the "noise" caused by multiple data items with which the clinician must cope. There is a danger that computerized reminders could add to this overload, and the fact that we introduced only one alert may have minimized this danger. Creative measures will need to be applied to sustain the effect of computerized alerts if they are used to draw attention to multiple conditions. Although we did not perform a systematic survey of physician satisfaction with the alert system, we heard comments such as "That flashing computer screen makes you pay attention." In a survey of US medical residents, 88% responded favorably to computerized alerts on hypokalemia,18 although in another study,11 28% expressed annoyance with alerts.
We conclude that the simple addition of a flashing computer terminal screen alerting the treating team to an extremely low serum potassium value can improve the management of hypokalemia in hospitalized patients. The intervention can be applied at a minimal one-time cost and effort (the programmer's time) and can easily be incorporated into a hospital's quality assurance program. The efficacy of computerized alerts can be assessed using data obtained from computerized laboratory databases. The usefulness of similar alerts should be investigated in other electrolyte abnormalities and in other settings.
Corresponding author: Ora Paltiel, MDCM, MSc, Department of Social Medicine, Hadassah Medical Center, Hadassah-Hebrew University, PO Box 12000, Jerusalem 91120, Israel (e-mail: email@example.com).
Accepted for publication May 7, 2002.
Thank you for submitting a comment on this article. It will be reviewed by JAMA Internal Medicine editors. You will be notified when your comment has been published. Comments should not exceed 500 words of text and 10 references.
Do not submit personal medical questions or information that could identify a specific patient, questions about a particular case, or general inquiries to an author. Only content that has not been published, posted, or submitted elsewhere should be submitted. By submitting this Comment, you and any coauthors transfer copyright to the journal if your Comment is posted.
* = Required Field
Disclosure of Any Conflicts of Interest*
Indicate all relevant conflicts of interest of each author below, including all relevant financial interests, activities, and relationships within the past 3 years including, but not limited to, employment, affiliation, grants or funding, consultancies, honoraria or payment, speakers’ bureaus, stock ownership or options, expert testimony, royalties, donation of medical equipment, or patents planned, pending, or issued. If all authors have none, check "No potential conflicts or relevant financial interests" in the box below. Please also indicate any funding received in support of this work. The information will be posted with your response.
Register and get free email Table of Contents alerts, saved searches, PowerPoint downloads, CME quizzes, and more
Subscribe for full-text access to content from 1998 forward and a host of useful features
Activate your current subscription (AMA members and current subscribers)
Purchase Online Access to this article for 24 hours
Some tools below are only available to our subscribers or users with an online account.
Download citation file:
Web of Science® Times Cited: 9
Customize your page view by dragging & repositioning the boxes below.
and access these and other features:
Enter your username and email address. We'll send you a link to reset your password.
Enter your username and email address. We'll send instructions on how to reset your password to the email address we have on record.
Athens and Shibboleth are access management services that provide single sign-on to protected resources. They replace the multiple user names and passwords necessary to access subscription-based content with a single user name and password that can be entered once per session. It operates independently of a user's location or IP address. If your institution uses Athens or Shibboleth authentication, please contact your site administrator to receive your user name and password.