Abstract
Purpose: To assess the impact of a clinical decision support (CDS) system’s recommendations on prescribing patterns targeting cardiovascular disease (CVD) when the recommendations are prioritized in order from greatest to least benefit toward overall CVD risk reduction.
Methods: Secondary analysis of trial data from September 20, 2018, to March 15, 2020, where 70 community health center clinics were cluster-randomized to the CDS intervention (42 clinics; 8 organizations) or control group (28 clinics; 7 organizations). Included patients were medication-naïve and aged 40 to 75 years with ≥1 uncontrolled cardiovascular disease risk factor, with known diabetes or cardiovascular disease, or ≥10% 10-year reversible CVD risk.
Results: Among eligible encounters with 29,771 patients, the probability of prescribing a medication targeting hypertension was greater at intervention clinic encounters when CDS was used (34.9% [95% CI, 31.5 to 38.3]) versus dismissed (29.6% [95% CI, 26.7 to 32.6]; P < .001), but not when compared with control clinic encounters (34.9% [95% CI, 31.1 to 38.7]; P = .998). Prescribing for dyslipidemia was significantly higher at intervention encounters where the CDS system was used (11.3% [95% CI, 9.3 to 13.3]) compared with dismissed (7.7% [95% CI, 6.1 to 9.3]; P = .003) and to control encounters (8.7% [95% CI, 7.0 to 10.4]; P = .044); smoking cessation medication showed a similar pattern. Except for dyslipidemia, prescribing rates increased according to their prioritization.
Conclusions: Use of this CDS system was associated with significantly higher prescribing targeting most cardiovascular risk factors. These results highlight how displaying prioritized actions to reduce reversible CVD risk could improve risk management.
Introduction
Evidence-based management of cardiovascular disease (CVD) risk factors leads to decreased occurrence of strokes, myocardial infarction, and cardiovascular mortality.1,2 Unfortunately, national rates of blood pressure (BP) control have declined since 2013,3 and inadequate control of other modifiable CVD risk factors (eg, cholesterol level, tobacco usage, and glucose level in diabetes) adds burden to health care systems’ capacity and costs.4⇓⇓⇓–8
One cause of this vexing problem is that time limitations at primary care encounters make it challenging for providers to prioritize CVD risk management approaches.9⇓–11 Data-driven, electronic health record (EHR)-based clinical decision support (CDS) systems have been developed to identify patients with uncontrolled CVD risk factors. These systems can also provide evidence-based treatment recommendations tailored to a patient’s current treatment regimen, comorbid conditions, medication allergies, and other factors.12⇓⇓⇓–16 Given the breadth of clinical domains managed in primary care, and the likelihood that a patient with elevated CVD risk will divide provider attention among multiple uncontrolled risk factors,17,18 CDS systems should be optimized by prioritizing treatment suggestions based on their relative potential benefit to a given patient, based on American College of Cardiology/American Heart Association (ACC/AHA) and other evidence-based CVD risk prediction equations.19 Communicating prioritized treatment options to both the clinician and patient can enable evidence-based shared decision making (SDM) and save time for clinic staff.20 However, few studies have evaluated the impact of providing prioritized treatment recommendations on actions taken during and after clinical encounters.21
CV Wizard is a web-based EHR-linked CDS system designed for use at primary care encounters. It has been well-described elsewhere,22⇓⇓⇓–26 but in brief, when blood pressure is entered into the EHR, rooming staff see an alert if system use is recommended for a given patient. At that point, the rooming staff can opt to print out the CDS output (CVD risk assessment with prioritized recommendations) and give it to the provider. The provider can also elect to view it in the EHR. If the CDS output is viewed or printed, it is considered that the CDS was used.
The CDS system’s risk assessment is created using EHR data to perform CVD risk calculations based on ACC/AHA CVD Pooled Risk Equations, as follows. It first assesses a given patient’s modifiable CVD risk. It then prioritizes CVD risk factors and associated treatment suggestions by calculating the degree to which CVD risk could be lowered by more effective management of each of that patient’s uncontrolled CVD risk factors. By presenting treatment suggestions prioritized by the risk factor whose control would offer the greatest benefit, this system allows the clinician to focus on the most beneficial treatment options during time-constrained encounters. This nonproprietary CDS system was developed at HealthPartners, a large, nonprofit, integrated care system. Its output is based on current evidence-based care guidelines and appropriate to each specific patient based on their comorbidities, medications, allergies, etc.7,27⇓⇓⇓⇓–32
In trials conducted in integrated care settings, use of the CDS system was associated with significantly improved CVD risk in diverse patient groups. We conducted a trial of its impact in community health centers (CHCs), which are the health care ‘safety net’ for socioeconomically vulnerable persons in the US and provide care regardless of patients’ ability to pay. That trial is described elsewhere,33 but in brief, 70 CHC clinics run by 15 CHC organizations were recruited and cluster-randomized 1:1 to 2 study arms: intervention (the CDS system was activated in September 2018) or control (not activated, but ran invisibly in the background to enable comparison). Implementation support for intervention clinics included a guide on use of the CDS system, staff training materials, examination room posters, several mandatory preactivation webinars, optional webinars for 6 months postactivation, monthly feedback on system-use rates at eligible encounters, and the ability to request additional support for the trial’s first year.
The CHC trial found that use of the CDS system was associated with significant risk reduction among patients with high baseline CVD risk. Extended analyses from that trial, presented here, were conducted to better understand 1 aspect of the mechanisms underlying that trial’s positive finding: whether prescribing patterns changed with system use and whether the decision to perform a clinical action was associated with the CDS system’s individualized prioritization of CVD risk factors. These analyses were needed because although uptake of CDS systems has been well studied (a recent systematic review and meta-analysis demonstrated an overall CDS adoption rate of 34% across diverse clinical settings),34 adoption of a CDS system is an imperfect predictor of how its recommendations are used. Furthermore, though use of some systems has been shown to be associated with increased pharmacotherapy,14,35 most of this research was conducted in academic settings and focused on a single clinical condition. Less is known about clinical actions taken after presentation of multiple prioritized risk factors that could benefit from attention, especially in CHC settings. Such knowledge could improve CDS design, adoption, and effectiveness in CHCs. To generate this knowledge, these analyses compared rates of prescribing at CDS-eligible encounters (where CDS use was suggested via EHR alert) at intervention clinics at which the CDS output was viewed or printed out, compared with those where the output was not thus ‘used,’ and also compared with eligible control clinic encounters (where the alert would have appeared if the CDS were live). We also assessed whether the CDS’ priority ranking of a given prescription was associated with higher likelihood of a prescription being issued.
Methods
Data on CVD prioritization, recommendations, and ACC/AHA 10-year CVD risk score for each encounter were obtained from the CDS system’s web service system. The CDS system generates these data regardless of whether clinic staff ‘uses’ the CDS output at a given encounter, and ran ‘invisibly’ in the control clinics, to generate the data needed for analyses. Additional data came from OCHIN (not an acronym), a nonprofit organization that provides a single instance of the Epic EHR to nearly 800 CHC clinics across 14 states (as of September 2018). Data extracted from this EHR were linked to the CDS system’s data from HealthPartners, Inc. using a computer-generated, patient-specific study identifier.
Data presented here are based on use of the CDS output at eligible encounters in intervention clinics (n = 42 clinics, 8 organizations) and control clinics (n = 28 clinics, 7 organizations) over an 18-month period (09/18/2018-03/15/2020) (Figure 1). The Kaiser Permanente Northwest institutional review board reviewed and approved all research activities for this project.
” data-icon-position data-hide-link-title=”0″>
Eligible encounters include those at all intervention clinics where the CDS output recommended starting any new hypertension medication, glucose-lowering medication, lipid-lowering medication (statin, ezetimibe or proprotein convertase subtilisin/kexin type 9 (PCSK9) inhibitor), or smoking cessation medication (bupropion or varenicline) to a medication-naïve patient; and those meeting the same eligibility criteria at control clinics, although at control clinics the CDS output could not be viewed. Outcomes were new evidence-based EHR prescriptions for blood pressure, glucose, lipid, or tobacco control medications within 7 days of an eligible encounter.
Statistical Analysis
Descriptive statistics show encounter characteristics included in these analyses. Characteristics of encounters with a recommendation to start a new medication at intervention clinic encounters were compared with control clinic encounters. In addition, characteristics of encounters at which a targeted prescription was made within 7 days of the recommendation were compared with encounters where a prescription was not made. P-values were calculated using chi-squared tests and unpaired t tests with unequal variance and significance set at 0.05.
Encounters where at least 1 new treatment suggestion was made were then identified. Analyses then compared the proportion of these encounters with a new prescription for an identified uncontrolled CVD risk factor at (1) intervention clinic encounters where the CDS system was used (displayed or printed), (2) intervention clinic encounters where the CDS system was not used, and (3) comparable control clinic encounters. The percentage of encounters with an associated prescription was also calculated for these groups based on prioritization of the treatment recommendations by the system (ranked as priority 1 to 2 or ranked as priority 3 to 6), as seen in Appendix. Two-tailed, unpaired t tests with significance set at 0.05 were used to test for significant differences within each group by priority. Because tobacco cessation was always priority 1 or 2, tests for significance between priority categories were not calculated for this CVD risk factor.
Multilevel logistic regression models were used to assess differences in new medication orders at (1) intervention clinic encounters where the CDS system was used (ie, the output was viewed) (CDS+) vs not used (CDS-), compared with (2) intervention clinic encounters where the CDS system was used, and compared with control clinic encounters where the CDS ran invisibly but did not alert users to eligible patients (CDSc). The association between recommendation priority assigned by the CDS system and prescription likelihood was also assessed across these groups. All models adjusted for patient (age, sex, race, and ethnicity) and encounter (health insurance, percent of federal poverty level, appointment length, time behind schedule, and total encounters during the study period) characteristics and included random effects for clinician and clinic and robust sandwich estimators. Post estimation predicted probabilities were obtained and statistical significance set at 0.05. SAS EG 8.3 and Stata version 15.1 were used for all analyses.
Results
Characteristics of the 106,769 eligible encounters involving 29,771 unique patients are shown in Table 1. Eligible encounters at intervention clinics, compared with control clinics, were on average more likely to be with patients (1) with lower 10-year atherosclerotic cardiovascular disease (ASCVD) risk (mean: 16.5% vs 18.1%); (2) of Hispanic ethnicity (32.0% vs 16.8%); (3) of Black race (21.2% vs 17.7%); (4) from households <138% of the federal poverty level (62.2% vs 40.6%); and (5) be time-constrained (21.0% vs 13.4%).
New prescriptions were issued at 35,078 (32.9%) of the encounters (Table 2). Encounters more often resulting in prescriptions were those where (1) the CDS system was used (16.2% of 35,078 encounters) versus those where is could have been used but was not (14.7% of 71,691 encounters); (2) the 10-year ASCVD risk was higher (mean: 17.9, vs 16.8); (3) the patient was of Hispanic ethnicity (30.4% vs 23.2% in those with a new prescription vs without a new prescription, respectively) or Black race (23.6% vs 17.8%); and (4) the patient was uninsured (20.3% vs 12.1%) or below 138% of the federal poverty level (55.1% vs 51.9%). Encounter characteristics such as average scheduled appointment length, amount of time clinician was behind schedule, and patient’s age, gender, and care utilization patterns were not meaningfully associated with medication prescription rates.
Prescription Frequency by Risk Factor and Recommendation Priority
The unadjusted probability of prescriptions associated with encounters in which the CDS system suggested starting new medication is shown in Table 3 by CVD risk factor and priority ranking. The numbers of encounters at which new medication was suggested was highest for hypertension (n = 48,352), followed by dyslipidemia (n = 27,273), tobacco cessation (n = 19,659), and glucose control (n = 8299).
Across all 4 CVD risk factors, in descriptive analyses, unadjusted prescription rates were higher in the intervention arm when the CDS system was used (CDS+) compared with the intervention cohort when it was not used (CDS-) and the control arm (CDSc). In all 3 cohorts, a higher rate of new prescriptions was seen when the CVD risk factor priority was high (ranked 1 or 2) versus low (ranked 3 to 6), except for dyslipidemia prescriptions. Suggestions for tobacco cessation medication were always a top priority for smokers, so a comparison of differences in prioritization of tobacco cessation medications could not be performed.
Adjusted Probability of Issued Prescriptions by Type of Prescription
Predicted probabilities obtained from adjusted logistic regression models (Figure 2) show that prescriptions were more likely to be written for uncontrolled hypertension at intervention clinic encounters if the CDS system was used, CDS+ (34.9% [95% CI, 31.5 to 38.3]) versus not used, CDS- (29.6% [95% CI, 26.7 to 32.6]; P < .001), but not when CDS system use was compared with control clinic encounters, CDSc (34.9% [95% CI, 31.1 to 38.7]; P = .998). There were no significant differences in the probability of diabetes-related prescriptions between any of the 3 groups.
” data-icon-position data-hide-link-title=”0″>
Probability of prescribing for lipid control was significantly higher when comparing intervention clinic encounters where the CDS system was used, CDS+ (11.3% [95% CI, 9.3 to 13.3]) with those where it was not used, CDS- (7.7% [95% CI, 6.1 to 9.3]; P = .003) and to control clinic encounters, CDSc (8.7% [95% CI, 7.0 to 10.4]; P = .044). The same pattern was seen for tobacco cessation medication when comparing encounters when the CDS system was used, CDS+ (9.9% [95% CI 8.1 to 11.7]) to encounters where it was not used, CDS- (6.8% [95% CI 5.4 to 8.1]; p=<0.001) and to control clinic encounters, CDSc (6.6% [95% CI 4.6 to 8.5]; P = .031).
Adjusted Probability of Issued Prescriptions by Recommendation Priority
The probability of a new medication order was associated with the priority ranking of its corresponding CVD risk factor (Figure 2), directly so for hypertension medication (36.9% for high priority vs 25.2% for low priority; P < .001) and for diabetes medication (41.9% for high priority vs 22.0% for low priority; P < .001). In contrast, there was a strong inverse association between dyslipidemia prescriptions and priority ranking (7.6% for high priority vs 12.6% for low priority; P < .001). Associations between priority ranking and ordering tobacco cessation medications could not be ascertained because quitting smoking always ranked as a top priority for smokers.
Discussion
Study results suggest that (a) medication ordering can increase with higher risk factor prioritization of hypertension and hyperglycemia, and (b) in intervention clinics, use of this CDS system can yield a significantly increased probability of new prescriptions for uncontrolled hypertension, but not glucose control, and (c) there is an increased probability of new prescriptions to address dyslipidemia and tobacco use when the CDS system was used among intervention clinics compared with control clinics. These results add knowledge by focusing on the impact of CDS care recommendation prioritization in the CHC setting, which has not been studied previously.
The likelihood that CDS system use was significantly associated with issuance of a given prescription varied by type of recommended medication. For example, a new prescription was added in approximately one-third of encounters where medications were suggested to treat uncontrolled hypertension or diabetes, whereas only 10% of encounters suggesting new treatment for dyslipidemia or smoking were associated with a new prescription. This is despite the fact that the provider was 3 times more likely to see a medication recommendation for lipid control and more than twice as likely to see a medication recommendation for tobacco cessation than one for hyperglycemia. This outcome is consistent with higher patient resistance to taking statins and quitting smoking, both well described; convincing patients to do either can be difficult and time-consuming.8,36⇓–38 As this trend was seen across all comparison groups, it may also reflect training or systemic biases leading to preferences for addressing some risk factors over others. Further study of differences between how varying CVD risk factors are managed would be useful.
This difficulty might also explain the finding that dyslipidemia as a lower priority was associated with more statin prescriptions than when it was a higher priority, even in encounters where the CDS system was used. One potential explanation of this is that patients for whom it was of higher priority were more likely to have been previously identified for treatment with statins but were not taking one due to prior refusal, or side effects. Conversely, patients for whom lipid control was a lower priority may have been more likely to be receiving this recommendation for the first time, and thus may be less reticent to try medication. This may demonstrate that a specific value of this CDS system is that its use can focus attention on addressing or readdressing more challenging risk factors which, like tobacco cessation, may have been previously advocated and abandoned, but are apt to benefit from repeated attempts.36 Patient compliance with these medications prescribed for smoking tobacco and for dyslipidemia would be expected to reduce the rate of major adverse cardiovascular events (MACE),39,40 and follow-up studies to quantify the extent of impact on these outcomes would be useful.
By focusing attention on prioritized CVD risk factors, this CDS may also help address inequitable gaps in risk management. The regression analyses presented here adjusted for differences seen in the baseline characteristics of the intervention and control populations. Yet we note that it is possible that these baseline differences explain the variation seen related to these characteristics in new medication prescriptions, as patients in disparate populations may have been more likely to be indicated for a medication which they had not previously been prescribed. Additional research is needed to explore this potential.
Last, low overall use of this CDS system at eligible encounters limited its impact. This CDS system was proven effective in integrated care settings, where its use rates were far higher than those seen here; research is needed on strategies for increasing CDS use rates in the CHC setting, which differs substantially from other care settings. Higher use rates could potentially have a greater impact in CHCs, where baseline rates of CVD management are low. Yet attaining these higher use rates is challenging for many reasons, including ‘alert fatigue.’ It is possible, however, that care recommendation prioritization would increase the CDS system’s utility and thus its use; these analyses demonstrate the benefits of such prioritization.
Limitations
The study was performed in CHCs sharing a single instance of an EHR, and results should be confirmed in other populations and care systems. We restricted our analysis to new prescriptions because of the decreased data completeness and veracity associated with medication usage and dosage adjustments in our system. We did not include aspirin recommendations in the analysis because it is commonly taken without a prescription and thus not reliably documented in EHRs. Many potential confounding effects were controlled by regression analysis, but other variables that were not considered or feasible to measure may have affected outcomes; for example, we cannot account for other actions taken by the study clinics to address CVD risk. Compliance with medication prescription and subsequent effect on outcomes and cost could not be ascertained in these analyses’ scope but would benefit from further investigation.
Conclusions
These results provide evidence that prioritization of CDS treatment suggestions related to blood pressure and hyperglycemia seems to increase ordering of new medication to address those CVD risk factors. They also show that use of this CDS system has a significant favorable impact on prescriptions for dyslipidemia and tobacco use, and within the intervention group, for uncontrolled hypertension, but not hyperglycemia. Additional effort is needed to maximize CDS use by improving intervention efficiency, integration into clinic workflows, including additional clinical domains, and communication of treatment benefits and risks to clinicians and patients in an accurate and comprehensible way.
Acknowledgments
This work was conducted with the Accelerating Data Value Across a National Community Health Center Network (ADVANCE) Clinical Research Network (CRN). ADVANCE is led by OCHIN in partnership with Health Choice Network, Fenway Health, and Oregon Health & Science University. ADVANCE is funded through the Patient-Centered Outcomes Research Institute (PCORI), contract number RI-OCHIN-01-MC.
Appendix. Example of CV Wizard Provider View.
Notes
-
This article was externally peer reviewed.
-
This is the Ahead of Print version of the Article.
-
Funding: National Heart, Lung, And Blood Institute of the National Institutes of Health (Award Number R01HL133793). National Institute of Health (Award Number P30DK092924) partially supported Drs. O’Connor and Sperl-Hillen.
-
Conflict of interest: We have no conficts of interest to declare.
-
To see this article online, please go to: http://jabfm.org/content/00/00/000.full.
- Received for publication November 17, 2022.
- Revision received January 30, 2023.
- Revision received May 19, 2023.
- Accepted for publication May 25, 2023.