Nutritional and Metabolic Diseases

Gland and Hormone Related Diseases

All Conditions

Diabetes Mellitus

Eligible, randomized participants will receive no text message reminder.

Eligible, randomized participants will receive a generic text message reminding them to close their outstanding health gap.

Eligible, randomized participants will receive a text message reminding them to close their outstanding health gap. This message will contain an anecdote of a patient whose cancer was caught early through similar, recommended preventive screenings.

Eligible, randomized participants will receive a text message reminding them to close their outstanding health gap. This message will prompt people to take care of the health gap right away before it slips their mind.

The investigators will send randomized participants an SMS reminder encouraging them to click the provided link and close their outstanding, overdue preventive care measures.

The provided link will take them to their MyChart login page; after logging in, they would see their personalized My Action Plan Letter detailing their personalized, overdue preventive care measures.

Reminder of preventive care measures

The message will contain an anecdote of a patient whose cancer was caught early through similar, recommended preventive screenings.

Persuasion via anecdote

The message will prompt people to take care of the health gap right away before it slips their mind.

Behavioral: Action prompt

This is a prospective randomized clinical trial evaluating how behaviorally-informed outreach text message reminders impact patient engagement with primary care. This prospective randomized control trial is being implemented in conjunction with UCLA Health's larger quality improvement initiative (the My Action Plan Quality Improvement Initiative) in order to improve primary care preventive measure completion rates.

UCLA Health will launch an initiative called My Action Plan which is an outreach effort targeting the primary care patients at UCLA who have an outstanding, clinically indicated primary care preventative care gap (e.g., overdue colorectal cancer screening, outstanding diabetes tests) and aims at encouraging patients to complete their overdue health maintenance measures.

At the beginning of each month, identified UCLA Health primary care patients will be enrolled in a trial the investigators have pre-registered under the title "UCLA Health Patient Health Maintenance Outreach Text Message" and randomized to receive one of four text messages informing them that they have overdue health maintenance measures and urging them to take action to complete these measures. These text messages will contain a link to their MyChart patient portal account, specifically linking them to a My Action Plan electronic letter that will contain a personalized list of outstanding preventive care items and actionable steps to complete the items.

In March and April 2023, if participants do not open their My Action Plan electronic letter within 7 days after the initial outreach, they will be enrolled in the trial described in the current pre-registration. This trial will evaluate the effect of sending a text reminder about health gaps as well as compare the effectiveness of different outreach text reminders. Patients will be randomly assigned in a 1:1:1:1 ratio to either the holdout control condition (without a reminder) or one of the three reminder arms (receiving one of three text reminders 2 weeks after the initial outreach message). Additionally, within each text-reminder arm, patients will be randomized to one of three time slots for getting the reminder. The investigators will examine patients' interaction with these reminders and how that ultimately translates to them completing their indicated health maintenance measures.

The UCLA Department of Medicine (DOM) intends to roll out this QI initiative at the beginning of the 2023 calendar year and continue it for a span of at least 12 months. Each month, the initiative targets patients whose birthday falls into that month. This proposed trial will run for two months (March and April 2023).

Analysis Plan:

The investigators will utilize patient-level ordinary least squares (OLS) estimation, with statistical inferences based on model-robust standard errors. The primary model term will be indicator variables for arm assignment.

The analysis will adjust for sex, age, race/ethnicity, indicators for screenings/tests that patients are due for, and whether patients have upcoming primary care appointments. Missing covariate values will be handled by including 'unknown' indicators, along with mean imputation for quantitative covariates.

The investigators will use this dataset to address two separate research questions.

Research question 1: The investigators will compare the average of Arms 2-4 with Arm 1 to test the average effect of sending a text reminder. If the average effect is significant, the investigators will explore if Arms 2, 3, and 4 separately differ from Arm 1.

Research question 2: The investigators will compare Arm 3, Arm 4, with Arm 2 to test whether, compared to a simple (control) reminder, it is more effective to boost patients' intentions to close the health gap via an anecdote or to prompt patients to take actions quickly.

Exploratory analyses will investigate heterogeneous treatment effects by patients' baseline motivation (i.e., the extent to which patients seem to have some intentions to get the screenings/tests) in two ways. First, the investigators will use each patient's history of screenings/tests to construct a proxy for their baseline motivation to obtain the due screenings/tests. Specifically, the investigator will calculate, among all the screenings/tests that are included in the My Action Plan Initiative and that a patient was due for in the past few years (exact time window TBD based on data availability), what percentage was completed by the patient (as far as UCLA Health could tell). A higher percentage indicates a higher baseline motivation to get the screenings/tests patients are due for during the study period. Second, the investigators will obtain demographics and medical information that UCLA Health is willing to provide (e.g., gender, age, race/ethnicity, history of cancer and other pre-existing conditions, family cancer history, past adherence to screenings/tests that are included in the My Action Plan Initiative, past receipt of influenza vaccination, frequency of doctor visits; time window of these variables is TBD depending on data availability). With such information, the investigators will train an algorithm to predict patients' baseline motivation level using patients in the holdout condition (Arm 1) as the ground truth. Specifically, the investigators will take the aforementioned information about patients in Arm 1 as input, and use whether they complete any of the screenings/visits recommended in the My Action Plan letter within 6 months as the outcome measure. Then the investigators will apply the algorithm to all patients to predict their baseline motivation level. For both approaches, the proxy for baseline motivation (Approach 1) and the predicted baseline motivation level (Approach 2) will be used to analyze the heterogeneous treatment effects of (1) Arms 3 and 4 (vs. Arm 2) and (2) the combination of Arms 2 and 4 vs. Arm 1.

Additionally the investigators will investigate proxies for whether patients face structural barriers to get screenings/tests as moderators, including socioeconomic factors at the zipcode level, insurance type, proxies for accessibility to healthcare resources such as distance from UCLA Health clinics.

The investigators will also explore how the effect of text reminders varies across the three times of the day when the reminders will be sent.

UCLA Health Patient Health Maintenance Text Reminder

We do not plan to make any individual participant data available.

Percentage of participants across the different arms who open their personalized My Action Plan letter on MyChart

Percentage of participants across the different reminder arms who click on the link in the reminder message

Rate of which eligible participants directly schedule an appointment for diabetic retinal exams, diabetes education, or breast cancer screening in order to complete these overdue screening/test(s). These screenings/tests have dedicated appointment resources that people can directly schedule for.

Rate of which participants schedule an appointment to complete their overdue screening/test or start the online tool for colorectal screening

Rate of completion of at least one screening/test within the observation window.

UCLA Department of Medicine

University of California, Los Angeles

Clinical Instructor of Medicine

Eligible, randomized participants will receive a text message reminding them to close their outstanding health gap. This message will contain an anecdote of a patient whose cancer was caught early through similar, recommended preventive screenings. The message prompts patients to click on a link to read the story about the patient.

Eligible, randomized participants will receive a text message reminding them to close their outstanding health gap. This message will contain an anecdote of a patient whose cancer was caught early through similar, recommended preventive screenings. The message won't contain a link to the story, but it will briefly describe the story.

Eligible, randomized participants will receive a text message reminding them to close their outstanding health gap. This message will mention that research has shown promptly closing health gaps saves lives. The message will contain a link to an official website that supports the statement.

The message will contain an anecdote of a patient whose cancer was caught early through similar, recommended preventive screenings. The message prompts patients to click on a link to read the story about the patient.

The message will contain a link to an anecdote of a patient whose cancer was caught early through similar, recommended preventive screenings. The message won't contain a link to the story, but it will briefly describe the story.

Persuasion via anecdote without link

This message will mention that research has shown promptly closing health gaps saves lives.The message will contain a link to an official website that supports the statement.

Persuasion via research

UCLA Health will launch an initiative called My Action Plan which is an outreach effort targeting the primary care patients at UCLA who have an outstanding, clinically indicated primary care preventative care gap (e.g., overdue colorectal cancer screening, outstanding diabetes tests) and aims at encouraging patients to complete their overdue health maintenance measures.

At the beginning of each month, identified UCLA Health primary care patients will be enrolled in a trial the investigators have pre-registered under the title "UCLA Health Patient Health Maintenance Outreach Text Message" and randomized to receive one of four text messages informing them that they have overdue health maintenance measures and urging them to take action to complete these measures. These text messages will contain a link to their MyChart patient portal account, specifically linking them to a My Action Plan electronic letter that will contain a personalized list of outstanding preventive care items and actionable steps to complete the items.

In July 2023, if participants do not open their My Action Plan electronic letter within 7 days after the initial outreach, they will be enrolled in the trial described in the current pre-registration. Patients will be randomly assigned in a 1:1:1:1 ratio to receive one of four text reminders 2 weeks after the initial outreach message. Additionally, within each text-reminder arm, patients will be randomized to one of three time slots for getting the reminder. The investigators will examine patients' interaction with these reminders and how that ultimately translates to them completing their indicated health maintenance measures.

The UCLA Department of Medicine (DOM) intends to roll out this QI initiative at the beginning of the 2023 calendar year and continue it for a span of at least 12 months. Each month, the initiative targets patients whose birthday falls into that month. This proposed trial will run for one month (July 2023).

Analysis Plan:

The investigators will utilize patient-level ordinary least squares (OLS) estimation, with statistical inferences based on model-robust standard errors. The primary model term will be indicator variables for arm assignment.

The analysis will adjust for sex, age, race/ethnicity, indicators for screenings/tests that patients are due for, and whether patients have upcoming primary care appointments. Missing covariate values will be handled by including 'unknown' indicators, along with mean imputation for quantitative covariates.

The investigators will first compare Arm 2 with Arm 1 to test the effect of encouraging patients to read the story about a patient whose life was saved by preventive screening.. If the difference is significant in an outcome measure, the investigators will then compare Arms 3 and 4 with Arms 1 and 2 to shed light on why Arm 2 differs from Arm 1.

Exploratory analyses will investigate heterogeneous treatment effects of Arm 2 (vs. Arm 1) by patients' gender, age, race/ethnicity, history of cancer and other pre-existing conditions, family cancer history, past adherence to screenings/tests that are included in the My Action Plan Initiative, past receipt of influenza vaccination, frequency of doctor visits.

UCLA Health Patient Health Maintenance Text Reminder July 2023

UCLA Health Department of Medicine

Eligible, randomized participant will receive a brief, specific SMS message informing patients that they should obtain screenings and tests they are due for.

Eligible, randomized participant will receive a brief, generic SMS message informing patients that they have a health gap to be closed.

Eligible, randomized participant will receive an intention-oriented, generic SMS message informing patients that they have a health gap to be closed and highlighting the importance of doing so.

Eligible, randomized participant will receive an action-oriented, generic SMS-message informing patients that they have a health gap to be closed and prompting them to act soon before they forget.

The investigators will send randomized participants an SMS message encouraging them to click provided link and close their outstanding, overdue preventive care measures.

The provided link will take them to their MyChart login page; after logging in, they would see their personalized My Action Plan Letter detailing their personalized, overdue preventive care measures. Message content will vary based on randomization arm as noted below.

Outreach Text Messages

The message will inform patients that the care team has identified tests/screenings that they are due for.

Specific

The message will inform patients that the care team has identified a care gap in their record.

General

The message will point out that even if patients feel healthy, their doctor recommends them to take care of their health gaps.

Elevating Intentions

The message will prompt patients to take care of their health gaps right away before they forget.

Prompting Action

This is a prospective randomized clinical trial evaluating how behaviorally-informed outreach text messages impact patient engagement with primary care. This prospective randomized control trial is being implemented in conjunction with UCLA Health's larger quality improvement initiative (the My Action Plan Quality Improvement Initiative) in order to improve primary care preventive measure completion rates.

Health maintenance measures have been shown to be critical in early detection, secondary prevention, and early management of numerous medical conditions--from diabetes to various cancers. The standardization of these health maintenance measures have resulted in major improvements in population health. Despite the importance of these primary care tests and screenings, many patients are overdue for these tests.

Given this healthcare gap, it is critical to investigate more effective strategies to facilitate health maintenance measure completion. This study aims to evaluate the effectiveness of a variety of behaviorally-informed outreach text messages. The investigators intend to launch the study as a part of UCLA Health's My Action Plan initiative, a UCLA Health primary care outreach quality improvement initiative aimed at encouraging patients to complete their overdue health maintenance measures.

Specifically, the My Action Plan initiative is an outreach effort targeting primary care patients at UCLA who have an outstanding, clinically indicated primary care preventative care gap (e.g., overdue colorectal cancer screening, outstanding diabetes tests). At the beginning of each month, identified UCLA Health primary care patients will be randomized in a 1:1:1:1 ratio to receive one of four text messages informing them that they have an overdue health maintenance measures and urging them to taking action to complete these measures. These text messages will contain a link to their MyChart patient portal account, specifically linking them to a My Action Plan electronic letter that will contain a personalized list of outstanding preventive care items and actionable steps to complete the items.

Within each text-message arm, patients will also be randomized to one of three time slots for getting the message.

The My Action Plan quality improvement initiative is expected to start at the beginning of the 2023 calendar year and continue for a span of at least 12 months. Each month, the initiative targets patients whose birthday falls into that month. The investigators plan to run this randomized clinical trial during four months of the larger QI initiative.

By studying how patients interact with these outreach messages and whether it then translates to them completing their indicated health maintenance measures, the proposed study would provide insightful information on how health systems could optimize electronic patient outreach, narrow the gap in health maintenance measures in primary care, and ultimately improve health on a population level.

Analysis Plan:

* The investigators will utilize patient-level ordinary least squares (OLS) estimation, with statistical inferences based on model-robust standard errors. The primary model term will be indicator variables for arm assignment.
* The analysis will adjust for sex, age, race/ethnicity, indicators for screenings/tests that patients are due for, and whether patients have upcoming primary care appointments. Missing covariate values will be handled by including 'unknown' indicators, along with mean imputation for quantitative covariates.
* The investigators will use this dataset to address two separate research questions.
* Research question 1: The investigators will compare Arm 1 with Arm 2 to test whether more specific or general text message is more likely to improve the outcome measures
* Research question 2: The investigators will compare Arm 3, Arm 4, with Arm 2 to test whether the general intention-oriented message and general action-oriented message can outperform the general text message as well as which of these two messages is better.
* For research question 2, exploratory analyses will investigate heterogeneous treatment effects by patients' baseline motivation (i.e., the extent to which patients seem to have some intentions to get the screenings/tests) in two ways. First, the investigators will use each patient's history of screenings/tests to construct a proxy for their baseline motivation to obtain the due screenings/tests. Specifically, the investigator will calculate, among all the screenings/tests that are included in the My Action Plan Initiative and that a patient was due for in the past few years (exact time window TBD based on data availability), what percentage was completed by the patient (as far as UCLA Health could tell). A higher percentage indicates a higher baseline motivation to get the screenings/tests patients are due for during the study period. Second, the investigators will obtain demographics and medical information that UCLA Health is willing to provide (e.g., gender, age, race/ethnicity, history of cancer and other pre-existing conditions, family cancer history, past adherence to screenings/tests that are included in the My Action Plan Initiative, past receipt of influenza vaccination, frequency of doctor visits; time window of these variables is TBD depending on data availability). With such information, the investigators will train an algorithm to predict patients' baseline motivation level using patients in Arm 2 as the ground truth. Specifically, the investigators will take the aforementioned information about patients in Arm 2 as input, and use whether they complete any of the screenings/visits recommended in the My Action Plan letter within 6 months as the outcome measure. Then the investigators will apply the algorithm to all patients to predict their baseline motivation level. For both approaches, the proxy for baseline motivation (Approach 1) and the predicted baseline motivation level (Approach 2) will be used to analyze the heterogeneous treatment effects of Arms 3 and 4 (vs. Arm 2).
* Additionally the investigators will investigate proxies for whether patients face structural barriers to get screenings/tests as moderators, including socioeconomic factors at the zipcode level, insurance type, proxies for accessibility to healthcare resources such as distance from UCLA Health clinics.
* The investigators will also explore how the effect of text messages varies across the three times of the day when the reminders will be sent.

UCLA Health Patient Health Maintenance Outreach Text Message

Percentage of participants across the different arms who click on the link from the outreach message

Percentage of participants across the different arms who open their personalized My Action Plan letter

Rate of completion of at least one screening/test within the observation window

Neoplasms

Urinary Tract, Sexual Organs, and Pregnancy Conditions

Infections

Symptoms and General Pathology

Digestive System Diseases

Uterine Cervical Neoplasms

Chlamydia Infections

Communicable Diseases

Colorectal Neoplasms

Intestinal Neoplasms

Gastrointestinal Neoplasms

Digestive System Neoplasms

Gastrointestinal Diseases

Colonic Diseases

Intestinal Diseases

Rectal Diseases

Uterine Neoplasms

Genital Neoplasms, Female

Urogenital Neoplasms

Uterine Cervical Diseases

Uterine Diseases

Genital Diseases, Female

Genital Diseases

Urogenital Diseases

Female Urogenital Diseases

Pregnancy Complications

Female Urogenital Diseases and Pregnancy Complications

Bacterial Infections

Gram-Negative Bacterial Infections

Mycoses

Bacterial Infections and Mycoses

Sexually Transmitted Diseases

Sexually Transmitted Diseases, Bacterial

Monthly email communication: Monthly standard communication via email informing physicians of their health maintenance completion rate over the prior three-month period. The email will also include a link to the performance dashboard, a link to a FAQ page that outlines their incentive plan, a link to helpful resources such as care guidelines, key tips from top performers, the quality measure on which they are performing the best, and the two quality measures that they could improve on the most.

Monthly email communication as in Arm 1

Social comparison: In addition to the information given in Arm 1 email messaging, physicians in this arm will receive a list of the names of the top 25 performers from the prior month, and a high performer benchmark. Each physician in this group will receive a personalized message and subject line based on where in the performance distribution they fall (categories: top 25 performers, high performers, nearly high performers, and low performers). Message content will incorporate language utilizing principles of social comparison theory.

Monthly email communication as in Arm 1 and Arm 2.

Social comparison as in Arm 2.

Quality improvement leadership training: Physician leads and clinic managers within clinics randomized to Group 3 will receive an in-person quality improvement and primary care clinic performance training, using the principles of quality improvement, self-determination theory and social comparison. Clinic leaders will be trained on how to guide these conversations, formulate their own performance/quality improvement goals, design effective strategies to reach these goals, and track their clinic's progress. Check-in emails and calls will be provided on a monthly basis to follow up on clinic-based quality improvement efforts and share key take-aways from the new Primary Care Clinical Excellence Recognition Program. This program aims to support a positive and collaborative culture of clinical excellence by recognizing and sharing best practices from high performing physicians and clinical teams.

This is the base communication that all physicians will receive.

Standard communication email

The social comparison is added onto the standard communication email to provide some peer comparison between the physicians.

Social comparison Intervention

Clinic and Physician leads will be provided with a clinic leadership training seminars in leadership, quality improvement, and support from the Quality Improvement team at UCLA Health.

Leadership Training

As part of UCLA Health's commitment to developing a premier integrated health system built on a foundation of physician-led, team-based primary care, the Department of Medicine (DOM) recently implemented a new performance based incentive plan called the Primary Care Clinical Excellence (PCCE) Incentive Plan. This incentive plan was developed to motivate providers to improve health maintenance screening rates.

The UCLA Health DOM Quality team is leading the implementation and evaluation of this new incentive plan across our primary care network. In addition, the DOM Quality team has partnered with the UCLA Anderson School of Management to study the most efficacious ways to frame and communicate performance based incentives.

Understanding the factors that motivate physicians to deliver the highest quality primary care will provide pivotal insights into the successful implementation of performance based programs nationwide. The investigators believe that physicians who receive communication built on behavioral principles will demonstrate more motivation towards and success at meeting national primary care screening guidelines.

Currently, UCLA Health has 42 primary care clinics staffed with approximately 205 PCP's serving more than 300,000 patients. In order to improve health maintenance screening rates associated with the performance based program, the investigators will use a communication strategy that leverages behavioral principles to motivate providers to improve health maintenance screening rates.

The investigators will implement a three-arm experimental communication campaign that includes monthly messages. The communication strategy will utilize behavioral change theory (particularly social comparison and recognition) to improve physician performance in health maintenance quality metrics.

This study will primarily focus on one quality domain of the PCCE incentive program-Clinical Quality. Two further quality domains of the PCCE incentive program will serve as exploratory measures: Patient Experience and Professional Participation.

For the primary outcome measure and high-priority secondary outcome measures, the investigators will first evaluate whether the combination of arms 2 and 3 differs from arm 1 in terms of the measures listed in the Outcome Measures section. If this comparison is statistically significant, the investigators will next compare arms 1 vs 2. and then, if also significant, the investigators will compare arms 1 vs 3 and 2 vs 3. For the 1 vs 3 and 2 vs 3 comparisons, we will use a Holm-Bonferroni p-value correction. These comparisons of treatment arms will be performed at the patient level using a mixed effects regression model, including random physician and clinic effects to account for clustering of patients. Control variables include (1) patient baseline order rates (or completion rates depending on the outcome measure) in July-October 2019, (2) patient characteristics (age, gender, comorbidity, insurance plan, zip code), and (3) physician characteristics (gender, race, years practiced, years at UCLA Health). Unless otherwise specified, p-values less than 0.05 will be considered statistically significant.

Parallel cluster randomized trial. Groups will be clustered at the clinic level taking into consideration total Clinical FTE, Primary Care network group, and baseline HM completion rates.

Primary Care Clinical Excellence Incentive Study

Effects of Social Comparison Performance Feedback on Primary Care Quality

There is no IPD sharing plan for this study.

For each patient who visits a given PCP in our sample from November 5, 2019 to March 3, 2020, we will consider all Focus Quality Measures open at his/her first visit to the PCP, and calculate the percent of these measures ordered within 7 days following his/her first visit.

Focus Quality Measures include: Diabetes HGB A1C, Diabetes Eye Exam, Diabetes Foot Exam, Diabetes Nephropathy Monitoring, Colon Cancer Screening, Breast Cancer screening, Cervical Cancer Screening, chlamydia screening, and HPV depending on primary care specialty. These Focus Measures are based on the USPSTF primary care recommendations.

\[Note: The original intent was to run the study over an eight month period - from November 1, 2019 through June 30, 2020 - but was cut short due to the COVID-19 pandemic. Our revised time frame includes (1) four full cycles (months) of the intervention (11/05/2019-03/03/2020) and four months prior to the experiment as a baseline period\]

For each patient who visits a given PCP in our sample from November 5, 2019 to March 3, 2020, we will consider all Focus Quality Measures that are open between November 5, 2019 and March 3, 2020. We will calculate the percentage of these measures completed between November 5, 2019 and March 10, 2020 as well as the percentage completed between November 5, 2019 and July 3, 2020.

For each patient who visits a given PCP in our sample from November 5, 2019 to March 3, 2020, for each Focus Quality Measure open at his/her first visit to the PCP, we will assess whether the open measure is ordered within 7 days following his/her first visit.

For each patient who visits a given PCP in our sample from November 5, 2019 to March 3, 2020, for each Focus Quality Measure open between November 5, 2019 to March 3, 2020, we will assess whether the measure is completed (1) between November 5, 2019 and March 10, 2020 as well as (2) between November 5, 2019 and July 3, 2020.

As measured by aggregate order rates for Complementary Health Maintenance Measures within seven days after each patient's first visit. Complementary Measures (Abdominal Aortic Aneurysm Screening, Osteoporosis Screening, Hepatitis C Screening, HIV Screening, Pneumococcal Vaccination, Tetanus Vaccination, Tdap Vaccination During Pregnancy, Shingles Vaccination, Meningitis Vaccination, Measles Mumps Rubella Vaccination, Polio Vaccination, Hepatitis A Vaccination, Hepatitis B vaccination, Pneumococcal Vaccination for Patients with Diabetes, Statin for Primary ASCVD Prevention, Aspirin for Secondary ASCVD Prevention, and Annual Wellness Visit) are based on USPSTF primary care recommendations regarding disease management, infectious disease screening, and standard vaccinations.

As measured by patient level aggregate performance Complementary Health Maintenance Measures (1) between November 5, 2019 and March 10, 2020 as well as (2) between November 5, 2019 and July 3, 2020.

Physicians will be surveyed to evaluate their level of burnout throughout the study period.

Physicians will be surveyed for their satisfaction throughout the study period.

Physicians will be surveyed regarding their provider experience throughout the study period.

Payment of performance based financial incentive to physicians throughout the study period.

Physician performance in patient satisfaction surveys throughout the study period.

Physician performance in professional participation will be based on provider/physician surveys throughout the study period.

For each patient who visits a given PCP in our sample from November 5, 2019 to March 3, 2020, we will consider all Focus Quality Measures that are open between November 5, 2019 and March 3, 2020, and calculate the percentage of these measures ordered between November 5, 2019 and March 10, 2020.

HM order rate is determined by the aggregate order rate of measures within the primary care Health Maintenance module of EPIC EHR ("Focus Quality Measures") and other Quality Measures that are not in the Health Maintenance module ("Complementary Measures"). Both the Focus Quality Measures and Complementary Measures are based on USPSTF primary care recommendations regarding disease management, infectious disease screening, cancer screening, and standard vaccinations.

HM completion rate is determined by the aggregate completion rate of variables within the primary care Health Maintenance module of EPIC EHR ("Focus Quality Measures") and other Quality Measures that are not in the Health Maintenance module ("Complementary Measures").

For each patient who visits a given PCP in our sample from November 5, 2019 to March 3, 2020, for each Focus Quality Measure open between November 5, 2019 to March 3, 2020, we will assess whether the measure is ordered between November 5, 2019 and March 10, 2020.

For each primary care physician, we assign patients to their panel using an attribution model. This model assigns patients to a physician if they have been seen by that physician within the last 3 years. Additional patient attribution logic includes: 1) the physician with a preventive/wellness visit in the prior 1 year is attributed first, 2) if there is no preventive/wellness visit in the prior 1 year, the physician with the largest number of visits is attributed, and 3) if there is a tie in either the preventive/wellness visit or number of visit scenario, the physician with the most recent visit is attributed. Once patients are assigned using the above attribution model, patients who have at least one visit with their attributed physician from November 5, 2019 to March 3, 2020 will be included in our evaluation.

For each physician, we will identify the number of new patients they have from November 5, 2019 to March 3, 2020.

For each patient who visits a given PCP in our sample from November 5, 2019 to March 3, 2020, we will measure the total number of times he/she visits the PCP from November 5, 2019 to March 3, 2020.

For each patient who visits a given PCP in our sample from November 5, 2019 to March 3, 2020, we will measure the number of open measures he/she has at the first visit as well as the total number of open measures he/she has from November 5, 2019 to March 3, 2020.

Study title	NCT ID	Conditions	Interventions	Eligibility	Organization
UCLA Health Patient Health Maintenance Text Reminder	NCT05791942	Health Maintena... Diabetes Cancer	Reminder of pre... Persuasion via ... Behavioral: Act...	18 Years -	University of California, Los Angeles
UCLA Health Patient Health Maintenance Text Reminder July 2023	NCT05979987	Health Maintena... Diabetes Cancer	Reminder of pre... Persuasion via ... Persuasion via ... Persuasion via ...	18 Years -	University of California, Los Angeles
UCLA Health Patient Health Maintenance Outreach Text Message	NCT05793788	Health Maintena... Diabetes Cancer	Outreach Text M... Specific General Elevating Inten... Prompting Actio...	18 Years -	University of California, Los Angeles
Primary Care Clinical Excellence Incentive Study	NCT04237883	Behavioral Econ... Primary Health ... Health Maintena... Diabetes Colorectal Canc... Cervical Cancer... Chlamydia Scree... HPV Screening	Standard commun... Social comparis... Leadership Trai...	18 Years -	University of California, Los Angeles
UCLA Health Patient Health Maintenance Text Reminder	NCT05791942	Health Maintena... Diabetes Cancer	Reminder of pre... Persuasion via ... Behavioral: Act...	18 Years -	University of California, Los Angeles

Spots Global Cancer Trial Database for health maintenance