Covid-19 Messaging to Underserved Communities - 2nd Experiment

• Sponsor: National Bureau of Economic Research, Inc. (Other)
• Overall Status: Completed
• CT.gov ID: NCT04502056
• Collaborator: Massachusetts General Hospital (Other), Stanford University (Other), Yale University (Other), Harvard University (Other)
• Enrollment: 20,460
• Location: 1
• Arms: 12
• Actual Duration (Days): 30
• Patients Per Site Per Month: 20758.4

Study Details

Study Description

Brief Summary

The aim of the study is to build off results from our first experiment (NCT04371419) , and test whether messages that acknowledge racial injustice on behalf of institutions affect the retention of knowledge and movement of beliefs and behavior with respect to Covid-19. The investigators will also test the effect of concordance of providers and whether highlighting the unequal burden of the disease has additional effects on knowledge, beliefs and behavior regarding covid-19. The sample will include African American and white adult Americans and oversample those with less than a college degree.

Condition or Disease	Intervention/Treatment	Phase
Covid19	Behavioral: Acknowledgement Racial Injustice AMA; Behavioral: African American Sender Acknowledgement; Behavioral: African American Sender in Informational Videos.; Behavioral: Racial Inequality Highlighted; Behavioral: AMA Acknowledgement Drug Pricing; Behavioral: White Sender in Acknowledgement; Behavioral: White Sender in Informational Videos; Behavioral: No Racial Inequality Highlighting; Behavioral: Placebo videos	N/A

Detailed Description

Recent data have shown that covid19 is disproportionately infecting and killing African Americans and Latinx people in the United States. Moreover, since our last experiment, the killing of George Floyd by Minnesota police has raised awareness of structural racism in the United States.

The aim of the study is to build off results from our first experiment (NCT04371419) , and test whether messages that acknowledge racial injustice on behalf of institutions affect the retention of knowledge and movement of beliefs and behavior with respect to Covid-19. The investigators will also test the effect of concordance of providers and whether highlighting the unequal burden of the disease has additional effects on knowledge, beliefs and behavior regarding covid-19.The sample will include African American and white adult Americans and oversample those with less than a college degree.

Study Design

• Study Type: Interventional
• Actual Enrollment: 20460 participants
• Allocation: Randomized
• Intervention Model: Parallel Assignment
• Masking: None (Open Label)
• Primary Purpose: Prevention
• Official Title: Covid-19 Messaging to Underserved Communities - 2nd Experiment
• Actual Study Start Date: Aug 7, 2020
• Actual Primary Completion Date: Sep 6, 2020
• Actual Study Completion Date: Sep 6, 2020

Arms and Interventions

Arm	Intervention/Treatment
Experimental: AMA RI - B- B - R Respondents will be randomized to an AMA statement acknowledging racial injustice read by an African American individual. The messenger / doctor in the follow-up AMA videos will also be African American - the message on Covid-19 will include information on the disproportionate impact on communities of color.	Behavioral: Acknowledgement Racial Injustice AMA; Investigators will examine whether acknowledgements of racial inequality are helpful towards improving knowledge retention and behaviors associated with the intervention among participants. In this arm, participants will receive a AMA statement on racial injustice.; Behavioral: African American Sender Acknowledgement; Investigators will also vary the messenger of the acknowledgement sender. In this arm participants receive a African American sender in acknowledgment of AMA; Behavioral: African American Sender in Informational Videos.; Investigators will vary the sender of the informational covid-19 videos. In this arm, participants receive a African American sender in informational videos.; Behavioral: Racial Inequality Highlighted; Investigators will include information on race-specific covid-19 cases and deaths in one variation in the messaging. In this arm, participants receive disproportionate race-specific Covid-19 facts
Experimental: AMA RI - B - B - N Respondents will be randomized to an AMA statement acknowledging racial injustice read by an African American individual. The messenger / doctor in the follow-up AMA videos will also be African American - the message on Covid-19 will not include information on the disproportionate impact on communities of color.	Behavioral: Acknowledgement Racial Injustice AMA; Investigators will examine whether acknowledgements of racial inequality are helpful towards improving knowledge retention and behaviors associated with the intervention among participants. In this arm, participants will receive a AMA statement on racial injustice.; Behavioral: African American Sender Acknowledgement; Investigators will also vary the messenger of the acknowledgement sender. In this arm participants receive a African American sender in acknowledgment of AMA; Behavioral: African American Sender in Informational Videos.; Investigators will vary the sender of the informational covid-19 videos. In this arm, participants receive a African American sender in informational videos.; Behavioral: No Racial Inequality Highlighting; In this arm, the disproportionate burden of Covid-19 on communities of color will not be highlighted
Experimental: AMA RI - W - W - R Respondents will be randomized to an AMA statement acknowledging racial injustice read by a white individual. The messenger / doctor in the follow-up AMA videos will be white - the message on Covid-19 will include information on the disproportionate impact on communities of color.	Behavioral: Acknowledgement Racial Injustice AMA; Investigators will examine whether acknowledgements of racial inequality are helpful towards improving knowledge retention and behaviors associated with the intervention among participants. In this arm, participants will receive a AMA statement on racial injustice.; Behavioral: Racial Inequality Highlighted; Investigators will include information on race-specific covid-19 cases and deaths in one variation in the messaging. In this arm, participants receive disproportionate race-specific Covid-19 facts; Behavioral: White Sender in Acknowledgement; Investigators will also vary the messenger of the acknowledgement sender. In this arm, participants receive a white sender in the acknowledgement; Behavioral: White Sender in Informational Videos; Investigators will vary the messenger of the informational covid-19 videos. In this arm, participants receive white sender in the informational video
Experimental: AMA RI - W - W - N Respondents will be randomized to an AMA statement acknowledging racial injustice read by a white individual. The messenger / doctor in the follow-up AMA videos will be white - the message on Covid-19 will not include information on the disproportionate impact on communities of color.	Behavioral: Acknowledgement Racial Injustice AMA; Investigators will examine whether acknowledgements of racial inequality are helpful towards improving knowledge retention and behaviors associated with the intervention among participants. In this arm, participants will receive a AMA statement on racial injustice.; Behavioral: White Sender in Acknowledgement; Investigators will also vary the messenger of the acknowledgement sender. In this arm, participants receive a white sender in the acknowledgement; Behavioral: White Sender in Informational Videos; Investigators will vary the messenger of the informational covid-19 videos. In this arm, participants receive white sender in the informational video; Behavioral: No Racial Inequality Highlighting; In this arm, the disproportionate burden of Covid-19 on communities of color will not be highlighted
Experimental: AMA DP - B- B - R Respondents will be randomized to an AMA statement acknowledging drug pricing read by an African American individual. The messenger / doctor in the follow-up AMA videos will also be African American - the message on Covid-19 will include information on the disproportionate impact on communities of color .	Behavioral: African American Sender Acknowledgement; Investigators will also vary the messenger of the acknowledgement sender. In this arm participants receive a African American sender in acknowledgment of AMA; Behavioral: African American Sender in Informational Videos.; Investigators will vary the sender of the informational covid-19 videos. In this arm, participants receive a African American sender in informational videos.; Behavioral: Racial Inequality Highlighted; Investigators will include information on race-specific covid-19 cases and deaths in one variation in the messaging. In this arm, participants receive disproportionate race-specific Covid-19 facts; Behavioral: AMA Acknowledgement Drug Pricing; Investigators will examine whether acknowledgements of racial inequality are helpful towards improving knowledge retention and behaviors associated with the intervention among participants. In this arm, participants receive AMA information on drug pricing
Experimental: AMA DP - B- B - N Respondents will be randomized to an AMA statement acknowledging drug pricing read by an African American individual. The messenger / doctor in the follow-up AMA videos will also be African American - the message on Covid-19 will not include information on the disproportionate impact on communities of color.	Behavioral: African American Sender Acknowledgement; Investigators will also vary the messenger of the acknowledgement sender. In this arm participants receive a African American sender in acknowledgment of AMA; Behavioral: African American Sender in Informational Videos.; Investigators will vary the sender of the informational covid-19 videos. In this arm, participants receive a African American sender in informational videos.; Behavioral: AMA Acknowledgement Drug Pricing; Investigators will examine whether acknowledgements of racial inequality are helpful towards improving knowledge retention and behaviors associated with the intervention among participants. In this arm, participants receive AMA information on drug pricing; Behavioral: No Racial Inequality Highlighting; In this arm, the disproportionate burden of Covid-19 on communities of color will not be highlighted
Experimental: AMA DP - W- W - R Respondents will be randomized to an AMA statement acknowledging drug pricing read by a white individual. The messenger / doctor in the follow-up AMA videos will be white - the message on Covid-19 will include information on the disproportionate impact on communities of color.	Behavioral: Racial Inequality Highlighted; Investigators will include information on race-specific covid-19 cases and deaths in one variation in the messaging. In this arm, participants receive disproportionate race-specific Covid-19 facts; Behavioral: AMA Acknowledgement Drug Pricing; Investigators will examine whether acknowledgements of racial inequality are helpful towards improving knowledge retention and behaviors associated with the intervention among participants. In this arm, participants receive AMA information on drug pricing; Behavioral: White Sender in Acknowledgement; Investigators will also vary the messenger of the acknowledgement sender. In this arm, participants receive a white sender in the acknowledgement; Behavioral: White Sender in Informational Videos; Investigators will vary the messenger of the informational covid-19 videos. In this arm, participants receive white sender in the informational video
Experimental: AMA DP - W- W - N Respondents will be randomized to an AMA statement acknowledging drug pricing read by a white individual. The messenger / doctor in the follow-up AMA videos will be white - the message on Covid-19 will not include information on the disproportionate impact on communities of color.	Behavioral: AMA Acknowledgement Drug Pricing; Investigators will examine whether acknowledgements of racial inequality are helpful towards improving knowledge retention and behaviors associated with the intervention among participants. In this arm, participants receive AMA information on drug pricing; Behavioral: White Sender in Acknowledgement; Investigators will also vary the messenger of the acknowledgement sender. In this arm, participants receive a white sender in the acknowledgement; Behavioral: White Sender in Informational Videos; Investigators will vary the messenger of the informational covid-19 videos. In this arm, participants receive white sender in the informational video; Behavioral: No Racial Inequality Highlighting; In this arm, the disproportionate burden of Covid-19 on communities of color will not be highlighted
Placebo Comparator: Control: AMA RI - B - B Respondents will be randomized to an AMA statement acknowledging racial injustice read by an African American individual. The messenger / doctor in the follow-up AMA videos will also be African American - No message on Covid-19 will be shown. Acknowledgement Racial Injustice AMA: Investigators will examine whether acknowledgements of racial inequality are helpful towards improving knowledge retention and behaviors associated with the intervention among participants. In this arm, participants will receive a AMA statement on racial injustice. African American Sender Acknowledgement: Investigators will also vary the messenger of the acknowledgement sender. In this arm participants receive a African American sender in acknowledgment of AMA	Behavioral: Acknowledgement Racial Injustice AMA; Investigators will examine whether acknowledgements of racial inequality are helpful towards improving knowledge retention and behaviors associated with the intervention among participants. In this arm, participants will receive a AMA statement on racial injustice.; Behavioral: African American Sender Acknowledgement; Investigators will also vary the messenger of the acknowledgement sender. In this arm participants receive a African American sender in acknowledgment of AMA; Behavioral: African American Sender in Informational Videos.; Investigators will vary the sender of the informational covid-19 videos. In this arm, participants receive a African American sender in informational videos.; Behavioral: Placebo videos; Videos not related to covid-19 will be shown
Placebo Comparator: Control: AMA RI - W - W Respondents will be randomized to an AMA statement acknowledging racial injustice read by a white individual. The messenger / doctor in the follow-up AMA videos will also be white - No message on Covid-19 will be shown. Acknowledgement Racial Injustice AMA: Investigators will examine whether acknowledgements of racial inequality are helpful towards improving knowledge retention and behaviors associated with the intervention among participants. In this arm, participants will receive a AMA statement on racial injustice. White Sender Acknowledgement: Investigators will also vary the messenger of the acknowledgement sender. In this arm participants receive a white sender in acknowledgment of AMA	Behavioral: Acknowledgement Racial Injustice AMA; Investigators will examine whether acknowledgements of racial inequality are helpful towards improving knowledge retention and behaviors associated with the intervention among participants. In this arm, participants will receive a AMA statement on racial injustice.; Behavioral: White Sender in Acknowledgement; Investigators will also vary the messenger of the acknowledgement sender. In this arm, participants receive a white sender in the acknowledgement; Behavioral: White Sender in Informational Videos; Investigators will vary the messenger of the informational covid-19 videos. In this arm, participants receive white sender in the informational video; Behavioral: Placebo videos; Videos not related to covid-19 will be shown
Placebo Comparator: Control: AMA DP - B - B Respondents will be randomized to an AMA statement acknowledging drug pricing read by an African American individual. The messenger / doctor in the follow-up AMA videos will also be African American - No message on Covid-19 will be shown. African American Sender Acknowledgement: Investigators will also vary the messenger of the acknowledgement sender. In this arm participants receive a African American sender in acknowledgment of AMA AMA Acknowledgement Drug Pricing: Investigators will examine whether acknowledgements of racial inequality are helpful towards improving knowledge retention and behaviors associated with the intervention among participants. In this arm, participants receive AMA information on drug pricing	Behavioral: African American Sender Acknowledgement; Investigators will also vary the messenger of the acknowledgement sender. In this arm participants receive a African American sender in acknowledgment of AMA; Behavioral: African American Sender in Informational Videos.; Investigators will vary the sender of the informational covid-19 videos. In this arm, participants receive a African American sender in informational videos.; Behavioral: AMA Acknowledgement Drug Pricing; Investigators will examine whether acknowledgements of racial inequality are helpful towards improving knowledge retention and behaviors associated with the intervention among participants. In this arm, participants receive AMA information on drug pricing; Behavioral: Placebo videos; Videos not related to covid-19 will be shown
Placebo Comparator: Control: AMA DP - W - W Respondents will be randomized to an AMA statement acknowledging drug pricing read by a white individual. The messenger / doctor in the follow-up AMA videos will also be white - No message on Covid-19 will be shown. White Sender Acknowledgement: Investigators will also vary the messenger of the acknowledgement sender. In this arm participants receive a white sender in acknowledgment of AMA AMA Acknowledgement Drug Pricing: Investigators will examine whether acknowledgements of racial inequality are helpful towards improving knowledge retention and behaviors associated with the intervention among participants. In this arm, participants receive AMA information on drug pricing	Behavioral: AMA Acknowledgement Drug Pricing; Investigators will examine whether acknowledgements of racial inequality are helpful towards improving knowledge retention and behaviors associated with the intervention among participants. In this arm, participants receive AMA information on drug pricing; Behavioral: White Sender in Acknowledgement; Investigators will also vary the messenger of the acknowledgement sender. In this arm, participants receive a white sender in the acknowledgement; Behavioral: White Sender in Informational Videos; Investigators will vary the messenger of the informational covid-19 videos. In this arm, participants receive white sender in the informational video; Behavioral: Placebo videos; Videos not related to covid-19 will be shown

Outcome Measures

Primary Outcome Measures

1. Incidence Rate for Knowledge Gaps: Control vs. Any Intervention [The outcome was measured immediately following the intervention in the baseline survey.]

   Participants were asked to identify ways to prevent COVID-19 spread and identify four common symptoms. The incidence rate for knowledge gaps is the count of knowledge gaps divided by the maximum possible count: 10.

2. Incidence Rate for Knowledge Gaps: Control vs. Any Intervention - Follow up [The outcome was measured at a follow-up within 2 weeks following the intervention]

   Participants were asked to identify ways to prevent COVID-19 spread and identify four common symptoms. Incidence rate for knowledge gaps is the count of knowledge gaps divided by the maximum possible count: 10.

3. Incidence Rate for Information-seeking Behavior: Control vs. Any Intervention [The outcome was measured immediately following the intervention in the baseline survey.]

   Participants were offered the option of requesting additional information on COVID-19 related resources by clicking on up to five links that included more content. We measured "information seeking behavior" as the number of links for which participants expressed interest, a count variable between 0 (lowest information seeking behavior) and 5 (greatest information seeking behavior). Incidence rate for interest in links is the count of links demanded divided by the maximum possible count: 5.

4. Incidence Rate - Safety Gap Score: Control vs. Any Intervention [The outcome was measured at a follow-up within 2 weeks following the intervention.]

   Participants were asked about how often they engaged in four behaviors of interest: if they wore a mask indoors/outdoors; if they washed their hands; if they followed social distancing guidelines. The safety gap index takes values of 0 (if a participant reported that they always practiced the four behaviors of interest) up to 4 (none). Incidence rate for safety gaps is the count of safety gaps divided by the maximum possible count: 4.

5. Willingness to Pay (WTP) for Masks: Control vs. Any Intervention [The outcome was measured immediately following the intervention in the baseline survey.]

   WTP: the participants will be asked to choose between two masks vs an unrestricted gift card. They will be asked what amount of gift card would make them just as happy to receive two mask versus the gift card.

6. Incidence Rate Ratio (IRR) - Knowledge Gap [The outcome was measured immediately following the intervention in the baseline survey.]

   Participants were asked to identify ways to prevent COVID-19 spread and identify four common symptoms. The incidence rate for knowledge gaps is the count of knowledge gaps divided by the maximum possible count: 10. The incidence rate ratio compares the incidence rate of participants in Arm A vs. Arm B within the intervention group (i.e. those who received covid-19-related videos), within in the control group (i.e. those who saw placebo videos), or across the intervention and control group. Arms A and B are described in each Arm/Group Title. The overall number of participants analyzed is all equal across 6 arms/groups because the outcome measure data presented below came from a single negative binomial regression.

7. Incidence Rate Ratio (IRR) - Knowledge Gap - Follow up [The outcome was measured at a follow-up within 2 weeks following the intervention]

   Participants were asked to identify ways to prevent COVID-19 spread and identify four common symptoms. The incidence rate for knowledge gaps is the count of knowledge gaps divided by the maximum possible count: 10. The incidence rate ratio compares the incidence rate of participants in Arm A vs. Arm B within the intervention group (i.e. those who received covid-19-related videos), within in the control group (i.e. those who saw placebo videos), or across the intervention and control group. Arms A and B are described in each Arm/Group Title. The overall number of participants analyzed is all equal across 6 arms/groups because the outcome measure data presented below came from a single negative binomial regression.

8. Incidence Rate Ratio (IRR) - Information-seeking Behavior [The outcome was measured immediately following the intervention in the baseline survey.]

   Participants were offered the option of requesting additional information on COVID-19 related resources by clicking on up to 5 links that included more content. We measured "information seeking behavior" as the number of links for which participants expressed interest, a count variable between 0 (lowest information seeking behavior) and 5 (greatest information seeking behavior). Incidence rate for interest in links is the count of links demanded divided by the maximum possible count: 5. The incidence rate ratio compares the incidence rate of participants in Arm A vs. Arm B within the intervention group (i.e. those who received covid-19-related videos), within in the control group (i.e. those who saw placebo videos), or across the intervention and control group. Arms A and B are described in each Arm/Group Title. The overall number of participants analyzed is all equal across 6 arms/groups because the outcome measure data presented below came from a single negative binomial regression.

9. Incidence Rate Ratio (IRR) - Safety Gap Score [The outcome was measured at a follow-up within 2 weeks following the intervention.]

   Participants were asked about how often they engaged in four behaviors of interest: if they wore a mask indoors/outdoors; if they washed their hands; if they followed social distancing guidelines. The safety gap index takes values of 0 (if a participant reported that they always practiced the four behaviors of interest) up to 4 (none). Incidence rate for safety gaps is the count of safety gaps divided by the maximum possible count: 4. The incidence rate ratio compares the incidence rate of participants in Arm A vs. Arm B within the intervention group (i.e. those who received covid-19-related videos), within in the control group (i.e. those who saw placebo videos), or across the intervention and control group. Arms A and B are described in each Arm/Group Title. The overall number of participants analyzed is all equal across 6 arms/groups because the outcome measure data presented below came from a single negative binomial regression.

10. OLS Regression Coefficients - Willingness to Pay (WTP) for Masks [The outcome was measured immediately following the intervention in the baseline survey.]

    WTP: the participants will be asked to choose between two masks vs an unrestricted gift card. They will be asked what amount of gift card would make them just as happy to receive two mask versus the gift card. The regression coefficients compares the incidence rate of participants in Arm A vs. Arm B within the intervention group (i.e. those who received covid-19-related videos), within in the control group (i.e. those who saw placebo videos), or across the intervention and control group. Arms A and B are described in each Arm/Group Title. The overall number of participants analyzed is all equal across 6 arms/groups because the outcome measure data presented below came from a single ordinary least squares (OLS) regression for WTP masks).

Eligibility Criteria

Criteria

• Ages Eligible for Study: 18 Years and Older
• Sexes Eligible for Study: All
• Accepts Healthy Volunteers: Yes

Inclusion Criteria:

• adults who self-identify as African American or white.

• an oversample of individuals with less than a college education

Exclusion Criteria:

Contacts and Locations

Locations

	Site	City	State	Country	Postal Code
1	JPAL North America	Cambridge	Massachusetts	United States	02138

Sponsors and Collaborators

• National Bureau of Economic Research, Inc.
• Massachusetts General Hospital
• Stanford University
• Yale University
• Harvard University

Investigators

None specified.

Study Documents (Full-Text)

• Study Protocol and Statistical Analysis Plan - Sep 4, 2020

More Information

Publications

None provided.

• Responsible Party: Esther Duflo, Abdul Latif Jameel Professor of Poverty Alleviation and Development Economics, MIT; Co-Director, Abdul Latif Jameel Poverty Action Lab, National Bureau of Economic Research, Inc.
• ClinicalTrials.gov Identifier: NCT04502056
• Other Study ID Numbers: 2029880
• First Posted: Aug 6, 2020
• Last Update Posted: Jul 27, 2021
• Last Verified: Jul 1, 2021

• Studies a U.S. FDA-regulated Drug Product: No
• Studies a U.S. FDA-regulated Device Product: No
• Additional relevant MeSH terms: COVID-19

Study Results

Participant Flow

Arm/Group Title	Intervention: AMA RI - B- B - R	Intervention: AMA RI - B - B - N	Intervention: AMA RI - W - W - R	Intervention: AMA RI - W - W - N	Intervention: AMA DP - B- B - R	Intervention: AMA DP - B- B - N	Intervention: AMA DP - W- W - R	Intervention: AMA DP - W- W - N	Control: AMA RI - B - B	Control: AMA RI - W - W	Control: AMA DP - B - B	Control: AMA DP - W - W
Arm/Group Description	Respondents will be randomized to an AMA statement acknowledging racial injustice read by an African American individual. The messenger / doctor in the follow-up AMA videos will also be African American - the message on Covid-19 will include information on the disproportionate impact on communities of color . Acknowledgement Racial Injustice AMA: Investigators will examine whether acknowledgements of racial inequality are helpful towards improving knowledge retention and behaviors associated with the intervention among participants. In this arm, participants will receive a AMA statement on racial injustice. African American Sender Acknowledgement: Investigators will also vary the messenger of the acknowledgement sender. In this arm participants receive a African American sender in acknowledgment of AMA African American Sender in Informational Videos.: Investigators will vary the sender of the informational covid-19 videos. In this arm, participants receive a African American sender in informational videos. Racial Inequality Highlighted: Investigators will include information on race-specific covid-19 cases and deaths in one variation in the messaging. In this arm, participants receive disproportionate race-specific Covid-19 facts	Respondents will be randomized to an AMA statement acknowledging racial injustice read by an African American individual. The messenger / doctor in the follow-up AMA videos will also be African American - the message on Covid-19 will not include information on the disproportionate impact on communities of color. Acknowledgement Racial Injustice AMA: Investigators will examine whether acknowledgements of racial inequality are helpful towards improving knowledge retention and behaviors associated with the intervention among participants. In this arm, participants will receive a AMA statement on racial injustice. African American Sender Acknowledgement: Investigators will also vary the messenger of the acknowledgement sender. In this arm participants receive a African American sender in acknowledgment of AMA African American Sender in Informational Videos.: Investigators will vary the sender of the informational covid-19 videos. In this arm, participants receive a African American sender in informational videos. No Racial Inequality Highlighting: In this arm, the disproportionate burden of Covid-19 on communities of color will not be highlighted	Respondents will be randomized to an AMA statement acknowledging racial injustice read by a white individual. The messenger / doctor in the follow-up AMA videos will be white - the message on Covid-19 will include information on the disproportionate impact on communities of color. Acknowledgement Racial Injustice AMA: Investigators will examine whether acknowledgements of racial inequality are helpful towards improving knowledge retention and behaviors associated with the intervention among participants. In this arm, participants will receive a AMA statement on racial injustice. Racial Inequality Highlighted: Investigators will include information on race-specific covid-19 cases and deaths in one variation in the messaging. In this arm, participants receive disproportionate race-specific Covid-19 facts White Sender in Acknowledgement: Investigators will also vary the messenger of the acknowledgement sender. In this arm, participants receive a white sender in the acknowledgement White Sender in Informational Videos: Investigators will vary the messenger of the informational covid-19 videos. In this arm, participants receive white sender in the informational video	Respondents will be randomized to an AMA statement acknowledging racial injustice read by a white individual. The messenger / doctor in the follow-up AMA videos will be white - the message on Covid-19 will not include information on the disproportionate impact on communities of color. Acknowledgement Racial Injustice AMA: Investigators will examine whether acknowledgements of racial inequality are helpful towards improving knowledge retention and behaviors associated with the intervention among participants. In this arm, participants will receive a AMA statement on racial injustice. White Sender in Acknowledgement: Investigators will also vary the messenger of the acknowledgement sender. In this arm, participants receive a white sender in the acknowledgement White Sender in Informational Videos: Investigators will vary the messenger of the informational covid-19 videos. In this arm, participants receive white sender in the informational video No Racial Inequality Highlighting: In this arm, the disproportionate burden of Covid-19 on communities of color will not be highlighted	Respondents will be randomized to an AMA statement acknowledging drug pricing read by an African American individual. The messenger / doctor in the follow-up AMA videos will also be African American - the message on Covid-19 will include information on the disproportionate impact on communities of color . African American Sender Acknowledgement: Investigators will also vary the messenger of the acknowledgement sender. In this arm participants receive a African American sender in acknowledgment of AMA African American Sender in Informational Videos.: Investigators will vary the sender of the informational covid-19 videos. In this arm, participants receive a African American sender in informational videos. Racial Inequality Highlighted: Investigators will include information on race-specific covid-19 cases and deaths in one variation in the messaging. In this arm, participants receive disproportionate race-specific Covid-19 facts AMA Acknowledgement Drug Pricing: Investigators will examine whether acknowledgements of racial inequality are helpful towards improving knowledge retention and behaviors associated with the intervention among participants. In this arm, participants receive AMA information on drug pricing	Respondents will be randomized to an AMA statement acknowledging drug pricing read by an African American individual. The messenger / doctor in the follow-up AMA videos will also be African American - the message on Covid-19 will not include information on the disproportionate impact on communities of color. African American Sender Acknowledgement: Investigators will also vary the messenger of the acknowledgement sender. In this arm participants receive a African American sender in acknowledgment of AMA African American Sender in Informational Videos.: Investigators will vary the sender of the informational covid-19 videos. In this arm, participants receive a African American sender in informational videos. AMA Acknowledgement Drug Pricing: Investigators will examine whether acknowledgements of racial inequality are helpful towards improving knowledge retention and behaviors associated with the intervention among participants. In this arm, participants receive AMA information on drug pricing No Racial Inequality Highlighting: In this arm, the disproportionate burden of Covid-19 on communities of color will not be highlighted	Respondents will be randomized to an AMA statement acknowledging drug pricing read by a white individual. The messenger / doctor in the follow-up AMA videos will be white - the message on Covid-19 will include information on the disproportionate impact on communities of color. Racial Inequality Highlighted: Investigators will include information on race-specific covid-19 cases and deaths in one variation in the messaging. In this arm, participants receive disproportionate race-specific Covid-19 facts AMA Acknowledgement Drug Pricing: Investigators will examine whether acknowledgements of racial inequality are helpful towards improving knowledge retention and behaviors associated with the intervention among participants. In this arm, participants receive AMA information on drug pricing White Sender in Acknowledgement: Investigators will also vary the messenger of the acknowledgement sender. In this arm, participants receive a white sender in the acknowledgement White Sender in Informational Videos: Investigators will vary the messenger of the informational covid-19 videos. In this arm, participants receive white sender in the informational video	Respondents will be randomized to an AMA statement acknowledging drug pricing read by a white individual. The messenger / doctor in the follow-up AMA videos will be white - the message on Covid-19 will not include information on the disproportionate impact on communities of color. AMA Acknowledgement Drug Pricing: Investigators will examine whether acknowledgements of racial inequality are helpful towards improving knowledge retention and behaviors associated with the intervention among participants. In this arm, participants receive AMA information on drug pricing White Sender in Acknowledgement: Investigators will also vary the messenger of the acknowledgement sender. In this arm, participants receive a white sender in the acknowledgement White Sender in Informational Videos: Investigators will vary the messenger of the informational covid-19 videos. In this arm, participants receive white sender in the informational video No Racial Inequality Highlighting: In this arm, the disproportionate burden of Covid-19 on communities of color will not be highlighted	Respondents will be randomized to an AMA statement acknowledging racial injustice read by an African American individual. The messenger / doctor in the follow-up AMA videos will also be African American - No message on Covid-19 will be shown. Acknowledgement Racial Injustice AMA: Investigators will examine whether acknowledgements of racial inequality are helpful towards improving knowledge retention and behaviors associated with the intervention among participants. In this arm, participants will receive a AMA statement on racial injustice. African American Sender Acknowledgement: Investigators will also vary the messenger of the acknowledgement sender. In this arm participants receive a African American sender in acknowledgment of AMA	Respondents will be randomized to an AMA statement acknowledging racial injustice read by a white individual. The messenger / doctor in the follow-up AMA videos will also be white - No message on Covid-19 will be shown. Acknowledgement Racial Injustice AMA: Investigators will examine whether acknowledgements of racial inequality are helpful towards improving knowledge retention and behaviors associated with the intervention among participants. In this arm, participants will receive a AMA statement on racial injustice. White Sender Acknowledgement: Investigators will also vary the messenger of the acknowledgement sender. In this arm participants receive a white sender in acknowledgment of AMA	Respondents will be randomized to an AMA statement acknowledging drug pricing read by an African American individual. The messenger / doctor in the follow-up AMA videos will also be African American - No message on Covid-19 will be shown. African American Sender Acknowledgement: Investigators will also vary the messenger of the acknowledgement sender. In this arm participants receive a African American sender in acknowledgment of AMA AMA Acknowledgement Drug Pricing: Investigators will examine whether acknowledgements of racial inequality are helpful towards improving knowledge retention and behaviors associated with the intervention among participants. In this arm, participants receive AMA information on drug pricing	Respondents will be randomized to an AMA statement acknowledging drug pricing read by a white individual. The messenger / doctor in the follow-up AMA videos will also be white - No message on Covid-19 will be shown. White Sender Acknowledgement: Investigators will also vary the messenger of the acknowledgement sender. In this arm participants receive a white sender in acknowledgment of AMA AMA Acknowledgement Drug Pricing: Investigators will examine whether acknowledgements of racial inequality are helpful towards improving knowledge retention and behaviors associated with the intervention among participants. In this arm, participants receive AMA information on drug pricing
Period Title: Overall Study
STARTED	2046	2044	2045	2046	2044	2052	2046	2043	1026	1025	1023	1020
Completed the Knowledge Questions, Included for the Knowledge Gaps Analysis	1859	1881	1879	1886	1846	1877	1888	1883	947	942	946	928
Completed the Entire Survey, Included for All Analysis Besides Knowledge Gaps, Except Follow-up	1799	1828	1830	1835	1792	1820	1821	1844	914	912	928	900
Completed the Follow-up Survey	608	607	591	601	631	598	607	607	301	313	291	316
COMPLETED	604	602	586	597	626	596	605	603	298	311	288	614
NOT COMPLETED	1442	1442	1459	1449	1418	1456	1441	1440	728	714	735	406

Baseline Characteristics

Arm/Group Title	Intervention	Control	Total
Arm/Group Description	Participants who are assigned to any intervention groups	Participants who are assigned to a control group	Total of all reporting groups
Overall Participants	14145	3544	17689
Age (years) [Mean (Standard Deviation) ]
Mean (Standard Deviation) [years]	40.20 (17.83)	40.30 (17.73)	40.22 (17.81)
Sex: Female, Male (Count of Participants)
Female	7907 55.9%	1973 55.7%	9880 55.9%
Male	6238 44.1%	1571 44.3%	7809 44.1%
Race (NIH/OMB) (Count of Participants)
American Indian or Alaska Native	0 0%	0 0%	0 0%
Asian	0 0%	0 0%	0 0%
Native Hawaiian or Other Pacific Islander	0 0%	0 0%	0 0%
Black or African American	6303 44.6%	1576 44.5%	7879 44.5%
White	7842 55.4%	1968 55.5%	9810 55.5%
More than one race	0 0%	0 0%	0 0%
Unknown or Not Reported	0 0%	0 0%	0 0%
Region of Enrollment (Count of Participants)
Northeast, United States	2424 17.1%	600 16.9%	3024 17.1%
Midwest, United States	3114 22%	770 21.7%	3884 22%
South, United States	6397 45.2%	1649 46.5%	8046 45.5%
West, United States	2210 15.6%	525 14.8%	2735 15.5%
High school graduate (Count of Participants)
Count of Participants [Participants]	12009 84.9%	3007 84.8%	15016 84.9%
Household income above 60k (Count of Participants)
Count of Participants [Participants]	3356 23.7%	850 24%	4206 23.8%
Party Affiliation (Count of Participants)
Democrat	5594 39.5%	1383 39%	6977 39.4%
Republican	3494 24.7%	882 24.9%	4376 24.7%
Independent	5057 35.8%	1279 36.1%	6336 35.8%
Preventive practices: mask in (always) (Count of Participants)
Count of Participants [Participants]	9648 68.2%	2458 69.4%	12106 68.4%
Preventive practices: mask out (always) (Count of Participants)
Count of Participants [Participants]	4408 31.2%	1109 31.3%	5517 31.2%
Preventive practices: wash hands (always) (Count of Participants)
Count of Participants [Participants]	8688 61.4%	2091 59%	10779 60.9%
Preventive practices: distance (always) (Count of Participants)
Count of Participants [Participants]	7571 53.5%	1890 53.3%	9461 53.5%

Outcome Measures

1. Primary Outcome

Title	Incidence Rate for Knowledge Gaps: Control vs. Any Intervention
Description	Participants were asked to identify ways to prevent COVID-19 spread and identify four common symptoms. The incidence rate for knowledge gaps is the count of knowledge gaps divided by the maximum possible count: 10.
Time Frame	The outcome was measured immediately following the intervention in the baseline survey.

Outcome Measure Data

Analysis Population Description

Any intervention was indeed an arm that included each sub arm of different types of message that we tested against a control and pre-specified in our study protocol and analysis plan to combine arms for analysis.

Arm/Group Title	Intervention	Control
Arm/Group Description	Participants who are assigned to any intervention groups	Participants who are assigned to a control group
Measure Participants	14999	3763
Mean (95% Confidence Interval) [proportion of knowledge gaps]	0.214	0.241

2. Primary Outcome

Title	Incidence Rate for Knowledge Gaps: Control vs. Any Intervention - Follow up
Description	Participants were asked to identify ways to prevent COVID-19 spread and identify four common symptoms. Incidence rate for knowledge gaps is the count of knowledge gaps divided by the maximum possible count: 10.
Time Frame	The outcome was measured at a follow-up within 2 weeks following the intervention

Outcome Measure Data

Analysis Population Description

Any intervention was indeed an arm that included each sub arm of different types of message that we tested against a control and pre-specified in our study protocol and analysis plan to combine arms for analysis.

Arm/Group Title	Intervention	Control
Arm/Group Description	Participants who are assigned to any intervention groups	Participants who are assigned to a control group
Measure Participants	4819	1211
Mean (95% Confidence Interval) [proportion of knowledge gaps]	0.241	0.250

3. Primary Outcome

Title	Incidence Rate for Information-seeking Behavior: Control vs. Any Intervention
Description	Participants were offered the option of requesting additional information on COVID-19 related resources by clicking on up to five links that included more content. We measured "information seeking behavior" as the number of links for which participants expressed interest, a count variable between 0 (lowest information seeking behavior) and 5 (greatest information seeking behavior). Incidence rate for interest in links is the count of links demanded divided by the maximum possible count: 5.
Time Frame	The outcome was measured immediately following the intervention in the baseline survey.

Outcome Measure Data

Analysis Population Description

Any intervention was indeed an arm that included each sub arm of different types of message that we tested against a control and pre-specified in our study protocol and analysis plan to combine arms for analysis.

Arm/Group Title	Intervention	Control
Arm/Group Description	Participants who are assigned to any intervention groups	Participants who are assigned to a control group
Measure Participants	14569	3654
Mean (95% Confidence Interval) [proportion of links]	0.338	0.320

4. Primary Outcome

Title	Incidence Rate - Safety Gap Score: Control vs. Any Intervention
Description	Participants were asked about how often they engaged in four behaviors of interest: if they wore a mask indoors/outdoors; if they washed their hands; if they followed social distancing guidelines. The safety gap index takes values of 0 (if a participant reported that they always practiced the four behaviors of interest) up to 4 (none). Incidence rate for safety gaps is the count of safety gaps divided by the maximum possible count: 4.
Time Frame	The outcome was measured at a follow-up within 2 weeks following the intervention.

Outcome Measure Data

Analysis Population Description

Any intervention was indeed an arm that included each sub arm of different types of message that we tested against a control and pre-specified in our study protocol and analysis plan to combine arms for analysis.

Arm/Group Title	Intervention	Control
Arm/Group Description	Participants who are assigned to any intervention groups	Participants who are assigned to a control group
Measure Participants	4823	1212
Mean (95% Confidence Interval) [proportion of safety gaps]	0.450	0.465

5. Primary Outcome

Title	Willingness to Pay (WTP) for Masks: Control vs. Any Intervention
Description	WTP: the participants will be asked to choose between two masks vs an unrestricted gift card. They will be asked what amount of gift card would make them just as happy to receive two mask versus the gift card.
Time Frame	The outcome was measured immediately following the intervention in the baseline survey.

Outcome Measure Data

Analysis Population Description

Any intervention was indeed an arm that included each sub arm of different types of message that we tested against a control and pre-specified in our study protocol and analysis plan to combine arms for analysis.

Arm/Group Title	Intervention	Control
Arm/Group Description	Participants who are assigned to any intervention groups	Participants who are assigned to a control group
Measure Participants	13399	3360
Mean (95% Confidence Interval) [dollar]	14.580	14.072

6. Primary Outcome

Title	Incidence Rate Ratio (IRR) - Knowledge Gap
Description	Participants were asked to identify ways to prevent COVID-19 spread and identify four common symptoms. The incidence rate for knowledge gaps is the count of knowledge gaps divided by the maximum possible count: 10. The incidence rate ratio compares the incidence rate of participants in Arm A vs. Arm B within the intervention group (i.e. those who received covid-19-related videos), within in the control group (i.e. those who saw placebo videos), or across the intervention and control group. Arms A and B are described in each Arm/Group Title. The overall number of participants analyzed is all equal across 6 arms/groups because the outcome measure data presented below came from a single negative binomial regression.
Time Frame	The outcome was measured immediately following the intervention in the baseline survey.

Outcome Measure Data

Analysis Population Description

Arms were combined to assess the differential effectiveness of each unique video message by comparing participants in Arm A vs. Arm B, since Arm A cut across several other studies: within the intervention group; or within the control group; or across the intervention and control groups. Arms A and B are described in each Arm/Group Title.

Arm/Group Title	Within Intervention Group: Black Physician (Arm A) vs. White Physician (Arm B)	Within Intervention Group: AMA Anti-racism (Arm A) vs. Either/Neither (Arm B)	Within Intervention Group: Doctor Racial Disparity (Arm A) vs. Either/Neither (Arm B)	Within Control Group: Black Physician (Arm A) vs. White Physician (Arm B)	Within Control Group: AMA Anti-racism vs. Either/Neither	Intervention Group vs. Control Group
Arm/Group Description	The relative IRR for intervention participants who saw a message delivered by a Black doctor and saw covid-19-related messages vs. those who did not see either or neither of the messages.	The relative IRR for intervention participants who saw the AMA anti-racism treatment and saw covid-19-related messages vs. those who did not see either or neither of the messages.	The relative IRR for intervention participants who saw the message on the relative incidence of COVID-19 among Black and white individuals and saw covid-19-related messages vs. those who did not see either or neither of the messages.	The relative IRR for intervention participants who saw a Black doctor vs. white doctor	The relative IRR for intervention participants who saw the AMA anti-racism treatment vs. those who saw the placebo message.	The relative IRR for intervention participants who saw covid-related messages vs. those who did not see any covid-19 related messages.
Measure Participants	18762	18762	18762	18762	18762	18762
Number (95% Confidence Interval) [ratio]	1.01	0.99	1.01	0.99	0.99	0.89

7. Primary Outcome

Title	Incidence Rate Ratio (IRR) - Knowledge Gap - Follow up
Description	Participants were asked to identify ways to prevent COVID-19 spread and identify four common symptoms. The incidence rate for knowledge gaps is the count of knowledge gaps divided by the maximum possible count: 10. The incidence rate ratio compares the incidence rate of participants in Arm A vs. Arm B within the intervention group (i.e. those who received covid-19-related videos), within in the control group (i.e. those who saw placebo videos), or across the intervention and control group. Arms A and B are described in each Arm/Group Title. The overall number of participants analyzed is all equal across 6 arms/groups because the outcome measure data presented below came from a single negative binomial regression.
Time Frame	The outcome was measured at a follow-up within 2 weeks following the intervention

Outcome Measure Data

Analysis Population Description

Arms were combined to assess the differential effectiveness of each unique video message by comparing participants in Arm A vs. Arm B, since Arm A cut across several other studies: within the intervention group; or within the control group; or across the intervention and control groups. Arms A and B are described in each Arm/Group Title.

Arm/Group Title	Within Intervention Group: Black Physician (Arm A) vs. White Physician (Arm B)	Within Intervention Group: AMA Anti-racism (Arm A) vs. Either/Neither (Arm B)	Within Intervention Group: Doctor Racial Disparity (Arm A) vs. Either/Neither (Arm B)	Within Control Group: Black Physician (Arm A) vs. White Physician (Arm B)	Within Control Group: AMA Anti-racism vs. Either/Neither	Intervention Group vs. Control Group
Arm/Group Description	The relative IRR for intervention participants who saw a message delivered by a Black doctor and saw covid-19-related messages vs. those who did not see either or neither of the messages.	The relative IRR for intervention participants who saw the AMA anti-racism treatment and saw covid-19-related messages vs. those who did not see either or neither of the messages.	The relative IRR for intervention participants who saw the message on the relative incidence of COVID-19 among Black and white individuals and saw covid-19-related messages vs. those who did not see either or neither of the messages.	The relative IRR for intervention participants who saw a Black doctor vs. white doctor	The relative IRR for intervention participants who saw the AMA anti-racism treatment vs. those who saw the placebo message.	The relative IRR for intervention participants who saw covid-related messages vs. those who did not see any covid-19 related messages.
Measure Participants	6030	6030	6030	6030	6030	6030
Number (95% Confidence Interval) [ratio]	0.98	0.98	1.01	1.01	0.98	0.97

8. Primary Outcome

Title	Incidence Rate Ratio (IRR) - Information-seeking Behavior
Description	Participants were offered the option of requesting additional information on COVID-19 related resources by clicking on up to 5 links that included more content. We measured "information seeking behavior" as the number of links for which participants expressed interest, a count variable between 0 (lowest information seeking behavior) and 5 (greatest information seeking behavior). Incidence rate for interest in links is the count of links demanded divided by the maximum possible count: 5. The incidence rate ratio compares the incidence rate of participants in Arm A vs. Arm B within the intervention group (i.e. those who received covid-19-related videos), within in the control group (i.e. those who saw placebo videos), or across the intervention and control group. Arms A and B are described in each Arm/Group Title. The overall number of participants analyzed is all equal across 6 arms/groups because the outcome measure data presented below came from a single negative binomial regression.
Time Frame	The outcome was measured immediately following the intervention in the baseline survey.

Outcome Measure Data

Analysis Population Description

Arms were combined to assess the differential effectiveness of each unique video message by comparing participants in Arm A vs. Arm B, since Arm A cut across several other studies: within the intervention group; or within the control group; or across the intervention and control groups. Arms A and B are described in each Arm/Group Title.

Arm/Group Title	Within Intervention Group: Black Physician (Arm A) vs. White Physician (Arm B)	Within Intervention Group: AMA Anti-racism (Arm A) vs. Either/Neither (Arm B)	Within Intervention Group: Doctor Racial Disparity (Arm A) vs. Either/Neither (Arm B)	Within Control Group: Black Physician (Arm A) vs. White Physician (Arm B)	Within Control Group: AMA Anti-racism vs. Either/Neither	Intervention Group vs. Control Group
Arm/Group Description	The relative IRR for intervention participants who saw a message delivered by a Black doctor and saw covid-19-related messages vs. those who did not see either or neither of the messages.	The relative IRR for intervention participants who saw the AMA anti-racism treatment and saw covid-19-related messages vs. those who did not see either or neither of the messages.	The relative IRR for intervention participants who saw the message on the relative incidence of COVID-19 among Black and white individuals and saw covid-19-related messages vs. those who did not see either or neither of the messages.	The relative IRR for intervention participants who saw a Black doctor vs. white doctor	The relative IRR for intervention participants who saw the AMA anti-racism treatment vs. those who saw the placebo message.	The relative IRR for intervention participants who saw covid-related messages vs. those who did not see any covid-19 related messages.
Measure Participants	18223	18223	18223	18223	18223	18223
Number (95% Confidence Interval) [ratio]	1.04	1.03	1.02	0.96	0.97	1.01

9. Primary Outcome

Title	Incidence Rate Ratio (IRR) - Safety Gap Score
Description	Participants were asked about how often they engaged in four behaviors of interest: if they wore a mask indoors/outdoors; if they washed their hands; if they followed social distancing guidelines. The safety gap index takes values of 0 (if a participant reported that they always practiced the four behaviors of interest) up to 4 (none). Incidence rate for safety gaps is the count of safety gaps divided by the maximum possible count: 4. The incidence rate ratio compares the incidence rate of participants in Arm A vs. Arm B within the intervention group (i.e. those who received covid-19-related videos), within in the control group (i.e. those who saw placebo videos), or across the intervention and control group. Arms A and B are described in each Arm/Group Title. The overall number of participants analyzed is all equal across 6 arms/groups because the outcome measure data presented below came from a single negative binomial regression.
Time Frame	The outcome was measured at a follow-up within 2 weeks following the intervention.

Outcome Measure Data

Analysis Population Description

Arms were combined to assess the differential effectiveness of each unique video message by comparing participants in Arm A vs. Arm B, since Arm A cut across several other studies: within the intervention group; or within the control group; or across the intervention and control groups. Arms A and B are described in each Arm/Group Title.

Arm/Group Title	Within Intervention Group: Black Physician (Arm A) vs. White Physician (Arm B)	Within Intervention Group: AMA Anti-racism (Arm A) vs. Either/Neither (Arm B)	Within Intervention Group: Doctor Racial Disparity (Arm A) vs. Either/Neither (Arm B)	Within Control Group: Black Physician (Arm A) vs. White Physician (Arm B)	Within Control Group: AMA Anti-racism vs. Either/Neither	Intervention Group vs. Control Group
Arm/Group Description	The relative IRR for intervention participants who saw a message delivered by a Black doctor and saw covid-19-related messages vs. those who did not see either or neither of the messages.	The relative IRR for intervention participants who saw the AMA anti-racism treatment and saw covid-19-related messages vs. those who did not see either or neither of the messages.	The relative IRR for intervention participants who saw the message on the relative incidence of COVID-19 among Black and white individuals and saw covid-19-related messages vs. those who did not see either or neither of the messages.	The relative IRR for intervention participants who saw a Black doctor vs. white doctor	The relative IRR for intervention participants who saw the AMA anti-racism treatment vs. those who saw the placebo message.	The relative IRR for intervention participants who saw covid-related messages vs. those who did not see any covid-19 related messages.
Measure Participants	6035	6035	6035	6035	6035	6035
Number (95% Confidence Interval) [ratio]	1.04	1.03	1.01	0.97	0.95	0.93

10. Primary Outcome

Title	OLS Regression Coefficients - Willingness to Pay (WTP) for Masks
Description	WTP: the participants will be asked to choose between two masks vs an unrestricted gift card. They will be asked what amount of gift card would make them just as happy to receive two mask versus the gift card. The regression coefficients compares the incidence rate of participants in Arm A vs. Arm B within the intervention group (i.e. those who received covid-19-related videos), within in the control group (i.e. those who saw placebo videos), or across the intervention and control group. Arms A and B are described in each Arm/Group Title. The overall number of participants analyzed is all equal across 6 arms/groups because the outcome measure data presented below came from a single ordinary least squares (OLS) regression for WTP masks).
Time Frame	The outcome was measured immediately following the intervention in the baseline survey.

Outcome Measure Data

Analysis Population Description

Arms were combined to assess the differential effectiveness of each unique video message by comparing participants in Arm A vs. Arm B, since Arm A cut across several other studies: within the intervention group; or within the control group; or across the intervention and control groups. Arms A and B are described in each Arm/Group Title.

Arm/Group Title	Within Intervention Group: Black Physician (Arm A) vs. White Physician (Arm B)	Within Intervention Group: AMA Anti-racism (Arm A) vs. Either/Neither (Arm B)	Within Intervention Group: Doctor Racial Disparity (Arm A) vs. Either/Neither (Arm B)	Within Control Group: Black Physician (Arm A) vs. White Physician (Arm B)	Within Control Group: AMA Anti-racism vs. Either/Neither	Intervention Group vs. Control Group
Arm/Group Description	The relative IRR for intervention participants who saw a message delivered by a Black doctor and saw covid-19-related messages vs. those who did not see either or neither of the messages.	The relative IRR for intervention participants who saw the AMA anti-racism treatment and saw covid-19-related messages vs. those who did not see either or neither of the messages.	The relative IRR for intervention participants who saw the message on the relative incidence of COVID-19 among Black and white individuals and saw covid-19-related messages vs. those who did not see either or neither of the messages.	The relative IRR for intervention participants who saw a Black doctor vs. white doctor	The relative IRR for intervention participants who saw the AMA anti-racism treatment vs. those who saw the placebo message.	The relative IRR for intervention participants who saw covid-related messages vs. those who did not see any covid-19 related messages.
Measure Participants	16759	16759	16759	16759	16759	16759
Number (95% Confidence Interval) [dollar]	-0.21	-0.29	0.07	0.17	0.32	0.71

Adverse Events

Time Frame	31 days
Arm/Group Title	Intervention: AMA RI - B- B - R		Intervention: AMA RI - B - B - N		Intervention: AMA RI - W - W - R		Intervention: AMA RI - W - W - N		Intervention: AMA DP - B- B - R		Intervention: AMA DP - B- B - N		Intervention: AMA DP - W- W - R		Intervention: AMA DP - W- W - N		Control: AMA RI - B - B		Control: AMA RI - W - W		Control: AMA DP - B - B		Control: AMA DP - W - W
Arm/Group Description	Respondents will be randomized to an AMA statement acknowledging racial injustice read by an African American individual. The messenger / doctor in the follow-up AMA videos will also be African American - the message on Covid-19 will include information on the disproportionate impact on communities of color . Acknowledgement Racial Injustice AMA: Investigators will examine whether acknowledgements of racial inequality are helpful towards improving knowledge retention and behaviors associated with the intervention among participants. In this arm, participants will receive a AMA statement on racial injustice. African American Sender Acknowledgement: Investigators will also vary the messenger of the acknowledgement sender. In this arm participants receive a African American sender in acknowledgment of AMA African American Sender in Informational Videos.: Investigators will vary the sender of the informational covid-19 videos. In this arm, participants receive a African American sender in informational videos. Racial Inequality Highlighted: Investigators will include information on race-specific covid-19 cases and deaths in one variation in the messaging. In this arm, participants receive disproportionate race-specific Covid-19 facts		Respondents will be randomized to an AMA statement acknowledging racial injustice read by an African American individual. The messenger / doctor in the follow-up AMA videos will also be African American - the message on Covid-19 will not include information on the disproportionate impact on communities of color. Acknowledgement Racial Injustice AMA: Investigators will examine whether acknowledgements of racial inequality are helpful towards improving knowledge retention and behaviors associated with the intervention among participants. In this arm, participants will receive a AMA statement on racial injustice. African American Sender Acknowledgement: Investigators will also vary the messenger of the acknowledgement sender. In this arm participants receive a African American sender in acknowledgment of AMA African American Sender in Informational Videos.: Investigators will vary the sender of the informational covid-19 videos. In this arm, participants receive a African American sender in informational videos. No Racial Inequality Highlighting: In this arm, the disproportionate burden of Covid-19 on communities of color will not be highlighted		Respondents will be randomized to an AMA statement acknowledging racial injustice read by a white individual. The messenger / doctor in the follow-up AMA videos will be white - the message on Covid-19 will include information on the disproportionate impact on communities of color. Acknowledgement Racial Injustice AMA: Investigators will examine whether acknowledgements of racial inequality are helpful towards improving knowledge retention and behaviors associated with the intervention among participants. In this arm, participants will receive a AMA statement on racial injustice. Racial Inequality Highlighted: Investigators will include information on race-specific covid-19 cases and deaths in one variation in the messaging. In this arm, participants receive disproportionate race-specific Covid-19 facts White Sender in Acknowledgement: Investigators will also vary the messenger of the acknowledgement sender. In this arm, participants receive a white sender in the acknowledgement White Sender in Informational Videos: Investigators will vary the messenger of the informational covid-19 videos. In this arm, participants receive white sender in the informational video		Respondents will be randomized to an AMA statement acknowledging racial injustice read by a white individual. The messenger / doctor in the follow-up AMA videos will be white - the message on Covid-19 will not include information on the disproportionate impact on communities of color. Acknowledgement Racial Injustice AMA: Investigators will examine whether acknowledgements of racial inequality are helpful towards improving knowledge retention and behaviors associated with the intervention among participants. In this arm, participants will receive a AMA statement on racial injustice. White Sender in Acknowledgement: Investigators will also vary the messenger of the acknowledgement sender. In this arm, participants receive a white sender in the acknowledgement White Sender in Informational Videos: Investigators will vary the messenger of the informational covid-19 videos. In this arm, participants receive white sender in the informational video No Racial Inequality Highlighting: In this arm, the disproportionate burden of Covid-19 on communities of color will not be highlighted		Respondents will be randomized to an AMA statement acknowledging drug pricing read by an African American individual. The messenger / doctor in the follow-up AMA videos will also be African American - the message on Covid-19 will include information on the disproportionate impact on communities of color . African American Sender Acknowledgement: Investigators will also vary the messenger of the acknowledgement sender. In this arm participants receive a African American sender in acknowledgment of AMA African American Sender in Informational Videos.: Investigators will vary the sender of the informational covid-19 videos. In this arm, participants receive a African American sender in informational videos. Racial Inequality Highlighted: Investigators will include information on race-specific covid-19 cases and deaths in one variation in the messaging. In this arm, participants receive disproportionate race-specific Covid-19 facts AMA Acknowledgement Drug Pricing: Investigators will examine whether acknowledgements of racial inequality are helpful towards improving knowledge retention and behaviors associated with the intervention among participants. In this arm, participants receive AMA information on drug pricing		Respondents will be randomized to an AMA statement acknowledging drug pricing read by an African American individual. The messenger / doctor in the follow-up AMA videos will also be African American - the message on Covid-19 will not include information on the disproportionate impact on communities of color. African American Sender Acknowledgement: Investigators will also vary the messenger of the acknowledgement sender. In this arm participants receive a African American sender in acknowledgment of AMA African American Sender in Informational Videos.: Investigators will vary the sender of the informational covid-19 videos. In this arm, participants receive a African American sender in informational videos. AMA Acknowledgement Drug Pricing: Investigators will examine whether acknowledgements of racial inequality are helpful towards improving knowledge retention and behaviors associated with the intervention among participants. In this arm, participants receive AMA information on drug pricing No Racial Inequality Highlighting: In this arm, the disproportionate burden of Covid-19 on communities of color will not be highlighted		Respondents will be randomized to an AMA statement acknowledging drug pricing read by a white individual. The messenger / doctor in the follow-up AMA videos will be white - the message on Covid-19 will include information on the disproportionate impact on communities of color. Racial Inequality Highlighted: Investigators will include information on race-specific covid-19 cases and deaths in one variation in the messaging. In this arm, participants receive disproportionate race-specific Covid-19 facts AMA Acknowledgement Drug Pricing: Investigators will examine whether acknowledgements of racial inequality are helpful towards improving knowledge retention and behaviors associated with the intervention among participants. In this arm, participants receive AMA information on drug pricing White Sender in Acknowledgement: Investigators will also vary the messenger of the acknowledgement sender. In this arm, participants receive a white sender in the acknowledgement White Sender in Informational Videos: Investigators will vary the messenger of the informational covid-19 videos. In this arm, participants receive white sender in the informational video		Respondents will be randomized to an AMA statement acknowledging drug pricing read by a white individual. The messenger / doctor in the follow-up AMA videos will be white - the message on Covid-19 will not include information on the disproportionate impact on communities of color. AMA Acknowledgement Drug Pricing: Investigators will examine whether acknowledgements of racial inequality are helpful towards improving knowledge retention and behaviors associated with the intervention among participants. In this arm, participants receive AMA information on drug pricing White Sender in Acknowledgement: Investigators will also vary the messenger of the acknowledgement sender. In this arm, participants receive a white sender in the acknowledgement White Sender in Informational Videos: Investigators will vary the messenger of the informational covid-19 videos. In this arm, participants receive white sender in the informational video No Racial Inequality Highlighting: In this arm, the disproportionate burden of Covid-19 on communities of color will not be highlighted		Respondents will be randomized to an AMA statement acknowledging racial injustice read by an African American individual. The messenger / doctor in the follow-up AMA videos will also be African American - No message on Covid-19 will be shown. Acknowledgement Racial Injustice AMA: Investigators will examine whether acknowledgements of racial inequality are helpful towards improving knowledge retention and behaviors associated with the intervention among participants. In this arm, participants will receive a AMA statement on racial injustice. African American Sender Acknowledgement: Investigators will also vary the messenger of the acknowledgement sender. In this arm participants receive a African American sender in acknowledgment of AMA		Respondents will be randomized to an AMA statement acknowledging racial injustice read by a white individual. The messenger / doctor in the follow-up AMA videos will also be white - No message on Covid-19 will be shown. Acknowledgement Racial Injustice AMA: Investigators will examine whether acknowledgements of racial inequality are helpful towards improving knowledge retention and behaviors associated with the intervention among participants. In this arm, participants will receive a AMA statement on racial injustice. White Sender Acknowledgement: Investigators will also vary the messenger of the acknowledgement sender. In this arm participants receive a white sender in acknowledgment of AMA		Respondents will be randomized to an AMA statement acknowledging drug pricing read by an African American individual. The messenger / doctor in the follow-up AMA videos will also be African American - No message on Covid-19 will be shown. African American Sender Acknowledgement: Investigators will also vary the messenger of the acknowledgement sender. In this arm participants receive a African American sender in acknowledgment of AMA AMA Acknowledgement Drug Pricing: Investigators will examine whether acknowledgements of racial inequality are helpful towards improving knowledge retention and behaviors associated with the intervention among participants. In this arm, participants receive AMA information on drug pricing		Respondents will be randomized to an AMA statement acknowledging drug pricing read by a white individual. The messenger / doctor in the follow-up AMA videos will also be white - No message on Covid-19 will be shown. White Sender Acknowledgement: Investigators will also vary the messenger of the acknowledgement sender. In this arm participants receive a white sender in acknowledgment of AMA AMA Acknowledgement Drug Pricing: Investigators will examine whether acknowledgements of racial inequality are helpful towards improving knowledge retention and behaviors associated with the intervention among participants. In this arm, participants receive AMA information on drug pricing
All Cause Mortality
	Intervention: AMA RI - B- B - R		Intervention: AMA RI - B - B - N		Intervention: AMA RI - W - W - R		Intervention: AMA RI - W - W - N		Intervention: AMA DP - B- B - R		Intervention: AMA DP - B- B - N		Intervention: AMA DP - W- W - R		Intervention: AMA DP - W- W - N		Control: AMA RI - B - B		Control: AMA RI - W - W		Control: AMA DP - B - B		Control: AMA DP - W - W
	Affected / at Risk (%)	# Events	Affected / at Risk (%)	# Events	Affected / at Risk (%)	# Events	Affected / at Risk (%)	# Events	Affected / at Risk (%)	# Events	Affected / at Risk (%)	# Events	Affected / at Risk (%)	# Events	Affected / at Risk (%)	# Events	Affected / at Risk (%)	# Events	Affected / at Risk (%)	# Events	Affected / at Risk (%)	# Events	Affected / at Risk (%)	# Events
Total	0/2046 (0%)		0/2044 (0%)		0/2045 (0%)		0/2046 (0%)		0/2044 (0%)		0/2052 (0%)		0/2046 (0%)		0/2043 (0%)		0/1026 (0%)		0/1025 (0%)		0/1023 (0%)		0/1020 (0%)
Serious Adverse Events
	Intervention: AMA RI - B- B - R		Intervention: AMA RI - B - B - N		Intervention: AMA RI - W - W - R		Intervention: AMA RI - W - W - N		Intervention: AMA DP - B- B - R		Intervention: AMA DP - B- B - N		Intervention: AMA DP - W- W - R		Intervention: AMA DP - W- W - N		Control: AMA RI - B - B		Control: AMA RI - W - W		Control: AMA DP - B - B		Control: AMA DP - W - W
	Affected / at Risk (%)	# Events	Affected / at Risk (%)	# Events	Affected / at Risk (%)	# Events	Affected / at Risk (%)	# Events	Affected / at Risk (%)	# Events	Affected / at Risk (%)	# Events	Affected / at Risk (%)	# Events	Affected / at Risk (%)	# Events	Affected / at Risk (%)	# Events	Affected / at Risk (%)	# Events	Affected / at Risk (%)	# Events	Affected / at Risk (%)	# Events
Total	0/2046 (0%)		0/2044 (0%)		0/2045 (0%)		0/2046 (0%)		0/2044 (0%)		0/2052 (0%)		0/2046 (0%)		0/2043 (0%)		0/1026 (0%)		0/1025 (0%)		0/1023 (0%)		0/1020 (0%)
Other (Not Including Serious) Adverse Events
	Intervention: AMA RI - B- B - R		Intervention: AMA RI - B - B - N		Intervention: AMA RI - W - W - R		Intervention: AMA RI - W - W - N		Intervention: AMA DP - B- B - R		Intervention: AMA DP - B- B - N		Intervention: AMA DP - W- W - R		Intervention: AMA DP - W- W - N		Control: AMA RI - B - B		Control: AMA RI - W - W		Control: AMA DP - B - B		Control: AMA DP - W - W
	Affected / at Risk (%)	# Events	Affected / at Risk (%)	# Events	Affected / at Risk (%)	# Events	Affected / at Risk (%)	# Events	Affected / at Risk (%)	# Events	Affected / at Risk (%)	# Events	Affected / at Risk (%)	# Events	Affected / at Risk (%)	# Events	Affected / at Risk (%)	# Events	Affected / at Risk (%)	# Events	Affected / at Risk (%)	# Events	Affected / at Risk (%)	# Events
Total	0/2046 (0%)		0/2044 (0%)		0/2045 (0%)		0/2046 (0%)		0/2044 (0%)		0/2052 (0%)		0/2046 (0%)		0/2043 (0%)		0/1026 (0%)		0/1025 (0%)		0/1023 (0%)		0/1020 (0%)

Limitations/Caveats

1. It was conducted online, and the participants may not be representative of the population with less than a college degree, since they have access to the internet and are used to participating in online studies; 2. Participants' preventive health behaviors were not directly observed; 3. Outcomes might be subject to social desirability bias.

More Information

Certain Agreements

Principal Investigators are NOT employed by the organization sponsoring the study.

There is NOT an agreement between Principal Investigators and the Sponsor (or its agents) that restricts the PI's rights to discuss or publish trial results after the trial is completed.