Minnesota COVID-19 Testing Project
Study Details
Study Description
Brief Summary
The goal of this project is to help the state of Minnesota understand why individuals are not getting tested and potentially identify trusted individuals or organizations that could be used in follow-up work to send messages. Investigators focus on the first two issues of unit and item nonresponse, which is not random across the population and thus could lead to nonresponse bias. To do so, investigators are deploying flyers through 10 Twin City area food shelves and potentially through public housing units with information on how to answer an online questionnaire.
| Condition or Disease | Intervention/Treatment | Phase |
|---|---|---|
|
N/A |
Detailed Description
In the United States, recent statistics show that African American and Latinx communities bear a disproportionate burden from COVID-19. Reaching vulnerable and underserved populations is therefore crucial to combating the disease. However, most public messaging campaigns are not targeted toward underserved communities and don't address fears of social stigma, mistrust in the healthcare system, or concerns about immigration status.
The goal of this project is to help the state of Minnesota understand why individuals are not getting tested and potentially identify trusted individuals or organizations that could be used in follow-up work to send messages. To do so, investigators are deploying flyers through 10 Twin City area food shelves and potentially through public housing units with information on how to answer an online questionnaire.
This provides us with an opportunity to study who answers surveys and why - and what questions are particularly sensitive. This is of general interest to academicians and policymakers alike.
The quality of household surveys is in decline, for three main reasons. First, households have become increasingly less likely to answer surveys at all (unit nonresponse). Second, those that respond are less likely to answer certain questions (item nonresponse). Third, when households do provide answers, they are less likely to be accurate (measurement error). This is important since household surveys help to estimate the employment rate, healthcare needs and of course the census determines resources/representation.
Investigators focus on the first two issues of unit and item nonresponse, which is not random across the population and thus could lead to nonresponse bias. Census tracts with predominantly Hispanic or Black residents had significantly lower response rates to the American Community Survey as compared to the response rates in predominantly white tracts. Similarly, response rates to the Health Information National Trends Survey (HINTS) were lower in areas with higher levels of Hispanic and minority residents.
Investigators hypothesize that financial incentives may encourage unit response; conversely, a close association with the government may discourage response. To test these hypotheses, investigators plan to cross-randomize the incentive amount offered and the emphasis placed on government involvement in the study on flyers advertising the baseline survey. Individuals will see either a) a 10 dollar incentive, or b) a 20 dollar incentive; and either a) messaging that emphasizes government involvement in the study, or b) messaging that emphasizes the involvement of academic researchers. Flyers will be randomized at the foodshelf-day level.
To test what affects item non-response on potentially sensitive questions, such as questions which ask for health information, investigators hypothesize that ethical framing may encourage individuals to answer questions. This takes two forms --- the deontological (or duty based) frame, and the consequential (or cost-benefit) frame. Moreover, knowing others feel the same way (regarding the obligation or benefits of providing health information) may amplify motivation. Finally, there is the possibility that emphasizing the importance of ethnic and racial disadvantage associated with COVID-19 outcomes may be important for improving item non-response on sensitive questions.
Upon completion of the demographic module of the survey but prior to starting several potentially sensitive survey modules, individuals will see a message that either a) emphasizes the public health benefits of answering the survey questions (cost-benefit frame);
- emphasizes an individual's responsibility to their community (duty frame); c) emphasizes the disproportionate impact of COVID-19 on certain ethnic and racial groups; or d) provides no messaging. Messaging content will be randomized at the individual level.
Study Design
Arms and Interventions
| Arm | Intervention/Treatment |
|---|---|
| Experimental: Government/High Incentive/Cost-Benefit Frame The participant is assigned to receive a flyer that includes a message emphasizing government involvement and a $20 incentive. Then the participant is assigned to be a message that emphasizes the public health benefits of answering the survey questions (i.e. cost-benefit frame). |
Behavioral: A $20 Survey Incentive
Individuals see a 10 dollar incentive on the flyers advertising the baseline survey.
Behavioral: Emphasis of Government Involvement
Individuals see a message emphasizing the involvement of the government in the study,
Behavioral: Cost-Benefit Frame
Individuals will see messaging that emphasizes the public health benefits of answering the survey questions in the baseline survey (cost-benefit frame).
|
| Experimental: Government/High Incentive/Duty Frame The participant is assigned to receive a flyer that includes a message emphasizing government involvement and a $20 incentive. Then the participant is assigned to be a message that emphasizes an individual's responsibility to their community (i.e. duty frame). |
Behavioral: A $20 Survey Incentive
Individuals see a 10 dollar incentive on the flyers advertising the baseline survey.
Behavioral: Emphasis of Government Involvement
Individuals see a message emphasizing the involvement of the government in the study,
Behavioral: Duty Frame
Individuals will see messaging that emphasizes an individual's responsibility to their community in the baseline survey (duty frame),
|
| Experimental: Government/High Incentive/Racial/Ethnic Frame The participant is assigned to receive a flyer that includes a message emphasizing government involvement and a $20 incentive. Then the participant is assigned to be a message that emphasizes the disproportionate impact of COVID-19 on certain ethnic and racial groups. |
Behavioral: A $20 Survey Incentive
Individuals see a 10 dollar incentive on the flyers advertising the baseline survey.
Behavioral: Emphasis of Government Involvement
Individuals see a message emphasizing the involvement of the government in the study,
Behavioral: Racial/Ethnic Frame
Individuals will see messaging that emphasizes the disproportionate impact of COVID-19 on certain ethnic and racial groups in the baseline survey.
|
| Experimental: Government/High Incentive/No Message Frame The participant is assigned to receive a flyer that includes a message emphasizing government involvement and a $20 incentive. Then the participant is assigned to the arm that provides no messaging. |
Behavioral: A $20 Survey Incentive
Individuals see a 10 dollar incentive on the flyers advertising the baseline survey.
Behavioral: Emphasis of Government Involvement
Individuals see a message emphasizing the involvement of the government in the study,
Behavioral: No Messaging
Individuals will see no messaging in the baseline survey.
|
| Experimental: Researchers/High Incentive/Cost-Benefit Frame The participant is assigned to receive a flyer that includes a message emphasizing the involvement of academic researchers and a $20 incentive. Then the participant is assigned to be a message that emphasizes the public health benefits of answering the survey questions (i.e. cost-benefit frame). |
Behavioral: A $20 Survey Incentive
Individuals see a 10 dollar incentive on the flyers advertising the baseline survey.
Behavioral: Emphasis of Academic Researchers Involvement
Individuals see a message emphasizing the involvement of academic researchers in the study,
Behavioral: Cost-Benefit Frame
Individuals will see messaging that emphasizes the public health benefits of answering the survey questions in the baseline survey (cost-benefit frame).
|
| Experimental: Researchers/High Incentive/Duty Frame The participant is assigned to receive a flyer that includes a message emphasizing the involvement of academic researchers and a $20 incentive. Then the participant is assigned to be a message that emphasizes an individual's responsibility to their community (i.e. duty frame). |
Behavioral: A $20 Survey Incentive
Individuals see a 10 dollar incentive on the flyers advertising the baseline survey.
Behavioral: Emphasis of Academic Researchers Involvement
Individuals see a message emphasizing the involvement of academic researchers in the study,
Behavioral: Duty Frame
Individuals will see messaging that emphasizes an individual's responsibility to their community in the baseline survey (duty frame),
|
| Experimental: Researchers/High Incentive/Racial/Ethnic Frame The participant is assigned to receive a flyer that includes a message emphasizing the involvement of academic researchers and a $20 incentive. Then the participant is assigned to be a message that emphasizes the disproportionate impact of COVID-19 on certain ethnic and racial groups. |
Behavioral: A $20 Survey Incentive
Individuals see a 10 dollar incentive on the flyers advertising the baseline survey.
Behavioral: Emphasis of Academic Researchers Involvement
Individuals see a message emphasizing the involvement of academic researchers in the study,
Behavioral: Racial/Ethnic Frame
Individuals will see messaging that emphasizes the disproportionate impact of COVID-19 on certain ethnic and racial groups in the baseline survey.
|
| Experimental: Researchers/High Incentive/No Message Frame The participant is assigned to receive a flyer that includes a message emphasizing the involvement of academic researchers and a $20 incentive. Then the participant is assigned to the arm that provides no messaging. |
Behavioral: A $20 Survey Incentive
Individuals see a 10 dollar incentive on the flyers advertising the baseline survey.
Behavioral: Emphasis of Academic Researchers Involvement
Individuals see a message emphasizing the involvement of academic researchers in the study,
Behavioral: No Messaging
Individuals will see no messaging in the baseline survey.
|
| Experimental: Government/Low Incentive/Cost-Benefit Frame The participant is assigned to receive a flyer that includes a message emphasizing government involvement and a $10 incentive. Then the participant is assigned to be a message that emphasizes the public health benefits of answering the survey questions (i.e. cost-benefit frame). |
Behavioral: A $10 Survey Incentive
Individuals see a 10 dollar incentive on the flyers advertising the baseline survey.
Behavioral: Emphasis of Government Involvement
Individuals see a message emphasizing the involvement of the government in the study,
Behavioral: Cost-Benefit Frame
Individuals will see messaging that emphasizes the public health benefits of answering the survey questions in the baseline survey (cost-benefit frame).
|
| Experimental: Government/Low Incentive/Duty Frame The participant is assigned to receive a flyer that includes a message emphasizing government involvement and a $10 incentive. Then the participant is assigned to be a message that emphasizes an individual's responsibility to their community (i.e. duty frame). |
Behavioral: A $10 Survey Incentive
Individuals see a 10 dollar incentive on the flyers advertising the baseline survey.
Behavioral: Emphasis of Government Involvement
Individuals see a message emphasizing the involvement of the government in the study,
Behavioral: Duty Frame
Individuals will see messaging that emphasizes an individual's responsibility to their community in the baseline survey (duty frame),
|
| Experimental: Government/Low Incentive/Racial/Ethnic Frame The participant is assigned to receive a flyer that includes a message emphasizing government involvement and a $10 incentive. Then the participant is assigned to be a message that emphasizes the disproportionate impact of COVID-19 on certain ethnic and racial groups. |
Behavioral: A $10 Survey Incentive
Individuals see a 10 dollar incentive on the flyers advertising the baseline survey.
Behavioral: Emphasis of Government Involvement
Individuals see a message emphasizing the involvement of the government in the study,
Behavioral: Racial/Ethnic Frame
Individuals will see messaging that emphasizes the disproportionate impact of COVID-19 on certain ethnic and racial groups in the baseline survey.
|
| Experimental: Government/Low Incentive/No Message Frame The participant is assigned to receive a flyer that includes a message emphasizing government involvement and a $10 incentive. Then the participant is assigned to the arm that provides no messaging. |
Behavioral: A $10 Survey Incentive
Individuals see a 10 dollar incentive on the flyers advertising the baseline survey.
Behavioral: Emphasis of Government Involvement
Individuals see a message emphasizing the involvement of the government in the study,
Behavioral: No Messaging
Individuals will see no messaging in the baseline survey.
|
| Experimental: Researchers/Low Incentive/Cost-Benefit Frame The participant is assigned to receive a flyer that includes a message emphasizing the involvement of academic researchers and a $10 incentive. Then the participant is assigned to be a message that emphasizes the public health benefits of answering the survey questions (i.e. cost-benefit frame). |
Behavioral: A $10 Survey Incentive
Individuals see a 10 dollar incentive on the flyers advertising the baseline survey.
Behavioral: Emphasis of Academic Researchers Involvement
Individuals see a message emphasizing the involvement of academic researchers in the study,
Behavioral: Cost-Benefit Frame
Individuals will see messaging that emphasizes the public health benefits of answering the survey questions in the baseline survey (cost-benefit frame).
|
| Experimental: Researchers/Low Incentive/Duty Frame The participant is assigned to receive a flyer that includes a message emphasizing the involvement of academic researchers and a $10 incentive. Then the participant is assigned to be a message that emphasizes an individual's responsibility to their community (i.e. duty frame). |
Behavioral: A $10 Survey Incentive
Individuals see a 10 dollar incentive on the flyers advertising the baseline survey.
Behavioral: Emphasis of Academic Researchers Involvement
Individuals see a message emphasizing the involvement of academic researchers in the study,
Behavioral: Duty Frame
Individuals will see messaging that emphasizes an individual's responsibility to their community in the baseline survey (duty frame),
|
| Experimental: Researchers/Low Incentive/Racial/Ethnic Frame The participant is assigned to receive a flyer that includes a message emphasizing the involvement of academic researchers and a $10 incentive. Then the participant is assigned to be a message that emphasizes the disproportionate impact of COVID-19 on certain ethnic and racial groups. |
Behavioral: A $10 Survey Incentive
Individuals see a 10 dollar incentive on the flyers advertising the baseline survey.
Behavioral: Emphasis of Academic Researchers Involvement
Individuals see a message emphasizing the involvement of academic researchers in the study,
Behavioral: Racial/Ethnic Frame
Individuals will see messaging that emphasizes the disproportionate impact of COVID-19 on certain ethnic and racial groups in the baseline survey.
|
| Experimental: Researchers/Low Incentive/No Message Frame The participant is assigned to receive a flyer that includes a message emphasizing the involvement of academic researchers and a $10 incentive. Then the participant is assigned to the arm that provides no messaging. |
Behavioral: A $10 Survey Incentive
Individuals see a 10 dollar incentive on the flyers advertising the baseline survey.
Behavioral: Emphasis of Academic Researchers Involvement
Individuals see a message emphasizing the involvement of academic researchers in the study,
Behavioral: No Messaging
Individuals will see no messaging in the baseline survey.
|
Outcome Measures
Primary Outcome Measures
- Effect of monetary incentives in increasing unit response 1 [This outcome will be assessed when the individual agrees to participate in the Baseline survey, which takes approximately 20 minutes.]
Number of participants who received a flyer that mentions a $20 incentive and completed the survey
- Effect of monetary incentives in increasing unit response 2 [This outcome will be assessed when the individual agrees to participate in the Baseline survey, which takes approximately 20 minutes.]
Number of participants who received a flyer that mentions a $10 incentive and completed the survey.
- Effect of a government frame in reducing unit response 1 [This outcome will be assessed when the individual agrees to participate in the Baseline survey, which takes approximately 20 minutes.]
Number of participants who received a flyer that mentions a government frame and completed the survey
- Effect of a government frame in reducing unit response 2 [This outcome will be assessed when the individual agrees to participate in the Baseline survey, which takes approximately 20 minutes.]
Number of participants who received a flyer that mentions a research frame and completed the survey.
- Interactions between monetary incentives and a government frame 1 [This outcome will be assessed when the individual agrees to participate in the Baseline survey, which takes approximately 20 minutes.]
Number of participants who received a flyer that mentions a government frame and $20 incentive and completed the survey
- Interactions between monetary incentives and a government frame 2 [This outcome will be assessed when the individual agrees to participate in the Baseline survey, which takes approximately 20 minutes.]
Number of participants who received a flyer that mentions a government frame and $10 incentive and completed the survey
- Interactions between monetary incentives and a government frame 3 [This outcome will be assessed during the 20-minute Baseline Survey.]
Number of participants who received a flyer that mentions a researcher frame and $20 incentive and completed the survey
- Interactions between monetary incentives and a government frame 4 [This outcome will be assessed during the 20-minute Baseline Survey.]
Number of participants who received a flyer that mentions a researcher frame and $10 incentive and completed the survey
- Demographic characteristics of participants assigned into each treatment arm [This outcome will be assessed during the 20-minute Baseline Survey.]
Demographic characteristics (e.g. sex, education level, income level, race/ethnicity) of participants who are assigned to each treatment arm and completed the survey.
- Effect of various messaging frames in increasing item non-response [This outcome will be assessed during the 20-minute Baseline Survey.]
Number of survey participants who are randomly assigned to receive each messaging frame that: a) emphasizes the public health benefits of answering the survey questions (cost-benefit frame); b) emphasizes an individual's responsibility to their community (duty frame); c) emphasizes the disproportionate impact of COVID-19 on certain ethnic and racial groups; or d) provides no messaging.
Eligibility Criteria
Criteria
Inclusion Criteria:
- All participants who are aged 18 or above and speak English or Spanish
Exclusion Criteria:
- Children, those who do not identify as above or adults who identify as above but do not agree to participate in survey during the consent stage.
Contacts and Locations
Locations
| Site | City | State | Country | Postal Code | |
|---|---|---|---|---|---|
| 1 | Volunteers Enlisted to Assist People | Bloomington | Minnesota | United States | 55420 |
| 2 | Southern Anoka Community Assistance | Columbia Heights | Minnesota | United States | 55421 |
| 3 | People Reaching Out to People Food Shelf | Eden Prairie | Minnesota | United States | 55344 |
| 4 | Fridley Covenant Church | Fridley | Minnesota | United States | 55432 |
| 5 | Calvary Lutheran Church Food Shelf | Minneapolis | Minnesota | United States | 55407 |
| 6 | NorthPoint Health and Wellness | Minneapolis | Minnesota | United States | 55411 |
| 7 | Community Emergency Assistance Programs | Minneapolis | Minnesota | United States | 55429 |
| 8 | Intercongregation Communities Association | Minnetonka | Minnesota | United States | 55343 |
| 9 | Valley Outreach | Stillwater | Minnesota | United States | 55082 |
| 10 | White Bear Area Foodshelf | White Bear Lake | Minnesota | United States | 55110 |
Sponsors and Collaborators
- Harvard University
- Abdul Latif Jameel Poverty Action Lab
- Government of Minnesota
Investigators
- Principal Investigator: Marcella Alsan, MD, MPH, PhD, Harvard Kennedy School
Study Documents (Full-Text)
More Information
Publications
- Griffin, DH. Measuring survey nonresponse by race and ethnicity. In Proceedings of the Annual Meetings of the American Statistical Association. 2002; 11-15.
- Maitland A, Lin A, Cantor D, Jones M, Moser RP, Hesse BW, Davis T, Blake KD. A Nonresponse Bias Analysis of the Health Information National Trends Survey (HINTS). J Health Commun. 2017 Jul;22(7):545-553. doi: 10.1080/10810730.2017.1324539. Epub 2017 May 30.
- IRB20-1444