Conversational Agent Vaccine Promotion RCT
Study Details
Study Description
Brief Summary
The objective of this study is to assess the use of and satisfaction with the ECA intervention over a 12-month period, its ability to increase SARS-CoV-2 and influenza vaccination in the BMATP community, and the comparative effectiveness of proactive engagement strategies and cultural tailoring on these factors. The Investigators will assess app use and satisfaction among these participants, along with self-reported vaccination attitudes and behavior, at 6 months and 12 months.
During this time the investigators will conduct a 2x2 factorial RCT (with the individual the unit of random assignment and measurement) to assess the impact of two app design features on engagement and outcomes: (1) the investigators will manipulate engagement mechanisms (ENGAGEMENT), including reminder notifications and trust-building dialogue by the ECA and, (2) independently manipulate cultural tailoring of vaccination promotion counseling language used by the agent (TAILORING) to either adaptive religiosity (tailored) or secular (non-tailored). The investigators' primary hypotheses are that participants with have significantly greater vaccination completion rates in the high engagement and tailored conditions at 6 months (H1) and 12 months (H2) compared to other conditions. The investigators' secondary hypotheses are that participants will use the app more, be more satisfied with the ECA, be more advanced in their stage of change, and have greater knowledge, self-efficacy, and decisional-balance from baseline to 6 and 12 months, in the high engagement and tailored conditions. In addition to the RCT participants, all members of the 12 participating BMATP churches will be invited to use the app (via snowball recruitment), to increase the utility of the social networking functions of the app by having as many users as possible.
| Condition or Disease | Intervention/Treatment | Phase |
|---|---|---|
|
N/A |
Detailed Description
4.1.a.1. Randomization. Study participants will be randomized into one of the four study conditions (ENGAGEMENT x TAILORING) using blocked randomization with randomly permuted block sizes of 2 and 4, by software on the central server referenced when participants first activate the app on their phone.
Participants will continue using the app at home, and will be called at 6 months and 12 months to assess outcome measures during a videoconference call with a research assistant.
4.1.a.2. Qualitative Interviews. The investigators will conduct interviews with a sample of participants completing the study (12), as well as with Church and Health Ministry leadership (12) to understand overall acceptance of ECA-ACE and barriers to deployment and use.
4.1.a.3. Qualitative Methods for all Project Focus Groups and Interviews. Videoconference-based focus groups and interviews will be facilitated using a semi-structured interview guide, audio-recorded, and transcribed verbatim by a professional transcription service. The investigators will conduct a thematic analysis of these transcripts guided by the investigators' research questions with the aim of identifying design insights. The investigators will use grounded theory analysis, including constant comparisons, axial and selective coding, and memo writing. Using NVivo 12.5.0 software, two researchers will inductively code transcripts separately, labeling emergent phenomena in the data to arrive at a codebook. Two researchers will then independently apply the codebook to participant transcripts, meeting regularly to discuss discrepancies in the applications of the codes, updates to the codebook, and contradictory data. Sample sizes specified should be adequate to reach thematic saturation relative to the investigators' research questions.
Study Design
Arms and Interventions
| Arm | Intervention/Treatment |
|---|---|
| Experimental: High engagement mechanisms, tailed content During this time the investigators will conduct a 2x2 factorial RCT (with the individual the unit of random assignment and measurement) to assess the impact of two app design features on engagement and outcomes: (1) the investigators will manipulate engagement mechanisms (ENGAGEMENT), including reminder notifications and trust-building dialogue by the ECA and, (2) independently manipulate cultural tailoring of vaccination promotion counseling language used by the agent (TAILORING) to either adaptive religiosity (tailored) or secular (non-tailored). The investigators' primary hypotheses are that participants with have significantly greater vaccination completion rates in the high engagement and tailored conditions at 6 months (H1) and 12 months (H2) compared to other conditions. |
Behavioral: ECA-ACE Vaccination Promotion Intervention
A smartphone-based embodied conversational agent that educates users and motivates them to obtain vaccinations for SARS-CoV-2 and Influenza, according to Boston Public Health Commission guidelines.
|
| Experimental: Low engagement mechanisms, tailed content manipulate low engagement mechanisms while provide adaptive religiosity (tailored) content |
Behavioral: ECA-ACE Vaccination Promotion Intervention
A smartphone-based embodied conversational agent that educates users and motivates them to obtain vaccinations for SARS-CoV-2 and Influenza, according to Boston Public Health Commission guidelines.
|
| Experimental: High engagement mechanism, non-tailed content manipulate high engagement mechanisms while provide secular (non-tailored) content |
Behavioral: ECA-ACE Vaccination Promotion Intervention
A smartphone-based embodied conversational agent that educates users and motivates them to obtain vaccinations for SARS-CoV-2 and Influenza, according to Boston Public Health Commission guidelines.
|
| Experimental: Low engagement mechanism, non-tailed content manipulate low engagement mechanisms and provide secular (non-tailored) content |
Behavioral: ECA-ACE Vaccination Promotion Intervention
A smartphone-based embodied conversational agent that educates users and motivates them to obtain vaccinations for SARS-CoV-2 and Influenza, according to Boston Public Health Commission guidelines.
|
Outcome Measures
Primary Outcome Measures
- Change of SARS-CoV-2 vaccination status [baseline, 6months, 12months]
Vaccination completion will be assessed via self-report by asking whether participants are up-to-date with Boston Public Health Commission vaccination guidelines (yes or no) for SARS-CoV-2
- Change of Influenza vaccination status Influenza vaccination status [baseline, 6months, 12months]
Vaccination completion will be assessed via self-report by asking whether participants are up-to-date with Boston Public Health Commission vaccination guidelines (yes or no) for Influenza
Secondary Outcome Measures
- Change of Satisfaction Status [6 months, 12 months]
Self report System Usability Scale (self report), plus system use from log file analysis.
- Stage of Change for Vaccination [baseline,6months,12months]
Self report of Precontemplation, Contemplation, Preparation, or Action/Maintenance for vaccination
- Self-Efficacy for Vaccination [baseline,6months,12months]
Self report of confidence in ability to get vaccinated in light of barriers
- Decisional Balance for Vaccination [baseline,6months,12months]
Self report of Pros and Cons of vaccination
- Knowledge [baseline,6months,12months]
Knowledge of COVID-19 and Influenza assessed via 10-item true/false knowledge tests.
Eligibility Criteria
Criteria
Inclusion Criteria:
-
over 18 years old;
-
speaks English fluently;
-
is able to independently consent;
-
has adequate corrected vision to use the ECA system (based on a 1 minute ECA functional screener deployed over the web);
-
has adequate hearing to use the ECA system;
-
owns a recent model iPhone or Android smartphone.
(6) do not meet current Boston Public Health commission guidelines for SARS-CoV-2 vaccination; (7) do not meet current Boston Public Health commission guidelines for Influenza vaccination.
Exclusion Criteria:
-
they are not able demonstrate comprehension of the research study;
-
they are unable to use the screener
Contacts and Locations
Locations
No locations specified.Sponsors and Collaborators
- Northeastern University
- Boston University
- Boston Medical Center
- Georgia Institute of Technology
Investigators
None specified.Study Documents (Full-Text)
None provided.More Information
Publications
None provided.- IRB#18-07-02