When: April 23 – April 25, 2025
Where: Seattle, Washington
RAISE, in collaboration with NASTAD, will host a 2.5-day in-person workshop on program evaluation, with a focus on implementation science methods. This initiative aims to support EHE evaluators at local and state health departments with continuing education so they can incorporate implementation science methodologies into EHE program evaluations. By the end of the workshop, participants will have prepared an evaluation plan to assess the implementation of an EHE activity.
If interested, please complete an application form by December 20, 2024.
Downloadable versions of the application form and the workshop agenda can be accessed here.
Evaluating EHE Implementation Workshop Overall Objectives:
- Equip health department EHE evaluators with the background and tools needed to conduct mixed methods evaluations of implementation activities within their EHE programs
- Provide dedicated time to develop an evaluation plan that evaluates the implementation of a selected activity or program in each jurisdiction
- Facilitate peer-to-peer sharing and learning about program implementation and evaluation
Eligibility Criteria:
- Current role is an EHE evaluator / epidemiologist / M&E analyst / etc. at a local or state health department within an EHE jurisdiction.
- Approval from supervisor to attend workshop
- Interest in developing skills to systematically plan and evaluate the implementation of health department activities. Please note that prior training in implementation science is not a requirement.
- In-person attendance of workshop from April 23 – 25, 2025. In addition, participants will be expected to attend 2 virtual sessions prior to coming to Seattle as preparation for the workshop (end of March and early April).
We welcome applications from EHE jurisdictions of varying sizes and geographies. Program evaluation questions on a wide range of HIV topics will be considered. Please note that we will only select one person per health department, so we ask that your team submits an application for the person you feel is the ideal representative from your jurisdiction. The workshop has no registration fee and funding for travel is available.
Pre-Workshop Videoconferences
Hour-long pre-workshop videoconferences cover important introductory topics that help participants formulate their individual evaluation questions prior to attending the workshop in-person.
| Videoconference Topic | Date Range |
| Introduction to EEI Workshop | 2-4 weeks before in-person workshop |
| Formulating Evaluation Questions | 1-2 weeks before in-person workshop |
In-Person Workshop Agenda
Wednesday April 23
| 8:00am | Breakfast, Welcome & Introductions |
| 8:45 | Warm-Up Activity: Evidence Based Interventions vs. Implementation Strategies |
| 9:00 | Program Evaluation Metrics and Outcomes
Discuss key evaluation metrics, including both clinical outcomes and implementation outcomes. |
| 10:45 | Break |
| 11:00 | Implementation Science Conceptual Diagramming
Discuss methods for diagramming evaluation questions and practice developing a conceptual diagram for a provided implementation evaluation question |
| 12:00pm | Lunch |
| 1:00 | Data Visualization
Discuss how to present findings and disseminate results for the appropriate target audience |
| 2:00 | Break |
| 2:15 | Small Group Work
Work on local implementation evaluation question with workshop mentor and peers. Focus on developing an evaluation question, specifying an implementation strategy, and defining outcomes. |
| 3:45 | Day 1 Debrief |
| 4:00 | Day 1 End |
Thursday April 24
| 8:30am | Breakfast & Day 1 Recap |
| 9:00 | Keynote Guest Lecture: Dr. Matthew Golden |
| 10:00 | Break |
| 10:15 | Implementation Science Theories, Models, and Frameworks
Discuss common implementation science theories, models, and frameworks with a focus on evaluation frameworks commonly used in health department program evaluation. |
| 11:15 | Analytic Approaches to Implementation Science Program Evaluation Part 1
Discuss different quantitative approaches for evaluating implementation, including different study designs and statistical approaches. |
| 12:00pm | Lunch |
| 1:00 | Analytic Approaches to Implementation Science Program Evaluation Part II
Discuss different qualitative approaches for evaluating implementation, including mixed-methods designs and evaluations |
| 2:30 | Break |
| 2:45 | Small Group Work / Presentation Preparation
Work on local implementation evaluation question with workshop mentor and peers. Focus on describing study design and analytic approach. Prepare short presentation for Day 3. |
| 4:15 | Day 2 Debrief |
| 4:30 | Day 2 End |
Friday April 25
| 8:30am | Breakfast & Day 2 Recap |
| 9:00 | Individual Evaluation Plan Presentations!
Participants present their evaluation plan to mentors and peer small groups |
| 11:30 | Summary, Evaluation & Wrap-Up |
| 12:00pm | Adjourn* |
*Our intention is to allow time for attendees to fly home on the afternoon of Day 3.
Post-Workshop Videoconference
We will host one videoconference with attendees 1-2 months after the workshop. The goals of that videoconference are to check-in on individual program evaluation project progress, debrief workshop evaluation results, and gauge interest of attendees (& their HD) to engage in longer-term follow-up.