Process Evaluations

Process evaluation overview

Process evaluations determine whether programme activities have been implemented as intended. They can be performed periodically throughout the life of your programme and involve the reviewing of inputs, activities, and outputs. They may also be called 'implementation evaluations'.¹

How to perform a process evaluation

Stage 1: Create an advisory group

The first step of a process evaluation is to create an advisory group. This group consists of evaluators and key stakeholders who will plan for and oversee the evaluation. Advisory groups lead to better quality and useful evaluations.^{2, 3}

Note: Advisory groups may also be called 'reference groups', 'working groups', or 'advisory panels'.

Stage 2: Determine the scope of the evaluation

The advisory group should clarify what is to be evaluated, develop or revisit a theory of change, discuss possible evaluation methods, and agree on the audience of the evaluation. These evaluation characteristics should be used to create a terms of reference and/or an evaluation plan.

Stage 3: Create an evaluation plan

Create an evaluation plan to outline the purpose of the evaluation and how it will be performed. At minimum, the plan should list evaluation questions, determine what data are required, select methods for obtaining and analysing the data, and include a schedule of dates, milestones, and responsibilities. Other information, such as a theory of change or Gantt chart, can also be included in the plan.⁴

Some examples of process evaluation questions include: ⁵

• How is the programme being implemented?
• Is the programme being implemented correctly?
• Are participants being reached as intended?

When selecting data collection and analysis methods, consider the following: ⁶

• Are the methods appropriate for the required data?
• Can the methods ensure accuracy and validity?
• Will technical assistance be required?
• Is routine data collection possible?

Stage 4: Perform the evaluation

Collect and analyse the data as outlined in the evaluation plan.

Stage 5: Interpret and report on the findings

Interpret the data, make a list of recommended actions, and present your findings. Results are typically presented in a final written report; but slide shows or informational videos can also be used. Visual aids, such as short videos or infographics, are great methods for communicating evaluation results in a clear and simple way. Results should be shared with all stakeholders.⁷

Stage 6: Apply the findings

The advisory group should review the recommendations, discuss what has been learned from the evaluation, and identify next steps for applying the results. Then prioritise the actions and create an action plan to ensure that the results are used.⁷

Additional resources

For more information on process evaluations, visit the resources below or contact evaluation@greo.ca to see how Greo can help.

• Process evaluation of complex interventions (UK Medical Research Council)
• Process evaluation guide (Centers for Disease Control and Prevention)
• Guidance on process evaluation (Public Health England)
• Developing process evaluation questions (Centers for Disease Control and Prevention)
• Process evaluation of two community-action based gambling harm minimization programs (Greo Research Snapshot)
• Process evaluation of a public health program on gambling policy development and implementation (Greo Research Snapshot)