WHAT WE DO
In all evaluation work, IDLO seeks to achieve best practice in the evaluation of legal reform initiatives in developing and transitional countries. During the period of IDLO’s current Strategic Plan (2009-2012), evaluations focus on measuring the ‘outcomes’ of policies, programs or activities, which means focusing on the short- and medium-term results. IDLO organizes three types of evaluations:
- Centralized evaluations, which are planned and managed by the Evaluation Unit, and target IDLO strategies, policies, and more complex, larger programs
- Decentralized evaluations, which are planned and managed by a regional or project office
- Self-evaluations, which are planned and undertaken by the unit responsible for implementing a particular program or activity
Given that IDLO does a significant amount of training of professionals in order to help develop country capacity, the organization has introduced a standardized, rigorous approach to evaluating training. The following table provides an overview of IDLO’s approach.
|
Evaluation level |
Training results chain |
Information sought |
Data collection tools |
Relation to training Objective |
|
Level 1
(monitoring) |
Activity: training course |
Quality of training design |
Satisfaction questionnaire (participant) |
Change at individual level |
Change at institutional level |
|
Quality assurance checklist (course manager) |
|
Level 2 (monitoring) |
Outputs: learning elements |
Immediate individual knowledge and skill gain |
Self-assessment of improvement
(participant) |
|
Skills assessment during training
(instructor) |
|
Level 3
(evaluation) |
Outcome: performance change |
Effects on individual performance in workplace |
Ex-post questionnaires
after 6-12 months |
|
Ad-hoc tools during project evaluation |
|
Level 4
(evaluation) |
Impact: institutional change |
Impact on institutional performance |
Ad-hoc tools during impact evaluation |
|
|