Advanced Training of Trainers - Pathfinder International

Specific Objective #5: Describe Level 4: Results Evaluation.
AdvAnced TrAining of TrAiners
CONTENT: METhOdOlOgy:
Level 4: Results Evaluation
Level 4, or results, evaluations measure
the impact of training on the program or
organization and how it contributed to
accomplishing the goals or objectives of
the program or organization. This type
of evaluation is both difficult and time
consuming. It is difficult to measure
the impact of training because so many
variables may come into play. It is
difficult to determine whether a change
was the result of the training or another
variable. Because of the complexity of this
type of evaluation, it is rarely used.
Guidelines for Evaluating Results
N If possible and practical, use a control
group to eliminate factors other than
training that could have caused the
observed changes to take place. In the
case of a clinical training, it should not
be difficult to find other care providers
who did not undergo training.
N Allow time for the results to be
achieved. It is impossible to say
exactly how much time is necessary,
but newly-trained providers must
have a chance to practice their skills
long enough to show a change in the
program.
N Measure both before and after the
training, if practical. This is easier to
do when you are evaluating results
85
UNIT 5/OBJECTIVE #5
Trainer Presentation (30 min.):
The trainer should:
N Explain that the final level of
evaluation is level 4, results or impact
evaluation.
N Using the content on the left side of
the page, give a lecturette on level 4
evaluation.
N Discuss the difficulties of evaluating
impact.
N Explain that 1 very important part
of level 4 evaluation is something
called return on investment, or ROI.
ROI measures and compares the
(monetary or other) benefits of the
program with the program costs. It
is an area of particular interest to
donors. Some evaluation experts
feel that it is so important that it
should be considered the fifth level of
evaluation.
N Pass out copies of Px Handouts 5.15:
Level 4 Results (Impact) Evaluation,
and refer to 5.2: Measuring Training
Results.
N Use Px Handout 5.15 to review the
4 levels of training evaluation and
summarize for each level
N What is evaluated.
N Who is evaluated.
N When the evaluation should be done.
5.15