OTIS Evaluation Guide (PDF) - California Department of Public Health

Part C. Evaluation Reporting
After you complete the Collection of Outcome Data and/or Collection of Process Data sections, OTIS will ask
you to talk about your final product, the Final Evaluation Report (FER) or the Brief Evaluation Report (BER). The
FER is a report that is written for primary objectives and requires a more in-depth evaluation plan compared to
non-primary objectives. The BER is written for non-primary objectives and only requires a 1-3 page summary of
evaluation activities. Both types of reports coalesce and capture data and analyses from all the different outcome
and/or process evaluation activities conducted.
For more information on how best to write these reports, please refer to, Tell Your Story: Guidelines for Preparing
a Complete High Quality Final Evaluation Report. In addition, there are links to a series of tools developed
by the TC Evaluation Center to help you with an evaluation of policy-related objectives. These tools include:
1) Writing and organizing interview questions
2) Conducting the interviews
3) Focus group interviews
4) Qualitative methods
5) Content Analysis
6) Record Review
In the meantime, OTIS will ask you questions relating to the FER or BER.
• Go to the “Scope of Work/View Objective” page
• Click on the “View” link of the “Evaluation Reporting” section
• On the blank “View Evaluation Reporting” page (Figure 38), click on the
“Edit Evaluation Reporting” link
• See Figure 39 to see how the following questions look on the page
What type of analysis will be done?
The statistical analysis should correspond to the evaluation design of the objective. We provide suggested statistical
analysis methods in the chapter on Sample Evaluation Plans, and you will notice for each study design,
several types of analyses are applicable. There are many analysis options--such as simple frequency, Chi
square, regression, comparison over time, comparison with other groups, comparison with a control group,
etc.
Keep in mind that your evaluation plan may contain modifications of the sample designs in OTIS. We recommend
that you consult with the TC Evaluation Center or a statistician on what analyses you should perform
and how to perform them. You will also find that an entry-level textbook in statistics (see References) is a very
useful reference for some simple analyses.
OTIS Evaluation Guide • March 2007
127