EVALUATION

AN INDEPENDENT EVALUATION OF THE LCNF
9. demonstrates clear project methodology and shows effectiveness of
implementation
It is with these criteria in mind that we have developed our evaluation methodology.
2.2 Evaluation process
Figure 1 presents the high-level process adopted for this evaluation. The process follows
three core workstreams, these are as follows:
• defining what is meant by innovation;
• stakeholder methodology; and
• evaluation framework.
Initially we defined ‘innovation’ in the context of the GB DNOs – and this was
subsequently used as part of the assessment process. This definition is a key input into
the remaining two workstreams (more details on the definition of innovation are set out in
2.3).
The second workstream concentrates on the development of the ‘stakeholder
engagement methodology’. The focus of this workstream has been to develop detailed
questionnaires which were sent to a list of key stakeholders (including the DNOs, project
partners, other industry and academics). The list has been developed in conjunction with
Ofgem. More detail on the stakeholder engagement methodology is set out in Section
2.4.
The third workstream is concerned with the development of the ‘evaluation framework’.
This has involved the development of a methodology for both the qualitative and
quantitative analysis and the subsequent assessment. More detail on the evaluation
framework is provided in Section 2.5.
Figure 1 – Approach to the evaluation
Develop
stakeholder
engagement
methodology
Develop three
different
questionnaire
types
Review
questionnaire
responses
Follow-up with
respondents
Define innovation
Engagement
with academics
Conduct
telephone
interviews
Qualitative
and
quantitative
assessment
Develop
evaluation
framework
Establish
qualitative &
quantitative
approach
Finalise
methodology
Apply
methodology to
responses
PÖYRY MANAGEMENT CONSULTING
October 2016
713_Poyry_Report_Evaluation_of_the_LCNF_FINAL_Oct_2016_v700.docx
12