Local Evaluation of Children's Services Learning from the Children's ...

Evaluators sometimes struggled to address the multiple requirements of theevaluation with the timing of their engagement and the expectations of when theywould feedback. It was recognised, for example, that early engagement andfeedback might assist programmes to plan their development on an informed basis.However, this would limit that evaluation’s ability to present what were seen asdefinitive conclusions. Conversely, later evaluation engagement/feedback were seenas providing a greater degree of confidence in findings, but as a retrospective viewthat may be less helpful in informing a partnership about future directions.Other evaluators pointed to the importance of maintaining ongoing dialogue withprogramme managers and members of the programme team in order to ensure thatevaluation outputs are useful, accessibly presented and that they are realistic aboutwhat the evaluation is able to produce. For example, one evaluator pointed to theproblems of not effectively managing the expectations of the partnership:… the previous director didn’t do enough in the way of dialogue with us…whathappened was that we were producing types of report and working on focuseswhich he didn’t particularly want or didn’t find particularly useful…whathappened in the end though was that the… clearly regretted the fact that he’dcome in half way through and hadn’t had a hands on approach because he feltvery strongly that for local evaluation to work it had to be a sort of collaborativething and in fact at times I feel he wants to be slightly too hands on for it to becalled evaluation to be honest.Another evaluator described a number of problems that limited the impact that theevaluation had on the work of the partnership. Such problems included limited clarityamong stakeholders about the purposes of evaluation, that the local evaluation hadproduced outputs that were too ‘academic’ in style and that it had not been able toproduce ‘hard’ data demonstrating outcomes which the programme required:… we began to get this sort of critical feedback about how you know the wholething was too academic and too weighty and it wasn’t telling them what theyneeded to know and so on and when we tried to get to the bottom of this werealised that they were expecting to walk away with sets of targets met and youknow hard data about outcomes and things; which we were never being askedto find actually.3.4 Chapter Summary1. Evaluators have each adopted a range of summative, formative, and forsome, dialogic approaches to engaging with partnerships reflecting theirChapter 3 45