As is clear from <strong>the</strong> above, <strong>the</strong> results described here were subject to a number <strong>of</strong>assumptions around salaries, working time and so on which make any findings tentative. Asensitivity analysis was carried out to explore <strong>the</strong> susceptibility <strong>of</strong> findings to changes in<strong>the</strong>se assumptions, and this will be discussed below. As well as this, <strong>the</strong> fact that data werecollected on <strong>the</strong> basis <strong>of</strong> interview and self-report makes <strong>the</strong> analyses susceptible tounreliability caused by faulty recall, perceptual errors and self-presentation bias. Bycollecting data from a range <strong>of</strong> respondents (local authority advisors, teachers, heads), wehave attempted to build in triangulation <strong>of</strong> data sources, which has allowed us to arrive atmean values which are more stable and reliable than individual estimates. The only data forwhich this was not possible was data on local authority advisor time, which was based solelyon local authority advisor self-report.3.6.4.2. Travel costsIncluding:• Local authority advisor travel• Secondary teacher travel• Primary teacher travel• O<strong>the</strong>r staff travel• Travel is fur<strong>the</strong>r subdivided by mode <strong>of</strong> transport (e.g. car, rail)Travel costs were again based on self-report estimates from interviews with local authorityadvisors, headteachers and teachers. Respondents were asked to estimate average milestravelled for Pathfinder purposes in one week, and were asked whe<strong>the</strong>r this was done by caror public transport. Costs were calculated as being 38p per mile for car transport, acommonly used cost estimate in <strong>the</strong> public sector. It was found that public transport was notused to any extent for Pathfinder travel.3.6.4.3. Cost <strong>of</strong> development <strong>of</strong> resources.This included:• Development <strong>of</strong> own resources. This included <strong>the</strong> cost <strong>of</strong> materials, bought in expertise,and time additional to that covered under staff costs.• Bought in resources, such as packs and materials, e.g. Pilote, Early years.• ‘Free’ resources, such as materials provided to schools by <strong>the</strong> local authority.119
Estimating development costs <strong>of</strong> resources, especially self-developed, but in some casespurchased as well, was found to be difficult for respondents. They <strong>of</strong>ten had little idea <strong>of</strong> <strong>the</strong>cost <strong>of</strong> materials or time spent on <strong>the</strong> development <strong>of</strong> resources. This was not true <strong>of</strong> allrespondents, some <strong>of</strong> whom were able to provide detailed estimates. However, manyrespondents, at both <strong>the</strong> school and local authority level were unable to do so. In <strong>the</strong>secases, an additional 5% was added to <strong>the</strong> total cost for <strong>the</strong> local authority (this being <strong>the</strong>mean cost <strong>of</strong> resources in educational interventions, Levin 2000). In cases where <strong>the</strong> datawere incomplete, an additional 3% was added. Again, this points to <strong>the</strong> strong reliance <strong>of</strong> <strong>the</strong>data both on reliable reporting from respondents and on assumptions about cost factors.3.6.4.4. Cost <strong>of</strong> use <strong>of</strong> existing resources.This included hired <strong>of</strong>fice space, stationery and materials costs, use <strong>of</strong> o<strong>the</strong>r schoolresources, mailing costs and ICT use.We have not estimated <strong>the</strong> cost <strong>of</strong> use <strong>of</strong> classrooms and local authority <strong>of</strong>fices used byadvisors. This is potentially contentious, as <strong>the</strong> same argument made for estimating teachingtime on languages (opportunity costs) could also be made for use <strong>of</strong> classrooms, localauthority <strong>of</strong>fices etc. However, collecting <strong>the</strong>se data would have stretched <strong>the</strong> resources <strong>of</strong><strong>the</strong> evaluation team, as respondents would have found it difficult to give a reliable estimate<strong>of</strong> <strong>the</strong> cost <strong>of</strong> classrooms or <strong>of</strong>fices in <strong>the</strong>ir buildings. Collecting <strong>the</strong> data would <strong>the</strong>reforehave required <strong>the</strong> estimation <strong>of</strong> <strong>the</strong> value <strong>of</strong> buildings used by each local authority andschool, <strong>the</strong>n a calculation <strong>of</strong> <strong>the</strong> approximate value <strong>of</strong> rooms used. This would have requiredboth an extensive study <strong>of</strong> local property markets (in view <strong>of</strong> large differences between, forexample, Richmond and Oldham, but also within local authorities, e.g. Tynemouth orMeadowell in North Tyneside), and <strong>of</strong> use <strong>of</strong> individual rooms by teachers and o<strong>the</strong>rPathfinder staff.Data on materials, stationery etc. were collected through interviews with LA and schoolrespondents. Again, <strong>the</strong> extent to which respondents were able to quantify this differedstrongly, and was strongly related to <strong>the</strong> extent to which <strong>the</strong>y could quantify developed andbought resources. Where respondents were unable to quantify, this was included in <strong>the</strong> 5%or 3% addition mentioned above.120
- Page 1 and 2:
RESEARCHEvaluation of the Key Stage
- Page 3 and 4:
Contents1. Executive summary 32. In
- Page 5 and 6:
practice and factors that might imp
- Page 7 and 8:
of the experience. Individual feedb
- Page 9 and 10:
• The analysis revealed the need
- Page 11 and 12:
• Are pupils with SEN and gifted
- Page 13 and 14:
Both respondent characteristics and
- Page 15 and 16:
Interviews were recorded and a 25%
- Page 17 and 18:
2.2. Advantages and disadvantages o
- Page 19 and 20:
2.2.2. Languages Delivery by the Pr
- Page 21 and 22:
2.2.4. Languages Delivery through a
- Page 23 and 24:
Analysing these models, conditions
- Page 25 and 26:
• Schools should be encouraged to
- Page 27 and 28:
however, instances of schools where
- Page 29 and 30:
3.1.3.4. Time allocated to language
- Page 31 and 32:
‘French would not be taught now a
- Page 33 and 34:
• beneficial for the subject’s
- Page 35 and 36:
Many teachers remained very depende
- Page 37 and 38:
Table 2: Integration and Communicat
- Page 39 and 40:
‘We’ve written a letter and dra
- Page 41 and 42:
‘it makes you realise that if acc
- Page 43 and 44:
Table 5: Languages and Learning - Q
- Page 45 and 46:
3.1.5. Pupils - Learning and Attitu
- Page 47 and 48:
• useful for travelling abroad -
- Page 49 and 50:
• ‘Comments at the end to help
- Page 51 and 52:
‘At times they find it difficult
- Page 53 and 54:
teacher who knew our level.’ In t
- Page 55 and 56:
In most Pathfinders, however, there
- Page 57 and 58:
3.2.2. Recommendations• Primary t
- Page 59 and 60:
Effective staffing is essential to
- Page 61 and 62:
Martin and Mitchell 1993). In anoth
- Page 63 and 64:
Nineteen respondents had specialise
- Page 65 and 66:
As revealed in questionnaire 1, in
- Page 67 and 68:
However, some teachers were pleasan
- Page 69 and 70: However, there were frequent instan
- Page 71 and 72: • team-teaching on the ground•
- Page 73 and 74: involved external bodies in the del
- Page 75 and 76: Generally, there was a sense that s
- Page 77 and 78: • Methods of recording progressio
- Page 79 and 80: However, there were challenges in a
- Page 81 and 82: In one Pathfinder one school cluste
- Page 83 and 84: One example of assessment included
- Page 85 and 86: trying to evaluate, prior to each u
- Page 87 and 88: Case study: exemplar of a well deve
- Page 89 and 90: In some Pathfinder schools effectiv
- Page 91 and 92: ‘Only a very small number (6/7) g
- Page 93 and 94: • transfer of more sensitive info
- Page 95 and 96: ‘…I know the Year 7 teachers we
- Page 97 and 98: 3.4.5. Links to KS3 Framework/Natio
- Page 99 and 100: situation was especially difficult
- Page 101 and 102: 3.5. Sustainability and Replicabili
- Page 103 and 104: develop ‘effective and replicable
- Page 105 and 106: 3.5.4. Leadership and managementThe
- Page 107 and 108: on one aspect of delivery. This was
- Page 109 and 110: 3.5.5. Staff and staff expertiseIn
- Page 111 and 112: ‘Usually it is impromptu: 10 or 1
- Page 113 and 114: ‘The reason why I have decided to
- Page 115 and 116: c) there is obvious progression fro
- Page 117 and 118: to be constrained. Methodologies ge
- Page 119: Time spent on the project was gathe
- Page 123 and 124: There were significant differences
- Page 125 and 126: on staff costs, with the impact on
- Page 127 and 128: 5. CONCLUSIONSOverall, this evaluat
- Page 129 and 130: 5.2. Teacher Competence• Primary
- Page 131 and 132: o for training secondary teachers i
- Page 133 and 134: ReferencesBell, E with Cox, K. (199
- Page 135 and 136: Case Study 2Case study 2 is a compa
- Page 137 and 138: channelled through this school. At
- Page 139 and 140: Case Study 5This LA is a large auth
- Page 141 and 142: Case Study 7Case study 7 is a joint
- Page 143: Copies of this publication can be o