21.11.2014 Views

Evaluation of TULI Programmes - Tekes

Evaluation of TULI Programmes - Tekes

Evaluation of TULI Programmes - Tekes

SHOW MORE
SHOW LESS

Create successful ePaper yourself

Turn your PDF publications into a flip-book with our unique Google optimized e-Paper software.

the universities to comply to their societal mission (e.g.“the<br />

third task”, “innovation union”, etc.) and greatly speed up<br />

the development process. Predominant strategy: entrepreneurship/start-ups.<br />

Capable <strong>of</strong> providing clear value and<br />

medium to high propensity for the university to finance<br />

operations.<br />

••<br />

Low to medium impact/medium value: VTT – Considerable<br />

prior experience (comparatively). <strong>TULI</strong> provided additional<br />

means to support the development that was already<br />

happening, possibly speeding up the process. Predominant<br />

strategy: licensing. In line with internal strategies/mission,<br />

provides clear value and a high propensity<br />

to continue financing operations.<br />

We acknowledge that there are exceptions to the categories.<br />

Programme additionality<br />

<strong>TULI</strong> provided an instrument that complemented and<br />

catalysed the development<br />

<strong>Evaluation</strong> methodology states that counterfactual analysis is<br />

preferred when analysing the additionality <strong>of</strong> a programme intervention.<br />

In reality this is seldom possible, as it is not possible<br />

to isolate the effects and impact <strong>of</strong> a programme to an uninfluenced<br />

environment. In consequence, additionality should<br />

be considered carefully and always clearly indicate other identified<br />

influencing factors. We have taken additional care to assure<br />

this, as can be seen from the prior discussion <strong>of</strong> <strong>TULI</strong> and<br />

parallel measures enacted during the programme life time.<br />

A European comparison shows that the programme’s<br />

objectives, such as Objective 1, have in the absolute majority<br />

<strong>of</strong> cases in other countries been developed through similar<br />

programmes such as <strong>TULI</strong> (albeit with slightly different programme<br />

functionality and logic). This realisation in combination<br />

with the input from the interviews, particularly with upper<br />

management, we conclude that it is highly doubtful that such<br />

a comprehensive change in particular in regards to awareness<br />

and structures would have been possible in the absence <strong>of</strong><br />

<strong>TULI</strong>, or a similar funding instrument. The parallel measures<br />

that accompanied <strong>TULI</strong> affected other fundamental aspects<br />

<strong>of</strong> the process, but a funding vehicle was absolutely necessary<br />

to enable the development <strong>of</strong> operations at universities and<br />

research institutes.<br />

At the same time, it can certainly be argued that structures<br />

and processes might have been developed based on individual<br />

initiatives, such as at the major universities (e.g. Aalto)<br />

or research institutes (e.g. VTT), as a result <strong>of</strong> these actors are<br />

more closely following the international trend and are more<br />

inclined to invest resources to stay on par with their immediate<br />

peers. The interviews with innovation managers and upper<br />

management, have however not clearly indicated that this<br />

would have been a parallel reality. On a holistic level however,<br />

we conclude that <strong>TULI</strong> in many cases has been instrumental<br />

in orchestrating a similar comprehensive system, which is now<br />

visible (in terms <strong>of</strong> competencies <strong>of</strong> staff, visible structures and<br />

documented processes).<br />

More to the point, we also conclude that the level <strong>of</strong> additionality<br />

has <strong>of</strong> course been <strong>of</strong> varying degree between the<br />

three research organisations (universities, research institutes<br />

and vocational universities – albeit with individual exceptions):<br />

••<br />

Universities: In the absence <strong>of</strong> Aalto, we regard that TU-<br />

LI has been critical for most universities to reach the programme’s<br />

objectives.<br />

••<br />

Research institutes: We conclude that the additionality <strong>of</strong><br />

<strong>TULI</strong> in this setting is lower. On the one hand we a committed<br />

and highly experienced RTO in VTT, whereas on the<br />

other hand the other RTOs did not have such a strong prior<br />

experience. We believe that the level <strong>of</strong> awareness, competence<br />

and pr<strong>of</strong>essionalism to a high degree already existed<br />

at VTT based on its closeness to and relationship with<br />

the Finnish industry. As such, it is likely that the structures<br />

and processes we today witness would have been developed<br />

anyway. In VTT’s absence, we witness both commitment<br />

and development at MTT, which we attribute highly<br />

to the programme. The same cannot be said for the remaining<br />

institutes, where we have seen very little sustainable<br />

development.<br />

••<br />

Vocational universities: Very high degree <strong>of</strong> additionality.<br />

Based on the interviews, it is evident that prior to <strong>TULI</strong><br />

nothing in terms structures and processes existed. This has<br />

been established with <strong>TULI</strong> funding. Since the vocational<br />

universities have chosen to focus on students, it is also evident<br />

that awareness among researchers has remained low,<br />

so also the commitment <strong>of</strong> management.<br />

The perceived and desired effects among the three types<br />

<strong>of</strong> research organisations should in hindsight be discussed<br />

with <strong>Tekes</strong> in order to understand possible internal priorities<br />

that should be used when finalising the analysis <strong>of</strong> these<br />

results.<br />

37

Hooray! Your file is uploaded and ready to be published.

Saved successfully!

Ooh no, something went wrong!