11.12.2012 Views

Appendix B. Further statistics of all samples

Appendix B. Further statistics of all samples

Appendix B. Further statistics of all samples

SHOW MORE
SHOW LESS

Create successful ePaper yourself

Turn your PDF publications into a flip-book with our unique Google optimized e-Paper software.

Is less more? A dynamic look at the effectiveness <strong>of</strong><br />

Abstract<br />

Swiss active labour market policy<br />

Heidi Steiger<br />

Date <strong>of</strong> this version: 13 February 2004<br />

Past studies found active labour market programmes to be ineffective compared to a state <strong>of</strong><br />

nonparticipation and more intense job search for Switzerland. One policy conclusion would be<br />

to do away with the programmes because they are very costly, and public money would only<br />

be wasted. But is less re<strong>all</strong>y more? This study re-evaluates Swiss active labour market programmes<br />

by means <strong>of</strong> the "conventional" non-dynamic matching estimator as well as a dynamic<br />

variant <strong>of</strong> it. The non-dynamic method leads to negative effects <strong>of</strong> almost <strong>all</strong> programmes<br />

compared to nonparticipation. The dynamic method reverses the findings, and nonparticipation<br />

loses any superiority compared to <strong>all</strong> other programmes. Not considering dynamics<br />

<strong>of</strong> treatment assignment therefore leads to biased conclusions. Effectiveness in this paper is<br />

measured in terms <strong>of</strong> a couple <strong>of</strong> outcomes that have not been considered so far, in order to<br />

give a clearer picture <strong>of</strong> the effects. They cover unemployment, employment, earnings, out <strong>of</strong><br />

labour force, and welfare dependency measures. The programmes are found to be effective in<br />

every possible sense. In aggregation, we find clearly positive effects in the sense <strong>of</strong> total income<br />

for language courses, computer courses, vocational training, and other courses, as well<br />

as for employment programmes in single workplaces and interim jobs. The aggregated total<br />

income <strong>of</strong> participants within 12 months after programme start is between 1700 and 3250 CHF<br />

higher for effective programmes. Subject to unemployment benefits, effects are positive and<br />

significant for interim jobs.<br />

Keywords: labour market programmes, evaluation, quasi-dynamic evaluation, nonparticipation,<br />

Switzerland<br />

JEL Classification: C14, J64<br />

Heidi Steiger, Swiss Institute for International Economics and Applied Economic Research (SIAW), University<br />

<strong>of</strong> St. G<strong>all</strong>en, Dufourstrasse 48, CH-9000 St. G<strong>all</strong>en, Switzerland; phone +41 71 224 22 99 fax +41<br />

71 224 22 98; e-mail heidi.steiger@unisg.ch; homepage http://www.siaw.unisg.ch/lechner/steiger


1 Introduction<br />

1<br />

This paper contributes to the evaluation <strong>of</strong> active labour market policies in Switzerland in two<br />

ways: first, programmes are re-evaluated with regard to a variety <strong>of</strong> outcomes such as unemployment,<br />

employment, earnings, out <strong>of</strong> labour force, and welfare dependency status. This<br />

provides a more complete insight <strong>of</strong> how labour market programmes affect participants. Secondly,<br />

for this purpose two different matching methods are used, one a non-dynamic estimator,<br />

the other a quasi-dynamic variant first suggested by Sianesi (2004). The results <strong>of</strong> the two<br />

methods are compared.<br />

Evaluation <strong>of</strong> active labour market programmes with respect to their "effectiveness" asks for a<br />

definition <strong>of</strong> the target variable, i.e. the context in which effectiveness is measured. Former<br />

work by Gerfin and Lechner (2002) and Lalive, van Ours and Zweimüller (2002) used the outcome<br />

"deregistered from unemployment" as efficiency measure. This paper doesn't want to<br />

restrict this term to either a single indicator or some composite welfare measure, but uses a<br />

variety <strong>of</strong> separate outcomes and analyzes them separately. For this purpose, a combination <strong>of</strong><br />

pension system and unemployment insurance records is used. This has partly been done in<br />

Gerfin, Lechner and Steiger (2002) already, but the focus <strong>of</strong> that study was different, and an indepth<br />

analysis was not the purpose <strong>of</strong> that study. Here, the data are used more efficiently to<br />

construct additional outcomes They provide an insight not only in how the employment status<br />

<strong>of</strong> participants evolves within and after their unemployment spells, but also gives earnings<br />

effects and indicators for dropping out <strong>of</strong> the labour force and/or welfare dependency. Therefore<br />

it gives a more complete picture <strong>of</strong> the effectiveness <strong>of</strong> different programmes than what is<br />

available until now.<br />

<strong>Further</strong>more, measuring effectiveness is always a comparison <strong>of</strong> different states. This paper has<br />

a micro perspective, i.e. the focus is on how a programme affects the participants compared to<br />

a state where they would not have participated in the corresponding treatment. Therefore, a<br />

natural comparison is a state "nonparticipation". For Gerfin and Lechner (2002) persons were<br />

defined as nonparticipants if they did not participate in any programme throughout their unemployment<br />

spell. Only nonparticipation and subsidised interim jobs by them were found to<br />

be superior programmes in terms <strong>of</strong> leaving unemployment and finding a job. Gerfin, Lechner<br />

and Steiger (2002) used updated data <strong>of</strong> the same sample to have a closer look at the different<br />

effects <strong>of</strong> different kinds <strong>of</strong> temporary subsidised employment in form <strong>of</strong> employment programmes<br />

and subsidised interim jobs; with better outcomes that also accounted for earnings<br />

effects they found that interim jobs to be superior for almost <strong>all</strong> possible subgroups; however,<br />

the superiority <strong>of</strong> nonparticipation compared to employment programmes was ch<strong>all</strong>enged<br />

though a clear picture could not be drawn. Lalive, van Ours and Zweimüller (2002) evaluated<br />

Swiss active labour market policies by means <strong>of</strong> a parametric duration model; nonparticipation<br />

was the base category and treated in a dynamic way. Almost <strong>all</strong> programmes were found to be


2<br />

effective, and employment programmes in particular turned out to be superior in <strong>all</strong> respects,<br />

more so for women.<br />

The research question posed here is how programmes affect the participants compared to<br />

nonparticipation. It is maybe the most interesting policy question in terms <strong>of</strong> active labour<br />

market programmes, because it directly asks if public spending is effective at <strong>all</strong>: <strong>all</strong> programmes<br />

are costly except for interim jobs which are less expensive than just passive maintenance.<br />

Therefore, efficient spending means that there is a return on active labour market programmes.<br />

This question was addressed in the earlier studies mentioned above also. However,<br />

recent work by Fredriksson and Johansson (2002) showed that both ways <strong>of</strong> treating nonparticipation<br />

give biased results. The method <strong>of</strong> Sianesi (2004) is an empirical strategy that is in<br />

line with these findings; she applied a quasi-dynamic approach to an evaluation <strong>of</strong> Swedish<br />

programmes that are very similarly set up as in Switzerland. It applies another definition <strong>of</strong><br />

nonparticipation altogether: every person is a nonparticipant until she participates in a programme<br />

or leaves unemployment. This method is adjusted here for the needs <strong>of</strong> evaluating<br />

Swiss programmes. Moreover, none <strong>of</strong> the previous studies re<strong>all</strong>y gave a comprehensive picture<br />

<strong>of</strong> the effects in terms <strong>of</strong> different outcomes.<br />

This paper is structured in the following way: section 2 gives an overview <strong>of</strong> active labour<br />

market policy in Switzerland. Section 3 explains the two estimation strategies, section 4 describes<br />

the data and how it is sampled for this study. Section 5 shows and discusses estimation<br />

results, and section 0 concludes.<br />

2 Active labour market policy in Switzerland<br />

2.1 Design<br />

Tradition<strong>all</strong>y, Switzerland has seen low unemployment, which facilitates high public spending<br />

on the unemployed. Besides comparatively high passive unemployment benefits (between 70<br />

and 80 percent <strong>of</strong> former salary), Switzerland maintains a comprehensive toolbox <strong>of</strong> active<br />

programmes also.<br />

Counselling and placement services are available to every job seeker in Switzerland, regardless<br />

<strong>of</strong> his or her unemployment status. Actual unemployed persons are entitled to more intensive<br />

programmes such as personality, computer, and language courses, or other vocational training,<br />

in order to re-fresh and improve their pr<strong>of</strong>essional abilities. For work experience different<br />

kinds <strong>of</strong> employment subsidies or specific<strong>all</strong>y designed temporary jobs are available. The duration<br />

<strong>of</strong> programmes varies substanti<strong>all</strong>y: full-time courses may not last longer than two months<br />

whereas employment programmes norm<strong>all</strong>y are assigned for 6 months.<br />

An unemployed person registers with the corresponding regional unemployment <strong>of</strong>fice. The<br />

responsible caseworker takes up the case and meets the unemployed on a regular basis to


3<br />

evaluate the endeavours for finding a job and to chart a roadmap to success. Caseworkers<br />

counsel the unemployed and decide about participation in active labour market programmes.<br />

Once decreed by the <strong>of</strong>ficer, a programme is compulsory: non-attendance by the unemployed<br />

is sanctioned by benefit cancellation.<br />

2.2 Nonparticipation<br />

Why do certain unemployed participate in a programme, but others do not? Nonparticipation<br />

in the Swiss setup arises, (1) if the unemployed has not been assigned to a programme by the<br />

caseworker, (2) if the unemployed has not come up with the idea <strong>of</strong> a programme himself, or<br />

(3) if the unemployed wanted to participate in a programme, but his request was not granted<br />

by the caseworker.<br />

ad (1): The policy for assignment <strong>of</strong> unemployed into programmes is not standardised in Switzerland;<br />

cantons have a considerable amount <strong>of</strong> autonomy in executing the federal law. Assignment<br />

<strong>of</strong> persons into programmes furthermore varies between employment <strong>of</strong>fices and<br />

<strong>of</strong>ficers themselves. A person might not be assigned to a programme by the caseworker because<br />

there is no programme available (limited supply), because the caseworker doesn't see<br />

any need for training, or because he wants to give the person more time to search for a job<br />

instead <strong>of</strong> keeping her busy with participation in a programme.<br />

ad (2) and (3): An unemployed person can apply herself for programmes. The request has to<br />

be granted by the caseworker or – in case <strong>of</strong> expensive programmes – by the cantonal authority.<br />

The programme by law has to increase the unemployed person's employability in order to<br />

be granted. Another programme that is mostly organised by the unemployed themselves is an<br />

interim job: a job is taken up interim in order to avoid joblessness, though the job is not "suitable"<br />

in the sense <strong>of</strong> the unemployment insurance act (more than 2 hours away from home,<br />

pays less than actual unemployment benefits, or has unacceptable working conditions for the<br />

person, e.g. work on c<strong>all</strong>).<br />

Participation furthermore is hardly related to a point <strong>of</strong> time within the total unemployment<br />

spell. There is no rule which says that after a certain point <strong>of</strong> time a person is obliged to participate<br />

in a specific programme or the opposite, i.e. participation is not possible any more.<br />

The federal authority gives a general recommendation to assign people into programmes early<br />

in their spell. However, this recommendation is not binding and <strong>of</strong>ten not followed.<br />

If a person has not participated in any programme, this therefore might be more a combination<br />

<strong>of</strong> dynamic decisions at every meeting with the caseworkers than a predefined and intentional<br />

strategy. Since meetings with caseworkers norm<strong>all</strong>y take place at least once in a month,<br />

a monthly decision basis is appropriate for evaluation purpose also.


3 Econometrics<br />

3.1 Identification and Estimation<br />

4<br />

The definition <strong>of</strong> an individual causal effect <strong>of</strong> a treatment 1 is the difference between what a<br />

person achieves when she got the treatment and what she would have achieved in the absence<br />

<strong>of</strong> it. The average effect then is the mean <strong>of</strong> <strong>all</strong> individual effects if macro effects are<br />

ruled out (stable unit treatment value assumption, SUTVA). By denoting the outcome (achieve-<br />

ment) as Y we thus can define two states for a person:<br />

the presence <strong>of</strong> a treatment. The average treatment effect then is<br />

1 0<br />

E ⎡<br />

⎣Y −Y<br />

⎤<br />

⎦.<br />

0<br />

Y is the state in the absence,<br />

1<br />

Y in<br />

In the presence <strong>of</strong> multiple (R) treatments the causal effect can be defined following Lechner<br />

(2001b) between any two programmes m and l as the effect <strong>of</strong> participating in one <strong>of</strong> the R<br />

programmes m compared to participation in any other programme l ≠ m. A natural effect <strong>of</strong><br />

interest would then be the comparison to nonparticipation:<br />

m 0<br />

E ⎡<br />

⎣Y −Y<br />

⎤<br />

⎦ .<br />

People now can be observed in only one programme (or in no programme), such that the<br />

specific outcome for them is known after actual programme participation. If we denote participation<br />

as D, we thus can observe<br />

m<br />

E ⎡<br />

⎣Y D = m ⎤<br />

⎦<br />

The possible outcome after another treatment or after not participating at <strong>all</strong> is unknown, since<br />

those people didn’t take place in any <strong>of</strong> them. They are referred to as counterfactuals, that is,<br />

hypothetical outcomes in a hypothetic<strong>all</strong>y existing par<strong>all</strong>el world.<br />

l<br />

E ⎣<br />

⎡Y D = 0⎤<br />

⎦ or<br />

⎡<br />

⎣<br />

⎤<br />

⎦<br />

0<br />

E Y D = l<br />

In the remaining part <strong>of</strong> this paper the focus will be on average treatment effects on the<br />

treated (ATT):<br />

⎣<br />

⎡ ⎤<br />

⎦<br />

⎡<br />

⎣<br />

⎤<br />

⎦<br />

⎡<br />

⎣<br />

⎤<br />

⎦<br />

m 0 m<br />

0<br />

E Y − Y D = m = E Y D = m − E Y D = m<br />

The outcomes <strong>of</strong> people who have not participated is<br />

⎡<br />

⎣ = 0⎤<br />

⎦ . What we observe thus is<br />

0<br />

E Y D<br />

⎡<br />

⎣ = ⎤<br />

⎦ − ⎡<br />

⎣ = 0⎤ ⎦ = ⎡<br />

⎣ − = ⎤<br />

⎦+ ⎡<br />

⎣ = ⎤<br />

⎦− ⎡<br />

⎣ = 0⎤<br />

������������� ⎦<br />

m 0 m 0 0 0<br />

E Y D m E Y D E Y Y D m E Y D m E Y D<br />

selection bias<br />

1 Active labour market programmes are referred to as “treatments” in this literature (following the biostatistical literature).


5<br />

The second part <strong>of</strong> this is the selection bias, i.e. the difference between their (hypothetical or<br />

actual) outcomes after nonparticipation. In non-experimental studies this bias is not expected<br />

to be zero; i.e. persons who actu<strong>all</strong>y participated in programme m might have a different expected<br />

outcome after nonparticipation than those who actu<strong>all</strong>y did not participate. In other<br />

words, people might have been selected into programmes according to their expected pr<strong>of</strong>its<br />

<strong>of</strong> the programme. Would this selection bias be zero, we just could take the average outcomes<br />

in both participant groups <strong>of</strong> programmes 0 and m, and it would be the causal effect. This is –<br />

under further assumptions – the case in experimental studies. However, experimental data are<br />

not at hand. For the identification <strong>of</strong> treatment effects from non-experimental data in principle<br />

two strategies are possible: the first strategy is to assume that <strong>all</strong> relevant information about the<br />

connection between programme selection and outcome is given. This is c<strong>all</strong>ed “selection on<br />

observables” or “conditional independence assumption” (CIA). If this assumption is not credible<br />

with the data at hand, other strategies based on “selection on unobservables” have to be<br />

applied (Instrument variable, difference-in-difference, distributional assumptions <strong>of</strong> selection<br />

bias components, etc.). For an overview <strong>of</strong> strategies see Heckman, LaLonde, Smith (1999).<br />

The CIA states that, given <strong>all</strong> known characteristics X that jointly influence participation decision<br />

and outcome after participation, the (hypothetical) outcome after participation in a programme<br />

is independent <strong>of</strong> the actual participation D:<br />

l<br />

Y � D X l ∈ { m,0}<br />

For the matching estimator we need a second assumption, namely that everybody has a positive<br />

probability to be in either programme m or programme 0:<br />

P( D = r ) > 0 r ∈ { m,0}<br />

With this assumption we can identify<br />

⎡<br />

⎣<br />

⎤<br />

⎦<br />

⎡<br />

⎣<br />

⎤<br />

⎦<br />

0 0<br />

E Y D = m, X = x = E Y D = 0, X = x<br />

Integrating over x we get:<br />

∫<br />

⎡<br />

⎣<br />

⎤<br />

⎦<br />

⎡<br />

⎣<br />

⎤<br />

⎦<br />

0 0<br />

E Y D = m = E Y D = 0, X = x f( x D = m) dx<br />

The average treatment effect <strong>of</strong> m on those who participated in m compared to those partici-<br />

m,0<br />

pating in 0 ( θ ) then is<br />

= E ⎣Y D = m⎦− E ⎣Y D = 0, X = x⎦f( x D = m) dx<br />

m,0 m<br />

0<br />

θ ⎡ ⎤ ⎡ ⎤<br />

∫<br />

m<br />

E ⎡<br />

⎣Y D = m ⎤<br />

⎦ is estimated by the sample mean outcome <strong>of</strong> <strong>all</strong> participants in treatment m.<br />

The second part is a little bit more difficult to estimate because X is multi-dimensional. It is<br />

shown that instead <strong>of</strong> the whole vector <strong>of</strong> X it is sufficient to condition on the participation<br />

probabilities P ( D = m X = x ) and P ( D 0 X x)<br />

= = (cf. Lechner 2001a). In this paper the


6<br />

conditioning is based on <strong>all</strong> participation probabilities as well as on other important variables<br />

(age, gender, duration <strong>of</strong> unemployment at beginning <strong>of</strong> programme, employability, mother<br />

tongue, qualification, canton), because the availability <strong>of</strong> additional programmes effects the<br />

choice <strong>of</strong> the actual programme. For every person in the sample <strong>of</strong> participants in treatment m<br />

one or several very similar persons in treatment 0 are found and the (weighted average) outcome<br />

is calculated. “Similarity” is in terms <strong>of</strong> the participation probabilities and the other variables<br />

also. The matching procedure can be based on one nearest neighbour only or on a<br />

weighted average <strong>of</strong> several similar persons. A comprehensive overview <strong>of</strong> matching estimators<br />

is given in Frölich (2004). In this application, nearest-neighbour-matching is done.<br />

3.2 Quasi-dynamic matching<br />

A non-dynamic variant <strong>of</strong> the matching method defines participants as those who participated<br />

in the programme once in their total spell, and nonparticipants as those who never participated<br />

in any programme. Fredriksson and Johansson (2002) showed that this leads to negative<br />

effects <strong>of</strong> treatments compared to nonparticipation, because the conditional independence<br />

assumption does not hold: The treatment indicator itself is defined based on future outcomes.<br />

Sianesi (2004) developed and applied an empirical approach to account for the dynamics <strong>of</strong><br />

the treatment decision: she treats nonparticipants as “waiters”. Nonparticipation is not treated<br />

as an own programme, but as a “default” state with more intensive job search. This approach<br />

resembles the hazard model with multiple risks: at any time after registration a person decides<br />

whether to participate in any programme m or to wait. All persons who haven’t participated<br />

until time t and who are still unemployed are “waiters”.<br />

The CIA that is required for this is<br />

�<br />

Y D X = x, D = D = ... = D = 0, still unemployed in τ, t > τ<br />

0 τ 1 2<br />

τ<br />

t<br />

This CIA states that how the (hypothetical) outcome evolves after not participating up to time<br />

τ is independent <strong>of</strong> a programme participation at time τ, given characteristics X.<br />

The treatment effect <strong>of</strong> having participated in programme m at time τ instead <strong>of</strong> waiting at<br />

least one period longer, for those who participated, is (note that the outcome is measured at<br />

different points <strong>of</strong> times t after programme participation):<br />

⎡ ⎤<br />

⎣ ⎦<br />

m, τ m,<br />

τ 0, τ τ<br />

θt = EYt − Yt D = m t > τ<br />

The composite treatment effect at time t for <strong>all</strong> persons having participated at any time before t<br />

compared to having waited therefore is:<br />

= ∑<br />

τ<<br />

τ<br />

⋅<br />

τ<br />

= =<br />

,<br />

m<br />

t<br />

t<br />

m<br />

t<br />

θ θ<br />

( )<br />

P D m D m<br />

Note that meaning <strong>of</strong> “causality” in this context is not straightforward. m<br />

θ is the over<strong>all</strong> treatment<br />

effect on those who participated in programme m at any time in their unemployment


7<br />

spell instead <strong>of</strong> waiting longer, which might include another programme participation later in<br />

their spell as well.<br />

3.3 Matching procedure<br />

Conventional nearest-neighbour-matching in a multiple treatment setup according to Gerfin<br />

and Lechner (2002) as well as an adjusted version for the Sianesi (2004) approach are used.<br />

The following subsections explain the steps.<br />

1. Propensity scores<br />

The suggested multinomial probit model for calculating the propensity scores is computation<strong>all</strong>y<br />

very expensive in the case <strong>of</strong> 10 treatments. Therefore 9 binomial probits based on <strong>all</strong><br />

observations are used here (dependent variable: “participant in treatment j”). Lechner (2002)<br />

found that this procedure leads to results very close to those obtained using the multinomial<br />

probit estimates.<br />

On the basis <strong>of</strong> the computed coefficients, for every person and every programme their re-<br />

0 9<br />

spective participation probabilities are computed ( P ,... P ).<br />

i i<br />

For the quasi-dynamic approach the same participation probabilities are computed. 2<br />

2. Common support<br />

The Common support restriction follows directly Gerfin and Lechner (2002). More work on<br />

common support and how it effects estimates is provided in Lechner (2001a). It eliminates <strong>all</strong><br />

observations that have propensity scores sm<strong>all</strong>er than the maximum <strong>of</strong> <strong>all</strong> minima or bigger<br />

than the minimum <strong>of</strong> <strong>all</strong> maxima within the treatment groups. This criterion guarantees comparability<br />

between treatment groups.<br />

In the quasi-dynamic approach the common support restriction is not applied, because regularly<br />

there are very few participants in every month, and a quite large set <strong>of</strong> corresponding<br />

nonparticipants.<br />

3. Matching procedure<br />

The matching procedure is nearest-neighbour matching with replacement, as used in GL:<br />

Within a treatment group m for every observation (person) i the most similar person j from the<br />

treatment group 0 is chosen. “Similarity” is defined in terms <strong>of</strong> the Mahalanobis distance based<br />

0<br />

on <strong>all</strong> propensity scores P – 9<br />

P as well as a subset <strong>of</strong> outcome specific covariates x� i : beginning<br />

<strong>of</strong> programme, age, gender, duration <strong>of</strong> unemployment at beginning <strong>of</strong> programme, em-<br />

2 A propensity score for participation at the corresponding time τ cannot be used because there are too few single<br />

observations in the corresponding cells starting a programme.


8<br />

ployability, mother tongue, qualification, canton. The person with the minimum Mahalanobis<br />

distance to person i from the pool <strong>of</strong> participants in treatment 0 is defined as her “counterfac-<br />

tual”. A person in 0 might be the closest match for more than one observation in m.<br />

counts the numbers <strong>of</strong> times a person in the pool l is used as the closest match for a person in<br />

pool m. The counterfactual outcome for a person is computed as:<br />

1<br />

Y = w ⋅Y<br />

∑<br />

cf m, l<br />

i<br />

N m j∈Il j j<br />

The treatment effect is computed as:<br />

ml , 1<br />

cf<br />

θ = ∑ ( Yi −Yi<br />

)<br />

N m i∈Im Simple standard errors <strong>of</strong> the ATT ignoring the variance <strong>of</strong> the first estimation step (propensity<br />

scores) are computed following Lechner (2001b) as the square root <strong>of</strong><br />

1 � 1 ml ,2<br />

Var Y + �<br />

2 ∑ w j ⋅Var<br />

Y ,<br />

N i∈Im N<br />

j∈Il m m<br />

j∈Il l is always used for the ‘untreated’ and m for the ‘treated’.<br />

This matching procedure in principle is independent <strong>of</strong> the outcome measured. However, in<br />

this framework there is a problem with the outcomes 2, 3, and 4: both <strong>of</strong> them are measured<br />

in months after programme start. For persons with an early programme start date, e.g. January<br />

1998, this outcome is observed for a very long time. For persons with a late programme start<br />

only a short time interval after programme start is observed, and later outcomes are missing.<br />

The same problem arises for persons whose benefit entitlement period started late (for outcome<br />

3) or whose registration was late (outcome 4). The following solution is chosen: Persons<br />

here are matched only once. For later time periods, the counterfactual outcome exists only if<br />

the counterfactual person also still has an outcome. The variance takes into account only the<br />

observations with positive weights.<br />

The quasi-dynamic matching estimator m<br />

θ is the following:<br />

t −<br />

�m � m,<br />

τ τ<br />

θ = θ ⋅ ˆ<br />

t t P ( D = m D = m, τ < t )<br />

∑<br />

τ =<br />

1<br />

1<br />

N N<br />

τ τ<br />

with Pˆ ( D = m D = m, τ < t) = ∑1 ( D = m, τ < t) / ∑1<br />

( D = m, τ < t )<br />

i= 1 i=<br />

1<br />

where �, m τ<br />

θ is the conventional matching estimator for the treatment effect on the treated <strong>of</strong><br />

t<br />

starting a programme m at time τ compared to not starting a programme until and by the end<br />

<strong>of</strong> month τ, as described above. The aggregate effect sums up over <strong>all</strong> persons having already<br />

started their programme before t. ˆ ( τ = , τ < )<br />

m starting their treatment at time τ <strong>of</strong> <strong>all</strong> those starting before t.<br />

The variance is computed the same way:<br />

ml<br />

w j<br />

P D m t is the share <strong>of</strong> participants in programme


−<br />

� � τ τ<br />

( θ ) = ∑ θ ⋅ ( = = τ < )<br />

1 t<br />

m m,<br />

Var ˆ<br />

t Var t P D m D m, t<br />

4. Validity <strong>of</strong> CIA<br />

τ = 1<br />

9<br />

CIA is a very strong assumption that states that <strong>all</strong> information that influences the participation<br />

decision and the outcome at the same time are observed and controlled for. Nullity would<br />

mean that there are unobservable differences between the treated and untreated group that are<br />

not controlled for but that jointly influence participation and outcome. In that case the effects<br />

don’t have any causal interpretation, but are a composite between the selection bias and the<br />

true causal effect. In the non-dynamic setup the CIA has proved to be violated. For the quasidynamic<br />

setup, scepticism about the validity <strong>of</strong> the CIA might come up. Nevertheless, we refer<br />

readers to the comprehensive data that among other variables also contains earnings pr<strong>of</strong>iles<br />

<strong>of</strong> the past 10 years as well as caseworkers’ subjective rating <strong>of</strong> the unemployed person’s employability.<br />

With these variables a lot <strong>of</strong> gener<strong>all</strong>y unobserved but important heterogeneity<br />

should be accounted for.<br />

4 Data and Sampling<br />

4.1 Data<br />

The sample contains a cross section <strong>of</strong> <strong>all</strong> people who were unemployed at the end <strong>of</strong> December<br />

1997. 3 The data is a combination <strong>of</strong> two information systems <strong>of</strong> the unemployment<br />

insurance (placement/<strong>statistics</strong> and payments) and pension system records. The different data<br />

sets can be combined through a unique personal identification number.<br />

The following information is available in the data:<br />

Placement and labour market <strong>statistics</strong> database: Monthly information about corresponding<br />

placement <strong>of</strong>fice, personal characteristics, characteristics <strong>of</strong> previous job and desired job, status<br />

<strong>of</strong> job seeking, work experience, skills and caseworker’s rating <strong>of</strong> chances to find a job, duration<br />

<strong>of</strong> unemployment spell, participation in active labour market programmes/job introduction<br />

<strong>all</strong>owances. 4 We use pre-programme information from December 1997 as well as monthly information<br />

for the definition <strong>of</strong> unemployment status from January 1998 to December 1999.<br />

Payment system: Total benefits and other supplementary <strong>all</strong>owances paid by the unemployment<br />

insurance, sanctions, interim jobs, benefit exhaustion (on a monthly basis). We use pre-<br />

3 The data is an update and extension <strong>of</strong> the one used by Gerfin and Lechner (2002). More information about the<br />

original sample is given there.<br />

4 Though the data is very rich and contains a lot <strong>of</strong> information, it has to be mentioned that information about education<br />

is not available for the time covered here.


10<br />

programme information from December 1997 as well as monthly information for the definition<br />

<strong>of</strong> interim jobs and unemployment status from January 1998 to December 1999.<br />

Pension system: All payments paid to the pension system by an employer, by the person for<br />

self or by the unemployment insurance (the source can be identified); data gives yearly information<br />

indicating months <strong>of</strong> begin and end <strong>of</strong> each income spell (maximum January and December).<br />

This data is available from 1988 to 1999 for this study. Data from 1988 to 1997 is<br />

used for the construction <strong>of</strong> unemployment and employment history, data from 1996-1999<br />

addition<strong>all</strong>y is used for identification <strong>of</strong> employment on a monthly basis.<br />

For privacy protection rules access to <strong>all</strong> <strong>of</strong> these data bases is rigorously restricted. They are<br />

not publicly available.<br />

The pension system data were available for a subset <strong>of</strong> 81'399 persons. After applying diverse<br />

selection criteria (see <strong>Appendix</strong> A for the exact selection criteria) and applying the minimum<br />

duration criterion <strong>of</strong> 15 days for a programme 33'700 people remain.<br />

4.2 Outcomes<br />

This paper uses 11 different outcomes and three time frames in which outcomes are measured.<br />

The outcomes a-f are computed using raw pension system data only; outcome g-k use pension<br />

system data combined with unemployment insurance data.<br />

Outcome a: A person has a positive entry <strong>of</strong> a salary in the pension system for the corresponding<br />

month.<br />

Outcome b: A person has a positive entry <strong>of</strong> an unemployment benefits payment in the pension<br />

system for the corresponding month.<br />

Outcome c: A person has no entry in the pension system for the corresponding month.<br />

Outcome d: "Raw" income from employment in corresponding month according to the pension<br />

system.<br />

Outcome e: "Raw" income from unemployment in corresponding month according to the pension<br />

system.<br />

Outcome f: Total income from unemployment in corresponding month according to the pension<br />

system.<br />

Outcome g: A person is employed according to the pension system data in an employment<br />

spell that lasts at least three consecutive months; at the same time that person doesn’t receive<br />

any payments from the unemployment insurance.<br />

Outcome h: A person is employed according to the same criteria as in outcome g (at least 3<br />

consecutive months, no benefits at the same time); addition<strong>all</strong>y, the earnings are at least 90<br />

percent <strong>of</strong> the last income which is the basis for the computation <strong>of</strong> benefits.<br />

Outcome i: Earnings in employment according to the definition in outcome g (at least 3 consecutive<br />

months, no benefits at the same time), this variable is 0 if outcome g is 0.


11<br />

Outcome j: A person is employed according to the same criteria as in outcome g (at least 3<br />

consecutive months, no benefits at the same time); addition<strong>all</strong>y, the earnings are “sustainable”<br />

in the sense that they exceed a minimal income criteria that is computed according to the<br />

guidelines <strong>of</strong> the social welfare (basic needs, additional needs, health insurance, flat rent) on<br />

the basis <strong>of</strong> the number <strong>of</strong> persons in the same household and the area the person lives.<br />

Outcome k: A person is registered at the regional employment <strong>of</strong>fice. This variable is set to 0 if<br />

the person at the same time has an ongoing earnings spell with earnings <strong>of</strong> at least 3000<br />

francs.<br />

Outcomes are measured in three different time frames:<br />

1. After programme start: maximum 23 months after programme start<br />

The first 6 outcomes (a-f) are measured in two more time frames:<br />

2. Entitlement period: months <strong>of</strong> entitlement period (maximum 48 months).<br />

3. Registration period: months since last registration (before beginning <strong>of</strong> 1998) in unemployment<br />

(maximum 36 months).<br />

Time frame 2 and 3 are not the same. The entitlement period starts with an unemployment<br />

spell. If the person re-registers unemployed after a short period <strong>of</strong> unemployment, the old<br />

entitlement period is still going on.<br />

For the time frames 2 and 3 only outcomes purely based on the pension system (i.e. a-f) exist<br />

because monthly data from the other systems is not complete for the time period January 1996<br />

– December 1997. Therefore, in total 23 outcomes are defined, each <strong>of</strong> them for the available<br />

time periods.<br />

4.3 Programmes<br />

In line with earlier evaluation work for Switzerland, the first significant programme after<br />

1.1.1998 is considered, i.e. the first programme that exceeds two weeks. Shorter programmes<br />

are not taken into account.<br />

The programme code in the unemployment insurance data differentiates between more than<br />

30 programmes. Here they are aggregated to 8 programme groups; this aggregation is similar<br />

to the one used by Frölich, Lechner and Steiger (2003): personality and other basic courses (1),<br />

language courses (2), basic computer courses (3), higher vocational training (4), lower vocational<br />

training (5), other training (6), employment programmes in single workplaces (7), employment<br />

programmes in collective workplaces (8). Basic programmes are not taken into account<br />

at <strong>all</strong> because they are <strong>of</strong>ten followed by another programme and the effects should be<br />

assigned to the predominant programme. A 9 th programme is defined according to the unemployment<br />

insurance payment data if the computed length exceeds 2 weeks: interim jobs (9).


12<br />

1 Personality and other basic courses: They are courses who help persons to position themselves<br />

and their needs in the labour market. Addition<strong>all</strong>y, there are courses for basic qualifications.<br />

2 Language courses: They can be either courses in a foreign language for persons with good<br />

knowledge in the corresponding Swiss language, or German/French courses for persons with<br />

another mother tongue.<br />

3 Basic computer course: This computer course gives basic knowledge, e.g. Word courses,<br />

beginners courses, internet courses, etc.<br />

4 Higher vocational training: These courses are on a higher level than an actual vocational<br />

education in Switzerland; they include computer courses on an advanced level for specialists,<br />

commercial, and technical courses.<br />

5 Lower vocational training: These courses are not beyond the level <strong>of</strong> a vocational education.<br />

They include commercial, technical, hotel/restaurant industry, nursing, and cleaning courses.<br />

6 Other training: This is a group that subsumes <strong>all</strong> other courses: laboratory firms, internship,<br />

self-employment courses.<br />

7 Employment programmes single workplace: Participants work in the public administration, in<br />

another public service, or in a non-pr<strong>of</strong>it organisation. They work together with other “norm<strong>all</strong>y”<br />

employed persons.<br />

8 Employment programmes collective workplace: Participants work in facilities speci<strong>all</strong>y designed<br />

for unemployed persons, e.g. recycling.<br />

9 Interim jobs: A job in the labour market that is not suitable for the unemployed but that<br />

he/she takes up temporarily to avoid joblessness. It is subsidised by the unemployment insurance<br />

such that the unemployed is better <strong>of</strong>f than with unemployment benefits only. This programme<br />

is observable only month-wise; here participation is defined as having received the<br />

subsidy for at least 2 weeks. 5<br />

4.4 Definition <strong>of</strong> nonparticipants and programme start dates<br />

Nonparticipants in the non-dynamic matching part are defined according to Gerfin and<br />

Lechner (2002) as persons who don't participate in any programme in the observable time<br />

frame. For the outcome after programme start a hypothetical programme start date is assigned<br />

to persons in the following way: the programme start variable for <strong>all</strong> other persons is regressed<br />

on <strong>all</strong> available X variables. Based on the estimated coefficients and the corresponding X characteristics<br />

<strong>of</strong> the nonparticipants hypothetical starts for nonparticipants are computed. Nonparticipants<br />

who are already employed or don't have any entry in their pension system records<br />

are excluded from the sample.


13<br />

For the quasi-dynamic method nonparticipation is defined on a monthly basis: a person in<br />

month t is a nonparticipant if she has not yet participated in a programme and at the same<br />

time is not employed or out <strong>of</strong> labour force yet.<br />

In both cases a person f<strong>all</strong>s out <strong>of</strong> the comparison sample if she has already participated in a<br />

programme, if she is employed according to a criterion combining pension system records and<br />

unemployment insurance data, or if she doesn't have any information in her pension system<br />

records, which is an indicator <strong>of</strong> being out <strong>of</strong> labour force or welfare dependent. In both cases<br />

a person in a strict sense is not part <strong>of</strong> the target group <strong>of</strong> a programme any more and hence<br />

is excluded.<br />

4.5 Descriptive <strong>statistics</strong><br />

Some selected descriptive <strong>statistics</strong> <strong>of</strong> the whole sample are given in Table 4-1. An overview <strong>of</strong><br />

<strong>all</strong> descriptive <strong>statistics</strong> <strong>of</strong> <strong>all</strong> variables available is given in <strong>Appendix</strong> B.<br />

Table 4-1 Selected descriptive <strong>statistics</strong><br />

Sample A Sample B<br />

Current unemployment spell<br />

Duration <strong>of</strong> current unemployment, 31.12.1997 151.03 147.12<br />

Unemployment benefit, daily, CHF 139.09 137.63<br />

Programme participation (in %)<br />

No course 0.32 0.47<br />

Personality course 0.05 0.04<br />

Language course 0.09 0.08<br />

Basic computer course 0.08 0.06<br />

Vocational training high level 0.02 0.02<br />

Vocational training low level 0.03 0.02<br />

Other training 0.02 0.01<br />

Employment programme public 0.07 0.05<br />

Employment programme private 0.07 0.05<br />

Temporary wage subsidy 0.25 0.20<br />

Duration <strong>of</strong> current unemployment spell at begin <strong>of</strong> first programme<br />

Other socio-economic characteristics<br />

94.66 206.26<br />

Female 0.44 0.46<br />

Marital status single 0.28 0.26<br />

Marital status married 0.59 0.61<br />

Nationality Swiss 0.56 0.54<br />

Foreigner with permanent permit 0.29 0.30<br />

Qualification: skilled 0.57 0.54<br />

Qualification: unskilled 0.27 0.31<br />

Mother tongue German 0.35 0.34<br />

Monthly earnings in last job in CHF 3883 3840<br />

Employability easy or very easy 0.20 0.21<br />

Employability medium<br />

Employment history from pension system data<br />

0.58 0.55<br />

Number <strong>of</strong> months unemployed since entry into pension system or since 1988 10.21 10.48<br />

Number <strong>of</strong> months employed since entry into pension system or since 1988 87.10 85.74<br />

5 For a comprehensive description <strong>of</strong> temporary interim jobs the reader is referred to Gerfin, Lechner and Steiger<br />

(2002).


Never unemployed 0.08 0.08<br />

Month <strong>of</strong> entry into pension system (1=January 1988) 13.49 14.13<br />

Number <strong>of</strong> unemployment spells since 1988 1.80 1.87<br />

Mean duration <strong>of</strong> unemployment spell in months 5.18 5.17<br />

Duration <strong>of</strong> last employment spell 52.60 50.23<br />

Graph 4-1 Descriptive <strong>statistics</strong> <strong>of</strong> outcomes<br />

Calendar time<br />

After programme start<br />

In benefit entitlement period<br />

Since registration<br />

%<br />

20 40 60 80 100<br />

%<br />

20 40 60 80 100<br />

%<br />

20 40 60 80 100<br />

%<br />

20 40 60 80 100<br />

14<br />

Outcomes in CHF Outcomes in %<br />

2 5 8 11 14 17 20 23<br />

calendar time in months (1 = Jan 98)<br />

Empl. >= 3 months<br />

Empl. w/o earnings loss<br />

Empl. with sust. earnings<br />

Searching for job<br />

Pension: empl>0<br />

Pension: unempl>0<br />

No info in AHV<br />

2 5 8 11 14 17 20 22<br />

months after programme start<br />

Empl. >= 3 months<br />

Empl. w/o earnings loss<br />

Empl. with sust. earnings<br />

Searching for job<br />

Pension: empl>0<br />

Pension: unempl>0<br />

No info in AHV<br />

2 5 8 11 14 17 20 23 26 29 32 35 38 41 44 47<br />

months in benefit entitlement period<br />

Pension: empl>0<br />

Pension: unempl>0<br />

No info in AHV<br />

2 5 8 11 14 17 20 23 26 29 32 35<br />

months since registration<br />

Pension: empl>0<br />

Pension: unempl>0<br />

No info in AHV<br />

CHF<br />

0 1000 2000 3000 4000<br />

CHF<br />

0 1000 2000 3000 4000<br />

CHF<br />

0 1000 2000 3000 4000<br />

CHF<br />

0 1000 2000 3000 4000<br />

2 5 8 11 14 17 20 23<br />

calendar time in months (1 = Jan 98)<br />

Earnings in empl. >=3 m<br />

Income from empl.<br />

Income from unempl.<br />

Total income<br />

2 5 8 11 14 17 20 22<br />

months after programme start<br />

Earnings in empl. >=3 m<br />

Income from empl.<br />

Income from unempl.<br />

Total income<br />

2 5 8 11 14 17 20 23 26 29 32 35 38 41 44 47<br />

months in benefit entitlement period<br />

Income from empl.<br />

Income from unempl.<br />

Total income<br />

2 5 8 11 14 17 20 23 26 29 32 35<br />

months since registration<br />

Income from empl.<br />

Income from unempl.<br />

Total income<br />

Note: All graphs are based on Sample A with 21'555 observations (after common support restriction and dropping out<br />

nonparticipants based on their assigned starting date).


15<br />

Graphs with descriptive <strong>statistics</strong> <strong>of</strong> outcomes are displayed in Graph 4-1. At the beginning <strong>of</strong><br />

1998, nobody is employed and <strong>all</strong> persons are searching for a job according to the unemployment<br />

insurance data. The pension system records show that still persons receive income from<br />

employment, which most probably comes from interim jobs or employment programmes. The<br />

amount <strong>of</strong> persons without information in the pension system increases by time. Typic<strong>all</strong>y, the<br />

share <strong>of</strong> persons without information jumps up after the benefit entitlement period is exhausted<br />

(after 24 months). Similarly, the total available income drops after benefit exhaustion.<br />

Surprisingly, at a first glance no employment effect close to benefit exhaustion can be found.<br />

The share <strong>of</strong> persons with a "stable" or "sustainable" job increases with time. Towards the end<br />

<strong>of</strong> the observation period, the income mainly comes from stable income <strong>of</strong> at least 3 months.<br />

5 Results<br />

5.1 Propensity Scores<br />

The computation <strong>of</strong> propensity scores should contain <strong>all</strong> variables X that potenti<strong>all</strong>y influence<br />

both the participation decision and the later outcome. In principle <strong>all</strong> available variables are<br />

used for estimation; variables not used are either collinear to other variables, or they predict a<br />

participation decision perfectly. As already described, 10 binomial probit models are estimated<br />

for the dynamic and the non-dynamic models. The coefficients are not <strong>of</strong> particular interest<br />

and therefore not given here.<br />

5.2 Common Support<br />

The common support criterion described above sh<strong>all</strong> guarantee comparability <strong>of</strong> the people in<br />

the treatment groups by excluding observations that are not comparable to observations in<br />

other programme participant groups. For this purpose, <strong>all</strong> those with a propensity score<br />

sm<strong>all</strong>er than the maximum <strong>of</strong> <strong>all</strong> minima <strong>of</strong> propensity scores within the 10 participant groups<br />

are deleted as well as those with a propensity score bigger than the minimum <strong>of</strong> <strong>all</strong> maxima.<br />

This restriction guarantees comparability between <strong>all</strong> groups, i.e. <strong>all</strong> pairwise comparisons are<br />

based on the same observations. This leads to a significant loss <strong>of</strong> observations (cf. Table 5-1)<br />

<strong>of</strong> around 18 percent. Participants in language courses, employment programmes in collective<br />

workplaces, and interim jobs lose more observations than the average. That means that the<br />

participants in these programmes are less comparable to others. They might be more specific<strong>all</strong>y<br />

selected into these programmes.<br />

This selection possibly alters the underlying sample considerably. Tests for equality <strong>of</strong> means<br />

show that there are significant differences. Table 5-2 shows the number <strong>of</strong> outcome means that<br />

are significantly different before and after common support. In the time frame "calendar time"


16<br />

we can hardly find any differences. In the time frame "entitlement period" there are differences,<br />

especi<strong>all</strong>y in the two groups <strong>of</strong> vocational training. These groups however are sm<strong>all</strong>,<br />

and the difference might come especi<strong>all</strong>y from higher time periods were numbers <strong>of</strong> observations<br />

are very low.<br />

The common support in terms <strong>of</strong> propensity scores is displayed in Graph 5-1 in the form <strong>of</strong><br />

Kernel densities for the probability <strong>of</strong> not participating, within the subgroups, respectively. The<br />

support is reasonable equal among groups. Comparability between groups might be reasonably<br />

good.<br />

Table 5-1: Observations deleted due to common support criterion<br />

Before After (%)<br />

Total observations 26'333 21'555 18<br />

No programme 8'331 6'936 17<br />

Personality or other basic course 1'293 1'076 17<br />

Language course 2'704 2'007 26<br />

Basic computer course 1'891 1'647 13<br />

Higher vocational training 609 519 15<br />

Lower vocational training 707 607 14<br />

Other training 376 334 11<br />

Employment programme single workplace 1'764 1'496 15<br />

Employment programme collective workplace 1'826 1'486 19<br />

Interim job 6'832 5'447 20<br />

Note: (%) denotes the percentage <strong>of</strong> observations lost.<br />

Table 5-2: Test for equality <strong>of</strong> outcome means before and after common support<br />

Outcome a b c d e f g h i j k<br />

No programme 0 0 0 0 1 1 0 0 0 0 0 0 1 1 1 1 1<br />

Personality course 0 1 0 1 0 1 0 1 0 1 0 1 0 1 0 1 0<br />

Language course 0 1 0 1 0 2 0 1 0 1 0 1 0 0 0 1 0<br />

Computer course 0 2 0 1 0 2 0 1 0 1 0 1 0 0 0 1 0<br />

Higher voc. training 0 4 0 6 0 4 0 1 0 6 0 1 0 0 0 0 1<br />

Lower voc. training 0 3 0 9 0 3 0 3 0 9 0 3 0 2 0 2 1<br />

Other training 0 4 0 3 0 4 0 1 0 3 0 1 0 1 0 0 0<br />

Empl. pr. single 0 1 0 1 0 4 0 1 0 1 0 1 0 0 0 0 0<br />

Empl. pr. collective 0 2 0 2 0 2 0 1 0 1 0 1 0 0 0 0 0<br />

Interim job 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0<br />

Note: For definitions <strong>of</strong> outcomes see above (4.2). Outcomes a-f are measured in calendar time since 1/1998 as well as in<br />

benefit entitlement period (maximal 48 periods). Outcomes g-k are measured in calendar time since 1/1998 (24<br />

months).<br />

Tests for comparing means before and after common support: ( ybefore − yafter ) /<br />

ber <strong>of</strong> significantly different means out <strong>of</strong> <strong>all</strong> time periods (23/48) are given.<br />

Var � / �<br />

before Nbefore+ Varafter/ Nafter<br />

>1.96; num


Graph 5-1 Kernel densities <strong>of</strong> propensity scores after common support restriction<br />

0 1 2 3 4 5<br />

17<br />

0 .2 .4 .6 .8<br />

no prog<br />

personality<br />

language<br />

computer<br />

voc. high<br />

voc. low<br />

other<br />

EP single<br />

EP coll.<br />

interim job<br />

Note: Kernel densities for Pr(no programme). The underlying sample is the final sample for the non-dynamic matching<br />

estimator, after dropping nonparticipants on the basis <strong>of</strong> computed programme start dates and after common support<br />

restriction, 21'555 observations (no programme: 8'331; personality: 1'293; language: 2'704; computer: 1'891; voc.<br />

high: 609; voc. low: 707; other training: 376; empl. prog. single: 1'764; empl. prog. collective: 1'826; interim job:<br />

6'832).<br />

5.3 Matching results<br />

In the following subsections the results <strong>of</strong> the different outcomes are discussed separately.<br />

Every section gives results from the non-dynamic as well as the quasi-dynamic setup. Every<br />

displayed point shows a significant average treatment effect on the treated (ATT, significance<br />

level 5 percent). For both setups, ATTs are given compared to nonparticipation (treatment<br />

effect on the participants compared to nonparticipation). "Nonparticipation" is defined by the<br />

corresponding non-dynamic and quasi-dynamic approaches, respectively. A point below 0<br />

means that for people having participated in the corresponding employment programme the<br />

outcome was lower than without any programme.<br />

The graphs display average treatment effects on the treated (ATT) for different treatments,<br />

points <strong>of</strong> times, and outcomes. Every point shows an ATT that is significant on the 5 percent<br />

level. Points above the 0 line mean that the reference treatment lead to a significantly higher<br />

outcome compared to the treatment defined by the symbol at the corresponding point <strong>of</strong> time,<br />

for the people having participated in the treatment the point is assigned to.


5.3.1 Employment and income based only on pension system data<br />

Table 5-3 Results for outcome "Employment based only on pension system data"<br />

%<br />

-30 -20 -10 0 10 20 30<br />

%<br />

-30 -20 -10 0 10 20 30<br />

%<br />

-30 -20 -10 0 10 20 30<br />

18<br />

Non-dynamic Quasi-dynamic<br />

After programme start<br />

2 5 8 11 14 17 20 22<br />

months after programme start<br />

2 5 8 11 14 17 20 23 26 29 32 35 38 40<br />

months in benefit entitlement period<br />

2 5 8 11 14 17 20 23 26 29 32<br />

months since registration<br />

%<br />

-40 -20 0 20 40<br />

2 5 8 11 14 17 20 23<br />

months after programme start<br />

In benefit entitlement period<br />

%<br />

-40 -20 0 20 40<br />

2 5 8 11 14 17 20 23 26 29 32 35 38 40<br />

months in benefit entitlement period<br />

Since registration<br />

%<br />

-40 -20 0 20 40<br />

2 5 8 11 14 17 20 23 26 29 32<br />

months since registration<br />

The first as well as the following outcomes are based purely on pension system data. A person<br />

is "employed" if she has a positive income that comes from a regular employer according to<br />

the data. A person is also "employed" by this definition when she is in an interim job or an<br />

employment programme, based on the way these earnings are defined. This is the reason for<br />

the positive effects after programme start (see Table 5-3): an employment programme regularly<br />

has a duration <strong>of</strong> around 6 months; this effect drops after 6 months for these programmes<br />

which means that this effect is "causal" only in the sense that these persons are in the programme<br />

whereas others are not. In general, programmes don't have negative effects in the<br />

quasi-dynamic framework compared to nonparticipation. In general, the effects are reversed.<br />

The earnings related to this employment are shown in Table 5-4. They mirror the employment<br />

effects displayed above.


Table 5-4 Results for outcome "Income from employment according to pension system"<br />

CHF<br />

-800-400 0 400 800<br />

CHF<br />

-800-400 0 400800<br />

CHF<br />

-800 -400 0 400 800<br />

19<br />

Non-dynamic Quasi-dynamic<br />

After programme start<br />

2 5 8 11 14 17 20 22<br />

months after programme start<br />

2 5 8 11 14 17 20 23 26 29 32 35 38 40<br />

months in benefit entitlement period<br />

2 5 8 11 14 17 20 23 26 29 32<br />

months since registration<br />

CHF<br />

-800 -400 0 400 800<br />

2 5 8 11 14 17 20 23<br />

months after programme start<br />

In benefit entitlement period<br />

CHF<br />

-800 -400 0 400 800<br />

2 5 8 11 14 17 20 23 26 29 32 35 38 40<br />

months in benefit entitlement period<br />

Since registration<br />

CHF<br />

-800-400 0 400800<br />

2 5 8 11 14 17 20 23 26 29 32<br />

months since registration<br />

5.3.2 Unemployment and income from unemployment based only on pension system<br />

data<br />

Income from unemployment in the definition here is benefit payments by the unemployment<br />

insurance, without earnings from employment programmes. For interim jobs the subsidy is<br />

counted as benefits, the employer's part itself not. In terms <strong>of</strong> unemployment a similar picture<br />

arises as for employment. A specific finding here is that after expiration <strong>of</strong> the <strong>of</strong>ficial benefit<br />

entitlement period (24 months) persons with interim jobs are more likely to receive unemployment<br />

benefits than others. Earnings in interim jobs <strong>all</strong>ow for extension <strong>of</strong> the benefit entitlement<br />

period whereas other programmes do not.


Table 5-5 Results for outcome "Employment based only on pension system data "<br />

%<br />

-30 -20 -10 0 10 20 30<br />

%<br />

-30 -20 -10 0 10 20 30<br />

%<br />

-30 -20 -10 0 10 20 30<br />

20<br />

Non-dynamic Quasi-dynamic<br />

After programme start<br />

2 5 8 11 14 17 20 22<br />

months after programme start<br />

2 5 8 11 14 17 20 23 26 29 32 35 38 40<br />

months in benefit entitlement period<br />

2 5 8 11 14 17 20 23 26 29 32<br />

months since registration<br />

%<br />

-40 -20 0 20 40<br />

2 5 8 11 14 17 20 23<br />

months after programme start<br />

In benefit entitlement period<br />

%<br />

-40 -20 0 20 40<br />

2 5 8 11 14 17 20 23 26 29 32 35 38 40<br />

months in benefit entitlement period<br />

Since registration<br />

%<br />

-40 -20 0 20 40<br />

2 5 8 11 14 17 20 23 26 29 32<br />

months since registration


21<br />

Table 5-6 Results for outcome "Income from unemployment according to pension system"<br />

CHF<br />

-800 -400 0 400 800<br />

CHF<br />

-800 -400 0 400 800<br />

CHF<br />

-800 -400 0 400 800<br />

Non-dynamic Quasi-dynamic<br />

After programme start<br />

2 5 8 11 14 17 20 22<br />

months after programme start<br />

2 5 8 11 14 17 20 23 26 29 32 35 38 40<br />

months in benefit entitlement period<br />

2 5 8 11 14 17 20 23 26 29 32<br />

months since registration<br />

CHF<br />

-800 -400 0 400 800<br />

2 5 8 11 14 17 20 23<br />

months after programme start<br />

In benefit entitlement period<br />

CHF<br />

-800 -400 0 400 800<br />

2 5 8 11 14 17 20 23 26 29 32 35 38 40<br />

months in benefit entitlement period<br />

After registration<br />

CHF<br />

-800-400 0 400 800<br />

2 5 8 11 14 17 20 23 26 29 32<br />

months since registration


5.3.3 No information in the pension system<br />

Table 5-7 Results for outcome "No information in the pension system "<br />

%<br />

-30 -20 -10 0 10 20 30<br />

%<br />

-30 -20 -10 0 10 20 30<br />

%<br />

-30 -20 -10 0 10 20 30<br />

22<br />

Non-dynamic Quasi-dynamic<br />

After programme start<br />

2 5 8 11 14 17 20 22<br />

months after programme start<br />

2 5 8 11 14 17 20 23 26 29 32 35 38 40<br />

months in benefit entitlement period<br />

2 5 8 11 14 17 20 23 26 29 32<br />

months since registration<br />

%<br />

-40 -20 0 20 40<br />

2 5 8 11 14 17 20 23<br />

months after programme start<br />

In benefit entitlement period<br />

%<br />

-40 -20 0 20 40<br />

2 5 8 11 14 17 20 23 26 29 32 35 38 40<br />

months in benefit entitlement period<br />

Since registration<br />

%<br />

-40 -20 0 20 40<br />

2 5 8 11 14 17 20 23 26 29 32<br />

months since registration<br />

The outcome "no information in pension system" is directly related to welfare dependency and<br />

out <strong>of</strong> labour force status, though these two issues can't be disentangled with the underlying<br />

data (welfare payments are not subject to pension system contributions). For the first time the<br />

effects are not reversed between the two methods. In fact, the non-dynamic variant shows an<br />

effect that would be more in favour <strong>of</strong> programmes. However, effects are negative throughout,<br />

which means that persons in programmes are less likely to "drop out <strong>of</strong> the system".


23<br />

5.3.4 Total income according to pension system data<br />

Table 5-8 Results for outcome "Total income according to pension system"<br />

CHF<br />

-800-400 0 400 800<br />

CHF<br />

-800-400 0 400 800<br />

CHF<br />

-800 -400 0 400 800<br />

Non-dynamic Quasi-dynamic<br />

After programme start<br />

2 5 8 11 14 17 20 22<br />

months after programme start<br />

2 5 8 11 14 17 20 23 26 29 32 35 38 40<br />

months in benefit entitlement period<br />

2 5 8 11 14 17 20 23 26 29 32<br />

months since registration<br />

CHF<br />

-800 -400 0 400 800<br />

2 5 8 11 14 17 20 23<br />

months after programme start<br />

In benefit entitlement period<br />

CHF<br />

-800 -400 0 400 800<br />

2 5 8 11 14 17 20 23 26 29 32 35 38 40<br />

months in benefit entitlement period<br />

After registration<br />

CHF<br />

-800 -400 0 400 800<br />

2 5 8 11 14 17 20 23 26 29 32<br />

months since registration<br />

Total income from the pension system data is an indicator <strong>of</strong> what the total purchasing power<br />

<strong>of</strong> a person is. Both methods show a similar picture: participants in general are better <strong>of</strong>f after<br />

participation, and the positive effect goes on for a long time.


24<br />

5.3.5 Employment for at least 3 consecutive months<br />

Table 5-9 Results for outcome "Employed for at least 3 consecutive months"<br />

%<br />

-30 -20 -10 0 10 20 30<br />

Non-dynamic Quasi-dynamic<br />

2 5 8 11 14 17 20 22<br />

months after programme start<br />

%<br />

-40 -20 0 20 40<br />

2 5 8 11 14 17 20 23<br />

months after programme start<br />

This outcome variable rates employment as "stable" if the income spell in the pension system<br />

lasts for at least 3 months. Using the quasi-dynamic approach, the results are almost reversed<br />

compared to the non-dynamic picture. In fact, the non-dynamic method might be biased by<br />

nonparticipants who just leave unemployment after their assigned start date (one month after<br />

programme start the effect is already minus 20 percent which is hardly credible to be a causal<br />

effect). The quasi-dynamic approach does not show negative effects for any programme after<br />

four months.<br />

5.3.6 Employment with at least 90 percent <strong>of</strong> former earnings<br />

Table 5-10 Results for outcome "Employed with at least 90 percent <strong>of</strong> former earnings"<br />

%<br />

-30 -20 -10 0 10 20 30<br />

Non-dynamic Quasi-dynamic<br />

2 5 8 11 14 17 20 22<br />

months after programme start<br />

%<br />

-40 -20 0 20 40<br />

2 5 8 11 14 17 20 23<br />

months after programme start<br />

In addition to the stability criterion, this outcome variable puts a "quality" restriction on the job<br />

by applying a minimum criterion <strong>of</strong> 90 percent <strong>of</strong> former income on the earnings. For this outcome<br />

again the conclusions are just reversed. The quasi-dynamic approach shows significantly


25<br />

positive effects only after four months. None <strong>of</strong> the programme had a negative effect in the<br />

longer run.<br />

5.3.7 Earnings if not unemployed<br />

Table 5-11 Results for outcome "Earnings if not unemployed"<br />

CHF<br />

-800-400 0 400 800<br />

Non-dynamic Quasi-dynamic<br />

2 5 8 11 14 17 20 22<br />

months after programme start<br />

CHF<br />

-800 -400 0 400 800<br />

2 5 8 11 14 17 20 23<br />

months after programme start<br />

personality<br />

language<br />

computer<br />

voc. high<br />

voc. low<br />

other<br />

EP single<br />

EP coll.<br />

int_job<br />

Aggregated average Treatment Effects on the Treated compared to waiting, significance level 5%;<br />

Outcome variable: Earnings in employment <strong>of</strong> at least 3 consecutive months<br />

This outcome shows the earnings only if a person is not registered at the unemployment <strong>of</strong>fice<br />

or doesn't receive any unemployment payments at the same time. Positive effects <strong>of</strong> up to almost<br />

800 francs are found (which <strong>of</strong> course are driven by the employment effect <strong>of</strong> the programmes).<br />

5.3.8 Employment with sustainable earnings<br />

Table 5-12 Results for outcome "Employment with sustainable earnings"<br />

%<br />

-30 -20 -10 0 10 20 30<br />

Non-dynamic Quasi-dynamic<br />

2 5 8 11 14 17 20 22<br />

months after programme start<br />

%<br />

-40 -20 0 20 40<br />

2 5 8 11 14 17 20 23<br />

months after programme start


26<br />

Employment with "sustainable earnings" is classified based on family and regional information<br />

<strong>of</strong> the unemployed (number <strong>of</strong> dependent persons, canton, and agglomeration). "Sustainable"<br />

means that the earnings are higher than a computed equivalence income which defines the<br />

existence minimum in Switzerland. The results based on the quasi-dynamic approach show<br />

positive effects on this classification <strong>of</strong> employment also whereas the non-dynamic approach<br />

rates nonparticipation much higher.<br />

5.3.9 Registered at the unemployment <strong>of</strong>fice<br />

Table 5-13 Results for outcome "Registered at the unemployment <strong>of</strong>fice"<br />

%<br />

-30 -20 -10 0 10 20 30<br />

Non-dynamic Quasi-dynamic<br />

2 5 8 11 14 17 20 22<br />

months after programme start<br />

%<br />

-40 -20 0 20 40<br />

2 5 8 11 14 17 20 23<br />

months after programme start<br />

The outcome "registered at the unemployment <strong>of</strong>fice" is 1 if the corresponding person still is<br />

enrolled with the regional placement <strong>of</strong>fice and doesn't have a "stable" job with 3000 CHF income<br />

at the same time. According to the non-dynamic approach, persons are more likely to be<br />

registered whereas the quasi-dynamic approach shows that participants in almost <strong>all</strong> programmes<br />

are less likely to be registered than nonparticipants.<br />

5.3.10 Bounds<br />

One relevant policy question is the size <strong>of</strong> aggregated effects over time, for the public as well<br />

as for the unemployed. This subsection picks out two outcomes and gives lower and upper<br />

bounds for aggregated effects <strong>of</strong> programmes over time. The chosen outcomes are "income<br />

from unemployment" and "total income". The first is related to the public expenses, the second<br />

is the private pr<strong>of</strong>it <strong>of</strong> programmes. The bounds are "worst case" and "best case" bounds, i.e.<br />

simple aggregation <strong>of</strong> single time 5 percent confidence bounds. An example how to read this<br />

table: A personality course leads in average to 101 CHF more unemployment benefits aggregated<br />

over 12 months after programme start; a "worst case" bound for this is 1556 CHF more<br />

unemployment benefits, "best case" would be 1354 CHF less unemployment benefits. The total<br />

income <strong>of</strong> a participant in a personality course aggregated over 12 months after programme<br />

start is 124 CHF lower than without the programme, with an lower bound <strong>of</strong> -2020 and an<br />

upper bound <strong>of</strong> 1772 CHF.


27<br />

Grey shaded areas show "effective" programmes in the sense that even the worst case bound<br />

shows lower unemployment income or higher total income. Note that the lower income from<br />

unemployment for employment programmes are not shaded because they might be due to the<br />

income during the programme which is not counted as "income from unemployment" in the<br />

pension system data. We find clearly positive effects in the sense <strong>of</strong> total income for language<br />

courses, computer courses, vocational training, and other courses, as well as for employment<br />

programmes in single workplaces and interim jobs. The aggregated total income <strong>of</strong> participants<br />

within 12 months after programme start is between 1700 and 3250 CHF higher for effective<br />

programmes.<br />

In terms <strong>of</strong> benefit payments only interim jobs lead to less public expenses. For the other programmes<br />

the aggregated effects are not clear. Participants and computer courses and high vocational<br />

training in average received less unemployment benefits within 12 months after programme<br />

start than if they had not participated. The effect for personality, language, and low<br />

vocational courses is to the other side: in average they need more unemployment benefits.<br />

However, these effects are not significant. For employment programmes this effect is not determinable<br />

for reasons explained above.<br />

Table 5-14 Upper and lower bounds for aggregated effects<br />

Income from unemployment Total income<br />

1-23 months 1-12 months 1-23 months 1-12 months<br />

lower mean upper lower mean upper lower mean upper lower mean upper<br />

Personality -3350 -729 1891 -1354 101 1556 -5164 -808 3549 -2020 -124 1772<br />

Language -2105 -326 1452 -564 430 1423 1703 4608 7514 393 1692 2991<br />

Computer -4299 -2044 211 -1921 -659 604 2100 5802 9504 359 2015 3670<br />

Voc. high -6736 -2516 1704 -3488 -1081 1327 2357 9460 16563 70 3145 6220<br />

Voc. low -4727 -1282 2163 -1725 155 2035 232 6028 11823 -137 2283 4702<br />

Other -4664 997 6659 -2037 907 3851 295 9461 18627 -431 3258 6948<br />

Empl. sing. -8542 -5985 -3428 -6013 -4829 -3644 -408 4449 9306 656 2314 3972<br />

Empl. coll. -9851 -7509 -5168 -6893 -5787 -4682 -2701 1758 6216 -811 735 2281<br />

Interim job -6831 -5685 -4538 -5326 -4721 -4117 5609 7600 9591 2192 3047 3902<br />

Note: Aggregation is after programme start. Treatment effects are based on the quasi-dynamic matching estimator.<br />

6 Conclusion<br />

Active labour market programmes are evaluated in terms <strong>of</strong> a variety <strong>of</strong> outcomes that give a<br />

clear picture <strong>of</strong> the effectiveness <strong>of</strong> active labour market policy. The focus <strong>of</strong> the study is the<br />

effect <strong>of</strong> the treatment on the treated compared to nonparticipation. Treatment assignment and<br />

therefore nonparticipation was modelled non-dynamic<strong>all</strong>y as well as in the quasi-dynamic design<br />

<strong>of</strong> Sianesi (2004) where nonparticipation is modelled as "waiting" and more intense job<br />

search status compared to participation. The two methodologies' estimated effects for active<br />

labour market programmes in Switzerland are compared. Indeed the consideration <strong>of</strong> dynamics<br />

reverse the results compared to a non-dynamic approach.


28<br />

The outcomes show that persons who have participated in programmes are better <strong>of</strong>f than<br />

nonparticipants in almost every sense: they are more likely to be employed, where "employment"<br />

was analyzed not only quantitatively, but also qualitatively in terms <strong>of</strong> stability, purchasing<br />

power, and sustainability. Moreover, participants tend to keep in touch with the labour<br />

market longer than untreated persons, in the sense that they don't leave the labour force and<br />

they don't become welfare dependent. In general effects don't change or jump close to benefit<br />

exhaustion, so a possible effect in terms <strong>of</strong> benefit exhaustion can be ruled out or is similar in<br />

<strong>all</strong> groups.<br />

In aggregation, we find clearly positive effects in the sense <strong>of</strong> total income for language<br />

courses, computer courses, vocational training, and other courses, as well as for employment<br />

programmes in single workplaces and interim jobs. The aggregated total income <strong>of</strong> participants<br />

within 12 months after programme start is between 1700 and 3250 CHF higher for effective<br />

programmes. Subject to unemployment benefits, effects are clear only for interim jobs: they<br />

lead to less unemployment benefits.


References<br />

29<br />

Fredriksson, Peter and Per Johansson (2002), Program evaluation and random program starts, IFAU Working Paper<br />

2003:1.<br />

Frölich, Markus (2004), Programme evaluation with multiple treatments, forthcoming in Journal <strong>of</strong> Economic Surveys.<br />

Frölich, Markus, Michael Lechner, and Heidi Steiger (2003), Statistic<strong>all</strong>y Assisted Programme Selection – International<br />

Experiences and Potential Benefits for Switzerland, Swiss Journal <strong>of</strong> Economics and Statistics, 139, 311-331.<br />

Gerfin, Michael, and Michael Lechner (2002); Microeconometric Evaluation <strong>of</strong> the Active Labour Market Policy in Switzerland,<br />

The Economic Journal, 112 (482), 854-893<br />

Gerfin, Michael, Michael Lechner, and Heidi Steiger (2002), Does subsidised temporary employment get the unemployed<br />

back to work? An econometric analysis <strong>of</strong> two different schemes, Discussion Paper 2002-22, Department <strong>of</strong> Economics,<br />

University <strong>of</strong> St. G<strong>all</strong>en.<br />

Heckman, James J., Robert LaLonde, and Jeffrey Smith (1999), The Economics and Econometrics <strong>of</strong> Active Labor Market<br />

Programs, in O. Ashenfelter and D. Card (eds.), Handbook <strong>of</strong> Labor Economics, Volume 3A. Amsterdam: North-<br />

Holland: 1865-2097.<br />

Lalive, Rafael, Jan van Ours, and Josef Zweimüller (2002), The Effect <strong>of</strong> Benefit Sanctions on the Duration <strong>of</strong> Unemployment,<br />

IZA Discussion Papers 469, Institute for the Study <strong>of</strong> Labor (IZA).<br />

Lechner, Michael (2001a), A note on the common support problem in applied evaluation studies, Discussion Paper 2001-<br />

01, Department <strong>of</strong> Economics, University <strong>of</strong> St. G<strong>all</strong>en<br />

Lechner, Michael (2001b), Identification and Estimation <strong>of</strong> Causal Effects <strong>of</strong> Multiple Treatments under the Conditional<br />

Independence Assumption, in: Lechner, M., Pfeiffer, F. (eds), Econometric Evaluation <strong>of</strong> Labour Market Policies,<br />

Heidelberg: Physica/Springer, 2001, p. 43-58<br />

Lechner, Michael (2002), Some practical issues in the evaluation <strong>of</strong> heterogeneous labour market programmes by matching<br />

methods, Journal <strong>of</strong> the Royal Statistical Society - Series A, 165/1, 59-82<br />

Sianesi, Barbara (2004), An Evaluation <strong>of</strong> the Swedish Active Labour Market Programmes, IFAU working paper 2001:5,<br />

forthcoming in the Review <strong>of</strong> Economics and Statistics.


30<br />

<strong>Appendix</strong> A. Sample selection rules<br />

The selection procedure starts from the total sample <strong>of</strong> pension system records available for<br />

the corresponding sample and selects step by step people with described characteristics.<br />

Table A-1 Sample restrictions<br />

Sample restrictions according to Lechner and Gerfin<br />

Initial number <strong>of</strong> observations 81'399 †<br />

First selection: personal characteristics<br />

No missing data about insured earnings in current unemployment spell<br />

Age 25 to 55<br />

No disability<br />

Earnings in last job > 100 CHF<br />

Only Swiss citizens and foreigners with at least yearly permit<br />

No homeworkers/trainees/students<br />

Information about duration <strong>of</strong> entitlement period available<br />

Remaining observations 70'680<br />

Second selection: unemployment duration<br />

Not long-term unemployed on 31 st <strong>of</strong> December 1997<br />

Beginning <strong>of</strong> spell is earlier than end <strong>of</strong> spell<br />

Has been registered as unemployed on 31 st December 1997<br />

Benefit entitlement not yet exhausted before 31 st December 1997<br />

Remaining observations 67'191<br />

Third selection: programme participation<br />

No significant programme participation according to AVAM (courses and empl. programmes) or<br />

ASAL (interim jobs) before 1998<br />

Programme doesn’t start on 1 st <strong>of</strong> January 1998<br />

Person has not participated in any other programme not considered in this study<br />

Remaining observations 34'393<br />

Fourth selection: pension system data<br />

Has been employed before at least once<br />

Remaining observations SAMPLE A 33'700<br />

After randomising programme start dates for nonparticipants (-7'367) 26'333<br />

After common support restriction (-4'778) SAMPLE B 21'555<br />

Note: † This sample is a random sub-sample <strong>of</strong> the underlying population, but after already having applied some <strong>of</strong> the here<br />

mentioned selection criteria on the population. The numbers <strong>of</strong> observations deleted due to these criteria hence<br />

should not be interpreted as shares in the total population <strong>of</strong> unemployed in Switzerland.


<strong>Appendix</strong> B. <strong>Further</strong> <strong>statistics</strong> <strong>of</strong> <strong>all</strong> <strong>samples</strong><br />

Table B-1: Descriptive Statistics<br />

Sample A Sample B<br />

21'555 33'700<br />

Programme participation (in %)<br />

No course 0.32 0.47<br />

Personality course 0.05 0.04<br />

Language course 0.09 0.08<br />

Basic computer course 0.08 0.06<br />

Vocational training high level 0.02 0.02<br />

Vocational training low level 0.03 0.02<br />

Other training 0.02 0.01<br />

Employment programme public 0.07 0.05<br />

Employment programme private 0.07 0.05<br />

Temporary wage subsidy 0.25 0.20<br />

Begin <strong>of</strong> programme in calendar time (1=1.1.1998) 101.06 59.14<br />

Duration <strong>of</strong> current unemployment spell at beginning <strong>of</strong> first programme 94.66 206.26<br />

Remaining time <strong>of</strong> benefit entitlement at beginning <strong>of</strong> programme (only people in 412.46 442.59<br />

courses and empl. programmes) in days<br />

Duration <strong>of</strong> first programme (only people in courses and empl. programmes) 40.28 94.20<br />

Current unemployment spell<br />

Duration <strong>of</strong> current unemployment, 31.12.1997 151.03 147.12<br />

Unemployment benefit, daily, CHF 139.09 137.63<br />

Beginning <strong>of</strong> benefit entitlement period in months since 1996 (1=Jan1996) 17.68 17.31<br />

Number <strong>of</strong> days <strong>of</strong> cancelled benefits (as sanction) in 1997 4.72 4.75<br />

Other personal characteristics<br />

Age in years 37.64 37.75<br />

Younger than 30 0.20 0.20<br />

Older than 50 0.12 0.13<br />

Female 0.44 0.46<br />

Number <strong>of</strong> additional persons in same household 1.41 1.44<br />

At least one additional person in same household 0.69 0.70<br />

Mother tongue<br />

German 0.35 0.34<br />

French 0.20 0.18<br />

Italian 0.10 0.11<br />

Other 0.35 0.37<br />

Language spoken in canton <strong>of</strong> residence 0.54 0.52<br />

German/French/Italian, but not canton language 0.11 0.11<br />

Foreign languages<br />

Number <strong>of</strong> foreign languages 1.42 1.43<br />

Marital status<br />

Single 0.28 0.26<br />

Married 0.59 0.61<br />

Widowed 0.01 0.01<br />

Divorced 0.13 0.12<br />

Nationality<br />

Swiss 0.56 0.54<br />

Foreign with permanent permit 0.29 0.30<br />

Foreign with yearly permit 0.14 0.17<br />

Qualification<br />

Skilled 0.57 0.54<br />

Semi-skilled 0.16 0.15<br />

Unskilled 0.27 0.31<br />

table continues on next page<br />

31


table continued<br />

Sample A Sample B<br />

Caseworker's subjective rating <strong>of</strong> employability<br />

No information 0.05 0.05<br />

Very easy 0.05 0.06<br />

Easy 0.15 0.15<br />

Medium 0.58 0.55<br />

Difficult 0.15 0.15<br />

Special case<br />

Mobility<br />

0.02 0.02<br />

Not mobile 0.09 0.09<br />

Daily commuter 0.87 0.86<br />

Mobile within parts <strong>of</strong> Switzerland 0.03 0.02<br />

Mobile within whole <strong>of</strong> Switzerland 0.01 0.02<br />

Mobile abroad<br />

Looking for ... job<br />

0.01 0.01<br />

Full-time 0.36 0.36<br />

Part-time 0.14 0.15<br />

No information<br />

Unemployment status<br />

0.49 0.49<br />

Full-time 0.82 0.81<br />

Part-time 0.16 0.16<br />

In part-time employment 0.01 0.02<br />

Other<br />

Monthly earnings in last job<br />

0.01 0.01<br />

Monthly earnings in CHF 3882.88 3839.75<br />

Less than 1000 CHF 0.02 0.02<br />

Between 1000 and 2000 0.09 0.10<br />

Between 2000 and 3000 0.19 0.20<br />

Between 3000 and 4000 0.25 0.25<br />

Between 4000 and 5000 0.24 0.22<br />

Between 5000 and 6000 0.11 0.11<br />

More than 6000<br />

Job position<br />

0.09 0.10<br />

Self-employed 0.01 0.01<br />

High (management, etc.) 0.06 0.06<br />

Medium 0.58 0.55<br />

Low<br />

Canton<br />

0.35 0.38<br />

Zurich 0.20 0.21<br />

Berne 0.09 0.09<br />

Lucerne 0.04 0.04<br />

Uri 0.00 0.00<br />

Schwyz 0.01 0.01<br />

Obwalden 0.00 0.00<br />

Nidwalden 0.00 0.00<br />

Glarus 0.00 0.00<br />

Zug 0.01 0.01<br />

Fribourg 0.03 0.03<br />

Solothurn 0.03 0.03<br />

Basle-Town 0.03 0.04<br />

Basle-Country 0.02 0.02<br />

Schaffhausen 0.01 0.01<br />

Appenzell Outer Rhodes 0.00 0.00<br />

Appenzell Inner-Rhodes 0.00 0.00<br />

St. G<strong>all</strong> 0.05 0.05<br />

Grisons 0.01 0.01<br />

Argovia 0.06 0.05<br />

Thurgovia 0.02 0.02<br />

Ticino 0.05 0.08<br />

Vaud<br />

table continues on next page<br />

0.14 0.12<br />

32


table continued<br />

Sample A Sample B<br />

Valais 0.05 0.05<br />

Neuchâtel 0.03 0.03<br />

Geneva 0.08 0.08<br />

Jura<br />

Canton language<br />

0.01 0.01<br />

French 0.34 0.32<br />

Italien 0.07 0.09<br />

German<br />

Region<br />

0.59 0.59<br />

East 0.10 0.10<br />

Central 0.07 0.06<br />

North-West 0.14 0.14<br />

Middle (Bern) 0.09 0.09<br />

Romandie (French speaking part) 0.34 0.32<br />

Zurich 0.20 0.21<br />

Italian speaking part<br />

Size <strong>of</strong> town where worked before<br />

0.05 0.08<br />

>=200’000 0.08 0.08<br />


table continued<br />

Sample A Sample B<br />

Paper 0.00 0.00<br />

Graphics 0.02 0.02<br />

Leather 0.00 0.00<br />

Chemistry 0.01 0.01<br />

Stone 0.01 0.01<br />

Metals 0.03 0.02<br />

Machinery 0.03 0.03<br />

Electronics 0.02 0.02<br />

Watches/jewellery 0.01 0.01<br />

Other industry 0.01 0.01<br />

Construction 0.13 0.12<br />

Trade 0.16 0.15<br />

Hotel industry 0.13 0.15<br />

Repairing 0.02 0.02<br />

Transportation 0.03 0.03<br />

Communication 0.00 0.00<br />

Banking 0.03 0.03<br />

Real estate 0.01 0.01<br />

Consulting 0.12 0.11<br />

Teaching 0.02 0.02<br />

R&D 0.00 0.00<br />

Health care 0.04 0.04<br />

Other services 0.10 0.10<br />

Civil services 0.04 0.04<br />

Unemployment rate in industry, 12/1997<br />

Employment history from pension system data<br />

6.38 6.60<br />

Uninterrupted history in pension system since registration or 1988 0.70 0.68<br />

Uninterrupted history in pension system since 1993 0.74 0.72<br />

Person was self-employed at least once since 1988 0.08 0.08<br />

Person was self-employed at least once since 1993 0.05 0.05<br />

Number <strong>of</strong> unemployment spells since registration or 1988 0.28 0.30<br />

Number <strong>of</strong> unemployment spells since 1993 0.83 0.89<br />

Was out <strong>of</strong> labour force since registration or 1988 0.15 0.15<br />

Number <strong>of</strong> months out <strong>of</strong> labour force since registration or 1988 1.87 1.89<br />

Was out <strong>of</strong> labour force since registration or 1993 0.18 0.18<br />

Income from employment (in 1000 CHF, inflation corr.) 1988 29.94 29.92<br />

1989 32.49 32.30<br />

1990 36.79 35.61<br />

1991 36.58 36.66<br />

1992 35.59 36.52<br />

1993 36.55 35.53<br />

1994 38.53 36.65<br />

1995 39.59 38.35<br />

1996 24.86 38.91<br />

1997 24.86 25.09<br />

Income from unemployment (in 1000 CHF, inflation corr.) 1988 0.14 0.20<br />

1989 0.13 0.18<br />

1990 0.17 0.22<br />

1991 0.56 0.60<br />

1992 1.66 1.70<br />

1993 3.50 3.54<br />

1994 2.87 2.94<br />

1995 2.30 2.40<br />

1996 1.91 2.29<br />

1997 12.74 12.39<br />

Immigrated to Switzerland 1988-1992 .05 0.06<br />

Immigrated to Switzerland 1993-1997<br />

table continues on next page<br />

.05 0.05<br />

34


table continued<br />

Sample A Sample B<br />

No information in pension system for 1998 0.00 0.01<br />

No information in pension system for 1999 0.09 0.10<br />

Number <strong>of</strong> months unemployed since entry into social security system or since 1988 10.21 10.48<br />

Number <strong>of</strong> months employed since entry into social security system or since 1988 87.10 85.74<br />

Never unemployed 0.08 0.08<br />

Month <strong>of</strong> entry into pension system (1=January 1988) 13.49 14.13<br />

Number <strong>of</strong> employment spells since 1988 2.30 2.38<br />

Number <strong>of</strong> unemployment spells since 1988 1.80 1.87<br />

Mean duration <strong>of</strong> employment spell in months 55.63 53.64<br />

Mean duration <strong>of</strong> unemployment spell in months 5.18 5.17<br />

Max. duration <strong>of</strong> employment spell in month 70.86 69.25<br />

Max. duration <strong>of</strong> unemployment spell in month 6.84 6.88<br />

Standard deviation <strong>of</strong> wages 1232.31 1313.86<br />

Duration <strong>of</strong> last employment spell in months 52.60 50.23<br />

Wage growth during last employment spell (inflation corrected) 0.01 0.01<br />

Proportion <strong>of</strong> time unemployed in % 0.10 0.11<br />

Proportion <strong>of</strong> time employed in % 0.81 0.80<br />

Mean wage 1988 2703.77 2716.2<br />

1989 2928.22 2927.58<br />

1990 3197.88 3219.62<br />

1991 3298.35 3306.75<br />

1992 3303.71 3313.09<br />

1993 3233.26 3242.38<br />

1994 3322.18 3451.41<br />

1995 3476.28 3483.09<br />

1996 3622.91 3596.84<br />

1997 3050.08 3078.53<br />

Graph B-1: Numbers <strong>of</strong> observations left in different outcome measures for Sample A<br />

number <strong>of</strong> observations<br />

5000 10000 15000 20000<br />

35<br />

2 5 8 11 14 17 20 23 26 29 32 35 38 41 44 47<br />

months<br />

after prog. start<br />

in entitl. period<br />

after registration


Graph B-2: Descriptive <strong>statistics</strong> <strong>of</strong> outcomes by treatment categories<br />

Outcome a<br />

Outcome c<br />

Outcome e<br />

Outcome g<br />

Outcome i<br />

Outcome k<br />

%<br />

20 40 60 80<br />

%<br />

20 40 60 80<br />

CHF<br />

1000 2000 3000<br />

%<br />

20 40 60 80<br />

CHF<br />

1000 2000 3000<br />

%<br />

20 40 60 80<br />

After programme start<br />

2 5 8 11 14 17 20 22<br />

months after programme start<br />

2 5 8 11 14 17 20 22<br />

months after programme start<br />

2 5 8 11 14 17 20 22<br />

months after programme start<br />

2 5 8 11 14 17 20 22<br />

months after programme start<br />

2 5 8 11 14 17 20 22<br />

months after programme start<br />

2 5 8 11 14 17 20 22<br />

months after programme start<br />

graphs continued on next page<br />

36<br />

Outcome b<br />

Outcome d<br />

Outcome f<br />

Outcome h<br />

Outcome j<br />

%<br />

20 40 60 80<br />

CHF<br />

1000 2000 3000<br />

CHF<br />

1000 2000 3000<br />

%<br />

20 40 60 80<br />

%<br />

20 40 60 80<br />

After programme start<br />

2 5 8 11 14 17 20 22<br />

months after programme start<br />

2 5 8 11 14 17 20 22<br />

months after programme start<br />

2 5 8 11 14 17 20 22<br />

months after programme start<br />

2 5 8 11 14 17 20 22<br />

months after programme start<br />

2 5 8 11 14 17 20 22<br />

months after programme start


graphs continued<br />

Outcome f<br />

Outcome g<br />

Outcome h<br />

Outcome i<br />

Outcome j<br />

Outcome k<br />

%<br />

20 40 60 80<br />

%<br />

20 40 60 80<br />

%<br />

20 40 60 80<br />

CHF<br />

100020003000<br />

CHF<br />

1000 2000 3000<br />

CHF<br />

100020003000<br />

37<br />

In entitlement period After registration<br />

2 5 8 11 14 17 20 23 26 29 32 35 38 41 44 47<br />

months in benefit entitlement period<br />

2 5 8 11 14 17 20 23 26 29 32 35 38 41 44 47<br />

months in benefit entitlement period<br />

2 5 8 11 14 17 20 23 26 29 32 35 38 41 44 47<br />

months in benefit entitlement period<br />

2 5 8 11 14 17 20 23 26 29 32 35 38 41 44 47<br />

months in benefit entitlement period<br />

2 5 8 11 14 17 20 23 26 29 32 35 38 41 44 47<br />

months in benefit entitlement period<br />

2 5 8 11 14 17 20 23 26 29 32 35 38 41 44 47<br />

months in benefit entitlement period<br />

%<br />

20 40 60 80<br />

%<br />

20 40 60 80<br />

%<br />

20 40 60 80<br />

CHF<br />

1000 2000 3000<br />

CHF<br />

1000 2000 3000<br />

CHF<br />

1000 2000 3000<br />

2 5 8 11 14 17 20 23 26 29 32 35<br />

months since registration<br />

2 5 8 11 14 17 20 23 26 29 32 35<br />

months since registration<br />

2 5 8 11 14 17 20 23 26 29 32 35<br />

months since registration<br />

2 5 8 11 14 17 20 23 26 29 32 35<br />

months since registration<br />

2 5 8 11 14 17 20 23 26 29 32 35<br />

months since registration<br />

2 5 8 11 14 17 20 23 26 29 32 35<br />

months since registration


Table B-2: Numbers <strong>of</strong> persons starting programme at what time (quasi-dynamic matching)<br />

38<br />

Personal. Lang. Comp. Voc. high Voc. low Other EP single EP coll. Int. job<br />

t (1) (2) (1) (2) (1) (2) (1) (2) (1) (2) (1) (2) (1) (2) (1) (2) (1) (2)<br />

1<br />

2 33 42 107 121 80 88 14 25 13 17 9 7 13 21 8 20 241 424<br />

3 88 108 189 278 219 232 40 44 34 47 17 31 29 49 33 62 435 663<br />

4 109 145 242 310 217 267 56 71 45 62 15 21 67 96 59 86 487 708<br />

5 110 143 278 316 175 235 49 68 52 69 29 39 75 116 74 102 421 661<br />

6 97 114 225 225 146 179 48 53 48 60 23 29 96 122 109 116 427 548<br />

7 82 88 200 219 149 161 43 40 50 63 23 26 93 112 97 118 392 526<br />

8 65 69 165 196 119 137 34 44 51 53 21 28 104 127 133 143 366 473<br />

9 73 85 147 162 97 100 41 46 41 41 17 18 116 132 104 129 344 380<br />

10 74 79 144 156 93 95 40 39 43 50 23 22 104 103 111 126 336 361<br />

11 77 89 154 164 91 80 29 37 47 46 16 16 133 128 109 120 316 336<br />

12 65 59 142 137 67 75 23 27 36 48 23 23 128 132 112 117 333 324<br />

13 83 82 153 142 88 84 36 34 48 43 24 22 125 119 113 119 378 345<br />

14 72 54 124 71 58 35 25 22 29 27 27 25 118 117 120 122 381 236<br />

15 43 28 88 65 52 33 21 18 32 20 20 22 100 78 124 102 285 160<br />

16 42 35 70 38 50 26 13 10 33 16 13 11 98 89 97 92 291 152<br />

17 27 21 57 27 28 20 19 11 18 8 17 10 96 64 86 65 241 139<br />

18 28 9 35 23 25 16 13 7 16 11 14 7 80 52 87 59 184 93<br />

19 32 21 42 15 24 8 17 5 18 3 8 3 57 36 84 47 176 79<br />

20 28 42 35 11 17 9 40 61 160<br />

21 25 31 16 6 12 11 31 37 122<br />

22 18 25 22 14 11 11 20 31 146<br />

23 9 23 21 5 7 11 8 124<br />

24 3 7 8 7 3 3 114<br />

25 8 4 3 4 60<br />

26 3 3 7 5 17<br />

27 3 5 10<br />

28 3 9<br />

29 5 5<br />

30 4 6<br />

31 4<br />

tot 1286 1271 2701 2665 1884 1871 607 601 704 684 370 360 1755 1693 1815 1745 6811 6608<br />

Note: Only cells with at least 3 observations are counted. Time frame (1): months in entitlement period. (2): months since<br />

registration. The number <strong>of</strong> participants in (1) and (2) differ slightly because both time frames were "cut" above (31<br />

and 19 months, respectively). This cut affected the number <strong>of</strong> participants a bit stronger in the registration time<br />

frame.

Hooray! Your file is uploaded and ready to be published.

Saved successfully!

Ooh no, something went wrong!