Is headspace making a difference to young people’s lives?
Evaluation-of-headspace-program
Evaluation-of-headspace-program
You also want an ePaper? Increase the reach of your titles
YUMPU automatically turns print PDFs into web optimized ePapers that Google loves.
Executive Summary<br />
<strong>young</strong> people with mental health concerns; 207 <strong>headspace</strong> centre managers, professionals<br />
affiliated with <strong>headspace</strong> and/or the mental health care service system; and 29 centre<br />
managers<br />
• a cost effectiveness analysis including estimates of government investment directed <strong>to</strong>wards<br />
treating <strong>young</strong> people and estimates of the effectiveness of <strong>headspace</strong> centres<br />
• an analysis of centre expansion under the current <strong>headspace</strong> allocation model, an evaluation<br />
of the effectiveness of the current centre allocation model <strong>to</strong> provide access <strong>to</strong> <strong>headspace</strong><br />
services, and a discussion of alternative methods of achieving national coverage for<br />
<strong>headspace</strong> services.<br />
The findings presented in this report are subject <strong>to</strong> the limitations and assumptions of the<br />
underpinning modelling as well as the limitations of the data. The evalua<strong>to</strong>rs have sought <strong>to</strong> identify<br />
and minimise, <strong>to</strong> the greatest extent possible, these limitations. While the analysis is firmly based on<br />
best practice and has been subjected <strong>to</strong> rigorous quality assurance procedures, the use of different<br />
datasets coupled with ongoing developments and improvements in data may potentially produce<br />
different results in different components of the analysis.<br />
The outcomes analysis reports the progress of <strong>young</strong> people over the course of their engagement<br />
with <strong>headspace</strong>. One key issue for the evaluation is the existence of two datasets which were used<br />
<strong>to</strong> examine the outcomes of <strong>headspace</strong> clients. The evaluation was originally designed <strong>to</strong> measure<br />
outcomes using a single source of data: a survey of <strong>headspace</strong> clients and a comparison group of<br />
<strong>young</strong> people. However, the implementation of a new administrative dataset (hCSA) at the beginning<br />
of the evaluation (January 2013) presented an opportunity <strong>to</strong> examine client outcomes using a<br />
comprehensive administrative data source. In using these two datasets the evaluation employed two<br />
complementary approaches <strong>to</strong> examine the effectiveness of <strong>headspace</strong> in relation <strong>to</strong> client outcomes:<br />
• a <strong>difference</strong>-in-<strong>difference</strong> (DID) approach, and<br />
• the clinically significant change (CSC) method.<br />
The CSC method utilises the administrative data collection (hCSA) and focuses on changes in<br />
psychological distress for different groups of <strong>headspace</strong> clients over the course of <strong>headspace</strong><br />
treatment, comparing the progress of <strong>headspace</strong> clients with benchmarks derived from functional<br />
populations.<br />
The DID approach analyses survey data collected from a sample of <strong>headspace</strong> clients and a<br />
comparison group of <strong>young</strong> people. The analysis compares the progress of <strong>young</strong> people in the<br />
‘<strong>headspace</strong> treatment’ group with those in two comparison groups – an ‘other treatment’ group<br />
comprising those in the general population who have sought mental health treatment outside the<br />
<strong>headspace</strong> program, and a ‘no treatment’ group comprising those in the general population who have<br />
sought no mental health treatment.<br />
The results of these distinct analyses align; both show <strong>headspace</strong> has a small program effect. The<br />
key findings related <strong>to</strong> client outcomes and the other evaluation scope areas are presented below.<br />
Key Findings<br />
A selection of key findings related <strong>to</strong> the scope areas are presented below.<br />
Access and Engagement<br />
The evaluation indicates that <strong>headspace</strong> is an accessible program. During the 2013/14 financial year,<br />
67 <strong>headspace</strong> centres provided 194,968 occasions of service <strong>to</strong> 45,195 <strong>young</strong> people with mental<br />
health or other issues (approximately 9,000-12,000 clients per month).<br />
Findings show that the centre-based program is being accessed by a diverse group of <strong>young</strong> people<br />
whose need for mental health care is evidenced by high levels of psychological distress. Almost<br />
three-quarters of <strong>young</strong> people who sought help at centres during the 2013/14 financial year had high<br />
Social Policy Research Centre 2015<br />
<strong>headspace</strong> Evaluation Final Report<br />
2