Is headspace making a difference to young people’s lives?
Evaluation-of-headspace-program
Evaluation-of-headspace-program
You also want an ePaper? Increase the reach of your titles
YUMPU automatically turns print PDFs into web optimized ePapers that Google loves.
2. Evaluation Methodology<br />
Evaluation method<br />
Fieldwork at sites<br />
Description of method<br />
Fieldwork was undertaken at 5 <strong>headspace</strong> sites around Australia between April and<br />
June 2013. Across these sites, a sample of 50 <strong>young</strong> people attending centres, 5 centre<br />
managers and 20 staff members were interviewed.<br />
2. Sexual practices and<br />
risk in gay men<br />
Survey of centre managers<br />
Survey of professional<br />
stakeholders<br />
Parents and carers study<br />
Cost effectiveness analysis<br />
Additional economic analysis<br />
Interviews were semi-structured and conducted face-<strong>to</strong>-face. All interviews were recorded<br />
with the permission of participants. Interviews were then transcribed and imported in<strong>to</strong><br />
QSR NVivo10, a qualitative data analysis software package <strong>to</strong> assist coding and thematic<br />
analysis. Transcripts were coded using pre-determined coding frameworks (one for<br />
<strong>headspace</strong> staff and another for <strong>headspace</strong> clients). Following coding, analytic memos<br />
were written <strong>to</strong> summarise each node (or code) used and queries were run <strong>to</strong> identify<br />
frequencies and relationships across nodes.<br />
An online survey was distributed <strong>to</strong> centre managers at 40 operational centres (that is,<br />
centres established during rounds 1-3). The survey collected data in June 2013 and valid<br />
responses were provided by a <strong>to</strong>tal of 29 managers.<br />
The survey collected data on the <strong>headspace</strong> service delivery model and program<br />
implementation from a sample of respondents.<br />
This survey was conducted <strong>to</strong> examine specific features of the <strong>headspace</strong> service model<br />
as well as aspects of access and engagement that other data sources do not provide<br />
sufficient information on.<br />
In particular, the survey examined the perceptions of professionals affiliated with youth<br />
mental health care, or providers connected <strong>to</strong> the broader service system with regard <strong>to</strong><br />
how <strong>headspace</strong> is collaborating with local services, and the impact of any collaboration.<br />
Representatives from <strong>headspace</strong> consortium organisations were invited <strong>to</strong> participate in<br />
the survey. In addition, a survey link and advertisement was posted on a number of forums<br />
including AIFS’ Child Family Community Australia news section, and the RACGP Friday<br />
Facts newsletter.<br />
The survey was distributed online through direct email invitation and advertisements with<br />
an embedded URL. The survey was open for approximately 4 weeks from early Oc<strong>to</strong>ber<br />
<strong>to</strong> early November 2014. A <strong>to</strong>tal of 207 professionals participated in the survey. The<br />
KeySurvey system that hosted the survey has an au<strong>to</strong>matic report function that provides<br />
basic analysis (descriptive results). Further analysis was conducted by exporting the data<br />
file in<strong>to</strong> excel. Text provided in open-ended questions was thematically coded.<br />
This study explored the views of parents and carers of <strong>young</strong> people with mental health<br />
problems about their own mental health needs, their experiences with <strong>headspace</strong> services,<br />
and how <strong>headspace</strong> compares <strong>to</strong> other services.<br />
The study comprised two components: an online survey of parents and carers; and 6 focus<br />
groups and 3 individual interviews with parents/carers. Study participants were recruited<br />
through posters that were located in <strong>headspace</strong> centre reception areas, advertisements<br />
posted on the Facebook pages of beyondblue and the Butterfly Foundation, and through<br />
an advertisement and survey link that was posted on the parents and carers section of the<br />
<strong>headspace</strong> website.<br />
A <strong>to</strong>tal of 226 valid survey responses were received between 1 June and 30 September<br />
2014. An additional 38 parents/carers participated in interviews that were held between<br />
August and Oc<strong>to</strong>ber 2014. All interviews were transcribed and uploaded <strong>to</strong> NVivo, a<br />
qualitative data analysis software. Transcripts were coded using a pre-determined<br />
framework. The survey data was analysed using KeySurvey, a software system that<br />
enables analysis through an au<strong>to</strong>matic report function. The analysis report provides basic<br />
descriptions of data collected. Further analysis of the survey was conducted following<br />
export of survey data in<strong>to</strong> excel. Text provided in open-ended questions was thematically<br />
coded.<br />
The cost effectiveness analysis of the <strong>headspace</strong> program examines the government’s<br />
investment in <strong>headspace</strong> and compares costs with the outcomes of <strong>young</strong> people in<br />
comparison <strong>to</strong> a functional population and <strong>to</strong> other similar <strong>young</strong> people that did not receive<br />
treatment at <strong>headspace</strong>. The analysis was undertaken by economists at the Bankwest<br />
Curtin Economics Centre at Curtin University and is based upon both the <strong>difference</strong>-in<strong>difference</strong><br />
methodology and the clinically significant change method.<br />
This component of the evaluation builds on the cost effectiveness analysis <strong>to</strong> consider<br />
different methodologies for increasing the efficiency and economy for the potential<br />
expansion of <strong>headspace</strong>.<br />
This analysis was undertaken by the Telethon Kids Institute at the University of Western<br />
Australia. It is presented in Appendix B.<br />
Social Policy Research Centre 2015<br />
<strong>headspace</strong> Evaluation Final Report<br />
13