05.12.2016 Views

Is headspace making a difference to young people’s lives?

Evaluation-of-headspace-program

Evaluation-of-headspace-program

SHOW MORE
SHOW LESS

You also want an ePaper? Increase the reach of your titles

YUMPU automatically turns print PDFs into web optimized ePapers that Google loves.

Appendix C<br />

The KeySurvey software system includes an analysis and reporting function that details frequencies<br />

and other details for all responses. This function was used <strong>to</strong> generate an analysis report. Further<br />

analysis was conducted by exporting the survey data <strong>to</strong> excel where an analyst developed graphs<br />

and tables <strong>to</strong> highlight key findings. The survey contained some non-compulsory open-ended<br />

questions and the small amount of textual data contained herein was exported <strong>to</strong> NVivo and<br />

thematically analysed through coding.<br />

Survey of Professional Stakeholders Affiliated with <strong>headspace</strong><br />

The Survey of Professional Stakeholders was included in the evaluation <strong>to</strong> examine a number of<br />

features of collaborative practice specified by the Department in RFQ DoHA 093-1213 and on which<br />

limited administrative data are available including:<br />

• The type and extent of connections and linkages between <strong>headspace</strong> centres, other<br />

government funded programs, and the broader service system;<br />

• The facilita<strong>to</strong>rs and barriers of effective and efficient collaborative practice;<br />

• The impact of collaborative practice on other service providers;<br />

• The transition of clients from <strong>headspace</strong> <strong>to</strong> adult services; and<br />

• Whether and how <strong>headspace</strong> has improved the skill and confidence of general practitioners<br />

in providing youth mental healthcare.<br />

The survey was designed <strong>to</strong> be conducted as an online survey and as a Computer Assisted<br />

Telephone Interview (CATI), however, only one participant used CATI. The survey was also designed<br />

<strong>to</strong> be completed by a diversity of practitioners from different organisational types (for example,<br />

government agencies, NGOs, private organisations) and sec<strong>to</strong>rs (such as education, primary<br />

healthcare, mental health care) as there were multiple pathways through the survey depending on<br />

answers provided. The survey items were based on specified evaluation requirements.<br />

The survey was distributed and implemented using KeySurvey, a software system supported by<br />

UNSW. This system enables survey launch through invitations emails containing a unique survey link,<br />

and through blanket distribution of the survey URL. Prior <strong>to</strong> implementation, the evalua<strong>to</strong>rs piloted<br />

the survey with a small number of consortium organisations and general practitioners located near<br />

<strong>headspace</strong> centres (n=15). The pilot launch was undertaken <strong>to</strong> assess participants’ understanding<br />

of survey questions and system operations. We received four responses <strong>to</strong> the pilot launch and one<br />

question was modified as a result.<br />

The survey was conducted online over a 2 month period from 9 September <strong>to</strong> 4 November, 2014.<br />

Survey participants were recruited using two methods: sending email invitations <strong>to</strong> identified contacts<br />

in <strong>headspace</strong> lead agencies and consortium organisations; and advertising the survey.<br />

After 5 weeks of survey promotion, a <strong>to</strong>tal of 207 professionals had responded <strong>to</strong> the survey. This<br />

result is somewhat disappointing and reflects the fact that service providers are often short of free<br />

time and need <strong>to</strong> prioritise their activities, and that no incentive was offered <strong>to</strong> boost respondent<br />

numbers.<br />

<strong>headspace</strong> National Office does not have a database containing contact details for the partner<br />

organisations that make up each <strong>headspace</strong> centre’s consortium. This would have been valuable <strong>to</strong><br />

use as a sampling frame, and without this information it is not possible <strong>to</strong> calculate a response rate<br />

for stakeholders’ organisations, or <strong>to</strong> estimate the validity of responses.<br />

Despite efforts of the evalua<strong>to</strong>rs <strong>to</strong> encourage stakeholder organisations <strong>to</strong> participate in the survey,<br />

we received a poor response <strong>to</strong> requests <strong>to</strong> lead agencies <strong>to</strong> provide consortium contact details,<br />

as well as <strong>to</strong> complete the survey. In circumstances where we did not receive contact details for<br />

consortium organisations, we sent an invitation with the survey URL <strong>to</strong> the lead agency and asked<br />

them <strong>to</strong> forward <strong>to</strong> their consortium organisations. This method was implemented only because we<br />

did not receive responses from all lead agencies. While we are unable <strong>to</strong> confirm this, it is likely that<br />

the majority of consortium organisations that participated in the survey are those where a nominated<br />

manager received a direct email invitation. This suggests that we received the majority of survey<br />

responses from lead agencies and consortium organisations that are working <strong>to</strong>gether well - or<br />

at least better than the consortiums where lead agencies did not provide contact details. This is<br />

Social Policy Research Centre 2015<br />

<strong>headspace</strong> Evaluation Final Report<br />

183

Hooray! Your file is uploaded and ready to be published.

Saved successfully!

Ooh no, something went wrong!