Is headspace making a difference to young people’s lives?
Evaluation-of-headspace-program
Evaluation-of-headspace-program
You also want an ePaper? Increase the reach of your titles
YUMPU automatically turns print PDFs into web optimized ePapers that Google loves.
Appendix C<br />
The KeySurvey software system includes an analysis and reporting function that details frequencies<br />
and other details for all responses. This function was used <strong>to</strong> generate an analysis report. Further<br />
analysis was conducted by exporting the survey data <strong>to</strong> excel where an analyst developed graphs<br />
and tables <strong>to</strong> highlight key findings. The survey contained some non-compulsory open-ended<br />
questions and the small amount of textual data contained herein was exported <strong>to</strong> NVivo and<br />
thematically analysed through coding.<br />
Survey of Professional Stakeholders Affiliated with <strong>headspace</strong><br />
The Survey of Professional Stakeholders was included in the evaluation <strong>to</strong> examine a number of<br />
features of collaborative practice specified by the Department in RFQ DoHA 093-1213 and on which<br />
limited administrative data are available including:<br />
• The type and extent of connections and linkages between <strong>headspace</strong> centres, other<br />
government funded programs, and the broader service system;<br />
• The facilita<strong>to</strong>rs and barriers of effective and efficient collaborative practice;<br />
• The impact of collaborative practice on other service providers;<br />
• The transition of clients from <strong>headspace</strong> <strong>to</strong> adult services; and<br />
• Whether and how <strong>headspace</strong> has improved the skill and confidence of general practitioners<br />
in providing youth mental healthcare.<br />
The survey was designed <strong>to</strong> be conducted as an online survey and as a Computer Assisted<br />
Telephone Interview (CATI), however, only one participant used CATI. The survey was also designed<br />
<strong>to</strong> be completed by a diversity of practitioners from different organisational types (for example,<br />
government agencies, NGOs, private organisations) and sec<strong>to</strong>rs (such as education, primary<br />
healthcare, mental health care) as there were multiple pathways through the survey depending on<br />
answers provided. The survey items were based on specified evaluation requirements.<br />
The survey was distributed and implemented using KeySurvey, a software system supported by<br />
UNSW. This system enables survey launch through invitations emails containing a unique survey link,<br />
and through blanket distribution of the survey URL. Prior <strong>to</strong> implementation, the evalua<strong>to</strong>rs piloted<br />
the survey with a small number of consortium organisations and general practitioners located near<br />
<strong>headspace</strong> centres (n=15). The pilot launch was undertaken <strong>to</strong> assess participants’ understanding<br />
of survey questions and system operations. We received four responses <strong>to</strong> the pilot launch and one<br />
question was modified as a result.<br />
The survey was conducted online over a 2 month period from 9 September <strong>to</strong> 4 November, 2014.<br />
Survey participants were recruited using two methods: sending email invitations <strong>to</strong> identified contacts<br />
in <strong>headspace</strong> lead agencies and consortium organisations; and advertising the survey.<br />
After 5 weeks of survey promotion, a <strong>to</strong>tal of 207 professionals had responded <strong>to</strong> the survey. This<br />
result is somewhat disappointing and reflects the fact that service providers are often short of free<br />
time and need <strong>to</strong> prioritise their activities, and that no incentive was offered <strong>to</strong> boost respondent<br />
numbers.<br />
<strong>headspace</strong> National Office does not have a database containing contact details for the partner<br />
organisations that make up each <strong>headspace</strong> centre’s consortium. This would have been valuable <strong>to</strong><br />
use as a sampling frame, and without this information it is not possible <strong>to</strong> calculate a response rate<br />
for stakeholders’ organisations, or <strong>to</strong> estimate the validity of responses.<br />
Despite efforts of the evalua<strong>to</strong>rs <strong>to</strong> encourage stakeholder organisations <strong>to</strong> participate in the survey,<br />
we received a poor response <strong>to</strong> requests <strong>to</strong> lead agencies <strong>to</strong> provide consortium contact details,<br />
as well as <strong>to</strong> complete the survey. In circumstances where we did not receive contact details for<br />
consortium organisations, we sent an invitation with the survey URL <strong>to</strong> the lead agency and asked<br />
them <strong>to</strong> forward <strong>to</strong> their consortium organisations. This method was implemented only because we<br />
did not receive responses from all lead agencies. While we are unable <strong>to</strong> confirm this, it is likely that<br />
the majority of consortium organisations that participated in the survey are those where a nominated<br />
manager received a direct email invitation. This suggests that we received the majority of survey<br />
responses from lead agencies and consortium organisations that are working <strong>to</strong>gether well - or<br />
at least better than the consortiums where lead agencies did not provide contact details. This is<br />
Social Policy Research Centre 2015<br />
<strong>headspace</strong> Evaluation Final Report<br />
183