Panyappi Indigenous Youth Mentoring Program Evaluation
Panyappi Indigenous Youth Mentoring Program Evaluation
Panyappi Indigenous Youth Mentoring Program Evaluation
Create successful ePaper yourself
Turn your PDF publications into a flip-book with our unique Google optimized e-Paper software.
<strong>Panyappi</strong> <strong>Indigenous</strong> <strong>Youth</strong><br />
<strong>Mentoring</strong> <strong>Program</strong><br />
External <strong>Evaluation</strong> Report<br />
Metropolitan<br />
Aboriginal <strong>Youth</strong> Team<br />
Prepared by:<br />
May 2004
<strong>Panyappi</strong> <strong>Indigenous</strong> <strong>Youth</strong> <strong>Mentoring</strong> <strong>Program</strong>:<br />
External evaluation report<br />
May 2004
© <strong>Panyappi</strong> <strong>Indigenous</strong> <strong>Youth</strong> <strong>Mentoring</strong> <strong>Program</strong><br />
This work is copyright. Apart from any use as permitted under the Copyright Act 1968, no<br />
part may be reproduced by any process without the written permission from the <strong>Panyappi</strong><br />
<strong>Program</strong>. Requests and enquiries concerning reproduction rights should be directed to<br />
<strong>Panyappi</strong> at the contact details listed below.<br />
The opinions expressed in this document are those of the authors and are not necessarily<br />
those of the State Government. This document is designed to provide information to<br />
assist policy and program development in government and non-government organisations.<br />
The National Library of Australia Cataloguing-in-Publication entry:<br />
Stacey, Kathleen.<br />
<strong>Panyappi</strong> <strong>Indigenous</strong> <strong>Youth</strong> <strong>Mentoring</strong> <strong>Program</strong> : external<br />
evaluation report.<br />
ISBN 0 7308 9340 5.<br />
1. <strong>Panyappi</strong> <strong>Indigenous</strong> <strong>Youth</strong> <strong>Mentoring</strong> <strong>Program</strong> - <strong>Evaluation</strong>.<br />
2. <strong>Evaluation</strong> research (Social action programs) - South<br />
Australia - Adelaide. 3. <strong>Indigenous</strong> youth - Services for -<br />
South Australia - Adelaide - <strong>Evaluation</strong>. 4. Aboriginal<br />
Australians - Services for - South Australia - Adelaide -<br />
<strong>Evaluation</strong>. 5. <strong>Mentoring</strong> in social service - South<br />
Australia - Adelaide - <strong>Evaluation</strong>. I. <strong>Panyappi</strong> <strong>Indigenous</strong><br />
<strong>Youth</strong> <strong>Mentoring</strong> <strong>Program</strong>. II. South Australia Dept. of<br />
Human Services. III. Title.<br />
362.849915094231<br />
Additional copies can be obtained by:<br />
Mail: <strong>Panyappi</strong> Coordinator<br />
Metropolitan Aboriginal <strong>Youth</strong> Team<br />
c/- The Parks Community Centre<br />
PO Box 2337<br />
Regency Park SA 5942<br />
Phone: 08 8243 5733<br />
Fax: 08 8243 5744<br />
Email: Lisa.Kambouris@dfc.sa.gov.au<br />
Suggested reference:<br />
beyond…(Kathleen Stacey & Associates) Pty Ltd (2004). <strong>Panyappi</strong> <strong>Indigenous</strong> <strong>Youth</strong><br />
<strong>Mentoring</strong> <strong>Program</strong>: External evaluation report. <strong>Panyappi</strong>, Metropolitan Aboriginal <strong>Youth</strong><br />
Team, SA Department of Human Services: Adelaide.
Contents<br />
Beginning the Story… ...................................................................................................1<br />
Executive Summary......................................................................................................3<br />
The <strong>Panyappi</strong> <strong>Program</strong> ............................................................................................... 10<br />
History of <strong>Panyappi</strong> ........................................................................................................................10<br />
Auspicing arrangement...................................................................................................................13<br />
Staffing structure..........................................................................................................................14<br />
<strong>Program</strong> collaborators....................................................................................................................16<br />
Young people involved with <strong>Panyappi</strong>...........................................................................................16<br />
How <strong>Panyappi</strong> works........................................................................................................................18<br />
A Brief Review of <strong>Mentoring</strong>...................................................................................26<br />
A cultural perspective...................................................................................................................26<br />
Published literature on mentoring: A brief summary ............................................................26<br />
The <strong>Evaluation</strong> Process .............................................................................................30<br />
<strong>Evaluation</strong> purpose .........................................................................................................................30<br />
<strong>Evaluation</strong> plan ................................................................................................................................30<br />
<strong>Evaluation</strong> questions ......................................................................................................................33<br />
The Stories..................................................................................................................34<br />
Painting a picture with numbers..................................................................................................34<br />
Young people and family themes.................................................................................................39<br />
<strong>Program</strong> management themes......................................................................................................52<br />
Being a mentor ................................................................................................................................62<br />
Weaving the Threads Together.............................................................................. 71<br />
Achieving desired program outcomes.........................................................................................71<br />
Implications for <strong>Indigenous</strong> youth mentoring programs.......................................................76<br />
Recommendations .......................................................................................................79<br />
Appendix A: <strong>Panyappi</strong> outcomes hierarchy........................................................... 81<br />
Appendix B: Glossary.................................................................................................82
Beginning the Story…<br />
<strong>Panyappi</strong> <strong>Indigenous</strong> <strong>Youth</strong> <strong>Mentoring</strong> <strong>Program</strong> <strong>Evaluation</strong><br />
<strong>Panyappi</strong> provides intensive support services to a small number of <strong>Indigenous</strong> young<br />
people and families. It is possible that those participating in the evaluation could be<br />
recognised if their actual stories were used, so only short non-identifying quotes are<br />
used in “The stories” section of the report.<br />
To protect their privacy, and given their willingness and generosity of time in<br />
participating, the following ‘story’ has been constructed out of the many different<br />
stories. It provides a description of the journey of many young people involved with<br />
<strong>Panyappi</strong>, although not all elements of the story are the same for all the young people.<br />
Susie is 13 years old and lives at home with both parents and two younger<br />
siblings. She plays a significant role in her family by caring for her younger<br />
siblings, including when her mother is less able to do this because of family<br />
violence. She also cares for her mother at these times. Susie’s father has<br />
regular work, but is a frequent user of yarndi, which is having negative effects<br />
on the whole family.<br />
In recent months Susie has started to spend more time away from home, often<br />
at night. She has been hanging out with a couple of new friends who are visiting<br />
the inner city and experimenting with yarndi. Susie is starting to get drawn into<br />
this other lifestyle. It is both exciting, but also an escape from the troubles at<br />
home and the heavy sense of responsibility she feels.<br />
Although it is common for young women to want to spend more time with their<br />
friends at this age, being with this group of friends means Susie is being<br />
exposed to and encouraged to use yarndi and alcohol. Doing this also exposes<br />
Susie to other risks on the streets, such as approaches by older men and<br />
invitations to go riding in cars. She still goes to school but is becoming more<br />
irregular. This is partly because of the times she cares for her mother and<br />
siblings as the family violence has been worse lately, but also the pull of the new<br />
friendships, which is timeout for her.<br />
Most of Susie’s other family members now live 2-3 hours away in the country, so<br />
connections with people who would offer her support have been interrupted.<br />
Susie was particularly close to her Auntie Lily on her mother’s side, but she has<br />
had to move to be near her grandchildren. Susie has found herself caught<br />
between two worlds, with limited support to help her look after herself. She<br />
often feels lonely, sad and is not sure what to do.<br />
Susie comes to <strong>Panyappi</strong>’s attention in two ways. The school has involved the<br />
regional Attendance Officer, but she is having difficulty getting past the door<br />
at home. By getting these phone calls and home visits her mother now knows<br />
Susie is not going to school consistently and this has created more arguments<br />
between them. Her mother is also unhappy that Susie is not caring for her<br />
younger siblings (aged 5 and 3) when asked. Susie’s mother approached the<br />
- 1 -
<strong>Panyappi</strong> <strong>Indigenous</strong> <strong>Youth</strong> <strong>Mentoring</strong> <strong>Program</strong> <strong>Evaluation</strong><br />
Aboriginal Education Worker (AEW ) at the school and that person told her<br />
about <strong>Panyappi</strong>. The AEW also tells the Attendance Officer about the program,<br />
who follows i t up and makes the referral.<br />
An inner city street worker has also noticed Susie, and her situation was raised<br />
at an Interagency Inner City Triage Meeting established by the <strong>Panyappi</strong><br />
program and the Crime Prevention Unit, State Attorney General’s Department.<br />
<strong>Panyappi</strong> reports they have just received a referral from education. The FAYS<br />
worker at the meeting agrees that Susie is at risk but indicates that FAYS<br />
cannot take her on. He does, however, do a check and reports that Aunt Li ly has<br />
previously rung through to FAYS to raise her concerns about Susie but no action<br />
was taken.<br />
The inner city street worker confirms that Susie has frequented the inner city<br />
more often in recent months, but does not believe she is there regularly enough<br />
to build a consistent relationship with her. She suggests that Susie probably<br />
needs another support option, as her group of friends do not just hang in the<br />
inner city, sometimes going to other places. The SAPOL Officer at the meeting<br />
suggests that she may be hooking up with a group of young people who are<br />
frequenting at least two other places in the metropolitan area late at night.<br />
<strong>Panyappi</strong> agrees to make contact with Susie and her family to see if they can<br />
assess the situation. At the following meeting they report that Susie and the<br />
family agreed, and they have accepted her and allocated a female mentor, Mary.<br />
Mary will work with Susie for 12-15 hours a week initially, and maintain support<br />
for several hours/week for as long as considered appropriate by Susie, her<br />
family and the <strong>Panyappi</strong> program. This may reduce over time according to needs<br />
and progress.<br />
The threads of Susie’s story will be picked up again in “The stories” section, where the<br />
work that <strong>Panyappi</strong> does to assist Susie to consider a different direction for her journal<br />
is described.<br />
Words used in this report<br />
Please note that Appendix B contains a glossary for some of the words used throughout<br />
this report that may be less familiar to readers.<br />
- 2 -
Executive Summary<br />
What is <strong>Panyappi</strong>?<br />
<strong>Panyappi</strong> <strong>Indigenous</strong> <strong>Youth</strong> <strong>Mentoring</strong> <strong>Program</strong> <strong>Evaluation</strong><br />
<strong>Panyappi</strong> 1 is an <strong>Indigenous</strong> youth mentoring service for young people who experience<br />
multiple problems that lead them to frequent inner city or other suburban hangouts,<br />
placing them at risk of being a victim of crime or engaging in offending behaviour.<br />
<strong>Panyappi</strong> aims to:<br />
1. To intervene in pathways of offending behaviour and bring about a positive shift in<br />
each young person’s attitude toward offending and in their behaviour.<br />
2. To decrease each young participant’s contact with the juvenile justice system and/or<br />
agencies associated with this system.<br />
3. To promote self-discovery and self-determination by young people participating in<br />
the program their family and wider community.<br />
4. To work collaboratively with all agencies that have mutual responsibility for resolving<br />
the young person’s difficulties.<br />
Most of the young people with whom <strong>Panyappi</strong> works are disengaging or already<br />
disengaged from education, have a high rate of social-emotional issues, and often engage<br />
in substance misuse. At least half of these young people are involved with FAYS and/or<br />
the juvenile justice system. They are unlikely to engage with mainstream youth<br />
mentoring programs, particularly on a voluntary basis, or with other youth groups or<br />
youth support services. They require longer-term, consistent, regular and more intense<br />
support in order to build trust, foster their personal resilience, and assist them to gain<br />
stability, a positive personal identity and constructive direction for their lives.<br />
Although it began in July 2001, like many pilot initiatives tackling a difficult issue<br />
<strong>Panyappi</strong> experienced disruptions during its establishment. Initially this was due to<br />
disagreement about the program focus, location, auspicing arrangements, and an<br />
insufficient funding base. The funding issue led to staffing the program with trainees<br />
only as mentors, rather than more experienced workers, which proved inappropriate and<br />
drew the Coordinator’s time away from service development. After making progress by<br />
March 2002, there were two quick changes of Coordinator resulting in an extended<br />
break in service in 2002. The program was stabilised in February 2003 and since then<br />
has functioned more smoothly, strengthened collaborative work with other agencies/<br />
services, and provided consistent mentoring services for young people and families.<br />
Evaluating <strong>Panyappi</strong><br />
<strong>Panyappi</strong> was evaluated through a series of personal interviews and focus groups with all<br />
key stakeholders, including young people, family members, program staff, program<br />
collaborators, program funders and Advisory Group Members. <strong>Program</strong> statistics, client<br />
demographics and program documentation were also reviewed and analysed. This<br />
1 This is a Kaurna word meaning younger brother or sister. It is pronounced “bunyip + ee.”<br />
- 3 -
<strong>Panyappi</strong> <strong>Indigenous</strong> <strong>Youth</strong> <strong>Mentoring</strong> <strong>Program</strong> <strong>Evaluation</strong><br />
provided a detailed picture of the journey of <strong>Panyappi</strong> and the progress it has made<br />
toward achieving its aims.<br />
<strong>Panyappi</strong>’s model of practice<br />
It became apparent that there were a number of important features in <strong>Panyappi</strong>’s model<br />
of practice that supported it to achieve its aims. They included:<br />
ω<br />
ω<br />
ω<br />
ω<br />
ω<br />
ω<br />
ω<br />
Having a formal rather than naturalistic mentoring process using a case management<br />
approach, where young people participate voluntarily in the program<br />
Focusing on the individual needs of young people<br />
Providing support beyond the “while the young person is in trouble” period and<br />
extending into the “consolidating new connections and commitments” period where<br />
young people are doing well and keeping their lives on a positive track - mentoring<br />
beyond the trouble zone<br />
Employing paid mentors who have quality training, professional development<br />
opportunities, and regular supervision and support<br />
Working from a developmental perspective by focusing on a lower age group, i.e. 10-<br />
14 years, who are already involved in offending behaviours and have disconnected<br />
from education<br />
Rebuilding and strengthening family connections as an important aspect of culturally<br />
appropriate practice in mentoring – this contrasts with mainstream mentoring<br />
programs that do not engage with families as standard practice<br />
Focusing on target geographical areas and developing collaborations with local key<br />
stakeholders to collectively address the problems <strong>Indigenous</strong> young people are<br />
experiencing and the issues this raises for the local community<br />
Progress toward desired program outcomes<br />
<strong>Panyappi</strong> has made substantial progress toward the desired program outcomes, despite<br />
the disruptions it experienced through the program establishment period, the loss of<br />
two coordinators and subsequent breaks in service. The collective opinion of evaluation<br />
participants was that <strong>Panyappi</strong> became a mentoring service in early 2003, so has only had<br />
just over 12 months to directly address the program aims. There was confidence that<br />
further outcomes could be achieved with more consistent support and committed<br />
funding, which could be tracked if this included resources for ongoing evaluation.<br />
Managing the program<br />
Advisory group members, program funders and collaborators reported the program was<br />
currently managed well and gained strong support from its auspicing agency. Most<br />
criticism related to issues known to be beyond the current program’s control. This<br />
includes the difficulty in ensuring program sustainability and continuity of service for<br />
young people, some ongoing effects from previous disruptions in staff, and limitations on<br />
how many young people they can work with due to the time needed to train staff.<br />
<strong>Panyappi</strong>’s experience mirrors the evidence on program targeting young offenders, where<br />
- 4 -
<strong>Panyappi</strong> <strong>Indigenous</strong> <strong>Youth</strong> <strong>Mentoring</strong> <strong>Program</strong> <strong>Evaluation</strong><br />
it is common for there to be a longer than expected period of time required to establish<br />
the program and develop effective partnerships, as well as to work with young people<br />
who are often uncertain about engaging and face multiple and complex issues.<br />
Reaching the target group<br />
The young people assessed and considered by <strong>Panyappi</strong> for mentoring support fit the<br />
profile originally identified for the program – described above. Most have multiple and<br />
serious problems to deal with, individually and within their families, which have often<br />
been longstanding issues. Therefore, <strong>Panyappi</strong> has addressed the intended target group,<br />
while also expanding the inner city focus in response to the location shifts of this group<br />
of young people.<br />
Supporting the mentors<br />
Mentors highly valued training and supervision support, seeing it as crucial to performing<br />
their roles. Some were keen to do further work placements and work in buddy systems<br />
with youth workers as part of their on-the-job training to deepen their knowledge of<br />
the services and systems in which their clients are involved. Some mentors wanted more<br />
supervision and support, which the Coordinator was keen to provide but was compromised<br />
by the multiple pressures of the role including efforts to obtain ongoing program<br />
funding.<br />
Mentors indicated an interest in continuing their mentoring work, but also doing further<br />
study, and progressing toward different jobs or more senior positions in the human<br />
services sector. This demonstrated the value of <strong>Panyappi</strong>’s two-level system of<br />
mentoring where their efforts to recruit and train <strong>Indigenous</strong> workers meant that they<br />
would be retained in the human services sector. It also highlighted the potential for<br />
<strong>Panyappi</strong> to nurture and encourage <strong>Indigenous</strong> workers who may taken on leadership<br />
positions in the human services sector and/or their communities.<br />
All mentors were linked with young people, with caseloads varying from 1 to 4 clients<br />
depending on confidence, experience, initiative and capacity. Their work was guided by a<br />
case plan developed by <strong>Panyappi</strong> in partnership with the young person, family, and, where<br />
relevant, other program collaborators. Occasionally some program collaborators felt<br />
uncomfortable that <strong>Panyappi</strong> was stepping into their territory with case planning, a<br />
situation that was or could be resolved through agreement to do mutual case planning.<br />
The value of mentoring relationships<br />
There was strong evidence from a range of evaluation participants that young people<br />
valued their relationships with mentors and grew to trust them, often in ways their<br />
family members or program collaborators had not previously witnessed. This was not<br />
always straightforward to achieve, particularly when there was a history of rejection,<br />
poor treatment or losses for young people, and it was important to allow time for this<br />
trust to develop.<br />
- 5 -
<strong>Panyappi</strong> <strong>Indigenous</strong> <strong>Youth</strong> <strong>Mentoring</strong> <strong>Program</strong> <strong>Evaluation</strong><br />
On a few occasions mentors had not performed their role appropriately, putting the<br />
relationship and young people’s progress at risk and drawing criticism from program<br />
collaborators. The <strong>Panyappi</strong> Coordinator addressed this by supporting mentors to<br />
improve their ability to meet their responsibilities, and, if necessary, reconsider their<br />
appropriateness for the role, or stepping in to work with the young person to bridge the<br />
gap until another mentor could be provided.<br />
Interagency collaboration<br />
Interagency collaboration has been variable at the Advisory Group level due to<br />
differences of opinion about the location and auspicing arrangements for <strong>Panyappi</strong>, and<br />
the disruption this creates when meetings are held, detracting from commitments to<br />
collaboration made in the early stages of the program. The viability of the current<br />
Advisory Group structure is uncertain and alternatives could be considered.<br />
In contrast, collaboration in the delivery of direct services appears to be strong.<br />
<strong>Program</strong> collaborators greatly appreciate access to a unique service that provides a high<br />
level of input into young people who are otherwise likely to disconnect from education<br />
and support services, and further increase the risk they will engage in or be a victim of<br />
crime. <strong>Panyappi</strong> has developed strong relationships with schools in providing everyday<br />
support for young people, and with family support services, especially through MAYT,<br />
but also other government and non-government agencies.<br />
Criticisms appeared to be based on confusion about the roles and responsibilities of<br />
mentors, the long-term and intensive nature of mentoring, and the extent of the<br />
program resources. This was reflected through reports about and from program<br />
collaborators of unrealistic expectations and inappropriate requests of mentors, and<br />
poor clarification of communication and information-sharing protocols. This may be<br />
restraining the achievement of best possible outcomes in some circumstances.<br />
Influencing young people’s attitudes and behaviour toward offending<br />
Both young people and family members reported a marked positive change in young<br />
people’s offending behaviour, which was supported by the justice system’s database that<br />
tracks and reports young people’s offending activity. Some young people with strong<br />
histories of offending and incarceration had not offended at all or only small incidents<br />
had occurred in a six-month period, often in the earlier stages of their work with<br />
<strong>Panyappi</strong>. The young people and their family members considered this remarkable and<br />
were proud as well as slightly surprised. Mentors and program collaborators supported<br />
these statements. Along with family members, they also indicated that young people’s<br />
attitudes had started to shift as they realised they could succeed in other areas and<br />
had other options they could take apart from offending.<br />
As would be expected for young people who have developed entrenched negative<br />
patterns, there were hiccoughs in this process. <strong>Evaluation</strong> participants were very keen<br />
that an investment was made in a long-term support program, like <strong>Panyappi</strong>, that would<br />
stay with young people through the ups and downs involved in getting back and staying on<br />
track.<br />
- 6 -
<strong>Panyappi</strong> <strong>Indigenous</strong> <strong>Youth</strong> <strong>Mentoring</strong> <strong>Program</strong> <strong>Evaluation</strong><br />
Decreasing young people’s contact with the juvenile justice system<br />
It was apparent from the range of qualitative data gained, that <strong>Panyappi</strong> clients<br />
decreased their contact with the juvenile justice system in terms of their level of and<br />
frequency of offending. This was confirmed through system data with substantial<br />
decreases in formal cautions, court orders, family conferences and convictions. Due to a<br />
previous history of offending it was common that some young people were still involved in<br />
court appearances or orders. <strong>Panyappi</strong> supported them through and, wherever possible,<br />
beyond this period. Whether this decreased contact is maintained will depend on the<br />
capacity to track these young people’s progress over a longer period of time, which will<br />
require ongoing program and evaluation funding.<br />
Supporting self-discovery and self-determination by young people and families<br />
There were consistent reports from a range of stakeholders that young people<br />
developed in their self-belief, and personal and cultural identity during their involvement<br />
with <strong>Panyappi</strong>. Many young people re-engaged with education, whether through schooling<br />
or VET options, started to develop other interests and friendships, and were developing<br />
better relationships with their families. Family members agreed to be involved with<br />
other support agencies to address personal or family issues, started to improve their<br />
skills in responding constructively to their young people, and became more convinced<br />
that their young person was making substantial changes. They reported experiencing a<br />
decrease in stress over time. They valued the way in which <strong>Panyappi</strong> included and<br />
supported them in the process.<br />
Family members, mentors and program collaborators believed that if young people were<br />
going to maintain belief in their ability to cope, stay motivated and achieve their goals, it<br />
would depend on further support from <strong>Panyappi</strong> at a similar or reduced intensity for a<br />
further period of time (i.e. at least 6-12 months). If this occurred, they were more<br />
confident that young people would become self-determining.<br />
Recommendations<br />
These outcomes lead to the following recommendations. Recommendations 1 through 6<br />
specifically focus on the <strong>Panyappi</strong> program, while recommendations 7 and 8 apply to<br />
future <strong>Indigenous</strong> youth programs.<br />
Recommendation 1: Ongoing commitment to <strong>Panyappi</strong><br />
ω<br />
ω<br />
Develop a long-term funding strategy for <strong>Panyappi</strong> involving two or more partners<br />
from the juvenile justice, crime prevention, and family and community service<br />
sectors, including <strong>Indigenous</strong> based agencies.<br />
Support <strong>Panyappi</strong> to document its model of work to be used as an example of good<br />
practice for both <strong>Indigenous</strong> and non-<strong>Indigenous</strong> youth mentoring programs, as well<br />
as a training tool within and beyond <strong>Panyappi</strong>.<br />
- 7 -
Recommendation 2: Extension of program scope<br />
ω<br />
ω<br />
ω<br />
ω<br />
ω<br />
ω<br />
ω<br />
ω<br />
<strong>Panyappi</strong> <strong>Indigenous</strong> <strong>Youth</strong> <strong>Mentoring</strong> <strong>Program</strong> <strong>Evaluation</strong><br />
Sustain the program and expand the funding base so that <strong>Panyappi</strong> has the capacity<br />
and flexibility to respond to a greater range of young people, specifically:<br />
� in other geographical areas of high need, and<br />
� across a wider age group, ie the 6-9 year old group.<br />
Recommendation 3: Strengthening collaborative work<br />
Continue to foster collaborative work with program collaborators beyond the<br />
auspicing agency, including formal memorandums of agreement where relevant.<br />
Develop a training strategy to inform and educate workers in FAYS and those in<br />
other collaborating agencies (government and non-government) to ensure they<br />
understand the:<br />
� role of mentoring,<br />
� responsibilities of mentors,<br />
� contrasts with other areas of work (statutory, education, counselling, etc), and<br />
� implications this has for effective communication and working relationships with<br />
<strong>Panyappi</strong>.<br />
Recommendation 4: An advisory and support function<br />
Explore alternative advisory and support models to the standard Advisory Group, eg<br />
regular information systems to a wider group of interested parties, buddy systems<br />
with one or more key stakeholders, occasional workshop or forums on specific issues,<br />
or invitations to program events or celebrations where discussion forums are built in.<br />
Recommendation 5: Family-inclusive approaches<br />
Maintain a family-inclusive approach in line with culturally appropriate practice.<br />
Further explore, document and evaluate this approach to assist in understanding its<br />
impact on program outcomes, and as a contribution to the literature on youth<br />
mentoring programs.<br />
Recommendation 6: <strong>Evaluation</strong><br />
Include a budget for evaluation in any future funding of <strong>Panyappi</strong> as it is a unique<br />
program in Australia - there are few independently evaluated youth mentoring<br />
programs and none have been both <strong>Indigenous</strong> run and focused apart from <strong>Panyappi</strong>.<br />
Develop an appropriate evaluation framework that:<br />
� tracks changes in offending behaviour by the client group over time,<br />
� accounts for other contributing factors, and<br />
- 8 -
<strong>Panyappi</strong> <strong>Indigenous</strong> <strong>Youth</strong> <strong>Mentoring</strong> <strong>Program</strong> <strong>Evaluation</strong><br />
� uses a consistent and agreed method of defining offending behaviour with a<br />
reliable system of recording it that has the cooperation and support of relevant<br />
government departments or agencies.<br />
Recommendation 7: Encouraging future <strong>Indigenous</strong> leaders<br />
ω<br />
ω<br />
ω<br />
Ensure that a formal mentoring process is provided for <strong>Indigenous</strong> workers taking up<br />
entry-level positions within human service organisations<br />
Develop a process for mentoring of workers at all levels within human service<br />
organisations and offer <strong>Indigenous</strong> workers the option to participate<br />
Recommendation 8: Establishment phase for future <strong>Indigenous</strong> youth programs<br />
Ensure that an establishment phase is built into the budget and plan in the funding<br />
of any future <strong>Indigenous</strong> youth program, and sufficient time is allowed for<br />
establishment to occur before service delivery commences.<br />
- 9 -
The <strong>Panyappi</strong> <strong>Program</strong><br />
<strong>Panyappi</strong> <strong>Indigenous</strong> <strong>Youth</strong> <strong>Mentoring</strong> <strong>Program</strong> <strong>Evaluation</strong><br />
<strong>Panyappi</strong> means “younger brother or sister” and is an <strong>Indigenous</strong> youth mentoring<br />
program that operates in a crime prevention context. Theory and practice in the<br />
mentoring and crime prevention fields, together with culturally appropriate practice in<br />
human services work, guide the design and conduct of <strong>Panyappi</strong>. This is reflected in its<br />
aims:<br />
1. To intervene in pathways of offending behaviour and bring about a positive shift in<br />
each young person’s attitude toward offending and in their behaviour.<br />
2. To decrease each young participant’s contact with the juvenile justice system and/or<br />
agencies associated with this system.<br />
3. To promote self-discovery and self-determination by young people participating in<br />
the program their family and wider community.<br />
4. To work collaboratively with all agencies that have mutual responsibility for resolving<br />
the young person’s difficulties.<br />
History of <strong>Panyappi</strong><br />
Why this program? 2<br />
The idea behind <strong>Panyappi</strong> emerged in 1999 as a response to the recurring problem of<br />
Aboriginal young people frequenting the inner city area of Adelaide and their<br />
involvement in a range of crimes, particularly on weekends. There was also concern about<br />
the risks that young people faced by being in the inner city late at night and engaging in<br />
criminal activity that may involve older people. The Metropolitan Aboriginal <strong>Youth</strong> Team<br />
(MAYT), an Aboriginal-focused youth program within Family and <strong>Youth</strong> Services (FAYS),<br />
Department of Human Services (DHS) discussed these issues with the Crime Prevention<br />
Unit of the State Attorney General’s Department. These discussions led to MAYT<br />
developing and submitting an initial proposal to the Attorney General’s Department in<br />
early 2000 for a 12-month mentoring program to work with the identified target group.<br />
Following in principal approval of the project in June 2000, a Project Management Group<br />
was formed. It was later known as the “Funders Group” to more accurately reflect its<br />
role, as a Project Advisory Group was also formed to support and guide the project with<br />
representation sought from a range of stakeholders in the justice, youth and community<br />
field. The Advisory Group had its inaugural meeting in November 2000. During 2000, the<br />
Funders Group engaged in detailed project planning, which led to a number of changes to<br />
the original proposal. For example, the establishment of a youth facility in the city area<br />
was dropped for several reasons, including practicality and cost effectiveness. There<br />
was a shift away from exclusively working after hours with young people, as there were<br />
existing youth services operating after hours with young people in the city and<br />
mentoring requires engagement with young people at different times, including day time.<br />
2 Crime Prevention Unit (2002). <strong>Panyappi</strong> Stage One Report. South Australian Attorney General’s Department:<br />
Adelaide, pp.4-5.<br />
- 10 -
<strong>Panyappi</strong> <strong>Indigenous</strong> <strong>Youth</strong> <strong>Mentoring</strong> <strong>Program</strong> <strong>Evaluation</strong><br />
The group also recognised that mentoring, especially with this group of young people,<br />
was a process that required a long-term commitment in order to achieve desired<br />
personal emotional and behavioural change. They put a submission to the national<br />
mentoring program funded by the Australian Attorney General’s Department as part of<br />
the national crime prevention program. This enabled the project to be funded for two<br />
years so it could establish appropriate policies and practices and develop an effective<br />
model for working with this group of young people. Following submission in January 2001<br />
a funding agreement was reached with the Australian Government in October 2001. The<br />
State Attorney General’s Department, Crime Prevention Unit also committed funds, and<br />
FAYS indicated it would, although the final outcome did not prove adequate (see below).<br />
Why mentoring? 3<br />
There are several possible responses to the issue of Aboriginal young people frequenting<br />
the inner city area of Adelaide. Some of these response options already exist, such as<br />
street work with young people in general or specifically with Aboriginal young people. In<br />
this instance, mentoring was chosen because it was seen as more likely to facilitate an<br />
effective intervention that moved beyond a crisis or short-term response to achieve<br />
outcomes that can be sustained over the long-term. A summary of reasons is:<br />
ω<br />
ω<br />
ω<br />
ω<br />
ω<br />
<strong>Mentoring</strong> usually focuses on one-on-one engagement with young people, thereby<br />
providing the opportunity to develop a relationship where the young person’s<br />
concerns, experiences and issues can be shared, and assistance and support provided<br />
by Mentors<br />
Mentors can act as role models, demonstrating and encouraging non-offending<br />
behaviours and moderating negative peer influences<br />
Mentors can provide a service to the young person in a wide variety of environments<br />
such as at school or on the street where the young person hangs out<br />
Mentors can also act as a bridge between the young person and services, providing<br />
advice, referral and advocacy<br />
Mentors have greater capacity to develop a relationship wider than the young<br />
person, establishing links with the family and peers<br />
This is based on the assumption that an effective relationship is established between a<br />
young person and the mentor demonstrated by trust and mutual respect between both<br />
parties. It was believed that the development of an effective relationship would lead to<br />
the young person moderating their offending behaviour.<br />
<strong>Mentoring</strong> is supported by research findings that identify mentoring as a “promising”<br />
crime prevention strategy. 4 <strong>Mentoring</strong> is also seen as having particular application in<br />
Aboriginal communities as it is compatible with the cultural tradition of older people in<br />
3 ibid, p.4.<br />
4 Lawrence, S. et al. (1997). Preventing crime: What works, what doesn’t, what’s promising? University of<br />
Maryland.<br />
- 11 -
<strong>Panyappi</strong> <strong>Indigenous</strong> <strong>Youth</strong> <strong>Mentoring</strong> <strong>Program</strong> <strong>Evaluation</strong><br />
the community providing guidance and transferring knowledge to younger members in the<br />
community (please see “A brief review of mentoring: A cultural perspective” below).<br />
<strong>Mentoring</strong> as a crime prevention approach is supported in the literature and research on<br />
developmental and early intervention approaches to crime prevention. This approach<br />
identifies risk and protective factors influencing an interrelated life pathway. A<br />
developmental prevention strategy will seek to reduce risk factors and promote<br />
protective factors. Identified protective factors include meeting a significant person<br />
and a supportive relationship with another adult 5 (please see “A brief review of<br />
mentoring: Published literature on mentoring” below). These ideas are consistent with<br />
literature on the development of resilience in young people where a stable and<br />
supportive relationship with a significant adult fosters coping and resilience. 6,7<br />
Deciding on the auspicing agency<br />
Since the early days of the Advisory Group there has been discussion about the location<br />
of the <strong>Panyappi</strong> program, with several people arguing that it should be auspiced by a<br />
community agency. At the same time there was acknowledgement that ever since the<br />
initial ideas for the program MAYT has been a key player in discussing the issues and<br />
developing proposals for its design and implementation. MAYT were highly familiar with<br />
the group of young people targeted in <strong>Panyappi</strong>, as they worked with many of them, their<br />
families and the community across their range of programs. They also were seen as<br />
having the capacity to offer strong infrastructure support and a track record with<br />
providing mentoring programs to Aboriginal young people. 8 This issue was tracked<br />
through the early internal evaluation of the program conducted by the Crime Prevention<br />
Unit in the State Attorney General’s Department and was revisited during Advisory<br />
Group meetings in 2002.<br />
Following the unexpected and quick loss of the 2 nd <strong>Panyappi</strong> Coordinator in September<br />
2002, the issue of <strong>Panyappi</strong>’s location was explored again at a specially convened<br />
Advisory Group about the future of the program in October 2002. 9 The Crime<br />
Prevention Unit agreed to develop a short discussion paper on a process for deciding<br />
whether the program should be transferred to a community organisation and what model<br />
would be used for this process. This was provided in early 2003. There was inconsistent<br />
attendance at meetings scheduled during this year, so Advisory Group members did not<br />
respond to the paper, discuss the issue in detail or formally recommend that the matter<br />
be pursued. Due to this history the location of <strong>Panyappi</strong> was raised as a question during<br />
the external evaluation.<br />
5 National Crime Prevention (1999). Pathways to Prevention: Developmental and early intervention approaches<br />
to crime in Australia. National Crime Prevention, Australian Attorney General’s Department: Canberra<br />
6 Garbarino, J., Dubrow, N., Kostelny, K., & Pardo, C. (1992). Children in danger: Coping with the consequences<br />
of community violence. San Francisco: Jossey-Bass.<br />
7<br />
Rutter, M. (1999). Resilience concepts and findings: Implications for family therapy. Journal of Family Therapy, 21, 119-144.<br />
8 Crime Prevention Unit (2002), op cit, p.10.<br />
9 Crime Prevention Unit (2003). <strong>Panyappi</strong> Stage Three Report. South Australian Crime Prevention Unit: Adelaide.<br />
- 12 -
<strong>Program</strong> funding<br />
<strong>Panyappi</strong> <strong>Indigenous</strong> <strong>Youth</strong> <strong>Mentoring</strong> <strong>Program</strong> <strong>Evaluation</strong><br />
<strong>Panyappi</strong> commenced operating in July 2001 based on collaborative funding that involved<br />
three partners:<br />
ω<br />
ω<br />
ω<br />
A 2 year grant from the Commonwealth Attorney General’s National Crime<br />
Prevention Unit for January 2002 – January 2004<br />
A grant from State Attorney General’s Department, Crime Prevention Unit for the<br />
same period to match this funding and support the program<br />
In-kind support and a small grant from Family and <strong>Youth</strong> Services, DHS<br />
Of the 24 programs funded by the Commonwealth it was one of only two programs<br />
targeting <strong>Indigenous</strong> young people. It is one of few mentoring programs in Australia that<br />
has a dedicated crime prevention focus. 10,11 Although <strong>Panyappi</strong> shares the main functions<br />
of mentoring and role model programs – “inspiration, setting an example and providing<br />
personalised support” 12 - it is developing a unique model for a mentoring program that<br />
also has unique challenges (see “The <strong>Panyappi</strong> program: How <strong>Panyappi</strong> works” below).<br />
Auspicing arrangement<br />
<strong>Panyappi</strong> is auspiced by MAYT, the only youth and Aboriginal specific government funded<br />
program in DHS and South Australia. MAYT is committed to developing and maintaining<br />
“a strong and supportive team ethic that respects and nurtures cultural identity and<br />
culturally appropriate ways of working.” 13 The key intentions of MAYT are:<br />
To support young people to reconnect with families, community, culture and<br />
education and, wherever possible, prevent them from becoming involved or reinvolved<br />
with the juvenile justice and social welfare systems. 14<br />
MAYT operates several programs in order to serve Aboriginal young people and families<br />
involved with FAYS, including a Juvenile Justice <strong>Program</strong>, Family Placement Coordinator,<br />
Family Worker, Drug and Alcohol Worker and Tutorial <strong>Program</strong>. It has recently been<br />
successful in gaining additional state funding to develop a full Family Team, ie 4 new<br />
workers in addition to an existing family worker. MAYT provides the following in-kind<br />
support (~$123K) for <strong>Panyappi</strong> to give it a strong infrastructure and collegial base:<br />
10 ARTD (1999/2001). Interim literature review for the mentoring as a crime prevention strategy pilot project.<br />
Sydney: Crime Prevention Division, NSW Attorney General’s Department.<br />
11 Wilczynski, A. (2002). A national audit review of mentoring projects for young offenders: Preliminary<br />
findings. Paper presented at the Crime Prevention Conference convened by the Australian Institute of<br />
Criminology and the Crime Prevention Branch, Commonwealth Attorney-General’s Department, Sydney.<br />
12 MacCallum, J. & Beltman, S. (2002). Role models for young people: What makes an effective role model<br />
program. National <strong>Youth</strong> Affairs Research Scheme: Hobart, p.63.<br />
13<br />
Stacey, K. (2003). MAYT - Metropolitan Aboriginal <strong>Youth</strong> Team: A metropolit an wide and community based<br />
initiative. Site visit report for the School Retention Reference. Social Inclusion Unit, SA Department of<br />
Premier & Cabinet: Adelaide, p.1.<br />
14 ibid, p.2.<br />
- 13 -
ω<br />
ω<br />
ω<br />
ω<br />
ω<br />
ω<br />
ω<br />
ω<br />
ω<br />
ω<br />
Offices and furniture, group room and meeting facilities<br />
<strong>Panyappi</strong> <strong>Indigenous</strong> <strong>Youth</strong> <strong>Mentoring</strong> <strong>Program</strong> <strong>Evaluation</strong><br />
Reception and administrative support, including office supplies, postage and<br />
photocopying<br />
Supervision of the Coordinator position<br />
Access to a vehicle<br />
Access to FAYS and MAYT training opportunities<br />
Inclusion of the <strong>Panyappi</strong> Coordinator in the MAYT management team to strengthen<br />
program cooperation<br />
Inclusion of <strong>Panyappi</strong> staff in MAYT team meetings and planning days to complement<br />
and integrate program operations<br />
Cooperative working relationships, especially with the Family, and Drug and Alcohol<br />
workers<br />
Development of joint programs for MAYT and <strong>Panyappi</strong> clients where appropriate<br />
$33K/year of direct funding over the two year grant period<br />
Staffing structure<br />
Original staffing structure<br />
At the time of appointing the first coordinator in July 2001, the recommended staffing<br />
structure included a <strong>Program</strong> Coordinator at the ASO5 level and then a budget allocation<br />
for mentors that could be divided as considered appropriate. The first round of mentor<br />
recruitment in October 2001 identified six suitable mentors who took up positions as<br />
outlined in Figure 1.<br />
2.6 Mentors – OPS1<br />
(Part-time)<br />
Revised staffing structure<br />
Figure 1: Original staffing structure<br />
MAYT – Auspicing agency<br />
Coordinator – ASO5<br />
3 Mentors – OPS1<br />
(Trainees)<br />
The original staffing structure was maintained during the 2001-2002 period while the 1 st<br />
Coordinator (July 2001 - March 2002) and 2 nd Coordinator (July 2002 – September<br />
2002) were managing the program. In February 2003, when the 3 rd Coordinator started,<br />
- 14 -
<strong>Panyappi</strong> <strong>Indigenous</strong> <strong>Youth</strong> <strong>Mentoring</strong> <strong>Program</strong> <strong>Evaluation</strong><br />
the staffing structure was reviewed. A decision was taken to create a Mentor Support<br />
Worker position to provide a viable career path for the mentors, and support both the<br />
mentors and the Coordinator in the ‘day-to-day’ running of the program. In addition<br />
there would be other specific tasks, such as monitoring the case management approach<br />
designed for <strong>Panyappi</strong>. This position was made possible through salary savings from the<br />
two time periods during which the Coordinator position was unfilled. The intention was to<br />
fill the position in July 2003. The revised structure is outlined in Figure 2.<br />
1 Mentor Support<br />
Worker – OPS2<br />
Current staffing structure<br />
Figure 2: Revised staffing structure<br />
MAYT – Auspicing agency<br />
Coordinator – ASO5<br />
2.6 Mentors – OPS1<br />
(Part-time)<br />
3 Mentors – OPS1<br />
(Trainees)<br />
During mid-late 2003 some mentors left <strong>Panyappi</strong> for other positions. With the funding<br />
period due to end in January 2004 these positions were not immediately filled, as new<br />
people would start a process with young people that they could not see through for a<br />
sufficient period of time. It was decided that the new OPS2 mentor position was more<br />
appropriately classified as OPS3, and MAYT provided additional funding to establish<br />
that position in September 2003, planning to absorb this cost into the ongoing <strong>Panyappi</strong><br />
budget, once that is clarified. Due to salary savings, the program could continue through<br />
to June 2004 so its future and budget remains uncertain until that time. The current<br />
staffing structure is outlined in Figure 3.<br />
$<br />
1 Senior Mentor –<br />
OPS3<br />
Figure 3: Current staffing structure<br />
MAYT – Auspicing agency<br />
Coordinator – ASO5<br />
1.6 Mentors – OPS1<br />
(Full and part-time)<br />
- 15 -<br />
1 Mentor – OPS1<br />
(Trainee)
<strong>Program</strong> collaborators<br />
<strong>Panyappi</strong> <strong>Indigenous</strong> <strong>Youth</strong> <strong>Mentoring</strong> <strong>Program</strong> <strong>Evaluation</strong><br />
As the young people who <strong>Panyappi</strong> target are often in more complex circumstances than<br />
young people in mainstream mentoring programs, an extensive network of connections<br />
are required. The key collaborations in the development and delivery of the <strong>Panyappi</strong><br />
program are shown in Figure 4 and may be:<br />
ω<br />
ω<br />
ω<br />
ω<br />
ω<br />
ω<br />
ω<br />
ω<br />
ω<br />
ω<br />
ω<br />
ω<br />
ω<br />
sources of referral to <strong>Panyappi</strong>,<br />
services with whom <strong>Panyappi</strong> mentors need to network or to whom they may need to<br />
refer due the needs of individual young people,<br />
services with whom <strong>Panyappi</strong> develops cooperative programs, and<br />
services with whom <strong>Panyappi</strong> networks to stay abreast of relevant local and sector<br />
issues that impact on their program, mentors and or young people.<br />
Young people involved with <strong>Panyappi</strong><br />
The initial intention was for <strong>Panyappi</strong> to focus on young Aboriginal people who frequent<br />
the inner city area although they may come from various parts of the metropolitan area,<br />
often the west, south and north. Although this focus has been maintained, <strong>Panyappi</strong> has<br />
also worked with young people who frequent other urban areas. This has been necessary<br />
as “the place” to hang out shifts over time and can quickly move back and forth. Young<br />
people who typically come into the inner city may temporarily go out to Salisbury, the<br />
Parks or other locations.<br />
The young people involved with <strong>Panyappi</strong> are usually 10-17 years old and are at risk of<br />
entering the juvenile justice system or incarceration. They usually have the following<br />
characteristics:<br />
In the 10-15 age group<br />
A history of offending or risk factors associated with offending<br />
Low socio-economic background<br />
Poor school attendance and often complete disengagement from schooling<br />
Poor educational achievement, low numeracy and literacy skills, and/or learning<br />
difficulties<br />
Behavioural difficulties and problems with violence<br />
A history of drug, alcohol and substance misuse<br />
Experiences of physical, sexual and emotional abuse<br />
Unstable living arrangements<br />
- 16 -
JUSTICE<br />
Strong support from the Crime Prevention Unit, Attorney<br />
General’s Department, and liaison with and support of other<br />
parts of the system (eg youth conference teams, courts) to<br />
co-develop and coordinate early intervention and prevention<br />
options.<br />
EDUCATION<br />
Liaison with and support to<br />
schools involved with the<br />
young people in <strong>Panyappi</strong><br />
YOUTH SERVICES<br />
<strong>Indigenous</strong> and non-<strong>Indigenous</strong>,<br />
and government and NGO<br />
community youth health and<br />
welfare services<br />
Figure 4: <strong>Panyappi</strong> program collaborators<br />
PANYAPPI<br />
Mentors Young<br />
people<br />
Family Drug &<br />
Team Alcohol Worker<br />
Coordinator<br />
Family Juvenile<br />
Placement Team Justice Team<br />
Tutoring <strong>Program</strong><br />
MAYT<br />
CAMHS<br />
LOCAL GOVERNMENT<br />
Community Service<br />
Teams<br />
In-depth therapy support from child and adolescent<br />
mental health services as indicated.<br />
- 17 -<br />
<strong>Panyappi</strong> <strong>Indigenous</strong> <strong>Youth</strong> <strong>Mentoring</strong> <strong>Program</strong> <strong>Evaluation</strong><br />
SA POLICE<br />
Co-develop and run<br />
some program<br />
aspects<br />
FAMILY SUP-<br />
PORT SERVICES<br />
<strong>Indigenous</strong> and non-<br />
<strong>Indigenous</strong>, and<br />
government and NGO<br />
family services
ω<br />
ω<br />
ω<br />
ω<br />
ω<br />
ω<br />
<strong>Panyappi</strong> <strong>Indigenous</strong> <strong>Youth</strong> <strong>Mentoring</strong> <strong>Program</strong> <strong>Evaluation</strong><br />
Families dealing with multiple problems (including several of the above), where family<br />
breakdown is common and young people’s relationships with significant others is<br />
often disrupted and inconsistent<br />
They are unlikely to engage with mainstream youth mentoring programs, particularly on a<br />
voluntary basis, or with other youth groups or youth support services. They require<br />
longer-term, consistent, regular and more intense support in order to build trust, foster<br />
their personal resilience and successfully meet the desired aims of the <strong>Panyappi</strong><br />
program.<br />
How <strong>Panyappi</strong> works<br />
Through the evaluation work it became apparent that <strong>Panyappi</strong> has developed a number<br />
of key features in its practice that cover:<br />
the mentoring process<br />
the mentoring role<br />
level of intervention<br />
relationships with families<br />
interagency work<br />
It is useful to outline these features at this point in the report as they provide a<br />
context for what participants in the evaluation say about their experience of <strong>Panyappi</strong>.<br />
In the stories and opinions shared in the evaluation, evaluation participants provided<br />
evidence to support this description of how <strong>Panyappi</strong> works.<br />
Some of these features align with recommended strategies for good practice in<br />
mainstream mentoring programs, while others are more unique to <strong>Panyappi</strong> as an<br />
<strong>Indigenous</strong> youth mentoring program (please also see “A brief overview of mentoring”<br />
below).<br />
The mentoring process<br />
<strong>Panyappi</strong> is a formal rather than naturalistic mentoring process based on a case<br />
management approach, where young people participate voluntarily in the program. The<br />
voluntary aspect is considered important, as the young people referred to <strong>Panyappi</strong> are<br />
often involved in court or educational processes where they are expected or required to<br />
participate. They do not always respond well to mandated requirements to attend human<br />
service programs.<br />
Making <strong>Panyappi</strong> voluntary assists in engaging the young person, as they see the <strong>Panyappi</strong><br />
mentor as being more on their side. Mentors build on this start by developing a positive,<br />
caring and non-judgemental relationship with young people. <strong>Panyappi</strong> staff believe that<br />
ensuring the program is voluntary creates some leverage for them to build a better<br />
relationship and then encourage young people to participate more effectively with court<br />
- 18 -
<strong>Panyappi</strong> <strong>Indigenous</strong> <strong>Youth</strong> <strong>Mentoring</strong> <strong>Program</strong> <strong>Evaluation</strong><br />
and education processes or other human services. This is supported by a recent national<br />
review of mentoring program in crime prevention. 15<br />
<strong>Panyappi</strong> focuses on the individual needs of young people in the following ways. They<br />
have a screening and assessment process to ensure young people fit the criteria. Once<br />
accepted into the program they identify individual needs and determine the best match<br />
with a mentor. The mentor spends committed one-to-one time with young people to build<br />
a relationship and assist the young person in dealing with the many issues they face in<br />
their life. They then identify what additional support is required from external agencies,<br />
such as the program collaborators identified in Figure 4. The Coordinator liaises and<br />
negotiates to gain this support, or supports mentors in this role.<br />
Although it may be more time and cost effective to offer group mentoring options, many<br />
of the young people involved in <strong>Panyappi</strong> need to start with individual mentoring before<br />
they can function effectively in a group environment. In addition to one-to-one time with<br />
mentors, the program develops and accesses a range of individual and group programs<br />
as another context in which mentoring work can occur. This is facilitated by co-location<br />
with MAYT, as <strong>Panyappi</strong> can utilise the range of programs they offer. In this way<br />
<strong>Panyappi</strong> offers a “both/and” approach of providing individual mentoring, as well as the<br />
benefits and cultural fit of group or collective strategies.<br />
A unique feature of <strong>Panyappi</strong> is that it provides an opportunity for personal mentoring<br />
support beyond the “while the young person is in trouble” period and extending into the<br />
“consolidating new connections and commitments” period where young people are doing<br />
well and keeping their lives on a positive track. This could be called mentoring beyond<br />
the trouble zone. This reverses the common experience for <strong>Panyappi</strong>’s target group.<br />
Often they only receive support because they are in trouble, rather than when they are<br />
doing well, which can work against long-term change.<br />
Continuing mentoring support after issues are resolved but before the young person has<br />
solidly established a new pattern minimises the revolving door phenomena of falling back<br />
into problematic patterns when support is withdrawn too early. Another rationale for<br />
doing this is that many of <strong>Panyappi</strong>’s young people have experienced disrupted<br />
relationships with important family members. The staff believe that providing an<br />
experience of a more stable relationship while strengthening or building up connections<br />
with other people in their everyday network will assist young people to sustain gains they<br />
make during their time with <strong>Panyappi</strong>.<br />
The mentoring role<br />
Assisting people to understand the mentoring role has been one of the challenges faced<br />
by <strong>Panyappi</strong> in working with program collaborators so there are appropriate expectations<br />
or requests of mentors – this issue will be addressed in the <strong>Evaluation</strong> Outcomes section.<br />
15 Wilczynski, A., Culvenor, C., Cunneen, C., Schwartzkoff, J. & Reed-Gilbert, K. (2003). Early intervention:<br />
<strong>Youth</strong> mentoring programs - An overview of mentoring programs for young people at risk of offending.<br />
Australian Government Attorney-General’s Department: Canberra.<br />
- 19 -
<strong>Panyappi</strong> <strong>Indigenous</strong> <strong>Youth</strong> <strong>Mentoring</strong> <strong>Program</strong> <strong>Evaluation</strong><br />
<strong>Mentoring</strong> may share some aspects of youth work or social work, but there is a different<br />
focus and intention. It is not a transport, even though mentors may transport or<br />
accompany young people to other appointments or obligations. These activities<br />
contribute to a larger purpose or goal that is agreed with the young person and<br />
family/caregivers. It is not a baby-sitting service, even though mentors may spend<br />
recreational time with young people individually or in groups. Individual or group<br />
excursions are an environment in which it may be more comfortable and safe for the<br />
young person to open up to the mentor, build trust and start to discuss the personal<br />
issues they face.<br />
In summary, the role of mentors is to ensure the care, health and wellbeing of young<br />
people who access <strong>Panyappi</strong> services. They act as a bridge between the young person and<br />
services, providing advice, referral and advocacy. They provide a service to the young<br />
person in a wide variety of environments by:<br />
ω<br />
ω<br />
ω<br />
ω<br />
ω<br />
ω<br />
ω<br />
ω<br />
ω<br />
ω<br />
Modelling appropriate behaviours<br />
Providing one-on-one engagement with a young person to build a trusting relationship<br />
with a commitment to maintaining the relationship over an extended period of time<br />
Assisting young people to access educational, training and recreational services to<br />
facilitate young peoples transition into the community<br />
Promoting, encouraging and ensuring positive relationships with parents, family<br />
members, significant others and the community<br />
Providing care, guidance, support and supervision of young people in a reasonable and<br />
appropriate manner, and their protection from harm and exploitation<br />
Offering a safe, secure and caring environment for young people.<br />
Developing and implementing programs that teach young people practical living skills,<br />
how to make choices and decisions and how to take responsibility for their actions<br />
Assisting young people who are moving towards independence by providing regular<br />
support and linking into appropriate services<br />
Escorting and supervising young people when attending relevant appointments in the<br />
community<br />
Providing opportunities for young people to experience success and to realise their<br />
full potential<br />
Due to the complex and often long-standing problems for young people in <strong>Panyappi</strong>, and a<br />
frequent history of previously unsuccessful intervention, mentoring involves regular and<br />
intensive involvement. This is up to 15 – 20 hours/week, particularly in the earlier months<br />
while the relationship and trust is being built. The belief is that an investment of this<br />
nature makes a difference that can be sustained as the young person becomes an adult<br />
and avoids further and more serious involvement in crime that has high social and<br />
financial costs at personal, family and societal levels.<br />
<strong>Panyappi</strong>’s approach to mentoring acknowledges that there are multiple ways of<br />
supporting young people and more than mentoring is required to make a difference, ie:<br />
- 20 -
<strong>Panyappi</strong> <strong>Indigenous</strong> <strong>Youth</strong> <strong>Mentoring</strong> <strong>Program</strong> <strong>Evaluation</strong><br />
Formal mentoring programs are one effective means of supporting young people,<br />
not a single solution to complex social and individual needs. Especially in<br />
circumstances where young people face multiple disadvantages, mentors are best<br />
regarded as complementary to and an addition to the work of professionals and<br />
other supportive services, not as a replacement for them. 16<br />
As noted in the above summary of their role, <strong>Panyappi</strong> mentors are actively involved in<br />
facilitating the engagement of young people and families with a range of other services<br />
that can respond to their needs, particularly where it has or will be difficult for<br />
engagement to occur.<br />
Support for mentors<br />
There has been strong commitment to ensuring that <strong>Panyappi</strong> mentors have access to<br />
quality training, professional development opportunities, and regular supervision and<br />
support. The intentions are to resource them appropriately and sustain them in their<br />
high intensity role with this group of young people.<br />
If they do not have it, all <strong>Panyappi</strong> mentors undertake training for a Certificate III in<br />
Community Services (<strong>Youth</strong> Work). They have access to the range of training offered<br />
through FAYS in the Department of Human Services, including required training in<br />
Mandated Notification and Occupational Health and Safety issues and other areas<br />
relevant to the program, e.g. juvenile justice, racism/anti-racism, substance misuse.<br />
They also participate in MAYT staff development and planning processes.<br />
The <strong>Panyappi</strong> Coordinator provides professional supervision for all mentors based on<br />
mutually negotiated superversion agreements. In addition each mentor has a<br />
performance management agreement that includes a focus on career development. The<br />
Coordinator conducts all screening and assessment, case planning and case management,<br />
including attending case conferences with other agencies where required. Case planning<br />
occurs in collaboration with individual mentors, and mentors learn about the case<br />
management process. In addition, under the current staffing structure they also have<br />
access to the Senior Mentor for day-to-day peer support and guidance, where the<br />
Senior Mentor can act as a mentor to the other mentors.<br />
<strong>Panyappi</strong> has adopted a strategy of two levels of mentoring. The primary focus is on<br />
young people, as required under the program funding arrangements. In addition, there is<br />
a secondary focus on people in the Mentor positions. This addresses the need to recruit<br />
and retain skilled <strong>Indigenous</strong> workers within Family & <strong>Youth</strong> Services, DHS, and<br />
responds to commitments to do this in the DHS Reconciliation Plan. 17 Although <strong>Panyappi</strong><br />
is very keen to retain mentors in order to ensure program stability and offer young<br />
people relationship stability, mentors are encouraged to consider further study options<br />
as part of their career development. In this way <strong>Panyappi</strong> contributes to developing and<br />
16 Hartley, R. (2004). Young people and mentoring: Towards a national strategy. Big Brothers Big Sisters<br />
Australia, Dusseldorp Skills Forum and The Smith Family: Australia.<br />
17<br />
Department of Human Services (2002). Department of Human Services: The Reconciliation Plan 2002-2003.<br />
Adelaide: SA Department of Human Services, p.28.<br />
- 21 -
<strong>Panyappi</strong> <strong>Indigenous</strong> <strong>Youth</strong> <strong>Mentoring</strong> <strong>Program</strong> <strong>Evaluation</strong><br />
supporting the people who will become the workers of the future within Aboriginal<br />
services and communities, and potentially leaders within services and communities.<br />
Level of and intensity of intervention<br />
<strong>Mentoring</strong> programs are often targeted at young people as they reach and proceed<br />
through their teenage years. There are two obvious reasons for this. First, the<br />
prevalence of mental health problems markedly increases in the 12 to 25 year age<br />
group. 18 Second, early school leaving is an increasing issue at this developmental time.<br />
About one third of young people leave school before the end of year 12 and many have<br />
only Year 10 schooling. 19,20 Once out of school, young people aged 15-24 years experience<br />
2.7 times the level of unemployment of people aged 25-54 years. 21 It is in these<br />
situations that young people often become disconnected from their personal and<br />
community connections and mentoring is one of several recommended and positive<br />
responses.<br />
According to very recent estimates:<br />
<strong>Indigenous</strong> young people in urban, regional and remote locations face a level of<br />
risk of disconnection from learning and work three times greater than non-<br />
<strong>Indigenous</strong> young people. 22<br />
<strong>Panyappi</strong> decided to work from a developmental perspective 23 by focusing on a lower age<br />
group, i.e. 10-14 year olds, who are already involved in offending behaviours and have<br />
disconnected from education. Once they have reached the age of 15 the young people in<br />
their target group typically do not reconnect to education via other available strategies<br />
and often reject the idea of mentoring. This group also exerts significant influence over<br />
the 10-14 year olds who may not have many other alternative influences or options apart<br />
from following their older peers.<br />
In addition, because they are working with young offenders, the intensity and frequency<br />
of their work with young people is much higher than young people who are “at risk” in<br />
some general way. A recent national overview of mentoring for young offenders reported<br />
that: 24<br />
18 Commonwealth Department of Health and Aged Care (2000). National action plan for promotion, prevention<br />
and early intervention for mental health 2000. Mental Health and Special <strong>Program</strong>s Branch, Commonwealth<br />
Department of Health and Aged Care: Canberra.<br />
19 Dusseldorp Skills Forum (2003). Fact sheet: Honouring our commitment – How does Australia compare?<br />
Viewed 22 Jan, 2004, < http://www.dsf.org.au/><br />
20 Applied Economics (2003). Young person’s education, training and employment outcomes with special<br />
reference to early school leavers. Business Council of Australia & Dusseldorp Skills Forum.<br />
21 Dusseldorp Skills Forum (2003). How young people are faring? Key indicators 2003: An update about the<br />
learning and work situation of young Australian including an analysis of how young <strong>Indigenous</strong> people are faring.<br />
Viewed 22 nd Jan. 2004, < http://www.dsf.org.au/><br />
22 ibid, p1.<br />
23 National Crime Prevention (1999), op cit.<br />
24 Wilczynski, Culvenor, et al. (2003), op cit, p. 82.<br />
- 22 -
<strong>Panyappi</strong> <strong>Indigenous</strong> <strong>Youth</strong> <strong>Mentoring</strong> <strong>Program</strong> <strong>Evaluation</strong><br />
The evidence shows that mentoring with young offenders may be more intensive<br />
or complex for young offenders than generally at risk young people (especially in<br />
relation to mentoring frequency). Therefore, programs need to carefully<br />
consider the implications of the target group and develop program elements and<br />
strategies accordingly, especially:<br />
�<br />
�<br />
the greater resources needed for young offenders<br />
the greater demands on mentors.<br />
Relationships with families<br />
Whilst many of the mainstream strategies and intentions of mentoring are also relevant<br />
for <strong>Indigenous</strong> young people, <strong>Panyappi</strong> believes it is critical to approach mentoring with<br />
this group from a cultural perspective. This involves a stronger focus on, and<br />
commitment to, rebuilding and strengthening family connections as an important aspect<br />
of culturally appropriate practice, not just on gaining family support for the young<br />
person’s involvement as often occurs in other mentoring programs. 25<br />
<strong>Indigenous</strong> cultures have a more inclusive concept of family compared with many non-<br />
<strong>Indigenous</strong> cultures, with cousins, aunties and uncles playing a critical role in young<br />
people’s lives. Although there is a high rate of family breakdown amongst <strong>Panyappi</strong>’s<br />
target population, there are other family connections that can be fostered, particularly<br />
when young people are living with relatives other than their parents. These connections<br />
may support mentoring being embedded into young people’s lives separately from and<br />
after their involvement with <strong>Panyappi</strong>.<br />
It is not common for mentors to have much contact with mentee’s families in mainstream<br />
mentoring programs, as they appear to operate from an individual rather than systemic<br />
model. Few program descriptions and evaluations mention parental or family<br />
involvement. 22,26 This is different in <strong>Panyappi</strong>. <strong>Panyappi</strong> mentors do this in two ways:<br />
through direct contact and by engaging the support and collaborating with the MAYT<br />
Family team or other family support services (see the <strong>Program</strong> Collaborators diagram in<br />
Figure 4).<br />
Although mentors are directly involved with families, the <strong>Panyappi</strong> Coordinator takes on<br />
the major responsibility of providing direct support and additional services for family<br />
members that will contribute positively to the young person’s overall situation. The<br />
Coordinator ensures families understand the role of the mentors and how <strong>Panyappi</strong> can<br />
work with the family to support the young person, as well as respond to issues that are<br />
difficult for the family. If <strong>Panyappi</strong> does advocacy work on behalf of the family, a good<br />
understanding of the family picture coupled with the family’s respect and endorsement<br />
for <strong>Panyappi</strong> to take this role is required. As part of its aims, <strong>Panyappi</strong> wants young<br />
people to build personal resilience and strong personal and cultural identity, and<br />
empower their sense of spirituality. One strategy is through a genealogy program,<br />
25 ARTD (1999/2001) op cit.<br />
26 Benard, B. (1992). <strong>Mentoring</strong> programs for urban youth: Handle with care. Northwest Regional Educational<br />
Laboratory.<br />
- 23 -
<strong>Panyappi</strong> <strong>Indigenous</strong> <strong>Youth</strong> <strong>Mentoring</strong> <strong>Program</strong> <strong>Evaluation</strong><br />
therefore they need information from families to assist young people in the program.<br />
The program also facilitates the family reconnecting with where they come from, as<br />
links may have been lost or broken.<br />
This family-inclusive approach fits with culturally appropriate practice, as well as<br />
systemic approaches to family work, 27 where change depends on having an understanding<br />
of the wider family context in line with an extended concept of families in Aboriginal<br />
cultures. It also helps develop respect lines back to elders, which these young people<br />
may have lost due to experiencing the harsh edge of the legacy and effects of<br />
colonisation and racism.<br />
In many ways, this offers a third layer of mentoring within the program, where the<br />
Coordinator is a mentor for family members. The Coordinator assists them in developing<br />
different ways to relate to and support their young person, and to manage other issues<br />
in their lives that drain their energy and negatively impact on their social and emotional<br />
wellbeing. Family members are contacted regularly by phone, home visits occur and they<br />
are encouraged to initiate contact with the program. They are also invited to take part<br />
in programs, such as the art program. Young people are usually aware that their family<br />
members are involved.<br />
Interagency work<br />
<strong>Panyappi</strong> has focused its efforts on target geographical areas. They needed to build<br />
effective collaborations with local key stakeholders, both <strong>Indigenous</strong> and non-<strong>Indigenous</strong><br />
agencies and groups, in order to collectively address the problems <strong>Indigenous</strong> young<br />
people are experiencing and the issues this raises for the local community. These<br />
collaborations were illustrated in Figure 4.<br />
A specific area of focus is education. For many <strong>Indigenous</strong> young people education has<br />
not been a positive and beneficial experience, as racism plays a factor in the curriculum<br />
generally, as well as their treatment at school level. 28,29,30 This also influences how the<br />
school relates to and communicates with their parents and family members – they often<br />
feel disconnected or disregarded by schools until it is “too late.” 31 Early school leaving<br />
rates for young people are highest for <strong>Indigenous</strong> young people, especially <strong>Indigenous</strong><br />
young males who also have a higher rate of offending behaviour compared to the overall<br />
population: “in almost all available data on <strong>Indigenous</strong> education, young <strong>Indigenous</strong> males<br />
have the worst retention and participation rates….a decrease in participation in<br />
30<br />
education correlates with an increase in juvenile crime among <strong>Indigenous</strong> males.”<br />
27 Nichols, M. & Schwartz, R. (Eds.) (1998). Family therapy concepts and methods (4 th ed). Boston: Allyn and<br />
Bacon.<br />
28<br />
Social Inclusion Unit (2003). School Retention Reference: How can we better support young people stay at<br />
school and successfull y complete 12 years of education? Getting there together. Social Inclusion Unit, South<br />
Australian Department of Premier and Cabinet: Adelaide. Available online at:<br />
http://www.socialinclusion.sa.gov.au/page.asp?ContainerID=3&SubPageID=50, pp.19-20, 24-26, 31, 45.<br />
29 Stacey, K. (2003), op cit, p.3.<br />
30<br />
Teese, R., Polesel, J., O’Brien, K., Jones, B., Davies, M., Walstab, A. & Maughan, M. (2000). Early school<br />
leaving:<br />
A review of the literature. Brisbane: Australian National Training Authority. (Quote from p.5).<br />
31 Stacey, K. (2003), op cit, p.17.<br />
- 24 -
ATSIC recently reported:<br />
<strong>Panyappi</strong> <strong>Indigenous</strong> <strong>Youth</strong> <strong>Mentoring</strong> <strong>Program</strong> <strong>Evaluation</strong><br />
Most indicators of poverty and related disadvantage show that <strong>Indigenous</strong><br />
people are between two and three times worse off than non-<strong>Indigenous</strong> people in<br />
Australia….the proportion of <strong>Indigenous</strong> teenagers (15-19 years) not fully<br />
engaged in work or education is three times that of non-<strong>Indigenous</strong> people. 32<br />
Many of <strong>Panyappi</strong>’s clients have difficult relationships with school, so there is<br />
considerable effort to do interagency work with schools. This contributes to other state<br />
initiatives to improve <strong>Indigenous</strong> young people’s connection or reconnection to schooling.<br />
Although the role of mentors is not to be an Aboriginal Education Worker, they enable<br />
young people to engage with or complete schoolwork, or to re-engage with schooling.<br />
<strong>Panyappi</strong> looks for opportunities to create a positive link between the young person and a<br />
school staff member as a way of embedding mentoring as a regular experience at school,<br />
which can be sustained beyond the young person’s connection to <strong>Panyappi</strong>.<br />
By helping young people’s reconnect and have a more positive and beneficial experience,<br />
it is possible for young people to take advantage of transition programs into education,<br />
training and employment that are usually targeted at the 15 and over age group.<br />
32 Dusseldorp Skills Forum (2003), op cit, p.35.<br />
- 25 -
A Brief Review of <strong>Mentoring</strong><br />
A cultural perspective<br />
<strong>Panyappi</strong> <strong>Indigenous</strong> <strong>Youth</strong> <strong>Mentoring</strong> <strong>Program</strong> <strong>Evaluation</strong><br />
<strong>Mentoring</strong> is not a new concept for Aboriginal people, as there has always been an<br />
emphasis on connection with significant people in young people’s lives. Today it is<br />
“languaged” under the term of mentoring. Different projects in recent years have<br />
explored and piloted ways of acknowledging this concept of the role of significant people<br />
within families, for example the Port Augusta “Families Project” funded by DHS and the<br />
Teenage Parenting Pilot in Adelaide operated by Anglicare SA.<br />
The concept of mentoring opened up the possibility of a better cultural fit provided that<br />
the program was built on cultural perspective as a foundation that acknowledged and<br />
respected cultural values and beliefs. The first step in doing this was choosing a<br />
meaningful name to represent mentoring from a cultural perspective. On this occasion a<br />
word from the Kaurna language was chosen – <strong>Panyappi</strong> (pronounced “bunyip + ee”). As<br />
stated earlier, this means younger brother or sister.<br />
Published literature on mentoring: A brief summary<br />
The following is a brief overview of key issues that are emerging in the literature,<br />
mostly from the USA and Australia. Some of this literature has been identified in the<br />
“How <strong>Panyappi</strong> works” section. FAYS is currently undertaking a review of mentoring in<br />
general and its own mentoring program. The outcomes and recommendations of the<br />
<strong>Panyappi</strong> <strong>Evaluation</strong> can contribute to and assist in this general review, as there is a<br />
paucity of evaluation outcomes for youth mentoring programs in a crime prevention<br />
context, particularly with an <strong>Indigenous</strong> focus. 33<br />
This summary focuses on literature specifically on mentoring and does not summarise<br />
concepts that mentoring may draw upon to argue its case. For example, as an<br />
intervention strategy mentoring is based on well-known research findings from the child<br />
development field. When young people have supportive relationships with adults<br />
(parents, family, teachers, neighbours, etc), their ability to develop resilience, meaning<br />
in life and deal with life’s challenges is enhanced. These relationships act as a protective<br />
factor when young people grow up in high-stress family or community<br />
environments. 34,35,36<br />
In more recent times these relationships have been understood as a form of “social<br />
capital.” The concept of social capital was originally named by Putnam in the early 1990s<br />
and popularised in Australia by Eva Cox in the mid-1990s. 37 Social capital means “the<br />
33 Wilczynski, A. (2002), op cit.<br />
34 Garbarino, J. et al. (1992), op cit.<br />
35 Werner, E. (1984). Resilient children. Young Children, November, 68-72<br />
36 Rutter, M. (1999) Resilience concepts and findings: Implications for family therapy. Journal of Family<br />
Therapy, 21, 119-144.<br />
37 Baum, F. (1998). The new public health: An Australian perspective. Melbourne: Oxford University Press.<br />
- 26 -
<strong>Panyappi</strong> <strong>Indigenous</strong> <strong>Youth</strong> <strong>Mentoring</strong> <strong>Program</strong> <strong>Evaluation</strong><br />
processes between people which establish networks, norms, social trust and facilitate<br />
coordination and cooperation for mutual benefit.” 38 In many ways this definition of social<br />
capital applies to mentoring relationships themselves, whether they occur ‘naturally’ or in<br />
planned mentoring programs, and the relationships that mentoring programs have with<br />
other parts of the health, human and community service sector in responding to the<br />
needs of young people by working with young people and family members.<br />
This summary will comment upon: the role of mentoring, mentor qualities and roles, age<br />
groups, geographical focus, stand alone or integrated programs, and paid staff.<br />
Role of mentoring programs<br />
The National <strong>Youth</strong> Affairs Research Scheme (NYARS) recently commissioned a national<br />
overview of mentoring and role model programs. It identified that the main functions of<br />
mentoring and role model programs were “inspiration, setting an example and providing<br />
personalised support” 39 and recommended that:<br />
<strong>Mentoring</strong>…needs to be tailored to the individual needs of particular young<br />
people. This requires that programs are organised in ways that allow for the<br />
development of trusting relationships between the [mentors] and the young<br />
people, and provide opportunities for young people to express their views and<br />
their needs and the means of following up on these needs. 40<br />
Other writers focus on the importance of building clear, specific and achievable goals<br />
for young people as a focus for the program. 41 In this way mentoring relationships can be<br />
tailored to young people’s individual needs and personal interests. The goals guide<br />
mentors in their role as they follow up on these needs, identify opportunities and<br />
support young people to achieve something that makes them feel competent and proud.<br />
Mentor qualities and roles<br />
The national review also emphasised the need to have a “clear rationale and procedure<br />
for recruiting, screening and training…mentors, which has multiple methods to ensure<br />
safety of young people” 42 and the quality of mentoring. The idea is to screen people out<br />
rather than in through making careful and responsible decisions on who can fulfil a<br />
mentor role, and ensure they are well prepared then supported. 43 Mentors “need ongoing<br />
support and training to further develop their skills and knowledge about developing [and<br />
sustaining] a mentoring relationship.” 44<br />
38 Cox, E. (1996). A truly civil society. Sydney: Australian Broadcasting Commission, p.<br />
39 MacCallum, J. & Beltman, S. (2002), op cit, p.63.<br />
40 ibid, p.96.<br />
41 Benard, B. (1992) op cit.<br />
42 MacCallum, J. & Beltman, S. (2002) op cit, p.98.<br />
43 Benard, B. (1992) op cit.<br />
44 ibid, p.101.<br />
- 27 -
<strong>Panyappi</strong> <strong>Indigenous</strong> <strong>Youth</strong> <strong>Mentoring</strong> <strong>Program</strong> <strong>Evaluation</strong><br />
Being a mentor is a unique role. Although it may overlap to a degree with other human<br />
service roles, e.g. youth workers and social workers, mentoring usually operates at a<br />
more intense level with a higher frequency of contact. Mentors are not expected to do<br />
case management or be qualified in counselling, although they often provide critical<br />
personal support and care for young people. The review highlighted the importance of<br />
mentors fostering a positive, caring and non-judgemental approach by mentors, as “those<br />
involved with young people on a one-to-one basis particularly need to be abe l to meet<br />
young people ‘where they are’ and guide them in their journey. ” 45 Researchers in the USA<br />
also emphasise that mentors must have “a caring attitude, high expectations [of what<br />
young people can achieve with support], participatory style and commitment.” 46<br />
Age group<br />
As noted above, mentoring for young people is often targeted at the 13 to 18 year age<br />
group. Reasons for mentoring programs may vary - not all are targeted at young people<br />
experiencing specific problems or showing disruptive behaviour. <strong>Evaluation</strong>s of youth<br />
mentoring programs in a crime prevention context have shown that there is greater<br />
success with engaging a younger age group. 47,48<br />
Geographical focus<br />
Previous evaluations of crime prevention focused mentoring programs also highlighted<br />
the importance of having a specific geographical focus. This supports <strong>Program</strong><br />
Coordinators to develop effective and positive networks with local service providers or<br />
referral sources. 49 It also responds to the way in which young people may gather in<br />
specific locations, which has an important social purpose and is not simply about engaging<br />
in offending behaviour or being exposed to other criminal activity.<br />
Stand alone or integrated programs<br />
An evaluation of the One2One mentoring program for young offenders in NSW has<br />
identified that “to be sustainable, a mentoring program may need to…be delivered in<br />
conjunction with other youth and family support programs.” 50 A recent national overview<br />
of mentoring programs also highlighted that “integrated mentoring projects are more<br />
likely to be effective.” 51 They may be integrated through being co-located with other<br />
youth and family support programs and/or due to the collaborative efforts of the<br />
program staff to link in and work collaboratively with a range of other government and<br />
non-government community services. When projects with a juvenile justice focus link to<br />
45 ibid, p.100.<br />
46 Benard, B. (1992) op cit, p.18.<br />
47<br />
ARTD (2000). <strong>Evaluation</strong> of <strong>Mentoring</strong> Mates: Wooloomooloo Crime Prevention and Safety Initiative. Sydney:<br />
NRMA.<br />
48 ARTD (1999/2001) op cit.<br />
49<br />
ARTD (2000), op c t; i ARTD (2002), op cit.<br />
50<br />
ARTD (2002). <strong>Mentoring</strong> for young offenders: One to one relationship producing positive benefits.<br />
<strong>Evaluation</strong> report of the NSW pilot program. Crime Prevention Division, Attorney General’s Department.<br />
www.lawlink.new.gov.au/cpd<br />
51 Wilczynski, A. (2002), op cit.<br />
- 28 -
<strong>Panyappi</strong> <strong>Indigenous</strong> <strong>Youth</strong> <strong>Mentoring</strong> <strong>Program</strong> <strong>Evaluation</strong><br />
other community organisations they have the capacity to contribute to systems reforms.<br />
However, integrated programs have different demands because:<br />
…developing viable collaborations is not easy and takes much time and effort.<br />
Organisations have different cultures and institutional climates, autonomy,<br />
flexibility and power; individuals with differing experiences and expertise; giving<br />
rise to different ways of defining issues and solutions. Once established,<br />
collaborative relationships need to be nurtured and maintained over time. 52<br />
The Australian view is that programs integrated into a range of services, including those<br />
offered by the auspicing organisation, provide a better support base as mentoring<br />
programs commonly take some time to establish and usually have a small number of staff.<br />
The availability of existing infrastructure, administrative support and access to<br />
established networks with key agencies, including those who may refer clients, may also<br />
improve cost-effectiveness and program sustainability. 53,54 Others acknowledged that:<br />
Even energy and commitment on the part of the program manager is usually not<br />
enough to sustain a mentoring program if it is not institutionalised within a<br />
55<br />
larger organisation or integrated into an array of services provided to youth.<br />
Paid staff<br />
Many Australian mentoring programs depend on volunteers to be mentors. 56 There is<br />
usually at least one paid staff member who is the <strong>Program</strong> Coordinator. Researchers in<br />
the US have argued that in successful mentoring programs the paid staff:<br />
…are the most important single ingredient….These individuals are in contact with<br />
the kids, the mentors, school staff and families. Not surprisingly, in programs<br />
where such staff are a full-time presence, the whole mentoring process tends to<br />
revolve around them; they are the ‘glue’ in the mentoring process. 57<br />
There is limited information available on what it means to have paid mentors in addition<br />
to a <strong>Program</strong> Coordinator, as in <strong>Panyappi</strong>. Those that do may be better positioned to<br />
meet the requirement that programs directed at young people in high risk or stress<br />
situations be “both intensive and extensive, start early and plan to stick around for a<br />
long time. They must also be prepared for inevitable failures and be ready to intervene<br />
when problems arise and relationships do not hold.” 58<br />
52 ARTD (1999/2001) op cit, p.22.<br />
53 Wilczynski, A. (2002) op cit.<br />
54 Wilczynski, Culvenor, et l. (2003), op cit.<br />
55 Benard, B. (1992) op cit, p.17.<br />
56 MacCallum, J. & Beltman, S. (2002) op cit.<br />
57 Freedman, M. (1991). The kindness of strangers: Reflections on the mentoring movement. Philadelphia, PA:<br />
Public/Private Ventures, p.63<br />
58 ibid, p.60.<br />
- 29 -
The <strong>Evaluation</strong> Process<br />
<strong>Evaluation</strong> purpose<br />
<strong>Panyappi</strong> <strong>Indigenous</strong> <strong>Youth</strong> <strong>Mentoring</strong> <strong>Program</strong> <strong>Evaluation</strong><br />
In order to tell a meaningful and useful story about a community-based human services<br />
program, an evaluation must provide:<br />
1. Information that informs a program’s future development.<br />
2. Guidance to others who wish to emulate aspects of or the entire program.<br />
3. Details for the wider field about whether the program is effective based on the<br />
nature and extent of the outcomes achieved.<br />
Process evaluation explains how and why program strategies were implemented – it<br />
provides the detail about the story of implementing the program. This equates with<br />
mapping the context, describing the “how” and “why” of the mechanisms involved<br />
(including program strategies) and analysing both. Without a focus on process evaluation,<br />
it is not possible to unpack the results of impact and outcome evaluation.<br />
Impact evaluation focuses on the achievement of objectives. This can occur when a<br />
program has been operating for 6 months to 2 years. It indicates any progress toward<br />
the objectives or full achievement of them. Outcome evaluation assesses achievement of<br />
the overall goal. As most goals for community-based human services program are broad<br />
in scope, this takes a minimum of 2 years and usually 4 or more years to determine with<br />
confidence.<br />
At this point in the <strong>Panyappi</strong> program the evaluation work can address both process and<br />
impact evaluation. <strong>Panyappi</strong> is an intensive program for a small number of young people<br />
and families. Therefore, the evaluation used predominantly qualitative information, with<br />
some quantitative information provided through program statistics and client<br />
demographics. It was conducted between January and May 2004.<br />
The State Crime Prevention Unit developed an outcomes hierarchy in 2002 in order to<br />
guide any evaluation work that occurred – see Appendix A. This will be used as the set of<br />
indicators against which <strong>Panyappi</strong>’s progress will be evaluated – outcomes will be<br />
discussed in the “Weaving the threads together” section.<br />
<strong>Evaluation</strong> plan<br />
Acknowledging history – addressing cultural accountability<br />
As an Aboriginal program focused on young people who have often had involvement with<br />
statutory bodies, it was critical that the non-<strong>Indigenous</strong> evaluation consultant was<br />
conscious of both historical experience and cultural accountability. Since colonisation<br />
there has been a strong history of outsiders inquiring into Aboriginal people’s everyday<br />
lives and then making decisions that affect them in serious ways. The evaluation did not<br />
want to replicate these intrusive, disrespectful and often painful experiences. It was<br />
- 30 -
<strong>Panyappi</strong> <strong>Indigenous</strong> <strong>Youth</strong> <strong>Mentoring</strong> <strong>Program</strong> <strong>Evaluation</strong><br />
understood that participation in the evaluation would be voluntary and something that<br />
participants felt good about doing because they were clear about the purpose. It was<br />
also acknowledged that people may decline because they had other priority issues or the<br />
evaluation may be experienced as intrusive.<br />
In order for the evaluation to be respectful of cultural protocols and practices, and to<br />
address the cultural accountability of the non-<strong>Indigenous</strong> evaluation consultant, an<br />
<strong>Indigenous</strong> cultural advisor was engaged to guide all stages of the evaluation. Through<br />
this arrangement many issues were addressed, such as how to introduce the evaluation<br />
to young people and families working with <strong>Panyappi</strong>, and who was appropriate to conduct<br />
interviews based on <strong>Indigenous</strong> or non-<strong>Indigenous</strong> identity and then cultural connections<br />
of the cultural advisor and evaluation participants.<br />
The evaluation introduction occurred in three layers. Due to connections and existing<br />
relationships with families as the Coordinator, Lisa Kambouris was instrumental in<br />
facilitating this process. In the initial stages of the evaluation she spoke to all young<br />
people and families currently engaged with <strong>Panyappi</strong> to explain why they were evaluating<br />
the program and the possibility of being involved. She also ensured that mentors were<br />
thoroughly briefed on the evaluation. Through this she identified who was interested in<br />
knowing more and potentially being an evaluation participant.<br />
Following ethics approval for the evaluation plan, a social gathering was held at <strong>Panyappi</strong><br />
for interested families and young people. They met the evaluation consultant and<br />
<strong>Indigenous</strong> cultural advisor, gained information on the evaluation plan and process, and<br />
also received a written version of this. They had the opportunity to ask questions or just<br />
talk with the evaluators during the gathering, either during the meeting or over lunch.<br />
Some families and young people decided to participate at that point, while others agreed<br />
or withdrew interest later in conversation with Lisa. Other families who were unable to<br />
make the gathering were offered the opportunity to meet or speak separately with the<br />
evaluators, and several agreed to be part of the evaluation.<br />
<strong>Evaluation</strong> participants and methods<br />
The people or groups outlined in the Table 1 were included in the evaluation using the<br />
methods (program funders were included through the Advisory Group and the Senior<br />
Project Officer, Crime Prevention Unit, AGD).<br />
The evaluation methods were designed to gain in-depth qualitative data to build a picture<br />
of the experiences and outcomes of the participants’ involvement in <strong>Panyappi</strong> (in<br />
whatever capacity) and their opinions of the cultural appropriateness of the project’s<br />
model of mentoring. These methods use narrative or story as the primary mode,<br />
particularly for the interviews with young people, family members and Mentors, as<br />
narrative has a cultural fit for <strong>Indigenous</strong> people. Interviews and focus groups were<br />
audiotaped with the consent of participants.<br />
- 31 -
<strong>Panyappi</strong> <strong>Indigenous</strong> <strong>Youth</strong> <strong>Mentoring</strong> <strong>Program</strong> <strong>Evaluation</strong><br />
Table 1: <strong>Panyappi</strong> evaluation participants and methods<br />
<strong>Evaluation</strong> Participant <strong>Evaluation</strong> methods<br />
Young people<br />
Family Members – this term includes<br />
relatives and other caregivers<br />
<strong>Panyappi</strong> Mentors – present and<br />
previous mentors<br />
<strong>Panyappi</strong> Coordinator – present and a<br />
previous Coordinator<br />
Social gathering to familiarise young people with<br />
evaluators and process<br />
One-to-one interviews<br />
A fictionalised compilation story<br />
Client demographics<br />
Social gathering to familiarise family members with<br />
evaluators and process<br />
One-to-one interviews<br />
A fictionalised compilation story<br />
One-to-one interviews<br />
A fictionalised compilation story<br />
One-to-one interviews<br />
<strong>Program</strong> statistics<br />
<strong>Panyappi</strong> Advisory Group Members One-to-one interviews<br />
<strong>Program</strong> Collaborators – FAYS,<br />
SAPOL, MAYT, Aboriginal community,<br />
family and youth services, individual<br />
schools, Education Department<br />
Senior Project Officer, Crime<br />
Prevention Unit, AGD<br />
Focus groups and one-to-one interviews<br />
One-to-one interview<br />
Where appropriate and agreed with participants “member checking” occurred: “member<br />
checking provides for credibility by allowing members of stakeholding groups to test<br />
categories, interpretations and conclusions.” 59 This occurred in three ways.<br />
ω<br />
ω<br />
ω<br />
Those participants who wanted one were sent a copy of their interview write-up as a<br />
record of their own story. This occurred before the interview tapes were deleted to<br />
ensure that they were happy with the account of their interview. They had the right<br />
to ask for information to be removed or altered.<br />
Participants’ information was used to create a “compilation story” – a fictional<br />
account based on using information from several actual stories. In this way no person<br />
was or could be personally identified.<br />
A <strong>Panyappi</strong> <strong>Evaluation</strong> Advisory Group was established during the writing phase to<br />
provided comment on the organisation, interpretations, opinions and conclusions in<br />
the report.<br />
59 Erlandson, D., E. Harris, Skipper, B. & Allen, S. (1993). Doing naturalistic inquiry: A guide to<br />
methods. Newbury Park, Sage, p.142.<br />
- 32 -
<strong>Evaluation</strong> questions<br />
<strong>Panyappi</strong> <strong>Indigenous</strong> <strong>Youth</strong> <strong>Mentoring</strong> <strong>Program</strong> <strong>Evaluation</strong><br />
Each interview and focus group followed an interview guide to explore a number of key<br />
areas. Rather than a question-answer format, it was used to initiate and where required<br />
redirect or focus the interview/focus group on issues specific to the <strong>Panyappi</strong> program.<br />
The key areas covered were:<br />
Experiences of <strong>Panyappi</strong> as a program, for example:<br />
ω<br />
ω<br />
ω<br />
ω<br />
ω<br />
ω<br />
ω<br />
ω<br />
ω<br />
ω<br />
ω<br />
ω<br />
ω<br />
ω<br />
ω<br />
ω<br />
How people became connected to <strong>Panyappi</strong> and their length of involvement<br />
Strengths and weaknesses of, or likes and dislikes about the program<br />
Relationships between young people and mentors, and families and mentors or the<br />
program<br />
<strong>Program</strong> challenges and how these have been managed<br />
<strong>Program</strong> highlights<br />
<strong>Program</strong> outcomes, for example:<br />
Any change for young people/mentors since involvement with <strong>Panyappi</strong> and what part<br />
<strong>Panyappi</strong> has played in this change<br />
<strong>Program</strong> collaborations, for example:<br />
Relationships between <strong>Panyappi</strong> and its program collaborators (individual referral,<br />
program level work, or funding and structural arrangements)<br />
<strong>Program</strong> management, for example:<br />
The effectiveness of program management<br />
Training and support for mentors<br />
<strong>Program</strong> challenges and how these have been managed<br />
Location of the program<br />
<strong>Program</strong> awareness, for example:<br />
Knowledge of <strong>Panyappi</strong><br />
What participants tell other people about <strong>Panyappi</strong><br />
Thoughts about the future of <strong>Panyappi</strong>, for example:<br />
Unique features of the program and availability of alternative programs<br />
Can programs like <strong>Panyappi</strong> offer benefits – if so, what are the benefits?<br />
Location of the program<br />
- 33 -
The Stories<br />
<strong>Panyappi</strong> <strong>Indigenous</strong> <strong>Youth</strong> <strong>Mentoring</strong> <strong>Program</strong> <strong>Evaluation</strong><br />
There are four ways in which the stories gathered in the evaluation will be told:<br />
ω<br />
ω<br />
ω<br />
ω<br />
Painting a picture with numbers: This section describes how many young people have<br />
been involved with <strong>Panyappi</strong> and the range of presenting issues, referral sources,<br />
interagency connections and programs they with which they were invovled.<br />
Young people and family themes: This section describes the experiences and<br />
outcomes identified for young people and families involved in <strong>Panyappi</strong> from the<br />
perspectives of all evaluation participants.<br />
<strong>Program</strong> management themes: These themes specifically relate to program<br />
collaborations, management and funding from the perspectives of all evaluation<br />
participants except young people and families.<br />
Being a mentor: This explores how <strong>Indigenous</strong> mentors have a unique role in the<br />
human services workforce and expectations from their communities based on<br />
comments from all evaluation participants where available. Appreciating their<br />
experiences offers important learning about the program.<br />
Painting a picture with numbers<br />
The information presented in this section is based on available records by up to May<br />
2004. Full records for young people assessed from March 2003 onwards were available.<br />
Records of those assessed prior to that time were incomplete. This was due to the initial<br />
establishment period where fewer referrals and assessments occurred, and breaks in<br />
service when the Coordinator position was not filled during most of 2002. Although<br />
young people were accepted onto the mentoring program following assessment prior to<br />
March 2003, most service delivery has occurred from this date onwards.<br />
The records indicate that <strong>Panyappi</strong> accepted 33 young people for assessment of their<br />
eligibility to gain mentoring support. Of these 30 were offered a service, with one being<br />
referred elsewhere within 2 months and two others becoming too old for <strong>Panyappi</strong><br />
services within a short time after referral. It is difficult to gain an accurate indication<br />
of the length of service received, as several young people were referred prior to the<br />
breaks in service availability, had periods when service was not available for them and<br />
their end-date of service may be after several months of non-engagement. This<br />
artificially lengthens their service period. Those who do receive a mentoring service<br />
often require it for at least 6 months and up to 2 years.<br />
The following figures provide a demographic description of this group of young people.<br />
They give a picture of their age range, living situation, referral sources and referral<br />
reasons. Changes in rates of offending is also available for 15 young people who received<br />
a mentoring service since March 2003.<br />
The average age of the group is 14.2 years. As shown in Figure 5, the majority of young<br />
people are in the 13-15 year age range. More males (60%) were referred compared with<br />
females (40%).<br />
- 34 -
<strong>Panyappi</strong> <strong>Indigenous</strong> <strong>Youth</strong> <strong>Mentoring</strong> <strong>Program</strong> <strong>Evaluation</strong><br />
Figure 5: Age distribution of referrals<br />
64%<br />
Age<br />
15%<br />
21%<br />
10-12 years<br />
13-15 years<br />
16-17 years<br />
Figure 6 shows that almost half the young people live with family members other than<br />
their parents, and a third are in formal foster or other care. “Other care” means nonformal<br />
arrangements with friends or friends’ families rather than formal foster care,<br />
with a quarter in this situation. Nearly 1 in 5 lived with their parents, while only one<br />
young person was homeless.<br />
Figure 6: Living situation for young people<br />
24.2<br />
9.1<br />
Living situation<br />
3.0<br />
18.2<br />
45.5<br />
With parent<br />
With family<br />
Foster care<br />
Other care<br />
Homeless<br />
Figure 7 identifies FAYS and schools as the most frequent referrers, making twice as<br />
many referrals as MAYT or other youth services. There were occasional referrals from<br />
juvenile justice and police. Family members initiated one referral, while one young person<br />
self-referred.<br />
- 35 -
90.0<br />
80.0<br />
70.0<br />
60.0<br />
50.0<br />
40.0<br />
30.0<br />
20.0<br />
10.0<br />
0.0<br />
3.0<br />
3.0<br />
9.1<br />
12.1<br />
<strong>Panyappi</strong> <strong>Indigenous</strong> <strong>Youth</strong> <strong>Mentoring</strong> <strong>Program</strong> <strong>Evaluation</strong><br />
Figure 7: Referral source*<br />
18.2<br />
21.2<br />
Referral source<br />
36.4<br />
39.4<br />
0.0 10.0 20.0 30.0 40.0 50.0<br />
Self<br />
Family members<br />
Police<br />
Justice<br />
<strong>Youth</strong> services<br />
MAYT<br />
Schools<br />
FAYS<br />
* Figures add up to more than 100 as young people were often referred collaboratively by two- four sources.<br />
Reasons for referral<br />
Figure 8: Reasons for referral*<br />
- 36 -<br />
Physical/emotional/sexual abuse<br />
Suicidal behaviour<br />
Substance misuse<br />
Placement breakdowns<br />
Family breakdowns<br />
At risk of sexual exploitation<br />
Frequenting inner city<br />
Medication needed<br />
Other medical issues<br />
Emotional/behavioural problems<br />
Self-damaging behaviour<br />
Running away<br />
Offending behaviour<br />
Teenage parent<br />
Violent behaviour<br />
Cultural connections unknown<br />
Disengaged from education
<strong>Panyappi</strong> <strong>Indigenous</strong> <strong>Youth</strong> <strong>Mentoring</strong> <strong>Program</strong> <strong>Evaluation</strong><br />
As is obvious from Figure 8 there were many reasons for referral, with between one and<br />
ten reasons listed for any single young person and an average number of six reasons per<br />
young person. Most young people were either disengaged or becoming disengaged from<br />
education and involved in offending behaviours. Seventy per cent showed emotional and<br />
behavioural problems, and/or substance misuse issues were very common. Half of all<br />
referrals were regularly frequenting the inner city, which was one of the key initial<br />
criteria for referral that was then broadened out to young people with similar problems<br />
who did not always frequent the inner city. Many were experiencing physical, sexual<br />
and/or emotional abuse, and family breakdown. Over a third were showing violent<br />
behaviour, this was slightly more common among males than females, and a similar<br />
number were running away from their home or placement, with most also frequenting the<br />
inner city and the others at risk of doing so. Placement breakdowns and self-damaging<br />
and/or suicidal behaviour were also apparent.<br />
Thirteen young people (40%) were involved with FAYS:<br />
ω<br />
ω<br />
ω<br />
ω<br />
ω<br />
ω<br />
ω<br />
Seven were under supervision for court orders<br />
Seven had an allocated social worker, with two of these also having a youth worker,<br />
while another three just had a youth worker<br />
Two were under the Guardianship of the Minister<br />
Nineteen young people (58%) were or agreed to became involved with other agencies:<br />
Twelve were involved with the courts<br />
Three were involved with a family worker, four with a counselling service (not<br />
CAMHS) and four with the police<br />
Four were involved with the DECS Attendance Officer<br />
One was involved with CAMHS (child and adolescent mental health services)<br />
Reasons for leaving <strong>Panyappi</strong> were known for eleven young people (33%). They included<br />
non-engagement with mentors after a minimum of at least 4 months of effort (7), being<br />
18 or over (2), being referred elsewhere after six months with <strong>Panyappi</strong> (1) and being<br />
ready to leave after seven months with <strong>Panyappi</strong> (1).<br />
By early May 2004 the current caseload was 14 young people. They were involved in one<br />
or more additional programs offered by <strong>Panyappi</strong> or in collaboration with MAYT. For<br />
example, all are involved in individual genealogy programs, five attend the Art <strong>Program</strong>,<br />
two go to the Tutorial Centre based at MAYT, while one does a Classic Holden program<br />
as an educational option. Several have been involved in a program with Taoundi College<br />
focused on cultural awareness and identity, however, this will now be offered by MAYT.<br />
More programs have been individually rather than group based, as the young people do<br />
not always cope well with group programs. However, since April 2003 there have been a<br />
number of group excursions (e.g. going bowling) and a group camp (e.g. on the One and All<br />
tall ship).<br />
- 37 -
# of offences<br />
<strong>Panyappi</strong> <strong>Indigenous</strong> <strong>Youth</strong> <strong>Mentoring</strong> <strong>Program</strong> <strong>Evaluation</strong><br />
A review of young people’s offending records was possible for 15 young people who are<br />
current clients and/or received mentoring for several months, mostly since March 2003.<br />
The change in the number of instances of offending behaviour is shown in Figure 9. This<br />
includes offences for which there were convictions, detentions, orders, family<br />
conferences, and/or formal cautions. It does not include breaches of orders. Lines in<br />
green indicate a decrease in offences, while the red lines show increases. It<br />
demonstrates that <strong>Panyappi</strong> worked effectively with a range of young people to reduce<br />
their offending behaviour, from those who were at an early stage in their juvenile<br />
justice career to those who were on their way to an entrenched career.<br />
70<br />
65<br />
60<br />
55<br />
50<br />
45<br />
40<br />
35<br />
30<br />
25<br />
20<br />
15<br />
10<br />
5<br />
Figure 9: Change in offending behaviour<br />
0 2 4 6 8 10 12 14 16 18<br />
Length of time with <strong>Panyappi</strong> (months)<br />
The greater majority (12 young people or 80%) decreased their rate of offending by<br />
25% or more – often much more (70 – 100%). Five young people have not offended since<br />
their involvement with <strong>Panyappi</strong>. This is a substantial achievement given the very high<br />
rates of offending for some of these young people over the previous one to three years.<br />
One young person (6.5%) decreased their offending behaviour by less than 25%, as they<br />
struggled to engage with the program for 3 months during which time most of the<br />
offences occurred - currently the young person is not offending. Two young people<br />
(13.5%) have increased their offending. One cannot receive regular mentoring support as<br />
they live in a rural area, but <strong>Panyappi</strong> connects with this young person on their occasional<br />
trips to Adelaide. This has greatly limited progress and the ability to work with the<br />
young person’s family and community network. For the other young person, the offending<br />
- 38 -
<strong>Panyappi</strong> <strong>Indigenous</strong> <strong>Youth</strong> <strong>Mentoring</strong> <strong>Program</strong> <strong>Evaluation</strong><br />
occurred early in the mentoring process then stopped altogether after 4 months of<br />
being with <strong>Panyappi</strong> and further offending has not occurred.<br />
Young people and family themes<br />
The six themes outlined here do not stand independently but intersect and reinforce<br />
each other like threads in a tapestry. We have teased them out so that each aspect is<br />
addressed, as well as being seen as part of a whole picture. Each theme commences with<br />
Susie’s evolving story that was introduced on page 1 – it may be useful to revisit her<br />
story prior to reading the following sections.<br />
A turning point<br />
Susie agreed to mentoring with <strong>Panyappi</strong> because she knew it was important to<br />
her Mum. She is really worried about her and doesn’t want to cause her Mum any<br />
more traumas. She checked this out with another young person at school who is<br />
a good friend, and also talked to the AEW who had been looking out for Susie as<br />
she knew that the family and Susie were having a difficult time.<br />
Susie meets with Mary, one of the <strong>Panyappi</strong> mentors, and they start to build a<br />
relationship although Susie is hesitant about how much she should say and what<br />
Mary will think or her. Susie slowly warms to Mary because she is not like her<br />
teachers or the police. Mary doesn’t give her a hard time about school, even<br />
though she says it will be important for Susie. Mary wants to know more about<br />
what Susie likes to do and why, and what things especialy l interest her. They<br />
talk about family and Mary lets her call her Auntie Lily each week to tell her<br />
know what she is doing.<br />
Even though she doesn’t like it there and there are still hassles to sort out,<br />
after a few weeks she stops skipping school as much and only stays away when<br />
her Mum needs her. She asks her Mum for permission to go out more often,<br />
although she still goes into the inner city.<br />
It is reasonably common that the young people accepted into <strong>Panyappi</strong> have had some or<br />
many people involved with or concerned about them. A few of them have slipped the net<br />
entirely, having disconnected from schooling at an early age and spent much time on the<br />
street. Others live with their families but are confused and unsettled because they have<br />
often experienced significant losses, been exposed to violence or substance misuse, and<br />
almost always been subjected to racism at a personal level and within the education and<br />
human service system.<br />
Many young people, family members and program collaborators reported that previous<br />
efforts to address the situation had been limited or unsuccessful. Every young person<br />
and family member interviewed reported that there was not, or they did not know if<br />
there was, an alternative service that could assist them in the way that <strong>Panyappi</strong> had.<br />
For example, one family member said: “ Without this he’d be nowhere.”<br />
- 39 -
<strong>Panyappi</strong> <strong>Indigenous</strong> <strong>Youth</strong> <strong>Mentoring</strong> <strong>Program</strong> <strong>Evaluation</strong><br />
Workers from collaborating agencies reinforced this position. They identified several<br />
other services, some of which they described as good and helpful, but were clear that<br />
<strong>Panyappi</strong> offered a unique approach. For some of the young people they were not<br />
convinced a viable alternative existed, for example: ”There is nothing else for these<br />
kids. We can’t get them into CAMHS. They don’t fit that as its voluntary and they are<br />
not going to go or CAMHS come to them. This is the only thing that I have seen that has<br />
been able to engage these children. They are still too young for other mentoring<br />
programs” (<strong>Program</strong> collaborator).<br />
More than provide intensive support, program collaborators said that <strong>Panyappi</strong> assisted<br />
young people and families to take steps toward and make connections with schooling and<br />
other services that had previously broken down or they had not accessed. For example,<br />
an education department worker commented:<br />
I have to be really honest. I think if they weren’t involved [with <strong>Panyappi</strong>] this<br />
young person wouldn’t be linked in any way to some form of educational program.<br />
I think in terms of even mainstream schooling he just doesn’t fit in where he is<br />
at the moment in terms of the outcomes for him. Without them being involved<br />
he would be invol ved in a lot more stuff that woul d have negative outcomes for<br />
him. (<strong>Program</strong> collaborator)<br />
One school identified that <strong>Panyappi</strong> had played a strong role in supporting a young<br />
person’s transition to them as a new school, having had a rocky road with the previous<br />
school after some time away from schooling altogether. They reported that:<br />
He has settled into the school really well, especially in terms of his classroom<br />
behaviour and he’s really starting to move on with his academics which is really<br />
fantastic….I suppose he has fitted in and adapted to the class environment very<br />
we ll. I think he is more willi ng to come and seek some help before he engages in<br />
trying to sort it out himself. (<strong>Program</strong> collaborator)<br />
<strong>Panyappi</strong> facilitates a turning point for these young people where changes become<br />
evident in their behaviour, personal choices, emotions, self-belief and relationships.<br />
Young people could identify these changes. One young person explained that:<br />
I would never be abl e to do the things I’ve done if it wasn’tfor Panyapp i.<br />
We<br />
wouldn’t have the money and my mum doesn’t have a car. My mentor comes and<br />
picks me up. I wouldn’t be goi ng to school much if it wasn’t for him….I read a bit<br />
better. I’m starting to go back to school and that’s been a hard thing to do. I<br />
still fight but my attitude has changed and I’ve calmed down. I used to be a lot<br />
angrier. I still get angry but I’m not as violent as I used to be. (Young person)<br />
Family members reinforced young people’s opinions, saying things like:<br />
He used to be a one shot boy – now he wi ll have another go at thi ngs . (Family member)<br />
- 40 -
<strong>Panyappi</strong> <strong>Indigenous</strong> <strong>Youth</strong> <strong>Mentoring</strong> <strong>Program</strong> <strong>Evaluation</strong><br />
He hasn’t been in trouble since he’s been involved. (Family member)<br />
He is wanting to get out and do it, not wanting to sit at home. (Family member)<br />
For other young people, family members indicated a change from being “very distant and<br />
cold” to the young person now having conversations with people he knows, showing<br />
emotions and being affectionate with people he cares about. It was as if young people<br />
had started to come alive and engage with their community again in more positive ways:<br />
“Many kids have done a u-turn and have been re-engaged back into education. Quality of<br />
life and well-being has improved, [there are] better relationships with the schools and<br />
even the Police” (<strong>Program</strong> funder).<br />
A program collaborator reported that, “this young boy had not been to the office for<br />
supervision and would not come. The workers didn’t like going out to the family as there<br />
was often other people there who would abuse them.” With the support of the <strong>Panyappi</strong><br />
mentor he regularly attended supervision for the first time. Although it was clear that<br />
gaining positive outcomes in the situation would not be straightforward, and hiccoughs<br />
have and continue to occur over the year of involvement, this worker said, “it enables my<br />
work and enables the young person to meet the conditions of their offender orders.<br />
With my workload I can’t run around after these kids. If they don’t come in they get<br />
letter, letter, letter. So what’s the use of that if the kid can’t read, which is the case<br />
here. So it’s enabled my work and better outcomes for the kid. In a sense the mentor is<br />
doing the supervision of this order.”<br />
Generating positivity and hope<br />
In a regular supervision session with the <strong>Panyappi</strong> Coordinator, Mary says that<br />
Susie’s outlook is starting to change – it has now been 3 months since the<br />
mentoring started. For the first few weeks she was quiet and shy, waiting for<br />
Mary to start conversations or suggest things to do. More often now she is<br />
smiling and excited when Mary picks her up and has ideas about what she would<br />
like to do – she will spontaneously start talking about things at school, home or<br />
when she goes out at night.<br />
The Coordinator and Mary reviewed the case plan that was developed two<br />
months previously. One goal was to encourage Susie to talk to a counsellor – her<br />
Mum agreed for this to happen but Susie wasn’t keen at first. Mary raises this<br />
issue with Susie again and she agrees, but only if Mary will go with her and as<br />
long as it is not the place the school sent her a year ago because they wanted<br />
her behaviour to improve.<br />
The young people in <strong>Panyappi</strong> have usually felt that no one and nothing is on their side.<br />
Reviewing their personal histories this is a fair summation of their life. When human<br />
service workers intervened it was often because of concern about the problems the<br />
young person was causing for others, or how they were not meeting required behavioural<br />
or developmental expectations. This strong negative focus individualised the problems<br />
and supported a view that maybe the situation was hopeless. Showing concern for the<br />
- 41 -
<strong>Panyappi</strong> <strong>Indigenous</strong> <strong>Youth</strong> <strong>Mentoring</strong> <strong>Program</strong> <strong>Evaluation</strong><br />
young person’s social-emotional wellbeing seemed a lesser consideration in the eyes of<br />
the young person and frequently in the eyes of family members.<br />
Some experienced promises of support being made and then not being followed through –<br />
building up their hopes and then dashing them, leaving them less trusting and more<br />
cynical. Although this does not fit well with existing rhetoric in human services about<br />
good practice, it represents the reality of these young people and families’ lives, as well<br />
intentioned efforts did not always have good outcomes. Several program collaborators<br />
acknowledged that if these young people were attached to statutory services, they were<br />
more likely to experience high turnover of workers and therefore more loss and<br />
rejection.<br />
Even when the referral to <strong>Panyappi</strong> happened under negative circumstances, e.g. young<br />
people were involved with court appearances, already had orders or were being<br />
suspended from school, all young people described <strong>Panyappi</strong> as a positive thing. This was<br />
reflected in a range of ways, from small yet absolutely critical matters such as “they<br />
show up” when they say they will, through to statements such as liking “everything” they<br />
do with <strong>Panyappi</strong>. “You go places, see movies and we went on a boat trip, which was good.”<br />
Young people were willing to do schoolwork with the support of their mentor and to<br />
choose options away from offending behaviour, such as going to the beach, “movies, the<br />
go-carts, playing games, or just hanging out.” One young person said, “we talk about just<br />
stuff we do on the weekend and if we got some new games.”<br />
Mentors identified changes in their clients that demonstrate positive shifts in their<br />
attitude, behaviour and personal situation. For example:<br />
She wants to do as much as she can while I’m with her to put her on a different<br />
track. I think she is really comfortable with herself now. I think [its] the fact<br />
that there is someone out there that is interested in what they are doing and<br />
just wanting to be there and help them and participate in what they want to do,<br />
so they feel valued and important. (<strong>Panyappi</strong> staff)<br />
Collaborating agency workers also noted the importance of other options and positive<br />
choices, for example, the mentor was there:<br />
…for role modelling, [with] that young person not having any other significant<br />
male in their life to [do this ] , so they are looking at this person in terms of their<br />
actions, and what they are doing and the decisions they are making. So it’s<br />
around that stuff as well, a real positive connection around that stuff. (<strong>Program</strong><br />
collaborator)<br />
Both young people and families were clear that they had taken a positive turn, and that<br />
there was hope about the situation. For example, “it gives me something to do, different<br />
from stealing. I used to steal all the time.” Family members were very pleased that<br />
their young people had opportunities to have “a diverse range of things to do and places<br />
to go.” The impact of this shone through: “He is different, more positive, you can tell he<br />
is happier.”<br />
- 42 -
<strong>Panyappi</strong> <strong>Indigenous</strong> <strong>Youth</strong> <strong>Mentoring</strong> <strong>Program</strong> <strong>Evaluation</strong><br />
Although they have often been referred to counselling or other intervention services,<br />
many of the young people have refused to go. <strong>Panyappi</strong> creates an environment where<br />
young people are willing to give something another try, to reconnect with the hope that<br />
it may be a useful and good experience (see the “Strengthening relationships” section<br />
next and “Being a mentor: Roles and responsibilities” for an explanation of how this<br />
occurs). When young people are in other programs, mentors can facilitate better<br />
outcomes through supporting a young person to engage more positively. For example:<br />
It makes it a lot easier. The kids are prepared and ready. A program we run has<br />
a young person from <strong>Panyappi</strong> on there and he is the best of the lot. When I<br />
first went [to pick him up] he wasn’t up. He was always sleeping, so I spoke to<br />
the mentor and I don’t know what he said to him but now he’s first one up in the<br />
mornings. He is a lot easier to get along with. He’s not so negative. He doesn’t<br />
talk so much about his past. The mentor has spoken to him in a way that hasn’t<br />
made the child angry at what he has said. Without the mentor there we would be<br />
struggling. The mentors are preparing them for the programs, which makes our<br />
job much easier. (<strong>Program</strong> collaborator)<br />
If young people still do not engage in other programs despite mentors’ efforts, often<br />
because they are afraid about opening up issues of grief and pain, or cannot easily<br />
access a service, then <strong>Panyappi</strong> provides an alternative outlet for emotional expression<br />
and this alone can make a difference. Family members identify and comment upon this,<br />
for example: “I think they are doing a fantastic job but there should just be a lot more<br />
of it.”<br />
One program collaborator gave an example of young people’s perceptions of <strong>Panyappi</strong><br />
through using word of mouth networks: “We had one kid who requested to be on the<br />
program, wasn’t referred but wanted to be on the program. That to me says a lot. It’s<br />
open. It’s friendly. The kids don’t feel intimidated” (<strong>Program</strong> collaborator).<br />
Strengthening relationships<br />
Susie used to hate Mary picking her up from school, but now she asks her to do<br />
this. She introduces Mary to her friends as her ‘big sister’ and is OK about her<br />
talking to the School Principal. She asks Mary to stay for a while at her house<br />
rather than just drop her off, and doesn’t mind Mary talking to her Mum.<br />
In one of their regular phone conversations Susie’s Mum tells the <strong>Panyappi</strong><br />
Coordinator that because Susie starts conversations with her about what she<br />
does with Mary this helps them have conversations about other things. Susie will<br />
tell her Mum her thoughts and feelings rather than just listen to her Mum and<br />
keep her thoughts to herself. However, Susie won’t talk to her father, just<br />
listen and usually do what he says when he is there because she is scared of him.<br />
There were many ways in which evaluation participants commented on the way that<br />
mentoring built and strengthened relationships. These were the relationships between<br />
mentors and young people, young people and family members, and young people and school<br />
- 43 -
<strong>Panyappi</strong> <strong>Indigenous</strong> <strong>Youth</strong> <strong>Mentoring</strong> <strong>Program</strong> <strong>Evaluation</strong><br />
staff or other services (relationships between the program and other services will be<br />
addressed in the “<strong>Program</strong> management themes” section).<br />
It was very common for family members, workers in collaborating agencies and the<br />
<strong>Panyappi</strong> staff to comment upon difficulties the young people in <strong>Panyappi</strong> had in learning<br />
to trust someone. This was usually based on having their trust broken frequently (at<br />
home, at school or with other services), which created barriers to taking the risk to<br />
trust people again. Current <strong>Panyappi</strong> staff were aware that the trust they built with<br />
young people can be fragile. Not keeping a commitment – even just being a few minutes<br />
late without the young person knowing – could damage any progress that had been made.<br />
MAYT workers identified that: “You have to be honest to that young person because<br />
they have been lied to so many times….[Its] a complete challenge of the family accepting<br />
you and the client accepting you. The hardest part is building the trust. You have to do<br />
what you say you will do.” Family members emphasised the impact of this issue: “Lots of<br />
agencies let kids down. If you get someone like [mentor] on a regular basis then kids<br />
start to trust again and parents know what is happening.”<br />
One of the collaborating agency workers explained what issues of trust meant for the<br />
mentor’s relationship with young people:<br />
They don’t need to be super knowledgeable about health or mental health and<br />
welfare. They don’t have to know everything. What they do need to know is who<br />
to talk to if they need i t,<br />
but they have to be there for the kid. So the young<br />
person can have a yarn to them, talk abou t what’s going on. Most of our kids are<br />
really angry about life, the universe, they don’t really know what. They need<br />
someone to relate to, to talk to….the young person may start sharing a little bit<br />
and get the help that they might not have at home or at school. The mentor is<br />
trustworthy, just listening and being there. (<strong>Program</strong> collaborator)<br />
This person gave examples of this occurring for young people with <strong>Panyappi</strong>:<br />
They would talk in a positive way about their mentor. They would tell us where<br />
they were goi ng. They would say ‘I need to tal k to my mentor about that’. They<br />
would identify another significant adult, which is what we are looking for, who is<br />
going to be consistent and in their life to sort something. (<strong>Program</strong> collaborator)<br />
The importance of this relationship was evident in straightforward comments from<br />
young people who reported that being in <strong>Panyappi</strong> was good and they “felt good” about<br />
seeing their mentor. There were excited about someone visiting and giving them focused<br />
time where the mentor was “listening to me and I would listen to him.” There was a sense<br />
of belonging and being special. This was expanded in family member comments, such as:<br />
He knows that [the mentor] won’t give up on him. (Family member)<br />
- 44 -
<strong>Panyappi</strong> <strong>Indigenous</strong> <strong>Youth</strong> <strong>Mentoring</strong> <strong>Program</strong> <strong>Evaluation</strong><br />
Mentors are like a big brother and they look forward to them coming and doing<br />
the big brother thing. They had a very good relationship the boys. (Family<br />
member)<br />
He looks forward to when [the mentor ] comes. He has got something to do, play<br />
games, can be with someone older that he tends to look up to….It was like a big<br />
brother who is involved in his life and will pick him up and help him, like a normal<br />
big brother does, take him to appointments, study, anything. He really fully<br />
trusts [the mentor] no matter what the situation. (Family member)<br />
<strong>Program</strong> collaborators also identified that the connection between young people and<br />
their mentors is usually strong, for example:<br />
[One young person] was presenting…a whole range of [difficult] issues. His Mum<br />
was saying one day that [the mentor] came around to see him, but [the young<br />
person] was a transient and not at home, but she was home and [the mentor] had<br />
a bit of a yarn with her….When [the young person] came home he was so<br />
disappointed that he had mi ssed [his mentor] . His face lights up when he sees<br />
[his mentor] arriving. (<strong>Program</strong> collaborator)<br />
An unexpected change of mentor when the mentoring relationship has been good does<br />
create the risk of going backwards or repeating traumatic and damaging experiences<br />
where young people feel rejected and lose a sense of positivity and hope. “ I t is critical<br />
that if somebody says that they will do something for our young people that they do it.<br />
Some of our kids are let down everywhere so if we let them down in this where we are<br />
supposed to be helping them then there is nothing left” (<strong>Program</strong> collaborator). If that<br />
does not occur, then the word “mentor” gets a bad reputation among the young people<br />
and they will reject offers to have a mentor.<br />
Unexpected change occurred on a few occasions during <strong>Panyappi</strong>’s life, either due to<br />
overall disruption in the service with changes of staff (as described earlier), or when a<br />
mentor left abruptly and had not prepared the young person for this change. Although<br />
risk management plans are now in place to deal with this, understandably this draws<br />
criticism from young people, families and program collaborators, which may dissuade<br />
them from being involved in <strong>Panyappi</strong>.<br />
One family member described the disruption when her young person was offered a<br />
service in the early stages of <strong>Panyappi</strong>. They initially met with a mentor but services<br />
were not consistently delivered and after a short time the mentor left. Many months<br />
later, after the young person was involved in further offending behaviour and another<br />
recommendation for referral to mentoring was made, the young person was completely<br />
opposed to it. With the encouragement of a FAYS worker and this family member, the<br />
young person gave it one last try, making it quite clear to the mentor that if<br />
commitments were not kept, it was over! This mentor was able to keep commitments,<br />
providing an alternative to previous experiences, and win this young person’s trust and<br />
respect.<br />
- 45 -
<strong>Panyappi</strong> <strong>Indigenous</strong> <strong>Youth</strong> <strong>Mentoring</strong> <strong>Program</strong> <strong>Evaluation</strong><br />
One program collaborator reported that another young person “really looked forward to<br />
[the mentor] coming in but once [the mentor] moved on [the young person] was pretty<br />
disappointed about that because they had a very strong relationship.” This program<br />
collaborator, along with the young person and caregiver, reported that although this was<br />
yet another loss for this young person and grief is still expressed about it, the<br />
relationship is remembered fondly. Further, they described how <strong>Panyappi</strong> buffered this<br />
loss through support from the Coordinator who made regular phone calls and visits until<br />
a new mentor could be allocated, and included the young person in large group outings.<br />
Family members often commented on changes in relationships with their young people.<br />
Either they had smoother and more frequent communication, or they noticed a change in<br />
attitude and confidence. For example:<br />
I have changed my tactics with him. I am not so angry now, listen more and I am<br />
starting to see results. He is coming to me more often, we are relating better.<br />
Its good, I like it, rather than always being at him. (Family member)<br />
He was very withdrawn to start with but he has built up in confidence and he is<br />
very happy now. (Family member)<br />
Other relationships that are influenced are young people’s connections with other<br />
workers. “It’s a great vehicle with [the mentor] being the link person and building that<br />
bridge between us and the client, and even with the family – the program is a bridge<br />
building thing” (<strong>Program</strong> collaborator). Young people, and the family, may be more open to<br />
the presence of these workers in their lives and through their collaboration with<br />
<strong>Panyappi</strong> staff, be happier about these workers knowing more about them. The MAYT<br />
juvenile justice team workers identified that this can create a complimentary situation.<br />
The juvenile justice worker may take up a stronger “disciplinary” role in helping young<br />
people see through their court obligations, while the young person sees the mentor as<br />
having the personal support role. Although the mentor has less authority in the wider<br />
human services context, they still have plenty of authority to the young person. In<br />
addition to the different nature of their roles, this can also relate to available time to<br />
work with young people:<br />
I believe the youth that we work with are basically in a vicious circle and there<br />
is no role model within the family structure. Without a one-on-one mentor with<br />
them to try and break that cycle there isn’t any way out of it. Without the<br />
mentoring we can have a lot of trouble working with the families and the other<br />
kids. We don’t have the time or the resources. We cannot do the mentoring or<br />
have the time to do one-on-one with the kids. (<strong>Program</strong> collaborators)<br />
Importance of family support<br />
Susie goes on a group outing with all the <strong>Panyappi</strong> mentors, the Coordinator and<br />
some of the other young people. When the Coordinator and Mary run a quick<br />
errand to get something the group needs, Susie asks to go with them. In the car<br />
she asks the Coordinator why they aren’t helping her Mum like they are helping<br />
- 46 -
<strong>Panyappi</strong> <strong>Indigenous</strong> <strong>Youth</strong> <strong>Mentoring</strong> <strong>Program</strong> <strong>Evaluation</strong><br />
her. When they ask her what she means, Susie says that her Mum gets really<br />
sad and she is worried about her. The Coordinator explains that she talks to her<br />
Mum by phone almost every week and has done a few home visits too. Susie was<br />
surprised – she knew this happened but didn’t realise how much.<br />
Mary reminds Susie that they were going to review her case plan with the<br />
Coordinator and her Mum in a couple of weeks. Maybe she could take part this<br />
time because she didn’t want to at first. The Coordinator suggests that Mary<br />
and Susie could work on what Susie wants to say at the meeting about how she is<br />
going and any other worries that she has about herself or the family. They will<br />
support Susie and also talk with her Mum about what else they could do to<br />
provide support to her, now that she has made sure Susie is being looked after.<br />
Young people commented that their mentors often talked with their family members or<br />
carers: “I try and get involved with all the family not just [the young person], it makes it<br />
a lot easier if everyone knows who I am” (<strong>Panyappi</strong> staff). They were not bothered by<br />
this and treated it as quite ordinary. Young people also knew that the Coordinator was<br />
involved with talking to their families, and gets to know each young person personally.<br />
They knew they could speak to her if their mentor was not available, which happens when<br />
young people start to initiate contact with their mentors once the relationship has<br />
strengthened, rather than waiting for mentors to do this.<br />
It was apparent from family members’ comments that they understood that <strong>Panyappi</strong><br />
saw them as part of the solution and involved them in identifying activities, options and<br />
goals. They identified how <strong>Panyappi</strong> was supportive of them as well as the young people.<br />
For example:<br />
[The mentor] and I get along well. We discuss things well. (Family member)<br />
It’s really a whole family thing anyway. It’s about [my child] but I feel<br />
supported , I don’t feel left out on my own . It’s gi ven me hope, a bit of hope for<br />
my family. (Family member)<br />
I’ve got to give lots of credit to [the mentors and the Coordinator]. They went<br />
out, talked to kids and parents and then came through [with what they said they<br />
would do ] . (Family member)<br />
Panyapp i became like a second family to us because he al ways looks forward to<br />
[the Coordinator or mentor] coming up. They are like a second family. It’s great.<br />
They show their concerns like family. (Family member)<br />
Witnessing changes in their young people, particularly seeing their young person<br />
disconnect from offending behaviour, reduced the anxiety and stress that family<br />
members had been experiencing for extended periods of time. One family member<br />
commented that: “We don’t get no knock on the door any more. We used to get that all<br />
the time with the police.” A mentor reported feedback they received from a family<br />
- 47 -
<strong>Panyappi</strong> <strong>Indigenous</strong> <strong>Youth</strong> <strong>Mentoring</strong> <strong>Program</strong> <strong>Evaluation</strong><br />
member about their relief to see their young person make a u-turn and become<br />
motivated to do other things: “One parent said to me, ‘I’ve had a really bad experience<br />
within the Department (ie Family and <strong>Youth</strong> Services) and I thought you would jus t be<br />
like the rest of the workers we’ve had, but you have really made a difference’ and<br />
thanked me” (<strong>Panyappi</strong> staff).<br />
Schools commented and appreciated the family-focused and supportive approach of<br />
<strong>Panyappi</strong>, as it often created a link between home and school that they were not always<br />
able to establish:<br />
When the mentor was tuned into the child they became an extra staff member<br />
for me. Not that they were doing things I wanted, [but] they were supporting<br />
the child in the link between us and home. The mentor could provide the link in<br />
special ways if the person was an Aboriginal person particularly, so then we could<br />
be doing that home school link and society link that is harder for us to establish.<br />
(<strong>Program</strong> collaborator)<br />
They also valued sharing the family support role with an outside group, particularly when<br />
they perceived that other services had not met their obligations to provide support:<br />
I think the other side of the mentor program is the Coordinator’s relationship<br />
with [the young person’s carer]. She at times gets to her wits end with him and I<br />
think [her] relationship with the Coordinator is very important. [The carer]<br />
knows she has someone other than me to contact. I’ve got to say I think FAYS’<br />
role with supporting [the young person] has been pretty ordinary. We are trying<br />
to kick that into gear a bit. I think they really need to be giving [the carer]<br />
heaps more support. (<strong>Program</strong> collaborator)<br />
<strong>Panyappi</strong> staff were aware that their work was limited without engagement with families,<br />
even though many problems seemed entrenched and difficult to change:<br />
We can’t just make decisions for this young person without their family. The<br />
information does tend to filter through the family. So I think this is a very<br />
important part of the project. I would like to see <strong>Panyappi</strong> develop this more.<br />
We would like to start taking the families away with us on camps. We are doi ng<br />
the genealogy program, which is built around the family, and so everybody gets<br />
to know ‘this is who you are.’ Even the art program we have told families that<br />
they are very welcome to join. Unless you’re going to make changes in the family<br />
home there is no point working with the young person. We need to understand<br />
what is going on in their li fe . We need to support the famili es so that changes<br />
can be made. (<strong>Panyappi</strong> Coordinator)<br />
When they are here with <strong>Panyappi</strong> they are trying to make a difference and they<br />
are going out. They are making the effort and they are such a changed young<br />
person, but when you see them in the community with their friends or family<br />
they are a totally different person. You can only do so much and what needs to<br />
change is the home. (<strong>Panyappi</strong> staff).<br />
- 48 -
<strong>Panyappi</strong> <strong>Indigenous</strong> <strong>Youth</strong> <strong>Mentoring</strong> <strong>Program</strong> <strong>Evaluation</strong><br />
At the same time, they were aware the effort was worth it once they got past families’<br />
initial cautiousness and trust started to build: ”I find that a lot of the families are really<br />
funny about FAYS because they have had a lot of bad experiences with them, so you<br />
really have to work with the family members because they see us all as one, not<br />
individuals. For the first couple of weeks working with the client, it’s really hard to<br />
engage with the family members, let alone the client, but when you start building a good<br />
relationship with them it’s excellent” (<strong>Panyappi</strong> staff).<br />
Other program collaborators and Advisory Group members talked about the importance<br />
of “respite” for families who are often stressed and in crisis while trying to support<br />
young people whose behaviour is difficult, often in response to family stress and crises.<br />
It can create a break in the vicious cycle they are in. They reinforced the value of a<br />
family-inclusive approach, for example: “It is good for the family as well, getting the<br />
young person back to school, getting the family involved and bringing the family back<br />
together.” Some recognised that there are times when <strong>Panyappi</strong> can engage families<br />
better than they can, and were happy to support that and take a background role in<br />
order to facilitate a more culturally appropriate response.<br />
Connections with schooling<br />
Although Susie is attending school more regularly she has frequent clashes with<br />
teachers about completing her work and her level of attention in classes. Susie<br />
agrees for her mentor and the Coordinator to meet with the School Principal,<br />
AEW and her main teacher. Susie doesn’t want to be at the meeting but asks her<br />
Mum to go, who agrees, and <strong>Panyappi</strong> helps to organise childcare for the younger<br />
ones. The school gains more information about the situation for Susie and what<br />
is getting in the way of her learning and ability to complete or concentrate on<br />
her work. They also learn about the racist teasing that Susie receives from<br />
other kids in the yard. They find out that Susie has started to see a counsellor<br />
and that through <strong>Panyappi</strong>’s work, her Mum is also receiving personal support<br />
from another service so she copes better and can move forward with addressing<br />
the violence at home.<br />
This expanded understanding helps the teacher and School Principal to agree on<br />
a different approach to responding to Susie in class, rather than assuming she is<br />
lazy or incapable, and avoid her getting suspended. They also agree to use some<br />
of their curriculum materials around bullying to help address the issues in the<br />
yard. In this way Susie may experience the teachers being more supportive and<br />
understanding. <strong>Panyappi</strong> offers to arrange access to a tutorial program<br />
connected to MAYT, their auspicing agency, to help Susie catch up on work that<br />
she has missed over the last two years so that she can have more positive<br />
experiences in class and feel like she is able to complete class work and<br />
homework.<br />
Every young person involved with <strong>Panyappi</strong> has had a difficult time with mainstream<br />
schooling. The disconnection from schooling may have been due to schools not identifying<br />
specific learning difficulties earlier in a child’s schooling, or reading them as behavioural<br />
problems and offering the wrong response. Young people get further and further behind<br />
- 49 -
<strong>Panyappi</strong> <strong>Indigenous</strong> <strong>Youth</strong> <strong>Mentoring</strong> <strong>Program</strong> <strong>Evaluation</strong><br />
and in response to feeling alienated from the curriculum develop erratic and disruptive<br />
behaviour, reinforcing misconceptions about the cause of their behaviour. In addition,<br />
the curriculum has often not represented Aboriginal people’s experiences or<br />
represented them poorly. <strong>Indigenous</strong> young people may be bullied in the yard and cope by<br />
withdrawing or fighting back, so they are then named as the troublemakers. Schools<br />
interact with family members mainly when there are problems, may assume that family<br />
members will not connect with schools or misunderstand why they may not get good<br />
responses when they do try and connect. These are examples of institutional and cultural<br />
racism that continue to be reported in the education system despite a desire and<br />
increasing efforts since the 1990s to minimise them. 60,61,62<br />
Upon referral some young people in <strong>Panyappi</strong> are no longer connected to any schooling<br />
and others attend alternative schooling options offered by the education department. If<br />
they are at mainstream schools, then often there are still issues in both the class and<br />
yard to address. Schools’ understanding of this situation can be variable. Although they<br />
are keen to have the <strong>Panyappi</strong> mentors involved, <strong>Panyappi</strong> staff reported that they can<br />
have unrealistic expectations of their role, such as expecting them to be like an<br />
Aboriginal Education Worker (AEW) or to attend classes with young people.<br />
As indicated in the themes above, young people in <strong>Panyappi</strong> have made significant<br />
changes in their attitude and connection to schooling. Family members have commented<br />
that working with a mentor has made their young person want to go back to school or<br />
take another educational option to learn more. MAYT workers identified young people<br />
with whom they previously worked who were “really clearly disengaging” from school but<br />
were now “going to school who haven’t been to school in a long time.”<br />
The young people are taking up different options suitable to their age and interest, such<br />
as full-time mainstream schooling, part-time mainstream schooling with on-the-job<br />
experience of vocational education and training (VET), full or part-time alternative<br />
education options within the education system, or straight VET options. Some have<br />
participated in the MAYT-based Tutorial <strong>Program</strong> as either a first step back into<br />
schooling or as an additional support. Most participate in the cultural awareness training<br />
and experiences offered through a joint program by MAYT and Taoundi College.<br />
In collaborating with <strong>Panyappi</strong>, schools are also considering what they do to support<br />
young people in having positive experiences at school. For example:<br />
Right from the word go I said to [the young person] ‘this is a fresh start so how<br />
you behave will set the reputation you are going to get as a student here.’ We<br />
have a lot of staff members here who have a great awareness of the needs of<br />
Aboriginal kids too. So I think he knows that out in the yard if a teacher comes<br />
along he is going to get a fair hearing…. I’m determined that I want to see him<br />
60 Rigney, L. (1995). <strong>Indigenous</strong> Australians: Addressing racism in education. Dulwich Centre Newsletter, 2&3,<br />
5-15.<br />
61 Thorsen, B. (1995). Being <strong>Indigenous</strong> in Australian schools. Proceedings of the Asia-Pacific Human Sciences<br />
Research Conference, Churchill, Victoria.<br />
62 Social Inclusion Unit. (2003), op cit, pp.19-20, 24-26, 31, 45.<br />
- 50 -
<strong>Panyappi</strong> <strong>Indigenous</strong> <strong>Youth</strong> <strong>Mentoring</strong> <strong>Program</strong> <strong>Evaluation</strong><br />
be successful, just the same as all kids, but I guess I’m keeping a bit of an eye<br />
on him to make sure resources are here to support him and his needs. (<strong>Program</strong><br />
collaborator)<br />
One family member said that the mainstream school her young person attended was<br />
“doing reconciliation with the other kids and they all want to be involved. The racism<br />
gets dealt with and he is doing great.”<br />
An issue important to schools is when mentoring work occurs. If young people attend<br />
school they would prefer them to not have too much time out unless it is educationally<br />
focused. Options for lunchtime or after-school support are preferable and they<br />
negotiate with <strong>Panyappi</strong> to offer this wherever possible.<br />
Looking to the future<br />
A few months into her time with <strong>Panyappi</strong>, Susie makes the transition to high<br />
school. Only a couple of her friends go with her and she feels isolated and<br />
worried about how she will get on with teachers who don’t know or understand<br />
her situation. She has made many changes by this stage, such as better<br />
relationships with her Mum, rare visits to the inner city but with permission<br />
from her Mum , no use of yarnd i or alcoho l, feeling more positive at schoo l and<br />
catching up with work. However, this proves to be a rocky time and she starts<br />
skipping school and catching up with her old friends from the inner city either<br />
there or at the current popular hang-out. The school calls <strong>Panyappi</strong> to ask them<br />
to find Susie when she hadn’t been for two days. When Mary does locate her,<br />
Susie tells Mary that she thinks <strong>Panyappi</strong> won’t continue with her now that she<br />
has mucked up. Mary reassures her that won’t happen – slip-ups happen. They will<br />
help her work out things at school so she can stay on track and they will stick by<br />
her until Susie is more confident of this.<br />
When asked what would happen after their time with <strong>Panyappi</strong>, it was apparent that<br />
most young people had the positive expectation that they would stay with <strong>Panyappi</strong>, and<br />
therefore their mentor, for some time. Some also expressed that they needed this, for<br />
example: “I should be right when <strong>Panyappi</strong> finishes - not for a while though.”<br />
Family members were more direct in their thoughts about this. There was a sense that<br />
their young people would be OK after <strong>Panyappi</strong>, coupled with the hope that there would<br />
be ongoing support. For example, “hopefully after all this work we are doing he will cope<br />
on his own.” Another comment was: “He will keep on going, he won’t look back, he doesn’t.<br />
He wi ll make it. I am pretty confident he is on a good track.” Others were concerned<br />
about <strong>Panyappi</strong> not stopping too soon, or about being there for the young person through<br />
a second stage where support was still present even if not as intensive. For example:<br />
It would be too soon for him because he has only just started all this (4 months<br />
ago ) and all of it is because of [the mentor ], so if he lost him I think everything<br />
woul d be lost . I thi nk it wil l be awhil e before he is ready to go it alone. (Famil y<br />
member)<br />
- 51 -
<strong>Panyappi</strong> <strong>Indigenous</strong> <strong>Youth</strong> <strong>Mentoring</strong> <strong>Program</strong> <strong>Evaluation</strong><br />
I think with <strong>Panyappi</strong> once they get him to this stage of the help, there should<br />
be a second stage of help for them when they leave. Help them to survive, keep<br />
on track with those kids so that they don’t get lost. It needs to go on. ( Family<br />
63<br />
member)<br />
Young people and families were not alone in their opinions on this. <strong>Program</strong> collaborators<br />
were concerned for the future of the program and the young people if the program was<br />
not available. They commented that the concept was excellent, but needed to be funded<br />
appropriately and over a sufficient length of time to allow the program to become<br />
established, offer job security to avoid losing staff, maintain continuity of support to<br />
young people, and for the mentoring role to be appropriately understood by program<br />
collaborators so there are reasonable expectations. They were confident that under<br />
these conditions ongoing evaluation of <strong>Panyappi</strong> would demonstrate outcomes with enough<br />
young people to substantiate those outcomes that had already been achieved.<br />
<strong>Program</strong> management themes<br />
Similarly to the young people and family themes, there is mutual influence between the<br />
themes named here. They reflect issues that typify the establishment and management<br />
of program initiatives that have uncertain futures beyond their initial funding grant.<br />
Establishing a new program<br />
It was apparent from talking with program collaborators, program funders and advisory<br />
group members that they appreciated the effort needed to establish a new program<br />
such as <strong>Panyappi</strong>. Many acknowledged that the program had a difficult start with three<br />
Coordinators to date and the second one leaving very suddenly. This had a negative<br />
impact on staff, resulting in them also leaving, and caused breaks in program continuity<br />
and mentor recruitment. Four months into the program the first Coordinator and MAYT<br />
management, who had a shared understanding of the program focus, were informed by<br />
program funders that they must maintain clearer distinctions between their client<br />
groups, with <strong>Panyappi</strong> having a strictly inner city focus on young people who may or may<br />
not be FAYS clients. This created problems in redefining auspicing arrangements (see<br />
below) and slowed the establishment process.<br />
<strong>Program</strong> funding was also not entirely secure, with a $90K shortfall that was not<br />
directly provided by FAYS as initially promised. FAYS decided to recover this through<br />
establishing most mentor positions as traineeships, reducing mentor numbers to 6 and<br />
removing car access. This was not a straightforward process and slowed program<br />
progress. It meant recruiting people with little or no experience in the workplace or in<br />
human services, resulting in the first Coordinator spending considerable time supporting<br />
and mentoring staff who did not always make good decisions in how to mentor young<br />
people or manage their time. The Coordinator often directly mentored young people to<br />
maintain support for them when mentors were inconsistent or tried to “save” the young<br />
63 This comment refers to the idea of providing support “beyond the trouble zone” as noted on<br />
page 18 in the “How <strong>Panyappi</strong> works” section.<br />
- 52 -
<strong>Panyappi</strong> <strong>Indigenous</strong> <strong>Youth</strong> <strong>Mentoring</strong> <strong>Program</strong> <strong>Evaluation</strong><br />
people rather than “teach” them life skills. Despite requests from the program, FAYS<br />
offered minimal support in managing these human resource and industrial problems.<br />
Although referrals began in the early stages, they were not actively encouraged and<br />
many went on hold “because the mentors were new and very young” (please also see<br />
“Becoming a human services worker: Being a Mentor” below.)<br />
[The first coordinator ] didn’t get a lot of referrals because he was pretty well<br />
flat out trying to put everything together and formulate how the program would<br />
operate. It was just getting the mentors together, organising training, and<br />
getting them to work in partnership with MAYT. See how that would all fit…and<br />
the paperwork that goes with it. (<strong>Program</strong> collaborator)<br />
<strong>Evaluation</strong> participants said that the establishment phase is the best time for bumps to<br />
occur in order to clarify issues, gain valuable learning, and set a strong foundation that<br />
supports programs in travelling smoothly - this certainly occurred for <strong>Panyappi</strong>. They<br />
viewed that <strong>Panyappi</strong> became a functioning program in early 2003 when the third and<br />
current Coordinator started, following a 5-month period of the position being vacant and<br />
MAYT oversaw it in addition to their own work. New mentors were recruited and<br />
establishment work was completed. Participants believed program impact could only be<br />
determined on the basis of the last 12 months - most evaluation interviews occurred in<br />
Feb-Mar 2004.<br />
There was pressure to provide services before the training of new mentors was<br />
complete in 2003. On the one hand this was positive in terms of responding to high level<br />
need, the waiting list and the repeated delays in service delivery moving to full capacity,<br />
but one program collaborator identified the downside: “Training should have been<br />
separate from the doing. Some may not have been ready for what was expected of<br />
them.” Shortcuts into program delivery may slow progress down in the long run if people<br />
are not sufficiently prepared for the varied aspects of their role. This was most<br />
apparent in the early phase of <strong>Panyappi</strong>, but still occurred in 2003.<br />
These views concur with evidence in the literature that mentoring program targeting<br />
young offenders often have longer than expected development times and require<br />
dedicated effort to create and maintain partnerships that help access young offenders<br />
through the juvenile justice system while keeping the program voluntary. This can<br />
increase the pressure on staff, leading to frustration and turnover of mentors,<br />
especially if they are unprepared for the effort required to engage young people. 64<br />
The role of the Advisory Group<br />
<strong>Panyappi</strong>’s Advisory Group included representatives from program funders, community<br />
representatives, and program collaborators (see Figure 4 on page 16). Meetings have<br />
been between one and five months apart across the duration of the program.<br />
64 ARTD (1999/2001) op cit, p.19.<br />
- 53 -
<strong>Panyappi</strong> <strong>Indigenous</strong> <strong>Youth</strong> <strong>Mentoring</strong> <strong>Program</strong> <strong>Evaluation</strong><br />
Attendance has been variable and with declining attendance meetings became infrequent<br />
during 2003. Advisory Group members identified that their role was to:<br />
ω<br />
ω<br />
ω<br />
ω<br />
offer the <strong>Panyappi</strong> program support and guidance in program implementation<br />
assist with exploring issues and identifying possible solutions<br />
provide feedback about program impact and progress<br />
facilitate networking and awareness among agencies likely to be involved with the<br />
young people and families serviced by <strong>Panyappi</strong><br />
Advisory Group members believed the group had not functioned optimally due to<br />
inconsistent attendance and meetings. For some this was due to managing multiple<br />
commitments and difficulty in dedicating time to this role. One member believed that<br />
members could be more proactive in contacting <strong>Panyappi</strong> staff to stay updated, offer<br />
support and network: “The Advisory Group need to support the Co-ordinator so that she<br />
can take the initiative - she also needs support.” Some reported that the <strong>Panyappi</strong><br />
Coordinator had contacted them to network and gain opinions on program developments.<br />
Others identified that differences in opinion about auspicing arrangements and issues<br />
that pre-existed the program had created fractures in the group that prevented<br />
constructive conversations and consistent support for <strong>Panyappi</strong>. They saw this as<br />
working against the program and the overall goals it was trying to achieve, and something<br />
that needs to be transcended. These issues appear to have led to few meetings during<br />
late 2003. Members made comments such as:<br />
I think more than enough information has been fed into the group but getting<br />
something back has been very disappointing. I think the project has<br />
demonstrated now that it doesn’t need an Advisory Gr oup. I would be looking at<br />
ways of translating the information to key stakeholders in different ways,<br />
through a newsletter or when you have events invite stakeholders rather than<br />
sitting around a table. (Advisory group member)<br />
So whether there is a lot of worth to having an advisory group now, perhaps not.<br />
The program is up and running efficiently and doesn’t need an advisory group<br />
anymore. (Advisory group member)<br />
I think we need to think about the standard Advisory Group differently. We<br />
should separate two functions. Community connections can be done at a more on<br />
the ground level rather than with workers in other services. The operational<br />
work is best done by the trage i group, like theInner City Triage Group that<br />
looks at the practical issues of working with the young people and collaborating<br />
on this – who should see them to do what. (Advisory group member)<br />
This situation raises questions about what are appropriate and effective support<br />
structures for the program and whether an Advisory Group is the option of choice.<br />
Trying to achieve and sustain an engaged and effective Advisory Group is a common issue<br />
- 54 -
<strong>Panyappi</strong> <strong>Indigenous</strong> <strong>Youth</strong> <strong>Mentoring</strong> <strong>Program</strong> <strong>Evaluation</strong><br />
in pilot programs in human services – it is not unique to <strong>Indigenous</strong> programs. Despite<br />
these issues, there is consistent evidence from Advisory Group members and other<br />
evaluation participants that the program is currently well managed, has dealt with many<br />
issues related to the earlier life of the program, and has made good progress toward<br />
program goals. Most agree that further outcomes could be achieved with more<br />
consistent support and committed funding (see below).<br />
Auspicing arrangements<br />
Any auspicing arrangement must tackle issues such as: infrastructure support, access to<br />
resources (shared or independent), communication agreements, role clarification, service<br />
philosophy, and levels of collaboration in management and service delivery. Similarities<br />
and differences in approaches and values will determine whether mutually supported<br />
arrangements are achieved. The questions surrounding the auspicing arrangement were<br />
described in “History of <strong>Panyappi</strong>: Deciding on the auspicing agency” above.<br />
In the early stages of <strong>Panyappi</strong> the program was taken in a more independent direction,<br />
which did not fit with MAYT’s hopes as the auspicing body. Together with the issues<br />
facing MAYT at that time this may have contributed to some of <strong>Panyappi</strong>’s teething<br />
difficulties. MAYT underwent a transition in staff and management, as well as dealing<br />
with crowded office facilities. The situation improved by late 2002, and then further<br />
throughout 2003 with their shift to The Parks location. This contributed to more stable<br />
support for <strong>Panyappi</strong> and increased collaboration between MAYT and <strong>Panyappi</strong> staff,<br />
first at the management level and subsequently at a worker level.<br />
Throughout 2003, evidence that the auspicing arrangement was effective, as well as<br />
appropriate, started to emerge more clearly. The shift to The Parks meant <strong>Panyappi</strong> had<br />
good access to space, cars, phones, computers and other infrastructure. This may have<br />
been less visible to Advisory Group members, as there were fewer meetings in 2003 and<br />
those that occurred were not well attended, so opinions may be not be based on the<br />
current situation. <strong>Program</strong> funders at the state level felt confident that <strong>Panyappi</strong>’s<br />
location was appropriate, particularly from an infrastructure point of view.<br />
Some program collaborators were concerned about access, with <strong>Panyappi</strong> based at The<br />
Parks in the western suburbs while its main brief was the Inner City. Although in an area<br />
with a significant Aboriginal community, other areas were named. Not all program<br />
collaborators realised that the workers were highly mobile and most mentoring occurs in<br />
young people’s homes, schools or communities, not at the <strong>Panyappi</strong> office. Although some<br />
group programs are located in The Parks and Port Adelaide, mentors provide transport<br />
for young people to get there. For a couple of evaluation participants, the long-held<br />
concern about whether <strong>Panyappi</strong> is sufficiently community based remains. Their opinions<br />
favour a non-government location with an inner city youth service as the auspicing body.<br />
Alternatively, if <strong>Panyappi</strong> continued and expanded they would support <strong>Panyappi</strong> remaining<br />
where it was as an umbrella body, provided it placed outreach workers in <strong>Indigenous</strong><br />
community agencies across the northern and western suburbs. The core issue that all<br />
evaluation participants shared was ensuring that it met the needs of <strong>Indigenous</strong> young<br />
people, whether they frequented the inner city or other suburban locations.<br />
- 55 -
<strong>Panyappi</strong> <strong>Indigenous</strong> <strong>Youth</strong> <strong>Mentoring</strong> <strong>Program</strong> <strong>Evaluation</strong><br />
All program collaborators indicated their support for <strong>Panyappi</strong> being located with and<br />
run by Aboriginal people in an Aboriginal agency. For some the location had limited<br />
impact as most contact was through phone, email or mentors visiting the agency with the<br />
young person. It was important “knowing the people work there with similar beliefs,<br />
attitudes and goals.” A comparison was made with the FAYS general mentoring pool:<br />
I am not sure what that would be worth. Whether those sorts of mentors would<br />
be able to engage these kids. I think the fact that it is an Aboriginal service for<br />
Aboriginal people, with the other stuff being more mainstream I don’t think it<br />
would be so effective, or the people I’m referring would be as open to their<br />
assistance as they are to <strong>Panyappi</strong>. (<strong>Program</strong> collaborator)<br />
While acknowledging the rocky journey <strong>Panyappi</strong> travelled to its current point, a MAYT<br />
staff member reported that:<br />
I think the reason why <strong>Panyappi</strong> can be so successful is it’s co-location. It’s<br />
auspicing under something like MAYT where you’ve got the support network, the<br />
career pathways and you’ve got training and all of the things that young mentors<br />
are going to need to learn and know so they can work credibly alongside [other<br />
workers involved with the young person and family]. (<strong>Program</strong> collaborators)<br />
MAYT staff identified the importance of having <strong>Panyappi</strong> at an Aboriginal agency that<br />
was sufficiently resourced and committed to culturally appropriate practice and working<br />
in partnership with mainstream agencies: “It’s about head sets and infrastructure too.<br />
We can always wriggle the infrastructure to fit another desk in but it’s hard to wriggle<br />
people’s brains to get another thought in or a different track” (<strong>Program</strong> collaborators).<br />
<strong>Panyappi</strong> mentors were mostly supportive of the co-location although they hoped that<br />
<strong>Panyappi</strong> could be more independent if it continued and expanded, as this would help<br />
distinguish it from MAYT and build its profile:<br />
It’s been a good location for the program and MAYT has been really supportive<br />
of <strong>Panyappi</strong>. I think we might have run into a brick wall if MAYT wasn’t here in<br />
terms of understanding what we are on about. I know with some of the programs<br />
that MAYT do we combine and bring all our clients in together. (<strong>Panyappi</strong> staff)<br />
MAYT believed their existing history of managing mentoring programs was valuable.<br />
FAYS fund this mentoring capacity as part of the larger pool of mainstream mentoring<br />
funds. It has been inadequate funding, ~ $33K/year which is less than one full-time<br />
position, but with a broad scope to provide mentoring for any young person involved in<br />
the juvenile justice system. Although <strong>Panyappi</strong> has a different focus, they have placed<br />
the casual mentor pool under <strong>Panyappi</strong>’s management to provide a consistent training,<br />
support, policy and practice environment for all <strong>Indigenous</strong> youth mentoring.<br />
The main concern that <strong>Panyappi</strong> faced in 2003 was developing effective partnerships<br />
with MAYT youth workers so the different roles of youth workers and mentors were<br />
- 56 -
<strong>Panyappi</strong> <strong>Indigenous</strong> <strong>Youth</strong> <strong>Mentoring</strong> <strong>Program</strong> <strong>Evaluation</strong><br />
understood and they could collaborate effectively. This proved more challenging than<br />
working with the MAYT family workers. Progress has been made in this area, e.g. “we<br />
know more and have more of an understanding [of what mentoring involves].” MAYT<br />
youth workers reported they were committed to building closer working relationships<br />
with mentors, and <strong>Panyappi</strong> mentors indicated they were keen to work in buddy systems<br />
with youth workers to strengthen collaboration and contribute to on-site training. MAYT<br />
Management has lead the way for collaboration, as it includes the <strong>Panyappi</strong> Coordinator<br />
in MAYT Management meetings, planning and decision-making processes. MAYT is aware<br />
that they also gain from the auspicing arrangement. MAYT Management reported that:<br />
<strong>Panyappi</strong> also offers MAYT support. It is another avenue at looking at different<br />
programming and ideas for the kids. There may be different ways of working<br />
together. They take the pressure off some of the main staff because they can<br />
do what the youth worker’s can’t do in relation to their time. (<strong>Program</strong><br />
collaborators)<br />
Funding partnerships<br />
<strong>Panyappi</strong> staff reported that the program gained strong support from the Crime<br />
Prevention Unit, State Attorney General’s Department. The Senior Project Officer<br />
assigned to supporting <strong>Panyappi</strong> was the key link with the Commonwealth Attorney<br />
General’s Department. As the local level of the Department of Human Services, <strong>Panyappi</strong><br />
staff perceived that MAYT offered high level support in terms of the in-kind resources<br />
and direct funding they contributed, and their consistent advocacy for funding support<br />
at a central level.<br />
Questions were raised about the level of support and leadership provided by the central<br />
office of DHS throughout the program’s history. A few people reported that the minimal<br />
support and interest for <strong>Panyappi</strong>’s work, and its vision for how that could be enhanced<br />
and expanded, has had a detrimental and constraining effect on program recognition and<br />
development in DHS. <strong>Program</strong> monies were shifted without consent, responses to budget<br />
queries were slow, and considerable work was required to get accurate budget figures<br />
and recover monies. Information was not passed on to senior management levels so they<br />
could fully appreciate what <strong>Panyappi</strong> offered. This was also seen as stepping away from<br />
responsibility when <strong>Panyappi</strong> is often involved with young people who are part of the<br />
Department’s core business through Family and <strong>Youth</strong> Services. For example, a person<br />
who is independent of <strong>Panyappi</strong> and MAYT staff commented:<br />
If we had more support from DHS we would have had a better platform to really<br />
raise the profile of <strong>Panyappi</strong> through DHS and through that, better advocate on<br />
behalf of young <strong>Indigenous</strong> kids invol ved in the program and [have] more people<br />
knowing and being aware of the program and where it’s trying to head.<br />
<strong>Program</strong> collaborators, particularly those in community-based agencies that often<br />
depend upon project grants to survive, were particularly frustrated with <strong>Panyappi</strong>’s<br />
short-term funding situation. They viewed this short-term approach as disrespectful; it<br />
allows something to get started but then fails to support it to become sustainable,<br />
rather than using a “capacity building” model where the funding body plays an active role<br />
- 57 -
<strong>Panyappi</strong> <strong>Indigenous</strong> <strong>Youth</strong> <strong>Mentoring</strong> <strong>Program</strong> <strong>Evaluation</strong><br />
in supporting project sites to develop sustainability plans and fund them for a sufficient<br />
length of time so they can be successfully implemented. 65 As one of the funding bodies,<br />
the Crime Prevention Unit, State Attorney Generals’ Department, was active in providing<br />
support and developing sustainability plans but this was not matched by the two other<br />
funding partners.<br />
We are sick of the merry-go-round. People get angry and frustrated at another<br />
short-term handout that makes the government look like they are doing<br />
something but little is left with the community as there is no ongoing support.<br />
This is disappointing with a program like <strong>Panyappi</strong> that can offer important<br />
things to young people who often have no one else to turn to, to tutor them in<br />
life like a tutor does with schoolwork. (<strong>Program</strong> collaborator)<br />
This situation raised the issue of whether, “these programs get set up to fail. I see that<br />
as not only failing ourselves, but the community and failing the young people. If programs<br />
are set up like this it’s really important to keep them running. To make a change, we need<br />
successful programmes like this. If funding runs out, where is it going to leave the young<br />
people?” (<strong>Panyappi</strong> staff).<br />
<strong>Program</strong> collaborations<br />
A central location for program collaborations was established through the Inner City<br />
Triage group set up by <strong>Panyappi</strong> and the State Attorney General’s Department, Crime<br />
Prevention Unit in the latter half of 2003. However the intention was to use it for<br />
identifying young people and determining immediate referral options, and less for<br />
ongoing service delivery. A program funder believed that creating the Inner City Triage<br />
Group has, “brought to the attention of many people and government agencies that there<br />
are some issues with young Indgenous i kds i especially withn i the city. It has aso l put<br />
these issues on the table…an outcome that we weren’t expecting. We had a lot of<br />
participation from other [youth and government] agencies in town. That level of<br />
communication wasn’t there before. <strong>Panyappi</strong> has been the driver.” Unfortunately, in<br />
May 2004 the Inner City Triage group was disbanded as the Department of Human<br />
Services supported an alternative group for inner city workers that focused more on<br />
networking, losing the interagency case discussion and decision focus.<br />
Most other program-based collaborations occur with schools, FAYS, MAYT youth and<br />
family workers, juvenile justice, and other family support programs. Schools have both<br />
referred to and directly benefited from <strong>Panyappi</strong>’s work. One school with a high number<br />
of Aboriginal students said that their enthusiasm for gaining mentoring support meant<br />
they nominated more young people than could be absorbed, and realised it was easy to<br />
overload <strong>Panyappi</strong> due to the intensive nature of the work and therefore small caseloads<br />
required. Their experience of the program once a referral was accepted “really<br />
depended on the nominated mentor after that. Some of the mentors were very good and<br />
some were not very good at all” (<strong>Program</strong> collaborator).<br />
65 The Foundation for Young Australians (http://www.youngaustralians.org/) has developed this approach over<br />
the past two years, which is also known as “venture philanthropy.”<br />
- 58 -
<strong>Panyappi</strong> <strong>Indigenous</strong> <strong>Youth</strong> <strong>Mentoring</strong> <strong>Program</strong> <strong>Evaluation</strong><br />
When young people attended school, the schools expected flexibility from mentors in<br />
offering after-school options to support young people’s engagement with education.<br />
When they gain this flexibility, then “schools are wrapped with <strong>Panyappi</strong> because of the<br />
work they do in the schools” (<strong>Program</strong> collaborators). When mentors were appreciated,<br />
they stayed in regular contact with school staff, negotiated visit timing as well as time<br />
away to help young people attend other appointments, supported schools in getting young<br />
people to attend and complete work, and provided links between home and school to<br />
facilitate that relationship. A non-school based education worker reported:<br />
It’s been a real partnership in terms of my role. There are certain things I can<br />
and can’t do in relation to the young person….There is regular dialogue in terms<br />
of where the young person is at, trying to work out the best outcomes for the<br />
young person as well. [The Coordinator] and [mentor] have been really supportive<br />
in terms of the work they have been doing. (<strong>Program</strong> collaborator)<br />
A different program collaborator described <strong>Panyappi</strong>’s work as a holistic, familyinclusive<br />
and culturally appropriate approach, while their agency stayed involved in a case<br />
management role with regular communication with the mentor as the “frontline” worker.<br />
Although this agency is used to doing the frontline work, they believed this arrangement<br />
works effectively in situations where the issues are serious, confronting and long-term:<br />
Its working with the kids that are falling through the gaps and trying to make<br />
the services available, getting kids to appointments, being creative with their<br />
service in some respect, working quite intensely with the family, the mentor<br />
being the role model for the kid and getting them on board with engaging the<br />
parents…With . this family (2 kids) we’ve linked in the MAYT Drug and Alcohol Counsellor so its been quite a holistic approach in terms of MAYT doing a broad<br />
range of things with the family, as well as involving a family support worker from<br />
[another agency]. (<strong>Program</strong> Collaborator)<br />
<strong>Youth</strong> or family workers at MAYT also reported high satisfaction when mentors engaged<br />
in collaborative work, for example:<br />
The family is interested in what is happening. It is a relief knowing that a<br />
mentor is working with that young person because we just don’t have the time.<br />
The mentor gives the workers time out and also the family. (<strong>Program</strong><br />
collaborators)<br />
We had a boy [with] a carer, social worker, MAYT worker and a mentor - also a<br />
family worker. There were a lot of people involved but with everybody talking<br />
and communicating i t worked pretty well for him. (<strong>Program</strong> collaborators)<br />
Although other services expressed some dissatisfaction with collaboration, it appears<br />
this was due to: unrealistic expectations of <strong>Panyappi</strong>’s capacity, misconceptions about<br />
the mentoring role (see below), and different opinions on the auspicing arrangements<br />
which may detract from collaboration and focusing on the work itself.<br />
- 59 -
<strong>Panyappi</strong> <strong>Indigenous</strong> <strong>Youth</strong> <strong>Mentoring</strong> <strong>Program</strong> <strong>Evaluation</strong><br />
Some program staff, funders and advisory group members acknowledged that, “there<br />
has been some really strong links forged with the police.” As part of their commitment<br />
to supporting <strong>Panyappi</strong>’s work and acknowledging their shared concerns about the<br />
wellbeing of <strong>Indigenous</strong> young people, SAPOL are finalising a Memorandum of Agreement<br />
with <strong>Panyappi</strong>. This stands out given the experiences that most young people in <strong>Panyappi</strong><br />
may have had with police.<br />
I’ve made a point of building very strong relationships wi th Police so that we can<br />
maybe make some changes in the way they feel and look at how they pick up our<br />
kids. I’ve done a lot of training, especially the inner city around what <strong>Panyappi</strong><br />
does and how we can involve the Police and they can be a referral point for us.<br />
They were so receptive and really wanted to know what they coul d do , as they<br />
didn’t feel that they had enough understanding to do the right thing by the kids<br />
whether they were victims or offenders. (<strong>Panyappi</strong> Coordinator)<br />
Scope – geography and age<br />
Schools working closely with the young people that <strong>Panyappi</strong> target are aware that they<br />
do not always frequent the inner city, but often spend time in their own communities and<br />
other suburban locations. Similarly to other program collaborators they appreciated that<br />
<strong>Panyappi</strong> had a brief to address the inner city, but were keen to see this expand to<br />
respond to the realities of these young people’s lives.<br />
I would certainly like to see that there are no boundary lines in future projects<br />
because our kids don’t follow them….There might be a rush of 3 or 4 weeks<br />
where they hit the city all the time and then all of a sudden they are hanging at<br />
Mansfield Park. They’re not going anywhere. They are wandering around at night<br />
looking for stuff to do, so it’s fairly variable. (<strong>Program</strong> collaborator)<br />
Such expansion would prevent the large gaps in service that occurred in their early<br />
contact with <strong>Panyappi</strong>. Contact is now more regular as <strong>Panyappi</strong> gained support to<br />
broaden its brief. In fact, several evaluation participants advocated a “no borders”<br />
approach. They emphasised that it should be irrelevant whether young people had FAYS<br />
involvement (this is not a current eligibility criterion), and although Inner City youth<br />
were a focus, the program could go beyond this group. This is recognised within MAYT:<br />
<strong>Panyappi</strong> [needs] to be flexible and shift with the trends of what is happening<br />
with young people. Originally it was set up for kids who frequent Hindley Street<br />
on a regular basis, but we know that the shift is now out into the community and<br />
the Parks area. MAYT and <strong>Panyappi</strong> need flexibility to go with it. (<strong>Program</strong><br />
collaborators)<br />
This flexibility also includes age. It has become increasingly evident to <strong>Panyappi</strong> staff,<br />
and some Advisory Group members, that there is both a need and wisdom in targeting a<br />
younger group. “There is nothing for the 7-9 year olds who often need some direction<br />
and support at this point but can’t access services easily for them as they don’t fall<br />
under FAYS.” Responding to these issues would also encourage <strong>Panyappi</strong> to target other<br />
- 60 -
<strong>Panyappi</strong> <strong>Indigenous</strong> <strong>Youth</strong> <strong>Mentoring</strong> <strong>Program</strong> <strong>Evaluation</strong><br />
geographical areas where problems with younger children are more evident, e.g.<br />
Mansfield Park. A program collaborator working with the younger children said:<br />
Its clear from the Layton Report 66 that our whole care system is falling apart<br />
miserably. The kids that I am working with will never go into the care system, as<br />
they will just run into placement breakdown after breakdown. We are not even<br />
trying to get them into alternative care. Relative options are diminishing and it’s<br />
just not possible, so we need something else for these sorts of kids. A long-term<br />
worker or service that will engage this family until they are back on track and<br />
try to get them back on track is what’s needed, and we are not seeing that.<br />
There is no ongoing service at the moment [elsewhere]….Its just a vicious circle<br />
really. (<strong>Program</strong> collaborator)<br />
Without this, some program collaborators believed that “its only a matter of time<br />
before they are 10 and can get charged” and then go on FAYS youth team caseloads as<br />
young offenders. People were keen to see a consistent and committed effort to start<br />
breaking this cycle and believed <strong>Panyappi</strong> could play a part in this.<br />
Alternative services<br />
Linked to the issue of scope was the consistent message from all evaluation participants<br />
about the poor availability of alternative services if <strong>Panyappi</strong> did not exist. Although<br />
people would use anything available, including existing <strong>Indigenous</strong> and non-<strong>Indigenous</strong><br />
youth and human service agencies, there was no equivalent service to <strong>Panyappi</strong>. As noted<br />
in quotes in the Young people and family themes section above, program collaborators<br />
and family members were equally concerned about outcomes for their young people if<br />
<strong>Panyappi</strong> was not available, and questioned if their own resources would be sufficient to<br />
achieve sufficient change: “If we hadn’t had that sort of stuff then it would have been<br />
up to [the carer] and myself and the resources we have between the two of us. ” They<br />
did not consider that it was only <strong>Panyappi</strong> they needed, but it made a substantial<br />
difference through enabling young people to gain greater benefit from other services or<br />
supports with which they may not be engaging.<br />
This situation gave rise to frustration regarding short-term funded initiatives where<br />
long-range planning for sustainability is not built into the budget. As noted above,<br />
although short-term pilot initiatives occur in all human service areas, Aboriginal<br />
communities are often serviced on the basis of such projects. This disrespects the<br />
issues they face, the services they deserve and shows poor appreciation of the realities<br />
of historical legacies on their lives.<br />
The consensus was that if you are going to support this work, then make it possible to do<br />
it well by resourcing it appropriately. You will retain more of your staff and provide a<br />
consistent service in situations where that consistency can make or break young people’s<br />
willingness to engage with support services at all. In cross-portfolio areas, such as the<br />
66 The Layton report was a report commissioned by the State Government to review the South Australian child<br />
protection system. It reported its findings in 2003 and recommended major changes to many areas of child<br />
protection and alternative care system.<br />
- 61 -
<strong>Panyappi</strong> <strong>Indigenous</strong> <strong>Youth</strong> <strong>Mentoring</strong> <strong>Program</strong> <strong>Evaluation</strong><br />
work of <strong>Panyappi</strong>, funding commitments are usually required by more than one agency or<br />
department to break the short-term funding cycle and sustain initiatives so they can<br />
build on their foundations and work toward their long-term goals.<br />
Being a mentor<br />
Becoming a human services worker<br />
For many of the mentors, <strong>Panyappi</strong> was their first experience of being a human services<br />
worker and they tended to be a younger group (20-30 years), in part due to the early<br />
funding dilemma addressed by employing people on traineeships where the age criteria<br />
was 18-28 years. Current and previous mentor staff reported that they had a strong<br />
personal interest to work with Aboriginal young people, “I have a passion for this sort of<br />
work.” <strong>Panyappi</strong> was their first formal opportunity: “I’ve wanted to be a youth worker<br />
and it was my first experience of doing this.” This was also evident to program<br />
collaborators: “He’s so keen. His heart’s so in his work….He’s pretty dedicated.”<br />
The initial focus for all mentors was training for their role in working with young people,<br />
families and other agencies, but becoming a human services worker requires learning<br />
about the cultural and administrative protocols of the sector. This was an additional<br />
learning curve to scale, and required support from the Coordinator, as well as the<br />
auspicing agency, which proved to be a more time intensive task than anticipated for all<br />
concerned. Not all mentors employed managed to learn and put into practice all aspects<br />
of the job, and either left, or where it was required were dismissed. It appears that the<br />
“traineeship only” employment approach advocated by FAYS to resolve the earlier<br />
funding dilemma set up the program and some of its workers to fail, as it did not<br />
recognise the knowledge and skills required for the role.<br />
The first main recruitment drives occurred during <strong>Panyappi</strong>’s early stages while it was<br />
establishing its identity, clarifying its focus, identifying what were reasonable<br />
expectations when mentoring involves time-intensive work with young people, and<br />
developing appropriate policies and practices. The second drive occurred early in 2003<br />
once the third Coordinator started when all of these areas needed to be revisited and<br />
revised. This situation should be more manageable in the future, as new staff would<br />
come into an existing staff team where there is stronger peer support in addition to<br />
supervision.<br />
Roles and responsibilities<br />
Most people actively involved with <strong>Panyappi</strong> were able to articulate the role of mentors,<br />
particularly the Coordinator, mentors, MAYT staff, and those program collaborators<br />
who worked in partnership with the <strong>Panyappi</strong> program, rather than just sending referrals<br />
to them. Some of these descriptions were provided above in the Young people and family<br />
themes section, but others included:<br />
My rol e is to stay in regular contact with my clients because what I am trying to<br />
do is give them a different direction, something else that is going to be<br />
interesting in their life so that they don’t get drawn back to hanging around the<br />
- 62 -
<strong>Panyappi</strong> <strong>Indigenous</strong> <strong>Youth</strong> <strong>Mentoring</strong> <strong>Program</strong> <strong>Evaluation</strong><br />
inner city a lot of the time and getting involved with whatever could be<br />
happening there, which might connect them up with the justice system. I make<br />
sure that I have a good connection with people at school, particularly the<br />
Aboriginal Education Workers in terms of how they are going, how they are<br />
managing at the school and how I can support that. (<strong>Panyappi</strong> staff)<br />
That you are a friend, you create a relationship with that young person whereby<br />
you are their big brother, big sister, confidant, their friend, the person that<br />
they build some sort of trust with, that feels like that person is there for them,<br />
to support them in their choices, helping them to get to them, whether it’s<br />
school or training. A role model for that person - helping them to make good<br />
choices…take them by the hand and lead them through life. I t is about teaching<br />
the kids to think for themselves, looking at what their options may be and<br />
thinking those options through before taking any steps. (<strong>Program</strong> collaborators)<br />
Mostly about getting the young person a voice in a world that often or doesn’t<br />
listen to young people. (<strong>Program</strong> collaborators)<br />
Connecting with him, having a relationship, someone he can look up to, be an<br />
appropriate model, someone he can confide in who is not going to be on his case<br />
as opposed to a statutory role, giving him some other things in hi s life that are<br />
more positive than wanting to go out and do crime or hang around the streets<br />
(<strong>Program</strong> Collaborator)<br />
Although it was important that mentors develop friendships with young people, some<br />
program collaborators emphasised that “A mentor needs to be the adult and needs to<br />
see the difference between what is a good thing and a bad thing.” Mentors emphasised<br />
the importance of trust, “I try to keep it confidential, just between me and him and I<br />
think he likes that,” but also understood their adult role. “He says things that he tells<br />
me not to tell Mum, but I’ve told him if it’s really bad I need to tell her. He understands<br />
and expects that” (<strong>Panyappi</strong> staff). They were aware of their responsibility to do the<br />
right thing by young people and set a good example.<br />
I never make promises. If you make an appointment, stick to it. Be honest, be<br />
responsible for your own actions, make sure you’re there. All this can make it or<br />
break it. If you don’t turn up…it’s the parents that have to deal with this kid<br />
going off. It’s just all these things. Confidentiality as well is a big thing and<br />
builds the trust…. The parent needs to know that you are responsible and you’re<br />
a good person and that their child is going to be looked after while they are in<br />
my care and that we can work together as well. (<strong>Panyappi</strong> staff)<br />
Mentors found short-term change inspiring, but indicated they were aware of the longterm<br />
impacts of their work. I like “the success that you see out of what I have done<br />
being the worker, seeing a difference in the youth that I work with. They open up to you<br />
and come to you when they are in trouble. There are no secrets. Something that I do<br />
now might affect them in years to come and maybe make a change in their life” (<strong>Panyappi</strong><br />
staff). This, of course, may be positive or negative and is why issues of consistency,<br />
- 63 -
<strong>Panyappi</strong> <strong>Indigenous</strong> <strong>Youth</strong> <strong>Mentoring</strong> <strong>Program</strong> <strong>Evaluation</strong><br />
responsibility, and continuity are emphasised in <strong>Panyappi</strong>. The focus is on what young<br />
people can learn and make part of their life both while they have <strong>Panyappi</strong>’s support and<br />
once they are on their own:<br />
All my kids have got into school and they are looking at their family life<br />
differently. They know they have the support out here and they have someone<br />
to talk to if things aren’t going so well in thei r family life. They have resources<br />
to go to other services as far as health and things like that. I have informed<br />
them of these services and resources that they can go to if I’m not<br />
available….[At first they won’t go and] want me there beside them because they<br />
feel more comfortable because they feel that there is someone they can trust,<br />
someone that will support them. That is only for the first couple of visits but<br />
once they form a relationship with, for example Second Story, where they have<br />
a lot of services in that one building, I find that the kids go there themselves.<br />
Once it builds their self-esteem and confidence and they get the guidance they<br />
need, they go on and do it themselves. (<strong>Panyappi</strong> staff)<br />
Despite program collaborators’ ability to give good descriptions of the mentor’s role,<br />
there were several reports about other agencies misunderstanding the mentor’s role and<br />
the personal and time-intensive level of engagement required. This was apparent to<br />
people beyond the <strong>Panyappi</strong> team, mostly MAYT staff, for example:<br />
I think a lot of the time other people view mentors as a run around, so things we<br />
can’t do, a taxi service, take him to school, whatever….District centres don’t<br />
understand the effort it takes or the time it takes to build relationships with<br />
the young people, so they are never going to understand or comprehend that,<br />
where as we know more and have more of an understanding. (<strong>Program</strong><br />
collaborators)<br />
I think if we are serious about the whole methodology about using mentors then<br />
it needs to be expanded. It is intensive one-on-one. I don’t think the rest of the<br />
system really understands mentoring. Because of the overload in the register<br />
system they basically see mentoring as babysitting and a transport service, a gap<br />
filler rather than a specific role on it’s own. I don’t think it’s valued for the role.<br />
(<strong>Program</strong> collaborators)<br />
This misunderstanding led to inappropriate requests of mentors, and expectations that<br />
the program could accept many referrals and provide immediate services. It also has the<br />
potential to distort people’s perceptions of program outcomes, including the evaluation<br />
outcomes. Some of these requests included hoping that the mentor would engage in<br />
investigative work with young people when there was reasonable suspicion they had<br />
engaged in criminal activities, and report their findings back to other workers to assist<br />
them in their role (the workers making this request were not police). Yet these workers<br />
noted that “they [mentors] aren’t the police” and it could risk destroying the<br />
relationship. Although very complimentary about the mentors’ work, a few program<br />
collaborators commented that they found it frustrating when <strong>Panyappi</strong> staff were<br />
reluctant to do this investigative work, or they were told by <strong>Panyappi</strong> this was not the<br />
- 64 -
<strong>Panyappi</strong> <strong>Indigenous</strong> <strong>Youth</strong> <strong>Mentoring</strong> <strong>Program</strong> <strong>Evaluation</strong><br />
mentor’s role, and wondered if this leaned toward “rescuing the kid, rather than<br />
acknowledging it’s a reality.”<br />
It was apparent there was some confusion between what constituted communication,<br />
information sharing and the overall best interests of the young person, and what actions<br />
compromised the mentoring work by achieving a short-term gain for a long-term loss.<br />
Clarifying roles and developing effective communication was not always seen as a mutual<br />
responsibility, but something that <strong>Panyappi</strong> should lead rather than other agencies ask<br />
about. This also reflected some frustration that “they look like the good guys and we<br />
look li ke the bad guys , as we have to tell them [young people] off for different things.”<br />
In contrast, other program collaborators said that:<br />
I know when I have issues that I want to raise with these kids I’ve struggled to<br />
confront them [as a professional worker]. I don’t think getting a mentor to do<br />
that is right, as I think that the rapport building that they have spent so much<br />
time on will go down the drain. I think if it is clear child protection, guardianship<br />
and court stuff…it needs to be coming from statutory [workers]…I think it<br />
needs to be kept separate from the mentor’s role. (<strong>Program</strong> collaborator)<br />
Facing the realities of the work – opportunities for personal growth<br />
Some of the mentors have been there a bit themselves or seen others or have<br />
siblings in similar situations. Aboriginal mentors come with a whole different<br />
concept than others I’d have to say because of that connection there. It’s<br />
already in the forefront of their mind about the family being important [as well<br />
as the young person]. (<strong>Program</strong> collaborators)<br />
This situation gives the <strong>Panyappi</strong> mentors considerable advantage in trying to engage<br />
young people who are not always keen to be involved with (yet another) service. At the<br />
same time, some mentors were not fully aware of the realities of these young people’s<br />
lives and therefore what they would face in the work.<br />
I guess it has opened their eyes to what our young kids are going through. The<br />
issues that they face on a regular basis, the stuff they deal with at home, the<br />
stuff they deal with the Police. The basic everyday life of a young person, all the<br />
emotions everything they go through each day. Sometimes they are very<br />
shocked. They really haven’t experienced being with kids that are hard core,<br />
that have witnessed and experienced drugs, alcohol, abuse, domestic violence. A<br />
lot of the mentors haven’t experienced that. When they do see that or are<br />
confronted they don’t have the skills to deal with this and it affects them in a<br />
strong way [so] that some don’t want to work here. (<strong>Program</strong> collaborators)<br />
On two occasions, when young people mentors were confronted with “hard end” issues or<br />
mandatory reporting responsibilities they decided to leave. Although support was<br />
provided and offered on an ongoing basis, mentors did not always experience it as<br />
sufficient or did not request further support when they needed it, which may have<br />
prevented them from leaving and then later regretting the decision (also see “Support<br />
- 65 -
<strong>Panyappi</strong> <strong>Indigenous</strong> <strong>Youth</strong> <strong>Mentoring</strong> <strong>Program</strong> <strong>Evaluation</strong><br />
for mentors” next). It is possible they may have blamed themselves for situations that<br />
are complex and need long-term solutions where mentoring is only one of several<br />
strategies required:<br />
I’ve told the mentors that if we’re not achieving some of the things we have<br />
written down then we need to try something different. What I’ve tried to tell<br />
the mentors is that ‘don’t ever think it’s you’, because these kids have got far<br />
more issues than what we could ever deal with. (<strong>Panyappi</strong> Coordinator)<br />
Others have used these situations to develop their resilience and capacity as workers,<br />
chalking it up to experience and therefore, gaining valuable learning.<br />
I think it has helped me understand a little more about our youth. It has<br />
cemented my general knowledge and helped me learn how to deal with them.<br />
Going to TAFE has helped a tremendous amount. It has made me want to get out<br />
there more and help as many kids as possi ble. I know now this is what I want to<br />
do and makes me fee l really good knowing that. Seeing my cli ent change is just<br />
wonderful to see and is so rewarding. It has done a lot for me. (<strong>Panyappi</strong> staff)<br />
MAYT staff have witnessed this shift in mentors, for example: “I have seen them grow<br />
in confidence and their ability to advocate for themselves as well as for other people,<br />
young people. I’ve seen them have an avenue to put their passion around young Aboriginal<br />
kids and their families and have a place to bring them to” (<strong>Program</strong> collaborators).<br />
Mentors could identify areas of personal development from working at <strong>Panyappi</strong>, such as<br />
confidence, skills in working with young people, communication, teamwork, and identifying<br />
goals for further training and study so they could move into other human services<br />
positions. For example:<br />
I’ve learnt a few thi ngs from Panyapp i. I al ways used to be shy . I thi nk by the<br />
meetings we have I have come out of my shell and that’s one good thing that<br />
<strong>Panyappi</strong> has done for me. I can talk to anyone now. It’s been a good<br />
improvement….I feel I can get along with younger people a lot better than I used<br />
to in my persona l life, like with my cousins….My own fami ly has seen a change in<br />
me also. I’m learning to manage my temper better as we ll, I have to keep calm<br />
with the kids here and can’t lose my temper and it’s carried over into my<br />
personal life. My family think it’s opened up my mind, instead of being so narrowminded….I’ve<br />
got a lot out of this personally. (<strong>Panyappi</strong> staff)<br />
I think being in this position, and because I need to think about what I want to<br />
do for the rest of my career, my next step if not still being here would be<br />
working in the schools as a teacher or working with <strong>Indigenous</strong> students at<br />
schools, just keeping them at school. I think school is really important for any<br />
child. (<strong>Panyappi</strong> staff)<br />
- 66 -
Support for mentors<br />
<strong>Panyappi</strong> <strong>Indigenous</strong> <strong>Youth</strong> <strong>Mentoring</strong> <strong>Program</strong> <strong>Evaluation</strong><br />
All mentors reported receiving supervision, training and personal support for their role -<br />
part of the two levels of mentoring built into the program (see page 18 in the “How<br />
<strong>Panyappi</strong> works: Support for mentors” section). Some program collaborators recognised<br />
this, for example: “The fact that the program is attached to a Certificate in <strong>Youth</strong><br />
Work is fantastic as well. So we are providing a program where they are getting<br />
employed, and also getting further education from it.” All mentors highly valued the<br />
range of training opportunities and believed they were fundamental to assisting them in<br />
their role. For some it was an opportunity to prove that they could do something that<br />
they never believed of themselves, and it has inspired them to study for a higher<br />
qualification.<br />
Some mentors were very positive about the supervision and personal support, “I have<br />
never experienced this support anywhere I’ve worked before.” They felt it was<br />
consistent, helpful and readily available when they asked for it. Others were not<br />
satisfied that supervision and personal support was sufficiently frequent and evenhanded,<br />
questioning whether the Coordinator demonstrated a similar level of interest<br />
for the work of all mentors. They wanted more encouragement and one-to-one training.<br />
They felt the current team still had some distance to go in having a team focus.<br />
Although additional training strategies were implemented early in 2004 to help mentors<br />
work their way out of difficult situations they may face, the current Coordinator<br />
recognised that having trainees and less experienced workers created support demands<br />
that were difficult to meet consistently with her numerous other roles. These roles<br />
included the work to gain support and funding for the program’s future. Although having<br />
the OPS3 position since September 2003 certainly made a difference, “at the moment I<br />
don’t have enough time to spend with these people. Maybe in the future I can look at<br />
some more trainees but I think for the moment I need to look at some other core<br />
positions that we can stabilise first” (<strong>Panyappi</strong> Coordinator).<br />
A few weeks following their evaluation interviews, all <strong>Panyappi</strong> staff participated in a<br />
MAYT team review and planning day that focused on communication, team building, and<br />
strengthening opportunities for collaboration within and between MAYT and <strong>Panyappi</strong>.<br />
The team reported that they made good progress in these areas, and have been<br />
committed and enthusiastic to continue this work so their team cohesion improves.<br />
MAYT staff had mixed views on the support provided to mentors. Some identified that<br />
there was strong and consistent support available: “All the support is here. If the<br />
Coordinator notices that a mentor is down, she tries to talk to them, offers support. If<br />
they say no, she lets them go for a bit, but if she can see it hasn’t been resolved she<br />
cal ls [the MAYT Manager ] in and…they get [the mentor] to talk about issues and what is<br />
bothering them.” Others wondered if there was sufficient support to assist the mentor<br />
in their role at times: “I think the Co-ordinator needs to be directing or supporting the<br />
mentor to know what to do with the young person as well. Sometimes that doesn’t<br />
happen.” Still others wondered if there is too much support and protection that may<br />
prevent mentors gaining more learning from experience. They advocated:<br />
- 67 -
<strong>Panyappi</strong> <strong>Indigenous</strong> <strong>Youth</strong> <strong>Mentoring</strong> <strong>Program</strong> <strong>Evaluation</strong><br />
…letting the mentors fall a little. Letting them practice and not waiting for them<br />
to be fully trained and perfect before letting them experience. I would have let<br />
them go and fall on their knees and get up again. Support them totally, but let<br />
them go and give it a go. (<strong>Program</strong> collaborators)<br />
Differences in opinion about what “good support” and “appropriate direction” mean for<br />
workers relate to a combination of personality, confidence, maturity, work approach,<br />
initiative and experience. As described above, mentors are often new to and confronted<br />
by the issues in the lives of these young people and families. At the same time they are<br />
trying to absorb both the explicit and unspoken culture of human services work. They<br />
are keen to work with more clients, but as already identified, funding issues have<br />
prevented the program from taking on clients due to sustainability questions.<br />
Alternatively, they must demonstrate the initiative that would indicate they could<br />
manage working with more clients.<br />
When these areas are out of balance mentors may perceive a need for even more<br />
support than is consistently offered. In particular, they may want it to always be<br />
offered rather than learning that they can ask for it. They may not yet perceive that<br />
directly asking is not shameful and they will not be judged negatively. In fact, it is a sign<br />
of good practice in human services to recognise limits and seek support, or gain support<br />
for stretching your limits even if this involves possible “mistakes.”<br />
Caseloads<br />
As all mentors needed to complete in-class and on the job training in studying for their<br />
Certificate III, as well as complete other training requirements or opportunities, this<br />
limited their caseload capacity in the first few months of their work to ensure they had<br />
sufficient time to spend with a young person. All mentors have small caseloads initially.<br />
As they complete their training and also demonstrate greater confidence, ability and<br />
independence in the role, their caseloads were increased. People beyond the program did<br />
not always understand this process.<br />
One impact of misunderstanding the role and nature of mentoring for these young people<br />
is the judgement about “how many” young people can be serviced at any point in time and<br />
over what length of time. Some program collaborators questioned whether the program<br />
should have a higher caseload capacity, for example:<br />
None of mine have been picked up because they don’t have enough mentors. I<br />
think they could have 3 clients each, rather than just one per mentor. We are on<br />
a waiting list and this can be frustrating. There is a lack of communication there<br />
and we don’t really know what they are doing or why there is only one client per<br />
mentor in some cases. (<strong>Program</strong> collaborator)<br />
Some advisory group members also suggested that the numbers involved may be<br />
perceived poorly by other agencies who see the number of young people in need and<br />
wonder about the worth of a program that has a slow uptake and then discharge of<br />
clients. In these comments it was apparent that some program collaborators thought<br />
- 68 -
<strong>Panyappi</strong> <strong>Indigenous</strong> <strong>Youth</strong> <strong>Mentoring</strong> <strong>Program</strong> <strong>Evaluation</strong><br />
more mentors were available. Alternatively they acknowledged the resources were very<br />
limited given the need.<br />
At times the intensive nature of the work was not always appreciated, and neither was it<br />
acknowledged that many young people <strong>Panyappi</strong> works with have already been through a<br />
number of workers within a single service, or several previous services that have failed<br />
to engage them or support the family. Quick success is highly unlikely in this<br />
circumstance. Moving young people on too soon can risk sending the young person back<br />
into a repeat cycle before new patterns and family/community supports are established.<br />
Choosing to “mentor beyond the trouble zone” in order to make sustainable gains will<br />
have an impact on caseloads at any point in time, as well as over a period of time.<br />
Another external factor was that in the last 12 months mentors have been ready to<br />
increase their caseload capacity on at least two occasions, and were very keen to do so,<br />
but were faced with a dubious future regarding an accurate accounting of their budget<br />
within DHS and whether there would be further funding for the program. These<br />
situations compromised <strong>Panyappi</strong>’s ability to respond to need, and its reputation with<br />
other workers and services. It could not risk increasing caseloads when it was not<br />
possible to guarantee young people and families an ongoing service. They were aware of<br />
frustration from other program collaborators:<br />
If I don’t have a good mentor or I don’t have any mentors there is nothing I can<br />
do about it and I would rather give no mentor than give one that is not going to<br />
do the job properly because I am only damagi ng that chil d . Some departments<br />
don’t understand that. I look at the bigger picture of the effects that we may<br />
be causing so I think very seriously when I get my referrals in. I’m waiting to do<br />
a recruitment drive, but i t’s<br />
funding again. (<strong>Panyappi</strong> Coordinator)<br />
A range of mentors<br />
There was a consistent theme that having the “right staff” is critical to the success of a<br />
program that is strongly relationship based, such as mentoring. When this did not occur<br />
people told stories of relationship breakdowns and poor staff performance. When this<br />
did occur, then stories reflected all of the themes outlined in the Young people and<br />
family themes section above.<br />
Most of the mentors to date have been relatively young. This has benefits because they<br />
may have better awareness of young people’s issues, being less distant from that stage<br />
in their life, and young people may be more willing to relate to them.<br />
I think it is good having young people working with young people. They know what<br />
these young people are going through. They relate better. It’s important to have<br />
a balance. I think it would be nice to have a varied age group as mentors.<br />
(Advisory Group Member)<br />
It also may have disadvantages when young people would respond better to an older<br />
person or benefit from their increased life wisdom. Exposure to this wisdom may assist<br />
- 69 -
<strong>Panyappi</strong> <strong>Indigenous</strong> <strong>Youth</strong> <strong>Mentoring</strong> <strong>Program</strong> <strong>Evaluation</strong><br />
young people develop some of the strategies they need to cope with their situations:<br />
“Our kids are professiona l at tel lingpeopl e what they want to hear because they have<br />
been doing that to agencies all over the place forever. So they need people who are a<br />
little bit wise, a little bit smarter and sensitive to what the kids need still. So our<br />
experience has been fairly variable” as not all of the mentors have been like this<br />
(<strong>Program</strong> collaborator).<br />
<strong>Mentoring</strong> that occurs naturally through the significant relationships developed as part<br />
of Aboriginal cultural practices encourages young people to have strong connections to<br />
people across a range of ages. “Mentors need resilience and we need a whole range of<br />
mentors like peer age mentors, seniors, elders, mothers, fathers. We need a range of<br />
different types of mentors for different types of kids and different types of stages<br />
that they are at and to meet all of those needs” (<strong>Program</strong> collaborators).<br />
The <strong>Panyappi</strong> Coordinator reported that any future recruitment would aim to gain a<br />
broad range of mentors to achieve this greater diversity. “I have quite a young team and<br />
it would be good to have some maturity in the team, like 40-45 year olds.”<br />
- 70 -
Weaving the Threads Together<br />
Achieving desired program outcomes<br />
<strong>Panyappi</strong> <strong>Indigenous</strong> <strong>Youth</strong> <strong>Mentoring</strong> <strong>Program</strong> <strong>Evaluation</strong><br />
The <strong>Panyappi</strong> outcomes hierarchy in Appendix 1 identifies the thirteen desired outcomes<br />
of the program. The overall goal of a long-term reduction in offending by the client<br />
group cannot be determined at this point for the following reasons:<br />
ω<br />
ω<br />
ω<br />
ω<br />
ω<br />
<strong>Panyappi</strong> was not funded at a level that made it accessible to all young people who<br />
met the target group criteria, as it had a limited number of staff each doing timeintensive<br />
work with a small caseload of young people.<br />
It was also not funded to reach a slightly younger age group where it is possible to<br />
engage in earlier and potentially more effectively preventive efforts that would<br />
intervene in pathways that lead to offending behaviour in young people.<br />
As a pilot program it was also not funded for a sufficient period of time to ensure<br />
that shorter-term success could be sustained through the provision of ongoing,<br />
although gradually reducing, support while further referrals were accepted, ie<br />
“mentoring beyond the trouble zone.” Therefore, it would be difficult to interpret<br />
any changes in the level of offending behaviour evident in available state or regional<br />
statistics as being attributable to the program.<br />
Recommendation 1<br />
Recommendation 2<br />
A longer period of time needs to elapse before this goal can be judged, i.e. three to<br />
five years after the program is functioning at an optimal level, particularly as it is<br />
based on a developmental crime-prevention perspective. 67<br />
An appropriate evaluation framework needs to be agreed and funded in order to<br />
track changes in offending behaviour by the client group that accounts for other<br />
contributing factors that may work for or against that goal – this includes a<br />
consistent and agreed method of defining offending behaviour and a reliable system<br />
of recording it based on this definition that has the cooperation and support of<br />
relevant government departments or agencies. To date, formal and external<br />
evaluation of mentoring programs has been infrequent, limiting what can be learnt. 68<br />
Recommendation 6<br />
Outcomes 1 through 9 are about formative or process issues and have been explored<br />
through the process evaluation work. Outcomes 10 through 13 relate to the impact<br />
evaluation work outcome areas. Achievement of these desired outcomes are described<br />
below based on the evaluation stories.<br />
67 Homel, R. (2000). Blazing the developmental trail: The past, the future and the critics. <strong>Youth</strong> Studies<br />
Australia, 19(1), 44-50.<br />
68 Wilczynski, Culvenor, et al. (2003), op cit, p. 82 & 86.<br />
- 71 -
<strong>Program</strong> process<br />
Interagency collaboration through an Advisory Group<br />
<strong>Panyappi</strong> <strong>Indigenous</strong> <strong>Youth</strong> <strong>Mentoring</strong> <strong>Program</strong> <strong>Evaluation</strong><br />
Interagency collaboration is variable at the Advisory Group level due to differences of<br />
opinion about the location and auspicing arrangements for <strong>Panyappi</strong>, and the disruption<br />
this creates when meetings are held, detracting from commitments to collaboration<br />
made in the early stages of the program. Advisory Group meetings have become<br />
infrequent, especially since mid-2003, and the <strong>Panyappi</strong> Coordinator initiated most<br />
liaisons with Advisory Group members at an individual level on an “as needs” basis. The<br />
viability of the current Advisory Group structure is uncertain and alternatives could be<br />
considered.<br />
Referrals<br />
Since <strong>Panyappi</strong> commenced it has consistently received referrals, although assessments<br />
and service delivery has increased since early 2003. The young people assessed and<br />
considered by <strong>Panyappi</strong> for mentoring support fit the profile originally identified in the<br />
planning of the program back in 2001. Therefore, <strong>Panyappi</strong> has addressed the intended<br />
target group, while also expanding the inner city focus in response to the location shifts<br />
of this group of young people. They arrive with multiple and often serious problems, both<br />
personally and in their immediate networks. Responding to these needs requires multiagency<br />
collaboration (see below), although young people and families can be reluctant to<br />
engage with other services beyond the statutory ones with whom they are obligated to<br />
be involved.<br />
Project Coordinator role<br />
Over the course of the program, three Coordinators were appointed, with the second<br />
Coordinator staying a very brief time. There was a 5 month gap before the third<br />
Coordinator started in February 2003. The opinion of both Advisory Group members and<br />
program funders was that the program was currently managed quite well and gained<br />
strong support from its auspicing agency.<br />
Most criticism related to issues known to be beyond the current program’s control, such<br />
as ensuring sustainability, ongoing effects from previous disruptions in staff, and<br />
limitations on how many young people they can work with due to the time needed to train<br />
staff, and uncertain funding arrangements that compromise any guarantee of an ongoing<br />
service.<br />
Mentors: Recruitment, training and linking with young people<br />
Mentors were recruited and appointed in two main phases. All mentors received several<br />
forms of training:<br />
ω<br />
ω<br />
The Certificate III in Community Services (<strong>Youth</strong> Work) qualification<br />
Orientation training program for new workers in FAYS<br />
- 72 -
ω<br />
ω<br />
ω<br />
<strong>Panyappi</strong> <strong>Indigenous</strong> <strong>Youth</strong> <strong>Mentoring</strong> <strong>Program</strong> <strong>Evaluation</strong><br />
Several training programs relevant to their work area run by the FAYS in-house<br />
training unit, eg mandatory reporting, conflict management<br />
Work placements in other areas of family, youth and juvenile justice services<br />
On-the-job training and mentoring in their work role<br />
Mentors consistently reported that this training was highly valuable and crucial in<br />
ensuring they could perform their work role. They were keen for more opportunities to<br />
do on-the-job training and further work placements to deepen their knowledge of the<br />
services and systems in which their clients are involved. All mentors were linked with<br />
young people, with caseloads varying from 1 to 4 clients depending on confidence,<br />
experience, initiative and capacity.<br />
Case plans<br />
The <strong>Panyappi</strong> Coordinator develops a case plan for all <strong>Panyappi</strong> clients by working with<br />
the mentor, family and other program collaborators where relevant. If another involved<br />
agency has an existing case plan, then the <strong>Panyappi</strong> Coordinator collaborates with this<br />
group and attends case meetings. This plan is reviewed with all parties at regular<br />
intervals to check progress, ensure that goals are suitable and identify alternative or<br />
additional goals. Occasionally some program collaborators felt uncomfortable that<br />
<strong>Panyappi</strong> was stepping into their territory with case planning, a situation that was or<br />
could be resolved through agreement to do mutual case planning.<br />
Relationships between young people and mentors<br />
There was strong evidence from a range of stakeholders that young people valued their<br />
relationships with mentors and grew to trust them, often in ways their family members<br />
or program collaborators had not previously witnessed. This was not always<br />
straightforward to achieve, particularly when there was a history of rejection, poor<br />
treatment or losses for young people, and it was important to allow time for this trust to<br />
develop.<br />
When established, relationships were critical in creating the possibility of change and<br />
building young people’s belief in and motivation to achieve the goals that had been<br />
negotiated with them. With some young people, considerable effort was needed to<br />
maintain good relationships when young people went through difficult times, slipped back<br />
into offending, and became distanced or disheartened.<br />
Where matches were inappropriate a change of mentor was organised. On the occasions<br />
when mentors did not perform their role appropriately, putting the relationship and the<br />
young person’s progress at risk, mentors received assistance to improve their ability to<br />
meet their responsibilities. On the occasions this was not possible, mentors either left<br />
or were dismissed after all human resource processes had been followed. In these<br />
circumstances, the <strong>Panyappi</strong> Coordinator (in particular the first and current one)<br />
stepped in to work with the young person to bridge the gap until another mentor could<br />
be provided.<br />
- 73 -
<strong>Program</strong> outcomes<br />
Multi agency collaboration develops around the young person<br />
<strong>Panyappi</strong> <strong>Indigenous</strong> <strong>Youth</strong> <strong>Mentoring</strong> <strong>Program</strong> <strong>Evaluation</strong><br />
<strong>Panyappi</strong> played a key role in establishing the Inner City Triage Group in order to better<br />
coordinate a response to young people who frequent the inner city area. Although one of<br />
the referral sources for <strong>Panyappi</strong> that could provide useful information on the key<br />
target group, it has been disbanded in favour of a general inner city youth forum which<br />
focuses more on networking rather than cases, although an inner city Aboriginal workers<br />
group is also being supported.<br />
Collaboration in the delivery of direct services appears to be strong in <strong>Panyappi</strong>. <strong>Program</strong><br />
collaborators greatly appreciate access to a unique service that provides a high level of<br />
input into young people who are otherwise likely to disconnect from education and<br />
support services, and further increase the risk they will engage in or be a victim of<br />
crime. <strong>Panyappi</strong> has developed strong relationships with schools in providing everyday<br />
support for young people, and with family support services, especially through MAYT,<br />
but also other government and non-government agencies.<br />
<strong>Panyappi</strong> has also made good use of the MAYT Tutorial Centre for those who do not<br />
attend school, or attend inconsistently. They have worked closely with Tauondi College<br />
at Port Adelaide and Nunga IT at The Parks to provide culturally relevant programs that<br />
build young people’s skills and cultural identity, and, where appropriate, have<br />
collaborated with or utilised MAYT run programs.<br />
Despite these achievements there is still some confusion about the roles and<br />
responsibilities of mentors, the long-term and intensive nature of mentoring, and the<br />
extent of the program resources. This was reflected through reports about and from<br />
program collaborators of unrealistic expectations and inappropriate requests of<br />
mentors, and poor clarification of communication and information-sharing protocols. This<br />
may be restraining the achievement of best possible outcomes in some circumstances.<br />
Positive shift in the young person’s behaviour and attitude regarding offending<br />
<strong>Panyappi</strong> works with young people where there is often an entrenched pattern of<br />
behaviour, even at an early age (by or before 10 years). Both young people and family<br />
members reported a marked change in young people’s offending behaviour. This is clearly<br />
evident in the decreased incidence of offending recorded within the state justice<br />
system’s database for almost all young people (see Figure 9). Where this did not occur it<br />
was because young people could not regularly engage in mentoring as they lived outside<br />
the metropolitan area and only visited it occasionally, or the offending occurred during<br />
their early involvement before they became fully engaged with <strong>Panyappi</strong>. Some young<br />
people with strong histories of offending and incarceration had not offended at all or<br />
only small incidents had occurred in a six-month period. The young people and their<br />
family members considered this remarkable and were proud as well as slightly surprised.<br />
Mentors and program collaborators supported these statements. Along with family<br />
members, they also indicated that young people’s attitudes had started to shift as they<br />
- 74 -
<strong>Panyappi</strong> <strong>Indigenous</strong> <strong>Youth</strong> <strong>Mentoring</strong> <strong>Program</strong> <strong>Evaluation</strong><br />
realised they could succeed in other areas and had other options they could take, apart<br />
from offending. At the same time, program collaborators and <strong>Panyappi</strong> staff reported<br />
and expected there would be hiccoughs and thought it was unreasonable to expect that<br />
young people would turn a corner and never look back within a few months. There was<br />
strong support for ensuring investment in a long-term support program, like <strong>Panyappi</strong>,<br />
that would stay with young people through the ups and downs involved in getting back<br />
and staying on track.<br />
Decreased contact with the juvenile justice system<br />
Anecdotal reports, corroborated from one or more sources, indicated that <strong>Panyappi</strong><br />
clients decreased their contact with the juvenile justice system in terms of their level<br />
of and frequency of offending. This was confirmed through system data with substantial<br />
decreases in formal cautions, orders, family conferences, convictions and detentions,<br />
especially when young people had been involved for 6 or more months. Due to a previous<br />
history of offending it was common that they were still involved in court appearances or<br />
orders. <strong>Panyappi</strong> supported them through and, wherever possible, beyond this period.<br />
Whether this decreased contact is maintained will depend on the capacity to track these<br />
young people’s progress over a longer period of time, which will require ongoing program<br />
and evaluation funding. It is not possible to identify this from the existing data and<br />
many of the young people who have received consistent service in the last year have only<br />
recently left the program or still require further support.<br />
Development of self-discovery and self-determination by the young person and<br />
family<br />
There were consistent reports from a range of stakeholders that young people<br />
developed in their self-belief, and personal and cultural identity during their involvement<br />
with <strong>Panyappi</strong>. Many young people re-engaged with education, whether through schooling<br />
or VET options, started to develop other interests and friendships, and were developing<br />
better relationships with their families.<br />
Family members agreed to be involved with other support agencies to address personal<br />
or family issues, started to improve their skills in responding constructively to their<br />
young people, and became more convinced that their young person was making substantial<br />
changes. They reported experiencing a decrease in stress over time, although they still<br />
had some worries about whether there would be continuing progress, particularly if the<br />
<strong>Panyappi</strong> program was not available.<br />
Due to the initial disruptions in establishing a stable program, most young people have<br />
only had mentoring for a few months (since April 2003 or later), so the work was not<br />
seen as a “complete” process. Young people were hopeful that support would continue for<br />
some time. Family members, mentors and program collaborators believed that if young<br />
people were going to maintain belief in their ability to cope, stay motivated and achieve<br />
their goals, it would depend on further support from <strong>Panyappi</strong> at a similar or reduced<br />
intensity for a further period of time (i.e. at least 6-12 months). If this occurred, they<br />
were more confident that young people would become self-determining.<br />
- 75 -
<strong>Panyappi</strong> <strong>Indigenous</strong> <strong>Youth</strong> <strong>Mentoring</strong> <strong>Program</strong> <strong>Evaluation</strong><br />
Implications for <strong>Indigenous</strong> youth mentoring programs<br />
The evaluation outcomes reinforce many of the issues raised previously in the “A brief<br />
review of mentoring” section that were critical to successful mentoring programs in<br />
general. These include the importance of a clear role for mentoring programs, supporting<br />
mentors so that they are well qualified for their role, positioning mentoring programs<br />
within or at least closely collaborating with youth and family services, building<br />
connection with and supporting young people’s families, targeting geographical areas, and<br />
the role of the <strong>Program</strong> Coordinator. They reinforce the conclusions that were drawn<br />
about the effectiveness of mentoring in a recent national overview of mentoring for<br />
young people at risk of offending. 69 These outcomes also identify issues that are<br />
instructive for <strong>Indigenous</strong> youth mentoring programs such as <strong>Panyappi</strong>.<br />
What mentoring can offer<br />
<strong>Panyappi</strong> highlights that features of an effective mentoring relationship include offering<br />
young people: 70<br />
ω<br />
ω<br />
ω<br />
ω<br />
ω<br />
Personalised attention and care through a one-to-one relationship with an adult who<br />
is willing and able to gain the young person’s trust, demonstrate genuine care and<br />
encourage them to pursue their personal interests<br />
Maintaining this relationship over a significant period of time - the amount of<br />
time/week may slowly reduce based on needs and progress<br />
Resources through access to information, people, opportunities and new experiences<br />
that may be cultural, social or vocational<br />
Support and challenge by having an expectation of young people that they can try to<br />
do things and be successful<br />
Opportunities for reciprocity where young people are active participants in the<br />
relationship by developing goals with mentors, working in small groups where they<br />
support their peers, or even working with those younger than them to share their<br />
learning and skills (although the latter strategy has not yet been trialled through<br />
<strong>Panyappi</strong>).<br />
Recent proposals for supporting <strong>Indigenous</strong> young people via mentoring have focused on<br />
short-term strategies offered as summer holiday programs. 71 These programs are not<br />
necessarily focused on young people who are engaged in or vulnerable to crime, but do<br />
aim to encourage school retention. Although it is likely that these will be valuable, they<br />
will not provide a committed and sustained relationship over a longer period of time that<br />
is required to effectively support the young people with the highest and most complex<br />
needs, such as those in <strong>Panyappi</strong>’s target group (with or without the inner city focus).<br />
69 Wilczynski, Culvenor, et al. (2003), op cit, p. 83.<br />
70 Benard, B. (1992) op cit.<br />
71<br />
South Australian Government (2004). Making the connections: The South Australian Government’s action<br />
strategy to keep young people connected to learning and opportunities. Social Inclusion Unit, Department of<br />
Premier & Cabinet: Adelaide.<br />
- 76 -
<strong>Panyappi</strong> <strong>Indigenous</strong> <strong>Youth</strong> <strong>Mentoring</strong> <strong>Program</strong> <strong>Evaluation</strong><br />
If long-term change is desired in areas such as offending behaviour or engagement with<br />
education, then close attention must be paid to matching the target group to a suitable<br />
mentoring strategy where there is a stronger likelihood of sustainable gains. Experts in<br />
the juvenile justice field believe there is a case for intervention with young offenders –<br />
mentoring is one of the options. 72 Further, consideration must be given to when to<br />
intervene (age), therefore which young people, how many need support, and where they<br />
are based if significant and constructive change is to be achieved.<br />
Working collaboratively – enabling change<br />
Recommendation 1<br />
Recommendation 2<br />
Many evaluation participants identified how <strong>Panyappi</strong>’s work enabled other services to<br />
either become involved or make more headway with the young person and family. This<br />
was an outcome of the mentoring relationship itself, but also a collaborative approach to<br />
the work. The literature on mentoring already points toward greater success from<br />
mentoring when it occurs in conjunction with a range of other health, community, family<br />
and/or education programs.<br />
<strong>Panyappi</strong> has done this through setting up collaborative work with its auspicing body<br />
(MAYT), and by actively building effective working relationships with the other services<br />
and/or people involved in young people’s lives. Future <strong>Indigenous</strong> youth mentoring<br />
programs should consider their auspicing arrangements, location and working<br />
relationships, including Memorandums of Agreement where relevant, in order to set<br />
themselves up for both short-term success and sustainable change.<br />
Gaining advice and support<br />
Recommendation 3<br />
<strong>Evaluation</strong>s of community-based human service programs in <strong>Indigenous</strong> and non-<br />
<strong>Indigenous</strong> areas commonly report problems with standard Advisory Groups, Reference<br />
Groups or Steering Committees that are meant to continue over the life of the program.<br />
The issue is in adopting a “one size fits all” attitude. <strong>Indigenous</strong> youth mentoring<br />
programs should be encouraged to think broadly about different sources and forums for<br />
advice and support, while paying attention to cultural protocols and community issues<br />
that may influence who should be included and how people come together.<br />
Family connections and support<br />
Recommendation 4<br />
All evaluation participants provided consistent endorsement of the value of a program<br />
that supports both young people and families. Not only was this considered culturally<br />
appropriate practice, it was seen as good practice in general to have a connection to and<br />
72<br />
Keogh, T. (2002). Juvenile recidivism: New and surprising possibilities for mental health promotion and<br />
prevention (pp.230-244). In L. Rowling, G. Martin & L. Walker (Eds.). Mental health promotion and young people:<br />
Concepts and practice. Sydney: McGraw Hill.<br />
- 77 -
<strong>Panyappi</strong> <strong>Indigenous</strong> <strong>Youth</strong> <strong>Mentoring</strong> <strong>Program</strong> <strong>Evaluation</strong><br />
impact on families – understanding and influencing young people’s everyday environments.<br />
<strong>Indigenous</strong> youth mentoring programs would be well advised to adopt and promote a<br />
family-inclusive approach, arguing for it in any funding application and ensuring they<br />
were resourced sufficiently to be family-inclusive.<br />
Leadership opportunities<br />
Recommendation 5<br />
<strong>Panyappi</strong> has developed two levels of mentoring, a primary focus on young people and a<br />
secondary focus on the mentors. This has highlighted the importance of supporting new<br />
<strong>Indigenous</strong> workers to develop the confidence and skills to continue with a career in<br />
human services. This may involve formal and informal study, gaining experience in several<br />
human service areas, learning advocacy skills and applying for more senior positions. The<br />
mentors currently with <strong>Panyappi</strong> indicated a desire to contribute to their communities in<br />
this way. It is an example of younger people, the mentors, being supported by more<br />
senior community members in starting to develop the skills to become leaders for their<br />
communities. In turn, the mentors provide a role model to their clients of what could<br />
take place in their future, which brings them back to cultural identity and commitments<br />
and away from destructive behaviour. Although recruitment of <strong>Indigenous</strong> workers was a<br />
deliberate program strategy, the development of leadership skills was not planned and is<br />
an unexpected but welcome outcome.<br />
Building and sustaining Aboriginal employment and leadership in human services is<br />
important for at least three reasons. The Department of Human Services has<br />
acknowledged that they have insufficient Aboriginal workers and need to recruit them.<br />
Aboriginal workers do not always stay in their positions due to a lack of support and<br />
cultural understanding in workplaces, especially if they are isolated workers or small<br />
teams in mainstream organisations. Those people who are current workers tend to be<br />
older, especially those in senior positions, and have been involved for a long period of<br />
time. This results in a gap in the 20-40 year age group, a time when foundations are<br />
created for people to move into leadership and advocacy positions within the human<br />
services and the community.<br />
Recommendation 7<br />
Establishing a new program<br />
Similar to the experience of many Australian mentoring programs, and as a very new<br />
initiative for youth-focused <strong>Indigenous</strong> services in South Australia, it took some time to<br />
establish credibility, build needed partnerships, gain cooperation from key stakeholders,<br />
and consolidate a stable and appropriately skilled staff base. 73 The time and energy<br />
required to do this was recognised by all stakeholders. Once that occurred and <strong>Panyappi</strong><br />
achieved a stable position, it was able to move forward as a program.<br />
73 ibid, p.66.<br />
- 78 -<br />
Recommendation 8
Recommendations<br />
<strong>Panyappi</strong> <strong>Indigenous</strong> <strong>Youth</strong> <strong>Mentoring</strong> <strong>Program</strong> <strong>Evaluation</strong><br />
These outcomes lead to the following recommendations. Recommendations 1 through 6<br />
specifically focus on the <strong>Panyappi</strong> program, while recommendations 7 and 8 apply to<br />
future <strong>Indigenous</strong> youth programs.<br />
Recommendation 1: Ongoing commitment to the program<br />
ω<br />
ω<br />
ω<br />
ω<br />
ω<br />
ω<br />
ω<br />
Develop a long-term funding strategy for <strong>Panyappi</strong> involving two or more partners<br />
from the juvenile justice, crime prevention, and family and community service<br />
sectors, including <strong>Indigenous</strong> based agencies.<br />
Support <strong>Panyappi</strong> to document its model of work to be used as an example of good<br />
practice for both <strong>Indigenous</strong> and non-<strong>Indigenous</strong> youth mentoring programs, as well<br />
as a training tool within and beyond <strong>Panyappi</strong>.<br />
Recommendation 2: Extension of program scope<br />
Sustain the program and expand the funding base so that <strong>Panyappi</strong> has the capacity<br />
and flexibility to respond to a greater range of young people, specifically:<br />
� in other geographical areas of high need, and<br />
� across a wider age group, ie the 6-9 year old group.<br />
Recommendation 3: Strengthening collaborative work<br />
Continue to foster collaborative work with program collaborators beyond the<br />
auspicing agency, including formal memorandums of agreement where relevant.<br />
Develop a training strategy to inform and educate workers in FAYS and those in<br />
other collaborating agencies (government and non-government) to ensure they<br />
understand the:<br />
� role of mentoring,<br />
� responsibilities of mentors,<br />
� contrasts with other areas of work (statutory, education, counselling, etc), and<br />
� implications this has for effective communication and working relationships with<br />
<strong>Panyappi</strong>.<br />
Recommendation 4: An advisory and support function<br />
Explore alternative advisory and support models to the standard Advisory Group, eg<br />
regular information systems to a wider group of interested parties, buddy systems<br />
with one or more key stakeholders, occasional workshop or forums on specific issues,<br />
or invitations to program events or celebrations where discussion forums are built in.<br />
Recommendation 5: Family-inclusive approaches<br />
Maintain a family-inclusive approach in line with culturally appropriate practice.<br />
- 79 -
ω<br />
ω<br />
ω<br />
ω<br />
ω<br />
ω<br />
<strong>Panyappi</strong> <strong>Indigenous</strong> <strong>Youth</strong> <strong>Mentoring</strong> <strong>Program</strong> <strong>Evaluation</strong><br />
Further explore, document and evaluate this approach to assist in understanding its<br />
impact on program outcomes, and as a contribution to the literature on youth<br />
mentoring programs.<br />
Recommendation 6: <strong>Evaluation</strong><br />
Include a budget for evaluation in any future funding of <strong>Panyappi</strong> as it is a unique<br />
program in Australia - there are few independently evaluated youth mentoring<br />
programs and none have been both <strong>Indigenous</strong> run and focused apart from <strong>Panyappi</strong>.<br />
Develop an appropriate evaluation framework that:<br />
� tracks changes in offending behaviour by the client group over time,<br />
� accounts for other contributing factors, and<br />
� uses a consistent and agreed method of defining offending behaviour with a<br />
reliable system of recording it that has the cooperation and support of relevant<br />
government departments or agencies.<br />
Recommendation 7: Encouraging future <strong>Indigenous</strong> leaders<br />
Ensure that a formal mentoring process is provided for <strong>Indigenous</strong> workers taking up<br />
entry-level positions within human service organisations<br />
Develop a process for mentoring of workers at all levels within human service<br />
organisations and offer <strong>Indigenous</strong> workers the option to participate<br />
Recommendation 8: Establishment phase for future <strong>Indigenous</strong> youth programs<br />
Ensure that an establishment phase is built into the budget and plan in the funding<br />
of any future <strong>Indigenous</strong> youth program, and sufficient time is allowed for<br />
establishment to occur before service delivery commences.<br />
- 80 -
Outcome<br />
Formative<br />
or process<br />
Appendix A: <strong>Panyappi</strong> outcomes hierarchy<br />
10. Multi<br />
agency<br />
collaboration<br />
develops<br />
around the<br />
young person<br />
8. Case plan developed<br />
<strong>Panyappi</strong> <strong>Indigenous</strong> <strong>Youth</strong> <strong>Mentoring</strong> <strong>Program</strong> <strong>Evaluation</strong><br />
Long-term reduction in offending by the<br />
client group<br />
11. Positive<br />
shift in the<br />
young persons<br />
behaviour and<br />
attitude reoffending<br />
9.Young people establish trust and value<br />
their relationship with the mentor<br />
7. Mentors linked with young people<br />
6. Mentors training initiated<br />
5. Mentors recruited and<br />
appointed<br />
3. Coordinator appointed<br />
12. Decrease<br />
contact with<br />
the juvenile<br />
justice<br />
system<br />
2. Multi agency commitment and collaboration established -<br />
Advisory Group<br />
1. Need identified and structured into project design - IYMP. Funding<br />
secured<br />
- 81 -<br />
13. Development<br />
of self-discovery<br />
and self<br />
determination by<br />
the young person<br />
and family<br />
4. Referrals<br />
for young<br />
people are<br />
received
Appendix B: Glossary<br />
<strong>Panyappi</strong> <strong>Indigenous</strong> <strong>Youth</strong> <strong>Mentoring</strong> <strong>Program</strong> <strong>Evaluation</strong><br />
Developmental crime prevention: 74,75 Development crime prevention occurs when you<br />
take action to prevent people from being involved in criminal activities by influencing the<br />
attitudes and behaviour of those people most likely to offend. You may reduce the risk<br />
factors that can lead to offending behaviour and increase protective factors that stop<br />
people from being involved in offending. Action often occurs at “transition points” in<br />
young people or people’s lives when they may be more vulnerable to negative influences<br />
or when they need more support and assistance in taking their next step in life.<br />
Actions are more effective if they occur early in the pathway of offending, which may<br />
be earlier in life or early in a person’s contact with the criminal justice system. Actions<br />
are also more effectively if they deal with several different risk or protective factors<br />
at the same time, and work at different levels, such as individuals, families and<br />
communities, including schools. These actions can include parenting programmes, school<br />
enrichment and youth prevention projects, mentoring and helping young people into<br />
training and work.<br />
Early intervention: Service responses that specifically target people who are showing<br />
early signs of a particular health, personal and/or social problem. Without this<br />
intervention, these problems are likely to become increasingly serious and entrenched,<br />
and require long-term services and support, often at high personal, social and financial<br />
costs to individuals, families, communities and societies.<br />
Formal mentoring: Relationships that are arranged through a program or service that<br />
are designed to build trust and offer young people support, care and encouragement<br />
from adults or older peers. This usually occurs when such relationships are not<br />
consistently or sufficiently available in young people’s existing networks in a way that<br />
meets their needs.<br />
Mainstream: When the word “mainstream” is used in this report it refers to human<br />
services, community programs or educational programs/schools that are directed at the<br />
needs of the dominant culture and/or the majority of the population and may not always<br />
take account of specific needs on the basis things such as cultural identity or<br />
ability/disability.<br />
Naturalistic mentoring: Supportive, trusting and caring relationships that young people<br />
develop with older peers or adults in their everyday networks, and may include close or<br />
extended family members, teachers, neighbours, coaches or other community members.<br />
74<br />
National Crime Prevention (1999). Pathways to prevention: Developmental and early intervention approaches<br />
to crime in Australia - Summary volume. National Crime Prevention, Attorney-General’s Department: Canberra.<br />
75<br />
Crime Prevention Unit, SA Attorney Generals’ Department (2002). Early Intervention in Crime Prevention in<br />
South Australia: <strong>Program</strong> Information. http://www.cpu.sa.gov.au/ei_article.pdf<br />
- 82 -