27.11.2012 Views

Panyappi Indigenous Youth Mentoring Program Evaluation

Panyappi Indigenous Youth Mentoring Program Evaluation

Panyappi Indigenous Youth Mentoring Program Evaluation

SHOW MORE
SHOW LESS

Create successful ePaper yourself

Turn your PDF publications into a flip-book with our unique Google optimized e-Paper software.

<strong>Panyappi</strong> <strong>Indigenous</strong> <strong>Youth</strong><br />

<strong>Mentoring</strong> <strong>Program</strong><br />

External <strong>Evaluation</strong> Report<br />

Metropolitan<br />

Aboriginal <strong>Youth</strong> Team<br />

Prepared by:<br />

May 2004


<strong>Panyappi</strong> <strong>Indigenous</strong> <strong>Youth</strong> <strong>Mentoring</strong> <strong>Program</strong>:<br />

External evaluation report<br />

May 2004


© <strong>Panyappi</strong> <strong>Indigenous</strong> <strong>Youth</strong> <strong>Mentoring</strong> <strong>Program</strong><br />

This work is copyright. Apart from any use as permitted under the Copyright Act 1968, no<br />

part may be reproduced by any process without the written permission from the <strong>Panyappi</strong><br />

<strong>Program</strong>. Requests and enquiries concerning reproduction rights should be directed to<br />

<strong>Panyappi</strong> at the contact details listed below.<br />

The opinions expressed in this document are those of the authors and are not necessarily<br />

those of the State Government. This document is designed to provide information to<br />

assist policy and program development in government and non-government organisations.<br />

The National Library of Australia Cataloguing-in-Publication entry:<br />

Stacey, Kathleen.<br />

<strong>Panyappi</strong> <strong>Indigenous</strong> <strong>Youth</strong> <strong>Mentoring</strong> <strong>Program</strong> : external<br />

evaluation report.<br />

ISBN 0 7308 9340 5.<br />

1. <strong>Panyappi</strong> <strong>Indigenous</strong> <strong>Youth</strong> <strong>Mentoring</strong> <strong>Program</strong> - <strong>Evaluation</strong>.<br />

2. <strong>Evaluation</strong> research (Social action programs) - South<br />

Australia - Adelaide. 3. <strong>Indigenous</strong> youth - Services for -<br />

South Australia - Adelaide - <strong>Evaluation</strong>. 4. Aboriginal<br />

Australians - Services for - South Australia - Adelaide -<br />

<strong>Evaluation</strong>. 5. <strong>Mentoring</strong> in social service - South<br />

Australia - Adelaide - <strong>Evaluation</strong>. I. <strong>Panyappi</strong> <strong>Indigenous</strong><br />

<strong>Youth</strong> <strong>Mentoring</strong> <strong>Program</strong>. II. South Australia Dept. of<br />

Human Services. III. Title.<br />

362.849915094231<br />

Additional copies can be obtained by:<br />

Mail: <strong>Panyappi</strong> Coordinator<br />

Metropolitan Aboriginal <strong>Youth</strong> Team<br />

c/- The Parks Community Centre<br />

PO Box 2337<br />

Regency Park SA 5942<br />

Phone: 08 8243 5733<br />

Fax: 08 8243 5744<br />

Email: Lisa.Kambouris@dfc.sa.gov.au<br />

Suggested reference:<br />

beyond…(Kathleen Stacey & Associates) Pty Ltd (2004). <strong>Panyappi</strong> <strong>Indigenous</strong> <strong>Youth</strong><br />

<strong>Mentoring</strong> <strong>Program</strong>: External evaluation report. <strong>Panyappi</strong>, Metropolitan Aboriginal <strong>Youth</strong><br />

Team, SA Department of Human Services: Adelaide.


Contents<br />

Beginning the Story… ...................................................................................................1<br />

Executive Summary......................................................................................................3<br />

The <strong>Panyappi</strong> <strong>Program</strong> ............................................................................................... 10<br />

History of <strong>Panyappi</strong> ........................................................................................................................10<br />

Auspicing arrangement...................................................................................................................13<br />

Staffing structure..........................................................................................................................14<br />

<strong>Program</strong> collaborators....................................................................................................................16<br />

Young people involved with <strong>Panyappi</strong>...........................................................................................16<br />

How <strong>Panyappi</strong> works........................................................................................................................18<br />

A Brief Review of <strong>Mentoring</strong>...................................................................................26<br />

A cultural perspective...................................................................................................................26<br />

Published literature on mentoring: A brief summary ............................................................26<br />

The <strong>Evaluation</strong> Process .............................................................................................30<br />

<strong>Evaluation</strong> purpose .........................................................................................................................30<br />

<strong>Evaluation</strong> plan ................................................................................................................................30<br />

<strong>Evaluation</strong> questions ......................................................................................................................33<br />

The Stories..................................................................................................................34<br />

Painting a picture with numbers..................................................................................................34<br />

Young people and family themes.................................................................................................39<br />

<strong>Program</strong> management themes......................................................................................................52<br />

Being a mentor ................................................................................................................................62<br />

Weaving the Threads Together.............................................................................. 71<br />

Achieving desired program outcomes.........................................................................................71<br />

Implications for <strong>Indigenous</strong> youth mentoring programs.......................................................76<br />

Recommendations .......................................................................................................79<br />

Appendix A: <strong>Panyappi</strong> outcomes hierarchy........................................................... 81<br />

Appendix B: Glossary.................................................................................................82


Beginning the Story…<br />

<strong>Panyappi</strong> <strong>Indigenous</strong> <strong>Youth</strong> <strong>Mentoring</strong> <strong>Program</strong> <strong>Evaluation</strong><br />

<strong>Panyappi</strong> provides intensive support services to a small number of <strong>Indigenous</strong> young<br />

people and families. It is possible that those participating in the evaluation could be<br />

recognised if their actual stories were used, so only short non-identifying quotes are<br />

used in “The stories” section of the report.<br />

To protect their privacy, and given their willingness and generosity of time in<br />

participating, the following ‘story’ has been constructed out of the many different<br />

stories. It provides a description of the journey of many young people involved with<br />

<strong>Panyappi</strong>, although not all elements of the story are the same for all the young people.<br />

Susie is 13 years old and lives at home with both parents and two younger<br />

siblings. She plays a significant role in her family by caring for her younger<br />

siblings, including when her mother is less able to do this because of family<br />

violence. She also cares for her mother at these times. Susie’s father has<br />

regular work, but is a frequent user of yarndi, which is having negative effects<br />

on the whole family.<br />

In recent months Susie has started to spend more time away from home, often<br />

at night. She has been hanging out with a couple of new friends who are visiting<br />

the inner city and experimenting with yarndi. Susie is starting to get drawn into<br />

this other lifestyle. It is both exciting, but also an escape from the troubles at<br />

home and the heavy sense of responsibility she feels.<br />

Although it is common for young women to want to spend more time with their<br />

friends at this age, being with this group of friends means Susie is being<br />

exposed to and encouraged to use yarndi and alcohol. Doing this also exposes<br />

Susie to other risks on the streets, such as approaches by older men and<br />

invitations to go riding in cars. She still goes to school but is becoming more<br />

irregular. This is partly because of the times she cares for her mother and<br />

siblings as the family violence has been worse lately, but also the pull of the new<br />

friendships, which is timeout for her.<br />

Most of Susie’s other family members now live 2-3 hours away in the country, so<br />

connections with people who would offer her support have been interrupted.<br />

Susie was particularly close to her Auntie Lily on her mother’s side, but she has<br />

had to move to be near her grandchildren. Susie has found herself caught<br />

between two worlds, with limited support to help her look after herself. She<br />

often feels lonely, sad and is not sure what to do.<br />

Susie comes to <strong>Panyappi</strong>’s attention in two ways. The school has involved the<br />

regional Attendance Officer, but she is having difficulty getting past the door<br />

at home. By getting these phone calls and home visits her mother now knows<br />

Susie is not going to school consistently and this has created more arguments<br />

between them. Her mother is also unhappy that Susie is not caring for her<br />

younger siblings (aged 5 and 3) when asked. Susie’s mother approached the<br />

- 1 -


<strong>Panyappi</strong> <strong>Indigenous</strong> <strong>Youth</strong> <strong>Mentoring</strong> <strong>Program</strong> <strong>Evaluation</strong><br />

Aboriginal Education Worker (AEW ) at the school and that person told her<br />

about <strong>Panyappi</strong>. The AEW also tells the Attendance Officer about the program,<br />

who follows i t up and makes the referral.<br />

An inner city street worker has also noticed Susie, and her situation was raised<br />

at an Interagency Inner City Triage Meeting established by the <strong>Panyappi</strong><br />

program and the Crime Prevention Unit, State Attorney General’s Department.<br />

<strong>Panyappi</strong> reports they have just received a referral from education. The FAYS<br />

worker at the meeting agrees that Susie is at risk but indicates that FAYS<br />

cannot take her on. He does, however, do a check and reports that Aunt Li ly has<br />

previously rung through to FAYS to raise her concerns about Susie but no action<br />

was taken.<br />

The inner city street worker confirms that Susie has frequented the inner city<br />

more often in recent months, but does not believe she is there regularly enough<br />

to build a consistent relationship with her. She suggests that Susie probably<br />

needs another support option, as her group of friends do not just hang in the<br />

inner city, sometimes going to other places. The SAPOL Officer at the meeting<br />

suggests that she may be hooking up with a group of young people who are<br />

frequenting at least two other places in the metropolitan area late at night.<br />

<strong>Panyappi</strong> agrees to make contact with Susie and her family to see if they can<br />

assess the situation. At the following meeting they report that Susie and the<br />

family agreed, and they have accepted her and allocated a female mentor, Mary.<br />

Mary will work with Susie for 12-15 hours a week initially, and maintain support<br />

for several hours/week for as long as considered appropriate by Susie, her<br />

family and the <strong>Panyappi</strong> program. This may reduce over time according to needs<br />

and progress.<br />

The threads of Susie’s story will be picked up again in “The stories” section, where the<br />

work that <strong>Panyappi</strong> does to assist Susie to consider a different direction for her journal<br />

is described.<br />

Words used in this report<br />

Please note that Appendix B contains a glossary for some of the words used throughout<br />

this report that may be less familiar to readers.<br />

- 2 -


Executive Summary<br />

What is <strong>Panyappi</strong>?<br />

<strong>Panyappi</strong> <strong>Indigenous</strong> <strong>Youth</strong> <strong>Mentoring</strong> <strong>Program</strong> <strong>Evaluation</strong><br />

<strong>Panyappi</strong> 1 is an <strong>Indigenous</strong> youth mentoring service for young people who experience<br />

multiple problems that lead them to frequent inner city or other suburban hangouts,<br />

placing them at risk of being a victim of crime or engaging in offending behaviour.<br />

<strong>Panyappi</strong> aims to:<br />

1. To intervene in pathways of offending behaviour and bring about a positive shift in<br />

each young person’s attitude toward offending and in their behaviour.<br />

2. To decrease each young participant’s contact with the juvenile justice system and/or<br />

agencies associated with this system.<br />

3. To promote self-discovery and self-determination by young people participating in<br />

the program their family and wider community.<br />

4. To work collaboratively with all agencies that have mutual responsibility for resolving<br />

the young person’s difficulties.<br />

Most of the young people with whom <strong>Panyappi</strong> works are disengaging or already<br />

disengaged from education, have a high rate of social-emotional issues, and often engage<br />

in substance misuse. At least half of these young people are involved with FAYS and/or<br />

the juvenile justice system. They are unlikely to engage with mainstream youth<br />

mentoring programs, particularly on a voluntary basis, or with other youth groups or<br />

youth support services. They require longer-term, consistent, regular and more intense<br />

support in order to build trust, foster their personal resilience, and assist them to gain<br />

stability, a positive personal identity and constructive direction for their lives.<br />

Although it began in July 2001, like many pilot initiatives tackling a difficult issue<br />

<strong>Panyappi</strong> experienced disruptions during its establishment. Initially this was due to<br />

disagreement about the program focus, location, auspicing arrangements, and an<br />

insufficient funding base. The funding issue led to staffing the program with trainees<br />

only as mentors, rather than more experienced workers, which proved inappropriate and<br />

drew the Coordinator’s time away from service development. After making progress by<br />

March 2002, there were two quick changes of Coordinator resulting in an extended<br />

break in service in 2002. The program was stabilised in February 2003 and since then<br />

has functioned more smoothly, strengthened collaborative work with other agencies/<br />

services, and provided consistent mentoring services for young people and families.<br />

Evaluating <strong>Panyappi</strong><br />

<strong>Panyappi</strong> was evaluated through a series of personal interviews and focus groups with all<br />

key stakeholders, including young people, family members, program staff, program<br />

collaborators, program funders and Advisory Group Members. <strong>Program</strong> statistics, client<br />

demographics and program documentation were also reviewed and analysed. This<br />

1 This is a Kaurna word meaning younger brother or sister. It is pronounced “bunyip + ee.”<br />

- 3 -


<strong>Panyappi</strong> <strong>Indigenous</strong> <strong>Youth</strong> <strong>Mentoring</strong> <strong>Program</strong> <strong>Evaluation</strong><br />

provided a detailed picture of the journey of <strong>Panyappi</strong> and the progress it has made<br />

toward achieving its aims.<br />

<strong>Panyappi</strong>’s model of practice<br />

It became apparent that there were a number of important features in <strong>Panyappi</strong>’s model<br />

of practice that supported it to achieve its aims. They included:<br />

ω<br />

ω<br />

ω<br />

ω<br />

ω<br />

ω<br />

ω<br />

Having a formal rather than naturalistic mentoring process using a case management<br />

approach, where young people participate voluntarily in the program<br />

Focusing on the individual needs of young people<br />

Providing support beyond the “while the young person is in trouble” period and<br />

extending into the “consolidating new connections and commitments” period where<br />

young people are doing well and keeping their lives on a positive track - mentoring<br />

beyond the trouble zone<br />

Employing paid mentors who have quality training, professional development<br />

opportunities, and regular supervision and support<br />

Working from a developmental perspective by focusing on a lower age group, i.e. 10-<br />

14 years, who are already involved in offending behaviours and have disconnected<br />

from education<br />

Rebuilding and strengthening family connections as an important aspect of culturally<br />

appropriate practice in mentoring – this contrasts with mainstream mentoring<br />

programs that do not engage with families as standard practice<br />

Focusing on target geographical areas and developing collaborations with local key<br />

stakeholders to collectively address the problems <strong>Indigenous</strong> young people are<br />

experiencing and the issues this raises for the local community<br />

Progress toward desired program outcomes<br />

<strong>Panyappi</strong> has made substantial progress toward the desired program outcomes, despite<br />

the disruptions it experienced through the program establishment period, the loss of<br />

two coordinators and subsequent breaks in service. The collective opinion of evaluation<br />

participants was that <strong>Panyappi</strong> became a mentoring service in early 2003, so has only had<br />

just over 12 months to directly address the program aims. There was confidence that<br />

further outcomes could be achieved with more consistent support and committed<br />

funding, which could be tracked if this included resources for ongoing evaluation.<br />

Managing the program<br />

Advisory group members, program funders and collaborators reported the program was<br />

currently managed well and gained strong support from its auspicing agency. Most<br />

criticism related to issues known to be beyond the current program’s control. This<br />

includes the difficulty in ensuring program sustainability and continuity of service for<br />

young people, some ongoing effects from previous disruptions in staff, and limitations on<br />

how many young people they can work with due to the time needed to train staff.<br />

<strong>Panyappi</strong>’s experience mirrors the evidence on program targeting young offenders, where<br />

- 4 -


<strong>Panyappi</strong> <strong>Indigenous</strong> <strong>Youth</strong> <strong>Mentoring</strong> <strong>Program</strong> <strong>Evaluation</strong><br />

it is common for there to be a longer than expected period of time required to establish<br />

the program and develop effective partnerships, as well as to work with young people<br />

who are often uncertain about engaging and face multiple and complex issues.<br />

Reaching the target group<br />

The young people assessed and considered by <strong>Panyappi</strong> for mentoring support fit the<br />

profile originally identified for the program – described above. Most have multiple and<br />

serious problems to deal with, individually and within their families, which have often<br />

been longstanding issues. Therefore, <strong>Panyappi</strong> has addressed the intended target group,<br />

while also expanding the inner city focus in response to the location shifts of this group<br />

of young people.<br />

Supporting the mentors<br />

Mentors highly valued training and supervision support, seeing it as crucial to performing<br />

their roles. Some were keen to do further work placements and work in buddy systems<br />

with youth workers as part of their on-the-job training to deepen their knowledge of<br />

the services and systems in which their clients are involved. Some mentors wanted more<br />

supervision and support, which the Coordinator was keen to provide but was compromised<br />

by the multiple pressures of the role including efforts to obtain ongoing program<br />

funding.<br />

Mentors indicated an interest in continuing their mentoring work, but also doing further<br />

study, and progressing toward different jobs or more senior positions in the human<br />

services sector. This demonstrated the value of <strong>Panyappi</strong>’s two-level system of<br />

mentoring where their efforts to recruit and train <strong>Indigenous</strong> workers meant that they<br />

would be retained in the human services sector. It also highlighted the potential for<br />

<strong>Panyappi</strong> to nurture and encourage <strong>Indigenous</strong> workers who may taken on leadership<br />

positions in the human services sector and/or their communities.<br />

All mentors were linked with young people, with caseloads varying from 1 to 4 clients<br />

depending on confidence, experience, initiative and capacity. Their work was guided by a<br />

case plan developed by <strong>Panyappi</strong> in partnership with the young person, family, and, where<br />

relevant, other program collaborators. Occasionally some program collaborators felt<br />

uncomfortable that <strong>Panyappi</strong> was stepping into their territory with case planning, a<br />

situation that was or could be resolved through agreement to do mutual case planning.<br />

The value of mentoring relationships<br />

There was strong evidence from a range of evaluation participants that young people<br />

valued their relationships with mentors and grew to trust them, often in ways their<br />

family members or program collaborators had not previously witnessed. This was not<br />

always straightforward to achieve, particularly when there was a history of rejection,<br />

poor treatment or losses for young people, and it was important to allow time for this<br />

trust to develop.<br />

- 5 -


<strong>Panyappi</strong> <strong>Indigenous</strong> <strong>Youth</strong> <strong>Mentoring</strong> <strong>Program</strong> <strong>Evaluation</strong><br />

On a few occasions mentors had not performed their role appropriately, putting the<br />

relationship and young people’s progress at risk and drawing criticism from program<br />

collaborators. The <strong>Panyappi</strong> Coordinator addressed this by supporting mentors to<br />

improve their ability to meet their responsibilities, and, if necessary, reconsider their<br />

appropriateness for the role, or stepping in to work with the young person to bridge the<br />

gap until another mentor could be provided.<br />

Interagency collaboration<br />

Interagency collaboration has been variable at the Advisory Group level due to<br />

differences of opinion about the location and auspicing arrangements for <strong>Panyappi</strong>, and<br />

the disruption this creates when meetings are held, detracting from commitments to<br />

collaboration made in the early stages of the program. The viability of the current<br />

Advisory Group structure is uncertain and alternatives could be considered.<br />

In contrast, collaboration in the delivery of direct services appears to be strong.<br />

<strong>Program</strong> collaborators greatly appreciate access to a unique service that provides a high<br />

level of input into young people who are otherwise likely to disconnect from education<br />

and support services, and further increase the risk they will engage in or be a victim of<br />

crime. <strong>Panyappi</strong> has developed strong relationships with schools in providing everyday<br />

support for young people, and with family support services, especially through MAYT,<br />

but also other government and non-government agencies.<br />

Criticisms appeared to be based on confusion about the roles and responsibilities of<br />

mentors, the long-term and intensive nature of mentoring, and the extent of the<br />

program resources. This was reflected through reports about and from program<br />

collaborators of unrealistic expectations and inappropriate requests of mentors, and<br />

poor clarification of communication and information-sharing protocols. This may be<br />

restraining the achievement of best possible outcomes in some circumstances.<br />

Influencing young people’s attitudes and behaviour toward offending<br />

Both young people and family members reported a marked positive change in young<br />

people’s offending behaviour, which was supported by the justice system’s database that<br />

tracks and reports young people’s offending activity. Some young people with strong<br />

histories of offending and incarceration had not offended at all or only small incidents<br />

had occurred in a six-month period, often in the earlier stages of their work with<br />

<strong>Panyappi</strong>. The young people and their family members considered this remarkable and<br />

were proud as well as slightly surprised. Mentors and program collaborators supported<br />

these statements. Along with family members, they also indicated that young people’s<br />

attitudes had started to shift as they realised they could succeed in other areas and<br />

had other options they could take apart from offending.<br />

As would be expected for young people who have developed entrenched negative<br />

patterns, there were hiccoughs in this process. <strong>Evaluation</strong> participants were very keen<br />

that an investment was made in a long-term support program, like <strong>Panyappi</strong>, that would<br />

stay with young people through the ups and downs involved in getting back and staying on<br />

track.<br />

- 6 -


<strong>Panyappi</strong> <strong>Indigenous</strong> <strong>Youth</strong> <strong>Mentoring</strong> <strong>Program</strong> <strong>Evaluation</strong><br />

Decreasing young people’s contact with the juvenile justice system<br />

It was apparent from the range of qualitative data gained, that <strong>Panyappi</strong> clients<br />

decreased their contact with the juvenile justice system in terms of their level of and<br />

frequency of offending. This was confirmed through system data with substantial<br />

decreases in formal cautions, court orders, family conferences and convictions. Due to a<br />

previous history of offending it was common that some young people were still involved in<br />

court appearances or orders. <strong>Panyappi</strong> supported them through and, wherever possible,<br />

beyond this period. Whether this decreased contact is maintained will depend on the<br />

capacity to track these young people’s progress over a longer period of time, which will<br />

require ongoing program and evaluation funding.<br />

Supporting self-discovery and self-determination by young people and families<br />

There were consistent reports from a range of stakeholders that young people<br />

developed in their self-belief, and personal and cultural identity during their involvement<br />

with <strong>Panyappi</strong>. Many young people re-engaged with education, whether through schooling<br />

or VET options, started to develop other interests and friendships, and were developing<br />

better relationships with their families. Family members agreed to be involved with<br />

other support agencies to address personal or family issues, started to improve their<br />

skills in responding constructively to their young people, and became more convinced<br />

that their young person was making substantial changes. They reported experiencing a<br />

decrease in stress over time. They valued the way in which <strong>Panyappi</strong> included and<br />

supported them in the process.<br />

Family members, mentors and program collaborators believed that if young people were<br />

going to maintain belief in their ability to cope, stay motivated and achieve their goals, it<br />

would depend on further support from <strong>Panyappi</strong> at a similar or reduced intensity for a<br />

further period of time (i.e. at least 6-12 months). If this occurred, they were more<br />

confident that young people would become self-determining.<br />

Recommendations<br />

These outcomes lead to the following recommendations. Recommendations 1 through 6<br />

specifically focus on the <strong>Panyappi</strong> program, while recommendations 7 and 8 apply to<br />

future <strong>Indigenous</strong> youth programs.<br />

Recommendation 1: Ongoing commitment to <strong>Panyappi</strong><br />

ω<br />

ω<br />

Develop a long-term funding strategy for <strong>Panyappi</strong> involving two or more partners<br />

from the juvenile justice, crime prevention, and family and community service<br />

sectors, including <strong>Indigenous</strong> based agencies.<br />

Support <strong>Panyappi</strong> to document its model of work to be used as an example of good<br />

practice for both <strong>Indigenous</strong> and non-<strong>Indigenous</strong> youth mentoring programs, as well<br />

as a training tool within and beyond <strong>Panyappi</strong>.<br />

- 7 -


Recommendation 2: Extension of program scope<br />

ω<br />

ω<br />

ω<br />

ω<br />

ω<br />

ω<br />

ω<br />

ω<br />

<strong>Panyappi</strong> <strong>Indigenous</strong> <strong>Youth</strong> <strong>Mentoring</strong> <strong>Program</strong> <strong>Evaluation</strong><br />

Sustain the program and expand the funding base so that <strong>Panyappi</strong> has the capacity<br />

and flexibility to respond to a greater range of young people, specifically:<br />

� in other geographical areas of high need, and<br />

� across a wider age group, ie the 6-9 year old group.<br />

Recommendation 3: Strengthening collaborative work<br />

Continue to foster collaborative work with program collaborators beyond the<br />

auspicing agency, including formal memorandums of agreement where relevant.<br />

Develop a training strategy to inform and educate workers in FAYS and those in<br />

other collaborating agencies (government and non-government) to ensure they<br />

understand the:<br />

� role of mentoring,<br />

� responsibilities of mentors,<br />

� contrasts with other areas of work (statutory, education, counselling, etc), and<br />

� implications this has for effective communication and working relationships with<br />

<strong>Panyappi</strong>.<br />

Recommendation 4: An advisory and support function<br />

Explore alternative advisory and support models to the standard Advisory Group, eg<br />

regular information systems to a wider group of interested parties, buddy systems<br />

with one or more key stakeholders, occasional workshop or forums on specific issues,<br />

or invitations to program events or celebrations where discussion forums are built in.<br />

Recommendation 5: Family-inclusive approaches<br />

Maintain a family-inclusive approach in line with culturally appropriate practice.<br />

Further explore, document and evaluate this approach to assist in understanding its<br />

impact on program outcomes, and as a contribution to the literature on youth<br />

mentoring programs.<br />

Recommendation 6: <strong>Evaluation</strong><br />

Include a budget for evaluation in any future funding of <strong>Panyappi</strong> as it is a unique<br />

program in Australia - there are few independently evaluated youth mentoring<br />

programs and none have been both <strong>Indigenous</strong> run and focused apart from <strong>Panyappi</strong>.<br />

Develop an appropriate evaluation framework that:<br />

� tracks changes in offending behaviour by the client group over time,<br />

� accounts for other contributing factors, and<br />

- 8 -


<strong>Panyappi</strong> <strong>Indigenous</strong> <strong>Youth</strong> <strong>Mentoring</strong> <strong>Program</strong> <strong>Evaluation</strong><br />

� uses a consistent and agreed method of defining offending behaviour with a<br />

reliable system of recording it that has the cooperation and support of relevant<br />

government departments or agencies.<br />

Recommendation 7: Encouraging future <strong>Indigenous</strong> leaders<br />

ω<br />

ω<br />

ω<br />

Ensure that a formal mentoring process is provided for <strong>Indigenous</strong> workers taking up<br />

entry-level positions within human service organisations<br />

Develop a process for mentoring of workers at all levels within human service<br />

organisations and offer <strong>Indigenous</strong> workers the option to participate<br />

Recommendation 8: Establishment phase for future <strong>Indigenous</strong> youth programs<br />

Ensure that an establishment phase is built into the budget and plan in the funding<br />

of any future <strong>Indigenous</strong> youth program, and sufficient time is allowed for<br />

establishment to occur before service delivery commences.<br />

- 9 -


The <strong>Panyappi</strong> <strong>Program</strong><br />

<strong>Panyappi</strong> <strong>Indigenous</strong> <strong>Youth</strong> <strong>Mentoring</strong> <strong>Program</strong> <strong>Evaluation</strong><br />

<strong>Panyappi</strong> means “younger brother or sister” and is an <strong>Indigenous</strong> youth mentoring<br />

program that operates in a crime prevention context. Theory and practice in the<br />

mentoring and crime prevention fields, together with culturally appropriate practice in<br />

human services work, guide the design and conduct of <strong>Panyappi</strong>. This is reflected in its<br />

aims:<br />

1. To intervene in pathways of offending behaviour and bring about a positive shift in<br />

each young person’s attitude toward offending and in their behaviour.<br />

2. To decrease each young participant’s contact with the juvenile justice system and/or<br />

agencies associated with this system.<br />

3. To promote self-discovery and self-determination by young people participating in<br />

the program their family and wider community.<br />

4. To work collaboratively with all agencies that have mutual responsibility for resolving<br />

the young person’s difficulties.<br />

History of <strong>Panyappi</strong><br />

Why this program? 2<br />

The idea behind <strong>Panyappi</strong> emerged in 1999 as a response to the recurring problem of<br />

Aboriginal young people frequenting the inner city area of Adelaide and their<br />

involvement in a range of crimes, particularly on weekends. There was also concern about<br />

the risks that young people faced by being in the inner city late at night and engaging in<br />

criminal activity that may involve older people. The Metropolitan Aboriginal <strong>Youth</strong> Team<br />

(MAYT), an Aboriginal-focused youth program within Family and <strong>Youth</strong> Services (FAYS),<br />

Department of Human Services (DHS) discussed these issues with the Crime Prevention<br />

Unit of the State Attorney General’s Department. These discussions led to MAYT<br />

developing and submitting an initial proposal to the Attorney General’s Department in<br />

early 2000 for a 12-month mentoring program to work with the identified target group.<br />

Following in principal approval of the project in June 2000, a Project Management Group<br />

was formed. It was later known as the “Funders Group” to more accurately reflect its<br />

role, as a Project Advisory Group was also formed to support and guide the project with<br />

representation sought from a range of stakeholders in the justice, youth and community<br />

field. The Advisory Group had its inaugural meeting in November 2000. During 2000, the<br />

Funders Group engaged in detailed project planning, which led to a number of changes to<br />

the original proposal. For example, the establishment of a youth facility in the city area<br />

was dropped for several reasons, including practicality and cost effectiveness. There<br />

was a shift away from exclusively working after hours with young people, as there were<br />

existing youth services operating after hours with young people in the city and<br />

mentoring requires engagement with young people at different times, including day time.<br />

2 Crime Prevention Unit (2002). <strong>Panyappi</strong> Stage One Report. South Australian Attorney General’s Department:<br />

Adelaide, pp.4-5.<br />

- 10 -


<strong>Panyappi</strong> <strong>Indigenous</strong> <strong>Youth</strong> <strong>Mentoring</strong> <strong>Program</strong> <strong>Evaluation</strong><br />

The group also recognised that mentoring, especially with this group of young people,<br />

was a process that required a long-term commitment in order to achieve desired<br />

personal emotional and behavioural change. They put a submission to the national<br />

mentoring program funded by the Australian Attorney General’s Department as part of<br />

the national crime prevention program. This enabled the project to be funded for two<br />

years so it could establish appropriate policies and practices and develop an effective<br />

model for working with this group of young people. Following submission in January 2001<br />

a funding agreement was reached with the Australian Government in October 2001. The<br />

State Attorney General’s Department, Crime Prevention Unit also committed funds, and<br />

FAYS indicated it would, although the final outcome did not prove adequate (see below).<br />

Why mentoring? 3<br />

There are several possible responses to the issue of Aboriginal young people frequenting<br />

the inner city area of Adelaide. Some of these response options already exist, such as<br />

street work with young people in general or specifically with Aboriginal young people. In<br />

this instance, mentoring was chosen because it was seen as more likely to facilitate an<br />

effective intervention that moved beyond a crisis or short-term response to achieve<br />

outcomes that can be sustained over the long-term. A summary of reasons is:<br />

ω<br />

ω<br />

ω<br />

ω<br />

ω<br />

<strong>Mentoring</strong> usually focuses on one-on-one engagement with young people, thereby<br />

providing the opportunity to develop a relationship where the young person’s<br />

concerns, experiences and issues can be shared, and assistance and support provided<br />

by Mentors<br />

Mentors can act as role models, demonstrating and encouraging non-offending<br />

behaviours and moderating negative peer influences<br />

Mentors can provide a service to the young person in a wide variety of environments<br />

such as at school or on the street where the young person hangs out<br />

Mentors can also act as a bridge between the young person and services, providing<br />

advice, referral and advocacy<br />

Mentors have greater capacity to develop a relationship wider than the young<br />

person, establishing links with the family and peers<br />

This is based on the assumption that an effective relationship is established between a<br />

young person and the mentor demonstrated by trust and mutual respect between both<br />

parties. It was believed that the development of an effective relationship would lead to<br />

the young person moderating their offending behaviour.<br />

<strong>Mentoring</strong> is supported by research findings that identify mentoring as a “promising”<br />

crime prevention strategy. 4 <strong>Mentoring</strong> is also seen as having particular application in<br />

Aboriginal communities as it is compatible with the cultural tradition of older people in<br />

3 ibid, p.4.<br />

4 Lawrence, S. et al. (1997). Preventing crime: What works, what doesn’t, what’s promising? University of<br />

Maryland.<br />

- 11 -


<strong>Panyappi</strong> <strong>Indigenous</strong> <strong>Youth</strong> <strong>Mentoring</strong> <strong>Program</strong> <strong>Evaluation</strong><br />

the community providing guidance and transferring knowledge to younger members in the<br />

community (please see “A brief review of mentoring: A cultural perspective” below).<br />

<strong>Mentoring</strong> as a crime prevention approach is supported in the literature and research on<br />

developmental and early intervention approaches to crime prevention. This approach<br />

identifies risk and protective factors influencing an interrelated life pathway. A<br />

developmental prevention strategy will seek to reduce risk factors and promote<br />

protective factors. Identified protective factors include meeting a significant person<br />

and a supportive relationship with another adult 5 (please see “A brief review of<br />

mentoring: Published literature on mentoring” below). These ideas are consistent with<br />

literature on the development of resilience in young people where a stable and<br />

supportive relationship with a significant adult fosters coping and resilience. 6,7<br />

Deciding on the auspicing agency<br />

Since the early days of the Advisory Group there has been discussion about the location<br />

of the <strong>Panyappi</strong> program, with several people arguing that it should be auspiced by a<br />

community agency. At the same time there was acknowledgement that ever since the<br />

initial ideas for the program MAYT has been a key player in discussing the issues and<br />

developing proposals for its design and implementation. MAYT were highly familiar with<br />

the group of young people targeted in <strong>Panyappi</strong>, as they worked with many of them, their<br />

families and the community across their range of programs. They also were seen as<br />

having the capacity to offer strong infrastructure support and a track record with<br />

providing mentoring programs to Aboriginal young people. 8 This issue was tracked<br />

through the early internal evaluation of the program conducted by the Crime Prevention<br />

Unit in the State Attorney General’s Department and was revisited during Advisory<br />

Group meetings in 2002.<br />

Following the unexpected and quick loss of the 2 nd <strong>Panyappi</strong> Coordinator in September<br />

2002, the issue of <strong>Panyappi</strong>’s location was explored again at a specially convened<br />

Advisory Group about the future of the program in October 2002. 9 The Crime<br />

Prevention Unit agreed to develop a short discussion paper on a process for deciding<br />

whether the program should be transferred to a community organisation and what model<br />

would be used for this process. This was provided in early 2003. There was inconsistent<br />

attendance at meetings scheduled during this year, so Advisory Group members did not<br />

respond to the paper, discuss the issue in detail or formally recommend that the matter<br />

be pursued. Due to this history the location of <strong>Panyappi</strong> was raised as a question during<br />

the external evaluation.<br />

5 National Crime Prevention (1999). Pathways to Prevention: Developmental and early intervention approaches<br />

to crime in Australia. National Crime Prevention, Australian Attorney General’s Department: Canberra<br />

6 Garbarino, J., Dubrow, N., Kostelny, K., & Pardo, C. (1992). Children in danger: Coping with the consequences<br />

of community violence. San Francisco: Jossey-Bass.<br />

7<br />

Rutter, M. (1999). Resilience concepts and findings: Implications for family therapy. Journal of Family Therapy, 21, 119-144.<br />

8 Crime Prevention Unit (2002), op cit, p.10.<br />

9 Crime Prevention Unit (2003). <strong>Panyappi</strong> Stage Three Report. South Australian Crime Prevention Unit: Adelaide.<br />

- 12 -


<strong>Program</strong> funding<br />

<strong>Panyappi</strong> <strong>Indigenous</strong> <strong>Youth</strong> <strong>Mentoring</strong> <strong>Program</strong> <strong>Evaluation</strong><br />

<strong>Panyappi</strong> commenced operating in July 2001 based on collaborative funding that involved<br />

three partners:<br />

ω<br />

ω<br />

ω<br />

A 2 year grant from the Commonwealth Attorney General’s National Crime<br />

Prevention Unit for January 2002 – January 2004<br />

A grant from State Attorney General’s Department, Crime Prevention Unit for the<br />

same period to match this funding and support the program<br />

In-kind support and a small grant from Family and <strong>Youth</strong> Services, DHS<br />

Of the 24 programs funded by the Commonwealth it was one of only two programs<br />

targeting <strong>Indigenous</strong> young people. It is one of few mentoring programs in Australia that<br />

has a dedicated crime prevention focus. 10,11 Although <strong>Panyappi</strong> shares the main functions<br />

of mentoring and role model programs – “inspiration, setting an example and providing<br />

personalised support” 12 - it is developing a unique model for a mentoring program that<br />

also has unique challenges (see “The <strong>Panyappi</strong> program: How <strong>Panyappi</strong> works” below).<br />

Auspicing arrangement<br />

<strong>Panyappi</strong> is auspiced by MAYT, the only youth and Aboriginal specific government funded<br />

program in DHS and South Australia. MAYT is committed to developing and maintaining<br />

“a strong and supportive team ethic that respects and nurtures cultural identity and<br />

culturally appropriate ways of working.” 13 The key intentions of MAYT are:<br />

To support young people to reconnect with families, community, culture and<br />

education and, wherever possible, prevent them from becoming involved or reinvolved<br />

with the juvenile justice and social welfare systems. 14<br />

MAYT operates several programs in order to serve Aboriginal young people and families<br />

involved with FAYS, including a Juvenile Justice <strong>Program</strong>, Family Placement Coordinator,<br />

Family Worker, Drug and Alcohol Worker and Tutorial <strong>Program</strong>. It has recently been<br />

successful in gaining additional state funding to develop a full Family Team, ie 4 new<br />

workers in addition to an existing family worker. MAYT provides the following in-kind<br />

support (~$123K) for <strong>Panyappi</strong> to give it a strong infrastructure and collegial base:<br />

10 ARTD (1999/2001). Interim literature review for the mentoring as a crime prevention strategy pilot project.<br />

Sydney: Crime Prevention Division, NSW Attorney General’s Department.<br />

11 Wilczynski, A. (2002). A national audit review of mentoring projects for young offenders: Preliminary<br />

findings. Paper presented at the Crime Prevention Conference convened by the Australian Institute of<br />

Criminology and the Crime Prevention Branch, Commonwealth Attorney-General’s Department, Sydney.<br />

12 MacCallum, J. & Beltman, S. (2002). Role models for young people: What makes an effective role model<br />

program. National <strong>Youth</strong> Affairs Research Scheme: Hobart, p.63.<br />

13<br />

Stacey, K. (2003). MAYT - Metropolitan Aboriginal <strong>Youth</strong> Team: A metropolit an wide and community based<br />

initiative. Site visit report for the School Retention Reference. Social Inclusion Unit, SA Department of<br />

Premier & Cabinet: Adelaide, p.1.<br />

14 ibid, p.2.<br />

- 13 -


ω<br />

ω<br />

ω<br />

ω<br />

ω<br />

ω<br />

ω<br />

ω<br />

ω<br />

ω<br />

Offices and furniture, group room and meeting facilities<br />

<strong>Panyappi</strong> <strong>Indigenous</strong> <strong>Youth</strong> <strong>Mentoring</strong> <strong>Program</strong> <strong>Evaluation</strong><br />

Reception and administrative support, including office supplies, postage and<br />

photocopying<br />

Supervision of the Coordinator position<br />

Access to a vehicle<br />

Access to FAYS and MAYT training opportunities<br />

Inclusion of the <strong>Panyappi</strong> Coordinator in the MAYT management team to strengthen<br />

program cooperation<br />

Inclusion of <strong>Panyappi</strong> staff in MAYT team meetings and planning days to complement<br />

and integrate program operations<br />

Cooperative working relationships, especially with the Family, and Drug and Alcohol<br />

workers<br />

Development of joint programs for MAYT and <strong>Panyappi</strong> clients where appropriate<br />

$33K/year of direct funding over the two year grant period<br />

Staffing structure<br />

Original staffing structure<br />

At the time of appointing the first coordinator in July 2001, the recommended staffing<br />

structure included a <strong>Program</strong> Coordinator at the ASO5 level and then a budget allocation<br />

for mentors that could be divided as considered appropriate. The first round of mentor<br />

recruitment in October 2001 identified six suitable mentors who took up positions as<br />

outlined in Figure 1.<br />

2.6 Mentors – OPS1<br />

(Part-time)<br />

Revised staffing structure<br />

Figure 1: Original staffing structure<br />

MAYT – Auspicing agency<br />

Coordinator – ASO5<br />

3 Mentors – OPS1<br />

(Trainees)<br />

The original staffing structure was maintained during the 2001-2002 period while the 1 st<br />

Coordinator (July 2001 - March 2002) and 2 nd Coordinator (July 2002 – September<br />

2002) were managing the program. In February 2003, when the 3 rd Coordinator started,<br />

- 14 -


<strong>Panyappi</strong> <strong>Indigenous</strong> <strong>Youth</strong> <strong>Mentoring</strong> <strong>Program</strong> <strong>Evaluation</strong><br />

the staffing structure was reviewed. A decision was taken to create a Mentor Support<br />

Worker position to provide a viable career path for the mentors, and support both the<br />

mentors and the Coordinator in the ‘day-to-day’ running of the program. In addition<br />

there would be other specific tasks, such as monitoring the case management approach<br />

designed for <strong>Panyappi</strong>. This position was made possible through salary savings from the<br />

two time periods during which the Coordinator position was unfilled. The intention was to<br />

fill the position in July 2003. The revised structure is outlined in Figure 2.<br />

1 Mentor Support<br />

Worker – OPS2<br />

Current staffing structure<br />

Figure 2: Revised staffing structure<br />

MAYT – Auspicing agency<br />

Coordinator – ASO5<br />

2.6 Mentors – OPS1<br />

(Part-time)<br />

3 Mentors – OPS1<br />

(Trainees)<br />

During mid-late 2003 some mentors left <strong>Panyappi</strong> for other positions. With the funding<br />

period due to end in January 2004 these positions were not immediately filled, as new<br />

people would start a process with young people that they could not see through for a<br />

sufficient period of time. It was decided that the new OPS2 mentor position was more<br />

appropriately classified as OPS3, and MAYT provided additional funding to establish<br />

that position in September 2003, planning to absorb this cost into the ongoing <strong>Panyappi</strong><br />

budget, once that is clarified. Due to salary savings, the program could continue through<br />

to June 2004 so its future and budget remains uncertain until that time. The current<br />

staffing structure is outlined in Figure 3.<br />

$<br />

1 Senior Mentor –<br />

OPS3<br />

Figure 3: Current staffing structure<br />

MAYT – Auspicing agency<br />

Coordinator – ASO5<br />

1.6 Mentors – OPS1<br />

(Full and part-time)<br />

- 15 -<br />

1 Mentor – OPS1<br />

(Trainee)


<strong>Program</strong> collaborators<br />

<strong>Panyappi</strong> <strong>Indigenous</strong> <strong>Youth</strong> <strong>Mentoring</strong> <strong>Program</strong> <strong>Evaluation</strong><br />

As the young people who <strong>Panyappi</strong> target are often in more complex circumstances than<br />

young people in mainstream mentoring programs, an extensive network of connections<br />

are required. The key collaborations in the development and delivery of the <strong>Panyappi</strong><br />

program are shown in Figure 4 and may be:<br />

ω<br />

ω<br />

ω<br />

ω<br />

ω<br />

ω<br />

ω<br />

ω<br />

ω<br />

ω<br />

ω<br />

ω<br />

ω<br />

sources of referral to <strong>Panyappi</strong>,<br />

services with whom <strong>Panyappi</strong> mentors need to network or to whom they may need to<br />

refer due the needs of individual young people,<br />

services with whom <strong>Panyappi</strong> develops cooperative programs, and<br />

services with whom <strong>Panyappi</strong> networks to stay abreast of relevant local and sector<br />

issues that impact on their program, mentors and or young people.<br />

Young people involved with <strong>Panyappi</strong><br />

The initial intention was for <strong>Panyappi</strong> to focus on young Aboriginal people who frequent<br />

the inner city area although they may come from various parts of the metropolitan area,<br />

often the west, south and north. Although this focus has been maintained, <strong>Panyappi</strong> has<br />

also worked with young people who frequent other urban areas. This has been necessary<br />

as “the place” to hang out shifts over time and can quickly move back and forth. Young<br />

people who typically come into the inner city may temporarily go out to Salisbury, the<br />

Parks or other locations.<br />

The young people involved with <strong>Panyappi</strong> are usually 10-17 years old and are at risk of<br />

entering the juvenile justice system or incarceration. They usually have the following<br />

characteristics:<br />

In the 10-15 age group<br />

A history of offending or risk factors associated with offending<br />

Low socio-economic background<br />

Poor school attendance and often complete disengagement from schooling<br />

Poor educational achievement, low numeracy and literacy skills, and/or learning<br />

difficulties<br />

Behavioural difficulties and problems with violence<br />

A history of drug, alcohol and substance misuse<br />

Experiences of physical, sexual and emotional abuse<br />

Unstable living arrangements<br />

- 16 -


JUSTICE<br />

Strong support from the Crime Prevention Unit, Attorney<br />

General’s Department, and liaison with and support of other<br />

parts of the system (eg youth conference teams, courts) to<br />

co-develop and coordinate early intervention and prevention<br />

options.<br />

EDUCATION<br />

Liaison with and support to<br />

schools involved with the<br />

young people in <strong>Panyappi</strong><br />

YOUTH SERVICES<br />

<strong>Indigenous</strong> and non-<strong>Indigenous</strong>,<br />

and government and NGO<br />

community youth health and<br />

welfare services<br />

Figure 4: <strong>Panyappi</strong> program collaborators<br />

PANYAPPI<br />

Mentors Young<br />

people<br />

Family Drug &<br />

Team Alcohol Worker<br />

Coordinator<br />

Family Juvenile<br />

Placement Team Justice Team<br />

Tutoring <strong>Program</strong><br />

MAYT<br />

CAMHS<br />

LOCAL GOVERNMENT<br />

Community Service<br />

Teams<br />

In-depth therapy support from child and adolescent<br />

mental health services as indicated.<br />

- 17 -<br />

<strong>Panyappi</strong> <strong>Indigenous</strong> <strong>Youth</strong> <strong>Mentoring</strong> <strong>Program</strong> <strong>Evaluation</strong><br />

SA POLICE<br />

Co-develop and run<br />

some program<br />

aspects<br />

FAMILY SUP-<br />

PORT SERVICES<br />

<strong>Indigenous</strong> and non-<br />

<strong>Indigenous</strong>, and<br />

government and NGO<br />

family services


ω<br />

ω<br />

ω<br />

ω<br />

ω<br />

ω<br />

<strong>Panyappi</strong> <strong>Indigenous</strong> <strong>Youth</strong> <strong>Mentoring</strong> <strong>Program</strong> <strong>Evaluation</strong><br />

Families dealing with multiple problems (including several of the above), where family<br />

breakdown is common and young people’s relationships with significant others is<br />

often disrupted and inconsistent<br />

They are unlikely to engage with mainstream youth mentoring programs, particularly on a<br />

voluntary basis, or with other youth groups or youth support services. They require<br />

longer-term, consistent, regular and more intense support in order to build trust, foster<br />

their personal resilience and successfully meet the desired aims of the <strong>Panyappi</strong><br />

program.<br />

How <strong>Panyappi</strong> works<br />

Through the evaluation work it became apparent that <strong>Panyappi</strong> has developed a number<br />

of key features in its practice that cover:<br />

the mentoring process<br />

the mentoring role<br />

level of intervention<br />

relationships with families<br />

interagency work<br />

It is useful to outline these features at this point in the report as they provide a<br />

context for what participants in the evaluation say about their experience of <strong>Panyappi</strong>.<br />

In the stories and opinions shared in the evaluation, evaluation participants provided<br />

evidence to support this description of how <strong>Panyappi</strong> works.<br />

Some of these features align with recommended strategies for good practice in<br />

mainstream mentoring programs, while others are more unique to <strong>Panyappi</strong> as an<br />

<strong>Indigenous</strong> youth mentoring program (please also see “A brief overview of mentoring”<br />

below).<br />

The mentoring process<br />

<strong>Panyappi</strong> is a formal rather than naturalistic mentoring process based on a case<br />

management approach, where young people participate voluntarily in the program. The<br />

voluntary aspect is considered important, as the young people referred to <strong>Panyappi</strong> are<br />

often involved in court or educational processes where they are expected or required to<br />

participate. They do not always respond well to mandated requirements to attend human<br />

service programs.<br />

Making <strong>Panyappi</strong> voluntary assists in engaging the young person, as they see the <strong>Panyappi</strong><br />

mentor as being more on their side. Mentors build on this start by developing a positive,<br />

caring and non-judgemental relationship with young people. <strong>Panyappi</strong> staff believe that<br />

ensuring the program is voluntary creates some leverage for them to build a better<br />

relationship and then encourage young people to participate more effectively with court<br />

- 18 -


<strong>Panyappi</strong> <strong>Indigenous</strong> <strong>Youth</strong> <strong>Mentoring</strong> <strong>Program</strong> <strong>Evaluation</strong><br />

and education processes or other human services. This is supported by a recent national<br />

review of mentoring program in crime prevention. 15<br />

<strong>Panyappi</strong> focuses on the individual needs of young people in the following ways. They<br />

have a screening and assessment process to ensure young people fit the criteria. Once<br />

accepted into the program they identify individual needs and determine the best match<br />

with a mentor. The mentor spends committed one-to-one time with young people to build<br />

a relationship and assist the young person in dealing with the many issues they face in<br />

their life. They then identify what additional support is required from external agencies,<br />

such as the program collaborators identified in Figure 4. The Coordinator liaises and<br />

negotiates to gain this support, or supports mentors in this role.<br />

Although it may be more time and cost effective to offer group mentoring options, many<br />

of the young people involved in <strong>Panyappi</strong> need to start with individual mentoring before<br />

they can function effectively in a group environment. In addition to one-to-one time with<br />

mentors, the program develops and accesses a range of individual and group programs<br />

as another context in which mentoring work can occur. This is facilitated by co-location<br />

with MAYT, as <strong>Panyappi</strong> can utilise the range of programs they offer. In this way<br />

<strong>Panyappi</strong> offers a “both/and” approach of providing individual mentoring, as well as the<br />

benefits and cultural fit of group or collective strategies.<br />

A unique feature of <strong>Panyappi</strong> is that it provides an opportunity for personal mentoring<br />

support beyond the “while the young person is in trouble” period and extending into the<br />

“consolidating new connections and commitments” period where young people are doing<br />

well and keeping their lives on a positive track. This could be called mentoring beyond<br />

the trouble zone. This reverses the common experience for <strong>Panyappi</strong>’s target group.<br />

Often they only receive support because they are in trouble, rather than when they are<br />

doing well, which can work against long-term change.<br />

Continuing mentoring support after issues are resolved but before the young person has<br />

solidly established a new pattern minimises the revolving door phenomena of falling back<br />

into problematic patterns when support is withdrawn too early. Another rationale for<br />

doing this is that many of <strong>Panyappi</strong>’s young people have experienced disrupted<br />

relationships with important family members. The staff believe that providing an<br />

experience of a more stable relationship while strengthening or building up connections<br />

with other people in their everyday network will assist young people to sustain gains they<br />

make during their time with <strong>Panyappi</strong>.<br />

The mentoring role<br />

Assisting people to understand the mentoring role has been one of the challenges faced<br />

by <strong>Panyappi</strong> in working with program collaborators so there are appropriate expectations<br />

or requests of mentors – this issue will be addressed in the <strong>Evaluation</strong> Outcomes section.<br />

15 Wilczynski, A., Culvenor, C., Cunneen, C., Schwartzkoff, J. & Reed-Gilbert, K. (2003). Early intervention:<br />

<strong>Youth</strong> mentoring programs - An overview of mentoring programs for young people at risk of offending.<br />

Australian Government Attorney-General’s Department: Canberra.<br />

- 19 -


<strong>Panyappi</strong> <strong>Indigenous</strong> <strong>Youth</strong> <strong>Mentoring</strong> <strong>Program</strong> <strong>Evaluation</strong><br />

<strong>Mentoring</strong> may share some aspects of youth work or social work, but there is a different<br />

focus and intention. It is not a transport, even though mentors may transport or<br />

accompany young people to other appointments or obligations. These activities<br />

contribute to a larger purpose or goal that is agreed with the young person and<br />

family/caregivers. It is not a baby-sitting service, even though mentors may spend<br />

recreational time with young people individually or in groups. Individual or group<br />

excursions are an environment in which it may be more comfortable and safe for the<br />

young person to open up to the mentor, build trust and start to discuss the personal<br />

issues they face.<br />

In summary, the role of mentors is to ensure the care, health and wellbeing of young<br />

people who access <strong>Panyappi</strong> services. They act as a bridge between the young person and<br />

services, providing advice, referral and advocacy. They provide a service to the young<br />

person in a wide variety of environments by:<br />

ω<br />

ω<br />

ω<br />

ω<br />

ω<br />

ω<br />

ω<br />

ω<br />

ω<br />

ω<br />

Modelling appropriate behaviours<br />

Providing one-on-one engagement with a young person to build a trusting relationship<br />

with a commitment to maintaining the relationship over an extended period of time<br />

Assisting young people to access educational, training and recreational services to<br />

facilitate young peoples transition into the community<br />

Promoting, encouraging and ensuring positive relationships with parents, family<br />

members, significant others and the community<br />

Providing care, guidance, support and supervision of young people in a reasonable and<br />

appropriate manner, and their protection from harm and exploitation<br />

Offering a safe, secure and caring environment for young people.<br />

Developing and implementing programs that teach young people practical living skills,<br />

how to make choices and decisions and how to take responsibility for their actions<br />

Assisting young people who are moving towards independence by providing regular<br />

support and linking into appropriate services<br />

Escorting and supervising young people when attending relevant appointments in the<br />

community<br />

Providing opportunities for young people to experience success and to realise their<br />

full potential<br />

Due to the complex and often long-standing problems for young people in <strong>Panyappi</strong>, and a<br />

frequent history of previously unsuccessful intervention, mentoring involves regular and<br />

intensive involvement. This is up to 15 – 20 hours/week, particularly in the earlier months<br />

while the relationship and trust is being built. The belief is that an investment of this<br />

nature makes a difference that can be sustained as the young person becomes an adult<br />

and avoids further and more serious involvement in crime that has high social and<br />

financial costs at personal, family and societal levels.<br />

<strong>Panyappi</strong>’s approach to mentoring acknowledges that there are multiple ways of<br />

supporting young people and more than mentoring is required to make a difference, ie:<br />

- 20 -


<strong>Panyappi</strong> <strong>Indigenous</strong> <strong>Youth</strong> <strong>Mentoring</strong> <strong>Program</strong> <strong>Evaluation</strong><br />

Formal mentoring programs are one effective means of supporting young people,<br />

not a single solution to complex social and individual needs. Especially in<br />

circumstances where young people face multiple disadvantages, mentors are best<br />

regarded as complementary to and an addition to the work of professionals and<br />

other supportive services, not as a replacement for them. 16<br />

As noted in the above summary of their role, <strong>Panyappi</strong> mentors are actively involved in<br />

facilitating the engagement of young people and families with a range of other services<br />

that can respond to their needs, particularly where it has or will be difficult for<br />

engagement to occur.<br />

Support for mentors<br />

There has been strong commitment to ensuring that <strong>Panyappi</strong> mentors have access to<br />

quality training, professional development opportunities, and regular supervision and<br />

support. The intentions are to resource them appropriately and sustain them in their<br />

high intensity role with this group of young people.<br />

If they do not have it, all <strong>Panyappi</strong> mentors undertake training for a Certificate III in<br />

Community Services (<strong>Youth</strong> Work). They have access to the range of training offered<br />

through FAYS in the Department of Human Services, including required training in<br />

Mandated Notification and Occupational Health and Safety issues and other areas<br />

relevant to the program, e.g. juvenile justice, racism/anti-racism, substance misuse.<br />

They also participate in MAYT staff development and planning processes.<br />

The <strong>Panyappi</strong> Coordinator provides professional supervision for all mentors based on<br />

mutually negotiated superversion agreements. In addition each mentor has a<br />

performance management agreement that includes a focus on career development. The<br />

Coordinator conducts all screening and assessment, case planning and case management,<br />

including attending case conferences with other agencies where required. Case planning<br />

occurs in collaboration with individual mentors, and mentors learn about the case<br />

management process. In addition, under the current staffing structure they also have<br />

access to the Senior Mentor for day-to-day peer support and guidance, where the<br />

Senior Mentor can act as a mentor to the other mentors.<br />

<strong>Panyappi</strong> has adopted a strategy of two levels of mentoring. The primary focus is on<br />

young people, as required under the program funding arrangements. In addition, there is<br />

a secondary focus on people in the Mentor positions. This addresses the need to recruit<br />

and retain skilled <strong>Indigenous</strong> workers within Family & <strong>Youth</strong> Services, DHS, and<br />

responds to commitments to do this in the DHS Reconciliation Plan. 17 Although <strong>Panyappi</strong><br />

is very keen to retain mentors in order to ensure program stability and offer young<br />

people relationship stability, mentors are encouraged to consider further study options<br />

as part of their career development. In this way <strong>Panyappi</strong> contributes to developing and<br />

16 Hartley, R. (2004). Young people and mentoring: Towards a national strategy. Big Brothers Big Sisters<br />

Australia, Dusseldorp Skills Forum and The Smith Family: Australia.<br />

17<br />

Department of Human Services (2002). Department of Human Services: The Reconciliation Plan 2002-2003.<br />

Adelaide: SA Department of Human Services, p.28.<br />

- 21 -


<strong>Panyappi</strong> <strong>Indigenous</strong> <strong>Youth</strong> <strong>Mentoring</strong> <strong>Program</strong> <strong>Evaluation</strong><br />

supporting the people who will become the workers of the future within Aboriginal<br />

services and communities, and potentially leaders within services and communities.<br />

Level of and intensity of intervention<br />

<strong>Mentoring</strong> programs are often targeted at young people as they reach and proceed<br />

through their teenage years. There are two obvious reasons for this. First, the<br />

prevalence of mental health problems markedly increases in the 12 to 25 year age<br />

group. 18 Second, early school leaving is an increasing issue at this developmental time.<br />

About one third of young people leave school before the end of year 12 and many have<br />

only Year 10 schooling. 19,20 Once out of school, young people aged 15-24 years experience<br />

2.7 times the level of unemployment of people aged 25-54 years. 21 It is in these<br />

situations that young people often become disconnected from their personal and<br />

community connections and mentoring is one of several recommended and positive<br />

responses.<br />

According to very recent estimates:<br />

<strong>Indigenous</strong> young people in urban, regional and remote locations face a level of<br />

risk of disconnection from learning and work three times greater than non-<br />

<strong>Indigenous</strong> young people. 22<br />

<strong>Panyappi</strong> decided to work from a developmental perspective 23 by focusing on a lower age<br />

group, i.e. 10-14 year olds, who are already involved in offending behaviours and have<br />

disconnected from education. Once they have reached the age of 15 the young people in<br />

their target group typically do not reconnect to education via other available strategies<br />

and often reject the idea of mentoring. This group also exerts significant influence over<br />

the 10-14 year olds who may not have many other alternative influences or options apart<br />

from following their older peers.<br />

In addition, because they are working with young offenders, the intensity and frequency<br />

of their work with young people is much higher than young people who are “at risk” in<br />

some general way. A recent national overview of mentoring for young offenders reported<br />

that: 24<br />

18 Commonwealth Department of Health and Aged Care (2000). National action plan for promotion, prevention<br />

and early intervention for mental health 2000. Mental Health and Special <strong>Program</strong>s Branch, Commonwealth<br />

Department of Health and Aged Care: Canberra.<br />

19 Dusseldorp Skills Forum (2003). Fact sheet: Honouring our commitment – How does Australia compare?<br />

Viewed 22 Jan, 2004, < http://www.dsf.org.au/><br />

20 Applied Economics (2003). Young person’s education, training and employment outcomes with special<br />

reference to early school leavers. Business Council of Australia & Dusseldorp Skills Forum.<br />

21 Dusseldorp Skills Forum (2003). How young people are faring? Key indicators 2003: An update about the<br />

learning and work situation of young Australian including an analysis of how young <strong>Indigenous</strong> people are faring.<br />

Viewed 22 nd Jan. 2004, < http://www.dsf.org.au/><br />

22 ibid, p1.<br />

23 National Crime Prevention (1999), op cit.<br />

24 Wilczynski, Culvenor, et al. (2003), op cit, p. 82.<br />

- 22 -


<strong>Panyappi</strong> <strong>Indigenous</strong> <strong>Youth</strong> <strong>Mentoring</strong> <strong>Program</strong> <strong>Evaluation</strong><br />

The evidence shows that mentoring with young offenders may be more intensive<br />

or complex for young offenders than generally at risk young people (especially in<br />

relation to mentoring frequency). Therefore, programs need to carefully<br />

consider the implications of the target group and develop program elements and<br />

strategies accordingly, especially:<br />

�<br />

�<br />

the greater resources needed for young offenders<br />

the greater demands on mentors.<br />

Relationships with families<br />

Whilst many of the mainstream strategies and intentions of mentoring are also relevant<br />

for <strong>Indigenous</strong> young people, <strong>Panyappi</strong> believes it is critical to approach mentoring with<br />

this group from a cultural perspective. This involves a stronger focus on, and<br />

commitment to, rebuilding and strengthening family connections as an important aspect<br />

of culturally appropriate practice, not just on gaining family support for the young<br />

person’s involvement as often occurs in other mentoring programs. 25<br />

<strong>Indigenous</strong> cultures have a more inclusive concept of family compared with many non-<br />

<strong>Indigenous</strong> cultures, with cousins, aunties and uncles playing a critical role in young<br />

people’s lives. Although there is a high rate of family breakdown amongst <strong>Panyappi</strong>’s<br />

target population, there are other family connections that can be fostered, particularly<br />

when young people are living with relatives other than their parents. These connections<br />

may support mentoring being embedded into young people’s lives separately from and<br />

after their involvement with <strong>Panyappi</strong>.<br />

It is not common for mentors to have much contact with mentee’s families in mainstream<br />

mentoring programs, as they appear to operate from an individual rather than systemic<br />

model. Few program descriptions and evaluations mention parental or family<br />

involvement. 22,26 This is different in <strong>Panyappi</strong>. <strong>Panyappi</strong> mentors do this in two ways:<br />

through direct contact and by engaging the support and collaborating with the MAYT<br />

Family team or other family support services (see the <strong>Program</strong> Collaborators diagram in<br />

Figure 4).<br />

Although mentors are directly involved with families, the <strong>Panyappi</strong> Coordinator takes on<br />

the major responsibility of providing direct support and additional services for family<br />

members that will contribute positively to the young person’s overall situation. The<br />

Coordinator ensures families understand the role of the mentors and how <strong>Panyappi</strong> can<br />

work with the family to support the young person, as well as respond to issues that are<br />

difficult for the family. If <strong>Panyappi</strong> does advocacy work on behalf of the family, a good<br />

understanding of the family picture coupled with the family’s respect and endorsement<br />

for <strong>Panyappi</strong> to take this role is required. As part of its aims, <strong>Panyappi</strong> wants young<br />

people to build personal resilience and strong personal and cultural identity, and<br />

empower their sense of spirituality. One strategy is through a genealogy program,<br />

25 ARTD (1999/2001) op cit.<br />

26 Benard, B. (1992). <strong>Mentoring</strong> programs for urban youth: Handle with care. Northwest Regional Educational<br />

Laboratory.<br />

- 23 -


<strong>Panyappi</strong> <strong>Indigenous</strong> <strong>Youth</strong> <strong>Mentoring</strong> <strong>Program</strong> <strong>Evaluation</strong><br />

therefore they need information from families to assist young people in the program.<br />

The program also facilitates the family reconnecting with where they come from, as<br />

links may have been lost or broken.<br />

This family-inclusive approach fits with culturally appropriate practice, as well as<br />

systemic approaches to family work, 27 where change depends on having an understanding<br />

of the wider family context in line with an extended concept of families in Aboriginal<br />

cultures. It also helps develop respect lines back to elders, which these young people<br />

may have lost due to experiencing the harsh edge of the legacy and effects of<br />

colonisation and racism.<br />

In many ways, this offers a third layer of mentoring within the program, where the<br />

Coordinator is a mentor for family members. The Coordinator assists them in developing<br />

different ways to relate to and support their young person, and to manage other issues<br />

in their lives that drain their energy and negatively impact on their social and emotional<br />

wellbeing. Family members are contacted regularly by phone, home visits occur and they<br />

are encouraged to initiate contact with the program. They are also invited to take part<br />

in programs, such as the art program. Young people are usually aware that their family<br />

members are involved.<br />

Interagency work<br />

<strong>Panyappi</strong> has focused its efforts on target geographical areas. They needed to build<br />

effective collaborations with local key stakeholders, both <strong>Indigenous</strong> and non-<strong>Indigenous</strong><br />

agencies and groups, in order to collectively address the problems <strong>Indigenous</strong> young<br />

people are experiencing and the issues this raises for the local community. These<br />

collaborations were illustrated in Figure 4.<br />

A specific area of focus is education. For many <strong>Indigenous</strong> young people education has<br />

not been a positive and beneficial experience, as racism plays a factor in the curriculum<br />

generally, as well as their treatment at school level. 28,29,30 This also influences how the<br />

school relates to and communicates with their parents and family members – they often<br />

feel disconnected or disregarded by schools until it is “too late.” 31 Early school leaving<br />

rates for young people are highest for <strong>Indigenous</strong> young people, especially <strong>Indigenous</strong><br />

young males who also have a higher rate of offending behaviour compared to the overall<br />

population: “in almost all available data on <strong>Indigenous</strong> education, young <strong>Indigenous</strong> males<br />

have the worst retention and participation rates….a decrease in participation in<br />

30<br />

education correlates with an increase in juvenile crime among <strong>Indigenous</strong> males.”<br />

27 Nichols, M. & Schwartz, R. (Eds.) (1998). Family therapy concepts and methods (4 th ed). Boston: Allyn and<br />

Bacon.<br />

28<br />

Social Inclusion Unit (2003). School Retention Reference: How can we better support young people stay at<br />

school and successfull y complete 12 years of education? Getting there together. Social Inclusion Unit, South<br />

Australian Department of Premier and Cabinet: Adelaide. Available online at:<br />

http://www.socialinclusion.sa.gov.au/page.asp?ContainerID=3&SubPageID=50, pp.19-20, 24-26, 31, 45.<br />

29 Stacey, K. (2003), op cit, p.3.<br />

30<br />

Teese, R., Polesel, J., O’Brien, K., Jones, B., Davies, M., Walstab, A. & Maughan, M. (2000). Early school<br />

leaving:<br />

A review of the literature. Brisbane: Australian National Training Authority. (Quote from p.5).<br />

31 Stacey, K. (2003), op cit, p.17.<br />

- 24 -


ATSIC recently reported:<br />

<strong>Panyappi</strong> <strong>Indigenous</strong> <strong>Youth</strong> <strong>Mentoring</strong> <strong>Program</strong> <strong>Evaluation</strong><br />

Most indicators of poverty and related disadvantage show that <strong>Indigenous</strong><br />

people are between two and three times worse off than non-<strong>Indigenous</strong> people in<br />

Australia….the proportion of <strong>Indigenous</strong> teenagers (15-19 years) not fully<br />

engaged in work or education is three times that of non-<strong>Indigenous</strong> people. 32<br />

Many of <strong>Panyappi</strong>’s clients have difficult relationships with school, so there is<br />

considerable effort to do interagency work with schools. This contributes to other state<br />

initiatives to improve <strong>Indigenous</strong> young people’s connection or reconnection to schooling.<br />

Although the role of mentors is not to be an Aboriginal Education Worker, they enable<br />

young people to engage with or complete schoolwork, or to re-engage with schooling.<br />

<strong>Panyappi</strong> looks for opportunities to create a positive link between the young person and a<br />

school staff member as a way of embedding mentoring as a regular experience at school,<br />

which can be sustained beyond the young person’s connection to <strong>Panyappi</strong>.<br />

By helping young people’s reconnect and have a more positive and beneficial experience,<br />

it is possible for young people to take advantage of transition programs into education,<br />

training and employment that are usually targeted at the 15 and over age group.<br />

32 Dusseldorp Skills Forum (2003), op cit, p.35.<br />

- 25 -


A Brief Review of <strong>Mentoring</strong><br />

A cultural perspective<br />

<strong>Panyappi</strong> <strong>Indigenous</strong> <strong>Youth</strong> <strong>Mentoring</strong> <strong>Program</strong> <strong>Evaluation</strong><br />

<strong>Mentoring</strong> is not a new concept for Aboriginal people, as there has always been an<br />

emphasis on connection with significant people in young people’s lives. Today it is<br />

“languaged” under the term of mentoring. Different projects in recent years have<br />

explored and piloted ways of acknowledging this concept of the role of significant people<br />

within families, for example the Port Augusta “Families Project” funded by DHS and the<br />

Teenage Parenting Pilot in Adelaide operated by Anglicare SA.<br />

The concept of mentoring opened up the possibility of a better cultural fit provided that<br />

the program was built on cultural perspective as a foundation that acknowledged and<br />

respected cultural values and beliefs. The first step in doing this was choosing a<br />

meaningful name to represent mentoring from a cultural perspective. On this occasion a<br />

word from the Kaurna language was chosen – <strong>Panyappi</strong> (pronounced “bunyip + ee”). As<br />

stated earlier, this means younger brother or sister.<br />

Published literature on mentoring: A brief summary<br />

The following is a brief overview of key issues that are emerging in the literature,<br />

mostly from the USA and Australia. Some of this literature has been identified in the<br />

“How <strong>Panyappi</strong> works” section. FAYS is currently undertaking a review of mentoring in<br />

general and its own mentoring program. The outcomes and recommendations of the<br />

<strong>Panyappi</strong> <strong>Evaluation</strong> can contribute to and assist in this general review, as there is a<br />

paucity of evaluation outcomes for youth mentoring programs in a crime prevention<br />

context, particularly with an <strong>Indigenous</strong> focus. 33<br />

This summary focuses on literature specifically on mentoring and does not summarise<br />

concepts that mentoring may draw upon to argue its case. For example, as an<br />

intervention strategy mentoring is based on well-known research findings from the child<br />

development field. When young people have supportive relationships with adults<br />

(parents, family, teachers, neighbours, etc), their ability to develop resilience, meaning<br />

in life and deal with life’s challenges is enhanced. These relationships act as a protective<br />

factor when young people grow up in high-stress family or community<br />

environments. 34,35,36<br />

In more recent times these relationships have been understood as a form of “social<br />

capital.” The concept of social capital was originally named by Putnam in the early 1990s<br />

and popularised in Australia by Eva Cox in the mid-1990s. 37 Social capital means “the<br />

33 Wilczynski, A. (2002), op cit.<br />

34 Garbarino, J. et al. (1992), op cit.<br />

35 Werner, E. (1984). Resilient children. Young Children, November, 68-72<br />

36 Rutter, M. (1999) Resilience concepts and findings: Implications for family therapy. Journal of Family<br />

Therapy, 21, 119-144.<br />

37 Baum, F. (1998). The new public health: An Australian perspective. Melbourne: Oxford University Press.<br />

- 26 -


<strong>Panyappi</strong> <strong>Indigenous</strong> <strong>Youth</strong> <strong>Mentoring</strong> <strong>Program</strong> <strong>Evaluation</strong><br />

processes between people which establish networks, norms, social trust and facilitate<br />

coordination and cooperation for mutual benefit.” 38 In many ways this definition of social<br />

capital applies to mentoring relationships themselves, whether they occur ‘naturally’ or in<br />

planned mentoring programs, and the relationships that mentoring programs have with<br />

other parts of the health, human and community service sector in responding to the<br />

needs of young people by working with young people and family members.<br />

This summary will comment upon: the role of mentoring, mentor qualities and roles, age<br />

groups, geographical focus, stand alone or integrated programs, and paid staff.<br />

Role of mentoring programs<br />

The National <strong>Youth</strong> Affairs Research Scheme (NYARS) recently commissioned a national<br />

overview of mentoring and role model programs. It identified that the main functions of<br />

mentoring and role model programs were “inspiration, setting an example and providing<br />

personalised support” 39 and recommended that:<br />

<strong>Mentoring</strong>…needs to be tailored to the individual needs of particular young<br />

people. This requires that programs are organised in ways that allow for the<br />

development of trusting relationships between the [mentors] and the young<br />

people, and provide opportunities for young people to express their views and<br />

their needs and the means of following up on these needs. 40<br />

Other writers focus on the importance of building clear, specific and achievable goals<br />

for young people as a focus for the program. 41 In this way mentoring relationships can be<br />

tailored to young people’s individual needs and personal interests. The goals guide<br />

mentors in their role as they follow up on these needs, identify opportunities and<br />

support young people to achieve something that makes them feel competent and proud.<br />

Mentor qualities and roles<br />

The national review also emphasised the need to have a “clear rationale and procedure<br />

for recruiting, screening and training…mentors, which has multiple methods to ensure<br />

safety of young people” 42 and the quality of mentoring. The idea is to screen people out<br />

rather than in through making careful and responsible decisions on who can fulfil a<br />

mentor role, and ensure they are well prepared then supported. 43 Mentors “need ongoing<br />

support and training to further develop their skills and knowledge about developing [and<br />

sustaining] a mentoring relationship.” 44<br />

38 Cox, E. (1996). A truly civil society. Sydney: Australian Broadcasting Commission, p.<br />

39 MacCallum, J. & Beltman, S. (2002), op cit, p.63.<br />

40 ibid, p.96.<br />

41 Benard, B. (1992) op cit.<br />

42 MacCallum, J. & Beltman, S. (2002) op cit, p.98.<br />

43 Benard, B. (1992) op cit.<br />

44 ibid, p.101.<br />

- 27 -


<strong>Panyappi</strong> <strong>Indigenous</strong> <strong>Youth</strong> <strong>Mentoring</strong> <strong>Program</strong> <strong>Evaluation</strong><br />

Being a mentor is a unique role. Although it may overlap to a degree with other human<br />

service roles, e.g. youth workers and social workers, mentoring usually operates at a<br />

more intense level with a higher frequency of contact. Mentors are not expected to do<br />

case management or be qualified in counselling, although they often provide critical<br />

personal support and care for young people. The review highlighted the importance of<br />

mentors fostering a positive, caring and non-judgemental approach by mentors, as “those<br />

involved with young people on a one-to-one basis particularly need to be abe l to meet<br />

young people ‘where they are’ and guide them in their journey. ” 45 Researchers in the USA<br />

also emphasise that mentors must have “a caring attitude, high expectations [of what<br />

young people can achieve with support], participatory style and commitment.” 46<br />

Age group<br />

As noted above, mentoring for young people is often targeted at the 13 to 18 year age<br />

group. Reasons for mentoring programs may vary - not all are targeted at young people<br />

experiencing specific problems or showing disruptive behaviour. <strong>Evaluation</strong>s of youth<br />

mentoring programs in a crime prevention context have shown that there is greater<br />

success with engaging a younger age group. 47,48<br />

Geographical focus<br />

Previous evaluations of crime prevention focused mentoring programs also highlighted<br />

the importance of having a specific geographical focus. This supports <strong>Program</strong><br />

Coordinators to develop effective and positive networks with local service providers or<br />

referral sources. 49 It also responds to the way in which young people may gather in<br />

specific locations, which has an important social purpose and is not simply about engaging<br />

in offending behaviour or being exposed to other criminal activity.<br />

Stand alone or integrated programs<br />

An evaluation of the One2One mentoring program for young offenders in NSW has<br />

identified that “to be sustainable, a mentoring program may need to…be delivered in<br />

conjunction with other youth and family support programs.” 50 A recent national overview<br />

of mentoring programs also highlighted that “integrated mentoring projects are more<br />

likely to be effective.” 51 They may be integrated through being co-located with other<br />

youth and family support programs and/or due to the collaborative efforts of the<br />

program staff to link in and work collaboratively with a range of other government and<br />

non-government community services. When projects with a juvenile justice focus link to<br />

45 ibid, p.100.<br />

46 Benard, B. (1992) op cit, p.18.<br />

47<br />

ARTD (2000). <strong>Evaluation</strong> of <strong>Mentoring</strong> Mates: Wooloomooloo Crime Prevention and Safety Initiative. Sydney:<br />

NRMA.<br />

48 ARTD (1999/2001) op cit.<br />

49<br />

ARTD (2000), op c t; i ARTD (2002), op cit.<br />

50<br />

ARTD (2002). <strong>Mentoring</strong> for young offenders: One to one relationship producing positive benefits.<br />

<strong>Evaluation</strong> report of the NSW pilot program. Crime Prevention Division, Attorney General’s Department.<br />

www.lawlink.new.gov.au/cpd<br />

51 Wilczynski, A. (2002), op cit.<br />

- 28 -


<strong>Panyappi</strong> <strong>Indigenous</strong> <strong>Youth</strong> <strong>Mentoring</strong> <strong>Program</strong> <strong>Evaluation</strong><br />

other community organisations they have the capacity to contribute to systems reforms.<br />

However, integrated programs have different demands because:<br />

…developing viable collaborations is not easy and takes much time and effort.<br />

Organisations have different cultures and institutional climates, autonomy,<br />

flexibility and power; individuals with differing experiences and expertise; giving<br />

rise to different ways of defining issues and solutions. Once established,<br />

collaborative relationships need to be nurtured and maintained over time. 52<br />

The Australian view is that programs integrated into a range of services, including those<br />

offered by the auspicing organisation, provide a better support base as mentoring<br />

programs commonly take some time to establish and usually have a small number of staff.<br />

The availability of existing infrastructure, administrative support and access to<br />

established networks with key agencies, including those who may refer clients, may also<br />

improve cost-effectiveness and program sustainability. 53,54 Others acknowledged that:<br />

Even energy and commitment on the part of the program manager is usually not<br />

enough to sustain a mentoring program if it is not institutionalised within a<br />

55<br />

larger organisation or integrated into an array of services provided to youth.<br />

Paid staff<br />

Many Australian mentoring programs depend on volunteers to be mentors. 56 There is<br />

usually at least one paid staff member who is the <strong>Program</strong> Coordinator. Researchers in<br />

the US have argued that in successful mentoring programs the paid staff:<br />

…are the most important single ingredient….These individuals are in contact with<br />

the kids, the mentors, school staff and families. Not surprisingly, in programs<br />

where such staff are a full-time presence, the whole mentoring process tends to<br />

revolve around them; they are the ‘glue’ in the mentoring process. 57<br />

There is limited information available on what it means to have paid mentors in addition<br />

to a <strong>Program</strong> Coordinator, as in <strong>Panyappi</strong>. Those that do may be better positioned to<br />

meet the requirement that programs directed at young people in high risk or stress<br />

situations be “both intensive and extensive, start early and plan to stick around for a<br />

long time. They must also be prepared for inevitable failures and be ready to intervene<br />

when problems arise and relationships do not hold.” 58<br />

52 ARTD (1999/2001) op cit, p.22.<br />

53 Wilczynski, A. (2002) op cit.<br />

54 Wilczynski, Culvenor, et l. (2003), op cit.<br />

55 Benard, B. (1992) op cit, p.17.<br />

56 MacCallum, J. & Beltman, S. (2002) op cit.<br />

57 Freedman, M. (1991). The kindness of strangers: Reflections on the mentoring movement. Philadelphia, PA:<br />

Public/Private Ventures, p.63<br />

58 ibid, p.60.<br />

- 29 -


The <strong>Evaluation</strong> Process<br />

<strong>Evaluation</strong> purpose<br />

<strong>Panyappi</strong> <strong>Indigenous</strong> <strong>Youth</strong> <strong>Mentoring</strong> <strong>Program</strong> <strong>Evaluation</strong><br />

In order to tell a meaningful and useful story about a community-based human services<br />

program, an evaluation must provide:<br />

1. Information that informs a program’s future development.<br />

2. Guidance to others who wish to emulate aspects of or the entire program.<br />

3. Details for the wider field about whether the program is effective based on the<br />

nature and extent of the outcomes achieved.<br />

Process evaluation explains how and why program strategies were implemented – it<br />

provides the detail about the story of implementing the program. This equates with<br />

mapping the context, describing the “how” and “why” of the mechanisms involved<br />

(including program strategies) and analysing both. Without a focus on process evaluation,<br />

it is not possible to unpack the results of impact and outcome evaluation.<br />

Impact evaluation focuses on the achievement of objectives. This can occur when a<br />

program has been operating for 6 months to 2 years. It indicates any progress toward<br />

the objectives or full achievement of them. Outcome evaluation assesses achievement of<br />

the overall goal. As most goals for community-based human services program are broad<br />

in scope, this takes a minimum of 2 years and usually 4 or more years to determine with<br />

confidence.<br />

At this point in the <strong>Panyappi</strong> program the evaluation work can address both process and<br />

impact evaluation. <strong>Panyappi</strong> is an intensive program for a small number of young people<br />

and families. Therefore, the evaluation used predominantly qualitative information, with<br />

some quantitative information provided through program statistics and client<br />

demographics. It was conducted between January and May 2004.<br />

The State Crime Prevention Unit developed an outcomes hierarchy in 2002 in order to<br />

guide any evaluation work that occurred – see Appendix A. This will be used as the set of<br />

indicators against which <strong>Panyappi</strong>’s progress will be evaluated – outcomes will be<br />

discussed in the “Weaving the threads together” section.<br />

<strong>Evaluation</strong> plan<br />

Acknowledging history – addressing cultural accountability<br />

As an Aboriginal program focused on young people who have often had involvement with<br />

statutory bodies, it was critical that the non-<strong>Indigenous</strong> evaluation consultant was<br />

conscious of both historical experience and cultural accountability. Since colonisation<br />

there has been a strong history of outsiders inquiring into Aboriginal people’s everyday<br />

lives and then making decisions that affect them in serious ways. The evaluation did not<br />

want to replicate these intrusive, disrespectful and often painful experiences. It was<br />

- 30 -


<strong>Panyappi</strong> <strong>Indigenous</strong> <strong>Youth</strong> <strong>Mentoring</strong> <strong>Program</strong> <strong>Evaluation</strong><br />

understood that participation in the evaluation would be voluntary and something that<br />

participants felt good about doing because they were clear about the purpose. It was<br />

also acknowledged that people may decline because they had other priority issues or the<br />

evaluation may be experienced as intrusive.<br />

In order for the evaluation to be respectful of cultural protocols and practices, and to<br />

address the cultural accountability of the non-<strong>Indigenous</strong> evaluation consultant, an<br />

<strong>Indigenous</strong> cultural advisor was engaged to guide all stages of the evaluation. Through<br />

this arrangement many issues were addressed, such as how to introduce the evaluation<br />

to young people and families working with <strong>Panyappi</strong>, and who was appropriate to conduct<br />

interviews based on <strong>Indigenous</strong> or non-<strong>Indigenous</strong> identity and then cultural connections<br />

of the cultural advisor and evaluation participants.<br />

The evaluation introduction occurred in three layers. Due to connections and existing<br />

relationships with families as the Coordinator, Lisa Kambouris was instrumental in<br />

facilitating this process. In the initial stages of the evaluation she spoke to all young<br />

people and families currently engaged with <strong>Panyappi</strong> to explain why they were evaluating<br />

the program and the possibility of being involved. She also ensured that mentors were<br />

thoroughly briefed on the evaluation. Through this she identified who was interested in<br />

knowing more and potentially being an evaluation participant.<br />

Following ethics approval for the evaluation plan, a social gathering was held at <strong>Panyappi</strong><br />

for interested families and young people. They met the evaluation consultant and<br />

<strong>Indigenous</strong> cultural advisor, gained information on the evaluation plan and process, and<br />

also received a written version of this. They had the opportunity to ask questions or just<br />

talk with the evaluators during the gathering, either during the meeting or over lunch.<br />

Some families and young people decided to participate at that point, while others agreed<br />

or withdrew interest later in conversation with Lisa. Other families who were unable to<br />

make the gathering were offered the opportunity to meet or speak separately with the<br />

evaluators, and several agreed to be part of the evaluation.<br />

<strong>Evaluation</strong> participants and methods<br />

The people or groups outlined in the Table 1 were included in the evaluation using the<br />

methods (program funders were included through the Advisory Group and the Senior<br />

Project Officer, Crime Prevention Unit, AGD).<br />

The evaluation methods were designed to gain in-depth qualitative data to build a picture<br />

of the experiences and outcomes of the participants’ involvement in <strong>Panyappi</strong> (in<br />

whatever capacity) and their opinions of the cultural appropriateness of the project’s<br />

model of mentoring. These methods use narrative or story as the primary mode,<br />

particularly for the interviews with young people, family members and Mentors, as<br />

narrative has a cultural fit for <strong>Indigenous</strong> people. Interviews and focus groups were<br />

audiotaped with the consent of participants.<br />

- 31 -


<strong>Panyappi</strong> <strong>Indigenous</strong> <strong>Youth</strong> <strong>Mentoring</strong> <strong>Program</strong> <strong>Evaluation</strong><br />

Table 1: <strong>Panyappi</strong> evaluation participants and methods<br />

<strong>Evaluation</strong> Participant <strong>Evaluation</strong> methods<br />

Young people<br />

Family Members – this term includes<br />

relatives and other caregivers<br />

<strong>Panyappi</strong> Mentors – present and<br />

previous mentors<br />

<strong>Panyappi</strong> Coordinator – present and a<br />

previous Coordinator<br />

Social gathering to familiarise young people with<br />

evaluators and process<br />

One-to-one interviews<br />

A fictionalised compilation story<br />

Client demographics<br />

Social gathering to familiarise family members with<br />

evaluators and process<br />

One-to-one interviews<br />

A fictionalised compilation story<br />

One-to-one interviews<br />

A fictionalised compilation story<br />

One-to-one interviews<br />

<strong>Program</strong> statistics<br />

<strong>Panyappi</strong> Advisory Group Members One-to-one interviews<br />

<strong>Program</strong> Collaborators – FAYS,<br />

SAPOL, MAYT, Aboriginal community,<br />

family and youth services, individual<br />

schools, Education Department<br />

Senior Project Officer, Crime<br />

Prevention Unit, AGD<br />

Focus groups and one-to-one interviews<br />

One-to-one interview<br />

Where appropriate and agreed with participants “member checking” occurred: “member<br />

checking provides for credibility by allowing members of stakeholding groups to test<br />

categories, interpretations and conclusions.” 59 This occurred in three ways.<br />

ω<br />

ω<br />

ω<br />

Those participants who wanted one were sent a copy of their interview write-up as a<br />

record of their own story. This occurred before the interview tapes were deleted to<br />

ensure that they were happy with the account of their interview. They had the right<br />

to ask for information to be removed or altered.<br />

Participants’ information was used to create a “compilation story” – a fictional<br />

account based on using information from several actual stories. In this way no person<br />

was or could be personally identified.<br />

A <strong>Panyappi</strong> <strong>Evaluation</strong> Advisory Group was established during the writing phase to<br />

provided comment on the organisation, interpretations, opinions and conclusions in<br />

the report.<br />

59 Erlandson, D., E. Harris, Skipper, B. & Allen, S. (1993). Doing naturalistic inquiry: A guide to<br />

methods. Newbury Park, Sage, p.142.<br />

- 32 -


<strong>Evaluation</strong> questions<br />

<strong>Panyappi</strong> <strong>Indigenous</strong> <strong>Youth</strong> <strong>Mentoring</strong> <strong>Program</strong> <strong>Evaluation</strong><br />

Each interview and focus group followed an interview guide to explore a number of key<br />

areas. Rather than a question-answer format, it was used to initiate and where required<br />

redirect or focus the interview/focus group on issues specific to the <strong>Panyappi</strong> program.<br />

The key areas covered were:<br />

Experiences of <strong>Panyappi</strong> as a program, for example:<br />

ω<br />

ω<br />

ω<br />

ω<br />

ω<br />

ω<br />

ω<br />

ω<br />

ω<br />

ω<br />

ω<br />

ω<br />

ω<br />

ω<br />

ω<br />

ω<br />

How people became connected to <strong>Panyappi</strong> and their length of involvement<br />

Strengths and weaknesses of, or likes and dislikes about the program<br />

Relationships between young people and mentors, and families and mentors or the<br />

program<br />

<strong>Program</strong> challenges and how these have been managed<br />

<strong>Program</strong> highlights<br />

<strong>Program</strong> outcomes, for example:<br />

Any change for young people/mentors since involvement with <strong>Panyappi</strong> and what part<br />

<strong>Panyappi</strong> has played in this change<br />

<strong>Program</strong> collaborations, for example:<br />

Relationships between <strong>Panyappi</strong> and its program collaborators (individual referral,<br />

program level work, or funding and structural arrangements)<br />

<strong>Program</strong> management, for example:<br />

The effectiveness of program management<br />

Training and support for mentors<br />

<strong>Program</strong> challenges and how these have been managed<br />

Location of the program<br />

<strong>Program</strong> awareness, for example:<br />

Knowledge of <strong>Panyappi</strong><br />

What participants tell other people about <strong>Panyappi</strong><br />

Thoughts about the future of <strong>Panyappi</strong>, for example:<br />

Unique features of the program and availability of alternative programs<br />

Can programs like <strong>Panyappi</strong> offer benefits – if so, what are the benefits?<br />

Location of the program<br />

- 33 -


The Stories<br />

<strong>Panyappi</strong> <strong>Indigenous</strong> <strong>Youth</strong> <strong>Mentoring</strong> <strong>Program</strong> <strong>Evaluation</strong><br />

There are four ways in which the stories gathered in the evaluation will be told:<br />

ω<br />

ω<br />

ω<br />

ω<br />

Painting a picture with numbers: This section describes how many young people have<br />

been involved with <strong>Panyappi</strong> and the range of presenting issues, referral sources,<br />

interagency connections and programs they with which they were invovled.<br />

Young people and family themes: This section describes the experiences and<br />

outcomes identified for young people and families involved in <strong>Panyappi</strong> from the<br />

perspectives of all evaluation participants.<br />

<strong>Program</strong> management themes: These themes specifically relate to program<br />

collaborations, management and funding from the perspectives of all evaluation<br />

participants except young people and families.<br />

Being a mentor: This explores how <strong>Indigenous</strong> mentors have a unique role in the<br />

human services workforce and expectations from their communities based on<br />

comments from all evaluation participants where available. Appreciating their<br />

experiences offers important learning about the program.<br />

Painting a picture with numbers<br />

The information presented in this section is based on available records by up to May<br />

2004. Full records for young people assessed from March 2003 onwards were available.<br />

Records of those assessed prior to that time were incomplete. This was due to the initial<br />

establishment period where fewer referrals and assessments occurred, and breaks in<br />

service when the Coordinator position was not filled during most of 2002. Although<br />

young people were accepted onto the mentoring program following assessment prior to<br />

March 2003, most service delivery has occurred from this date onwards.<br />

The records indicate that <strong>Panyappi</strong> accepted 33 young people for assessment of their<br />

eligibility to gain mentoring support. Of these 30 were offered a service, with one being<br />

referred elsewhere within 2 months and two others becoming too old for <strong>Panyappi</strong><br />

services within a short time after referral. It is difficult to gain an accurate indication<br />

of the length of service received, as several young people were referred prior to the<br />

breaks in service availability, had periods when service was not available for them and<br />

their end-date of service may be after several months of non-engagement. This<br />

artificially lengthens their service period. Those who do receive a mentoring service<br />

often require it for at least 6 months and up to 2 years.<br />

The following figures provide a demographic description of this group of young people.<br />

They give a picture of their age range, living situation, referral sources and referral<br />

reasons. Changes in rates of offending is also available for 15 young people who received<br />

a mentoring service since March 2003.<br />

The average age of the group is 14.2 years. As shown in Figure 5, the majority of young<br />

people are in the 13-15 year age range. More males (60%) were referred compared with<br />

females (40%).<br />

- 34 -


<strong>Panyappi</strong> <strong>Indigenous</strong> <strong>Youth</strong> <strong>Mentoring</strong> <strong>Program</strong> <strong>Evaluation</strong><br />

Figure 5: Age distribution of referrals<br />

64%<br />

Age<br />

15%<br />

21%<br />

10-12 years<br />

13-15 years<br />

16-17 years<br />

Figure 6 shows that almost half the young people live with family members other than<br />

their parents, and a third are in formal foster or other care. “Other care” means nonformal<br />

arrangements with friends or friends’ families rather than formal foster care,<br />

with a quarter in this situation. Nearly 1 in 5 lived with their parents, while only one<br />

young person was homeless.<br />

Figure 6: Living situation for young people<br />

24.2<br />

9.1<br />

Living situation<br />

3.0<br />

18.2<br />

45.5<br />

With parent<br />

With family<br />

Foster care<br />

Other care<br />

Homeless<br />

Figure 7 identifies FAYS and schools as the most frequent referrers, making twice as<br />

many referrals as MAYT or other youth services. There were occasional referrals from<br />

juvenile justice and police. Family members initiated one referral, while one young person<br />

self-referred.<br />

- 35 -


90.0<br />

80.0<br />

70.0<br />

60.0<br />

50.0<br />

40.0<br />

30.0<br />

20.0<br />

10.0<br />

0.0<br />

3.0<br />

3.0<br />

9.1<br />

12.1<br />

<strong>Panyappi</strong> <strong>Indigenous</strong> <strong>Youth</strong> <strong>Mentoring</strong> <strong>Program</strong> <strong>Evaluation</strong><br />

Figure 7: Referral source*<br />

18.2<br />

21.2<br />

Referral source<br />

36.4<br />

39.4<br />

0.0 10.0 20.0 30.0 40.0 50.0<br />

Self<br />

Family members<br />

Police<br />

Justice<br />

<strong>Youth</strong> services<br />

MAYT<br />

Schools<br />

FAYS<br />

* Figures add up to more than 100 as young people were often referred collaboratively by two- four sources.<br />

Reasons for referral<br />

Figure 8: Reasons for referral*<br />

- 36 -<br />

Physical/emotional/sexual abuse<br />

Suicidal behaviour<br />

Substance misuse<br />

Placement breakdowns<br />

Family breakdowns<br />

At risk of sexual exploitation<br />

Frequenting inner city<br />

Medication needed<br />

Other medical issues<br />

Emotional/behavioural problems<br />

Self-damaging behaviour<br />

Running away<br />

Offending behaviour<br />

Teenage parent<br />

Violent behaviour<br />

Cultural connections unknown<br />

Disengaged from education


<strong>Panyappi</strong> <strong>Indigenous</strong> <strong>Youth</strong> <strong>Mentoring</strong> <strong>Program</strong> <strong>Evaluation</strong><br />

As is obvious from Figure 8 there were many reasons for referral, with between one and<br />

ten reasons listed for any single young person and an average number of six reasons per<br />

young person. Most young people were either disengaged or becoming disengaged from<br />

education and involved in offending behaviours. Seventy per cent showed emotional and<br />

behavioural problems, and/or substance misuse issues were very common. Half of all<br />

referrals were regularly frequenting the inner city, which was one of the key initial<br />

criteria for referral that was then broadened out to young people with similar problems<br />

who did not always frequent the inner city. Many were experiencing physical, sexual<br />

and/or emotional abuse, and family breakdown. Over a third were showing violent<br />

behaviour, this was slightly more common among males than females, and a similar<br />

number were running away from their home or placement, with most also frequenting the<br />

inner city and the others at risk of doing so. Placement breakdowns and self-damaging<br />

and/or suicidal behaviour were also apparent.<br />

Thirteen young people (40%) were involved with FAYS:<br />

ω<br />

ω<br />

ω<br />

ω<br />

ω<br />

ω<br />

ω<br />

Seven were under supervision for court orders<br />

Seven had an allocated social worker, with two of these also having a youth worker,<br />

while another three just had a youth worker<br />

Two were under the Guardianship of the Minister<br />

Nineteen young people (58%) were or agreed to became involved with other agencies:<br />

Twelve were involved with the courts<br />

Three were involved with a family worker, four with a counselling service (not<br />

CAMHS) and four with the police<br />

Four were involved with the DECS Attendance Officer<br />

One was involved with CAMHS (child and adolescent mental health services)<br />

Reasons for leaving <strong>Panyappi</strong> were known for eleven young people (33%). They included<br />

non-engagement with mentors after a minimum of at least 4 months of effort (7), being<br />

18 or over (2), being referred elsewhere after six months with <strong>Panyappi</strong> (1) and being<br />

ready to leave after seven months with <strong>Panyappi</strong> (1).<br />

By early May 2004 the current caseload was 14 young people. They were involved in one<br />

or more additional programs offered by <strong>Panyappi</strong> or in collaboration with MAYT. For<br />

example, all are involved in individual genealogy programs, five attend the Art <strong>Program</strong>,<br />

two go to the Tutorial Centre based at MAYT, while one does a Classic Holden program<br />

as an educational option. Several have been involved in a program with Taoundi College<br />

focused on cultural awareness and identity, however, this will now be offered by MAYT.<br />

More programs have been individually rather than group based, as the young people do<br />

not always cope well with group programs. However, since April 2003 there have been a<br />

number of group excursions (e.g. going bowling) and a group camp (e.g. on the One and All<br />

tall ship).<br />

- 37 -


# of offences<br />

<strong>Panyappi</strong> <strong>Indigenous</strong> <strong>Youth</strong> <strong>Mentoring</strong> <strong>Program</strong> <strong>Evaluation</strong><br />

A review of young people’s offending records was possible for 15 young people who are<br />

current clients and/or received mentoring for several months, mostly since March 2003.<br />

The change in the number of instances of offending behaviour is shown in Figure 9. This<br />

includes offences for which there were convictions, detentions, orders, family<br />

conferences, and/or formal cautions. It does not include breaches of orders. Lines in<br />

green indicate a decrease in offences, while the red lines show increases. It<br />

demonstrates that <strong>Panyappi</strong> worked effectively with a range of young people to reduce<br />

their offending behaviour, from those who were at an early stage in their juvenile<br />

justice career to those who were on their way to an entrenched career.<br />

70<br />

65<br />

60<br />

55<br />

50<br />

45<br />

40<br />

35<br />

30<br />

25<br />

20<br />

15<br />

10<br />

5<br />

Figure 9: Change in offending behaviour<br />

0 2 4 6 8 10 12 14 16 18<br />

Length of time with <strong>Panyappi</strong> (months)<br />

The greater majority (12 young people or 80%) decreased their rate of offending by<br />

25% or more – often much more (70 – 100%). Five young people have not offended since<br />

their involvement with <strong>Panyappi</strong>. This is a substantial achievement given the very high<br />

rates of offending for some of these young people over the previous one to three years.<br />

One young person (6.5%) decreased their offending behaviour by less than 25%, as they<br />

struggled to engage with the program for 3 months during which time most of the<br />

offences occurred - currently the young person is not offending. Two young people<br />

(13.5%) have increased their offending. One cannot receive regular mentoring support as<br />

they live in a rural area, but <strong>Panyappi</strong> connects with this young person on their occasional<br />

trips to Adelaide. This has greatly limited progress and the ability to work with the<br />

young person’s family and community network. For the other young person, the offending<br />

- 38 -


<strong>Panyappi</strong> <strong>Indigenous</strong> <strong>Youth</strong> <strong>Mentoring</strong> <strong>Program</strong> <strong>Evaluation</strong><br />

occurred early in the mentoring process then stopped altogether after 4 months of<br />

being with <strong>Panyappi</strong> and further offending has not occurred.<br />

Young people and family themes<br />

The six themes outlined here do not stand independently but intersect and reinforce<br />

each other like threads in a tapestry. We have teased them out so that each aspect is<br />

addressed, as well as being seen as part of a whole picture. Each theme commences with<br />

Susie’s evolving story that was introduced on page 1 – it may be useful to revisit her<br />

story prior to reading the following sections.<br />

A turning point<br />

Susie agreed to mentoring with <strong>Panyappi</strong> because she knew it was important to<br />

her Mum. She is really worried about her and doesn’t want to cause her Mum any<br />

more traumas. She checked this out with another young person at school who is<br />

a good friend, and also talked to the AEW who had been looking out for Susie as<br />

she knew that the family and Susie were having a difficult time.<br />

Susie meets with Mary, one of the <strong>Panyappi</strong> mentors, and they start to build a<br />

relationship although Susie is hesitant about how much she should say and what<br />

Mary will think or her. Susie slowly warms to Mary because she is not like her<br />

teachers or the police. Mary doesn’t give her a hard time about school, even<br />

though she says it will be important for Susie. Mary wants to know more about<br />

what Susie likes to do and why, and what things especialy l interest her. They<br />

talk about family and Mary lets her call her Auntie Lily each week to tell her<br />

know what she is doing.<br />

Even though she doesn’t like it there and there are still hassles to sort out,<br />

after a few weeks she stops skipping school as much and only stays away when<br />

her Mum needs her. She asks her Mum for permission to go out more often,<br />

although she still goes into the inner city.<br />

It is reasonably common that the young people accepted into <strong>Panyappi</strong> have had some or<br />

many people involved with or concerned about them. A few of them have slipped the net<br />

entirely, having disconnected from schooling at an early age and spent much time on the<br />

street. Others live with their families but are confused and unsettled because they have<br />

often experienced significant losses, been exposed to violence or substance misuse, and<br />

almost always been subjected to racism at a personal level and within the education and<br />

human service system.<br />

Many young people, family members and program collaborators reported that previous<br />

efforts to address the situation had been limited or unsuccessful. Every young person<br />

and family member interviewed reported that there was not, or they did not know if<br />

there was, an alternative service that could assist them in the way that <strong>Panyappi</strong> had.<br />

For example, one family member said: “ Without this he’d be nowhere.”<br />

- 39 -


<strong>Panyappi</strong> <strong>Indigenous</strong> <strong>Youth</strong> <strong>Mentoring</strong> <strong>Program</strong> <strong>Evaluation</strong><br />

Workers from collaborating agencies reinforced this position. They identified several<br />

other services, some of which they described as good and helpful, but were clear that<br />

<strong>Panyappi</strong> offered a unique approach. For some of the young people they were not<br />

convinced a viable alternative existed, for example: ”There is nothing else for these<br />

kids. We can’t get them into CAMHS. They don’t fit that as its voluntary and they are<br />

not going to go or CAMHS come to them. This is the only thing that I have seen that has<br />

been able to engage these children. They are still too young for other mentoring<br />

programs” (<strong>Program</strong> collaborator).<br />

More than provide intensive support, program collaborators said that <strong>Panyappi</strong> assisted<br />

young people and families to take steps toward and make connections with schooling and<br />

other services that had previously broken down or they had not accessed. For example,<br />

an education department worker commented:<br />

I have to be really honest. I think if they weren’t involved [with <strong>Panyappi</strong>] this<br />

young person wouldn’t be linked in any way to some form of educational program.<br />

I think in terms of even mainstream schooling he just doesn’t fit in where he is<br />

at the moment in terms of the outcomes for him. Without them being involved<br />

he would be invol ved in a lot more stuff that woul d have negative outcomes for<br />

him. (<strong>Program</strong> collaborator)<br />

One school identified that <strong>Panyappi</strong> had played a strong role in supporting a young<br />

person’s transition to them as a new school, having had a rocky road with the previous<br />

school after some time away from schooling altogether. They reported that:<br />

He has settled into the school really well, especially in terms of his classroom<br />

behaviour and he’s really starting to move on with his academics which is really<br />

fantastic….I suppose he has fitted in and adapted to the class environment very<br />

we ll. I think he is more willi ng to come and seek some help before he engages in<br />

trying to sort it out himself. (<strong>Program</strong> collaborator)<br />

<strong>Panyappi</strong> facilitates a turning point for these young people where changes become<br />

evident in their behaviour, personal choices, emotions, self-belief and relationships.<br />

Young people could identify these changes. One young person explained that:<br />

I would never be abl e to do the things I’ve done if it wasn’tfor Panyapp i.<br />

We<br />

wouldn’t have the money and my mum doesn’t have a car. My mentor comes and<br />

picks me up. I wouldn’t be goi ng to school much if it wasn’t for him….I read a bit<br />

better. I’m starting to go back to school and that’s been a hard thing to do. I<br />

still fight but my attitude has changed and I’ve calmed down. I used to be a lot<br />

angrier. I still get angry but I’m not as violent as I used to be. (Young person)<br />

Family members reinforced young people’s opinions, saying things like:<br />

He used to be a one shot boy – now he wi ll have another go at thi ngs . (Family member)<br />

- 40 -


<strong>Panyappi</strong> <strong>Indigenous</strong> <strong>Youth</strong> <strong>Mentoring</strong> <strong>Program</strong> <strong>Evaluation</strong><br />

He hasn’t been in trouble since he’s been involved. (Family member)<br />

He is wanting to get out and do it, not wanting to sit at home. (Family member)<br />

For other young people, family members indicated a change from being “very distant and<br />

cold” to the young person now having conversations with people he knows, showing<br />

emotions and being affectionate with people he cares about. It was as if young people<br />

had started to come alive and engage with their community again in more positive ways:<br />

“Many kids have done a u-turn and have been re-engaged back into education. Quality of<br />

life and well-being has improved, [there are] better relationships with the schools and<br />

even the Police” (<strong>Program</strong> funder).<br />

A program collaborator reported that, “this young boy had not been to the office for<br />

supervision and would not come. The workers didn’t like going out to the family as there<br />

was often other people there who would abuse them.” With the support of the <strong>Panyappi</strong><br />

mentor he regularly attended supervision for the first time. Although it was clear that<br />

gaining positive outcomes in the situation would not be straightforward, and hiccoughs<br />

have and continue to occur over the year of involvement, this worker said, “it enables my<br />

work and enables the young person to meet the conditions of their offender orders.<br />

With my workload I can’t run around after these kids. If they don’t come in they get<br />

letter, letter, letter. So what’s the use of that if the kid can’t read, which is the case<br />

here. So it’s enabled my work and better outcomes for the kid. In a sense the mentor is<br />

doing the supervision of this order.”<br />

Generating positivity and hope<br />

In a regular supervision session with the <strong>Panyappi</strong> Coordinator, Mary says that<br />

Susie’s outlook is starting to change – it has now been 3 months since the<br />

mentoring started. For the first few weeks she was quiet and shy, waiting for<br />

Mary to start conversations or suggest things to do. More often now she is<br />

smiling and excited when Mary picks her up and has ideas about what she would<br />

like to do – she will spontaneously start talking about things at school, home or<br />

when she goes out at night.<br />

The Coordinator and Mary reviewed the case plan that was developed two<br />

months previously. One goal was to encourage Susie to talk to a counsellor – her<br />

Mum agreed for this to happen but Susie wasn’t keen at first. Mary raises this<br />

issue with Susie again and she agrees, but only if Mary will go with her and as<br />

long as it is not the place the school sent her a year ago because they wanted<br />

her behaviour to improve.<br />

The young people in <strong>Panyappi</strong> have usually felt that no one and nothing is on their side.<br />

Reviewing their personal histories this is a fair summation of their life. When human<br />

service workers intervened it was often because of concern about the problems the<br />

young person was causing for others, or how they were not meeting required behavioural<br />

or developmental expectations. This strong negative focus individualised the problems<br />

and supported a view that maybe the situation was hopeless. Showing concern for the<br />

- 41 -


<strong>Panyappi</strong> <strong>Indigenous</strong> <strong>Youth</strong> <strong>Mentoring</strong> <strong>Program</strong> <strong>Evaluation</strong><br />

young person’s social-emotional wellbeing seemed a lesser consideration in the eyes of<br />

the young person and frequently in the eyes of family members.<br />

Some experienced promises of support being made and then not being followed through –<br />

building up their hopes and then dashing them, leaving them less trusting and more<br />

cynical. Although this does not fit well with existing rhetoric in human services about<br />

good practice, it represents the reality of these young people and families’ lives, as well<br />

intentioned efforts did not always have good outcomes. Several program collaborators<br />

acknowledged that if these young people were attached to statutory services, they were<br />

more likely to experience high turnover of workers and therefore more loss and<br />

rejection.<br />

Even when the referral to <strong>Panyappi</strong> happened under negative circumstances, e.g. young<br />

people were involved with court appearances, already had orders or were being<br />

suspended from school, all young people described <strong>Panyappi</strong> as a positive thing. This was<br />

reflected in a range of ways, from small yet absolutely critical matters such as “they<br />

show up” when they say they will, through to statements such as liking “everything” they<br />

do with <strong>Panyappi</strong>. “You go places, see movies and we went on a boat trip, which was good.”<br />

Young people were willing to do schoolwork with the support of their mentor and to<br />

choose options away from offending behaviour, such as going to the beach, “movies, the<br />

go-carts, playing games, or just hanging out.” One young person said, “we talk about just<br />

stuff we do on the weekend and if we got some new games.”<br />

Mentors identified changes in their clients that demonstrate positive shifts in their<br />

attitude, behaviour and personal situation. For example:<br />

She wants to do as much as she can while I’m with her to put her on a different<br />

track. I think she is really comfortable with herself now. I think [its] the fact<br />

that there is someone out there that is interested in what they are doing and<br />

just wanting to be there and help them and participate in what they want to do,<br />

so they feel valued and important. (<strong>Panyappi</strong> staff)<br />

Collaborating agency workers also noted the importance of other options and positive<br />

choices, for example, the mentor was there:<br />

…for role modelling, [with] that young person not having any other significant<br />

male in their life to [do this ] , so they are looking at this person in terms of their<br />

actions, and what they are doing and the decisions they are making. So it’s<br />

around that stuff as well, a real positive connection around that stuff. (<strong>Program</strong><br />

collaborator)<br />

Both young people and families were clear that they had taken a positive turn, and that<br />

there was hope about the situation. For example, “it gives me something to do, different<br />

from stealing. I used to steal all the time.” Family members were very pleased that<br />

their young people had opportunities to have “a diverse range of things to do and places<br />

to go.” The impact of this shone through: “He is different, more positive, you can tell he<br />

is happier.”<br />

- 42 -


<strong>Panyappi</strong> <strong>Indigenous</strong> <strong>Youth</strong> <strong>Mentoring</strong> <strong>Program</strong> <strong>Evaluation</strong><br />

Although they have often been referred to counselling or other intervention services,<br />

many of the young people have refused to go. <strong>Panyappi</strong> creates an environment where<br />

young people are willing to give something another try, to reconnect with the hope that<br />

it may be a useful and good experience (see the “Strengthening relationships” section<br />

next and “Being a mentor: Roles and responsibilities” for an explanation of how this<br />

occurs). When young people are in other programs, mentors can facilitate better<br />

outcomes through supporting a young person to engage more positively. For example:<br />

It makes it a lot easier. The kids are prepared and ready. A program we run has<br />

a young person from <strong>Panyappi</strong> on there and he is the best of the lot. When I<br />

first went [to pick him up] he wasn’t up. He was always sleeping, so I spoke to<br />

the mentor and I don’t know what he said to him but now he’s first one up in the<br />

mornings. He is a lot easier to get along with. He’s not so negative. He doesn’t<br />

talk so much about his past. The mentor has spoken to him in a way that hasn’t<br />

made the child angry at what he has said. Without the mentor there we would be<br />

struggling. The mentors are preparing them for the programs, which makes our<br />

job much easier. (<strong>Program</strong> collaborator)<br />

If young people still do not engage in other programs despite mentors’ efforts, often<br />

because they are afraid about opening up issues of grief and pain, or cannot easily<br />

access a service, then <strong>Panyappi</strong> provides an alternative outlet for emotional expression<br />

and this alone can make a difference. Family members identify and comment upon this,<br />

for example: “I think they are doing a fantastic job but there should just be a lot more<br />

of it.”<br />

One program collaborator gave an example of young people’s perceptions of <strong>Panyappi</strong><br />

through using word of mouth networks: “We had one kid who requested to be on the<br />

program, wasn’t referred but wanted to be on the program. That to me says a lot. It’s<br />

open. It’s friendly. The kids don’t feel intimidated” (<strong>Program</strong> collaborator).<br />

Strengthening relationships<br />

Susie used to hate Mary picking her up from school, but now she asks her to do<br />

this. She introduces Mary to her friends as her ‘big sister’ and is OK about her<br />

talking to the School Principal. She asks Mary to stay for a while at her house<br />

rather than just drop her off, and doesn’t mind Mary talking to her Mum.<br />

In one of their regular phone conversations Susie’s Mum tells the <strong>Panyappi</strong><br />

Coordinator that because Susie starts conversations with her about what she<br />

does with Mary this helps them have conversations about other things. Susie will<br />

tell her Mum her thoughts and feelings rather than just listen to her Mum and<br />

keep her thoughts to herself. However, Susie won’t talk to her father, just<br />

listen and usually do what he says when he is there because she is scared of him.<br />

There were many ways in which evaluation participants commented on the way that<br />

mentoring built and strengthened relationships. These were the relationships between<br />

mentors and young people, young people and family members, and young people and school<br />

- 43 -


<strong>Panyappi</strong> <strong>Indigenous</strong> <strong>Youth</strong> <strong>Mentoring</strong> <strong>Program</strong> <strong>Evaluation</strong><br />

staff or other services (relationships between the program and other services will be<br />

addressed in the “<strong>Program</strong> management themes” section).<br />

It was very common for family members, workers in collaborating agencies and the<br />

<strong>Panyappi</strong> staff to comment upon difficulties the young people in <strong>Panyappi</strong> had in learning<br />

to trust someone. This was usually based on having their trust broken frequently (at<br />

home, at school or with other services), which created barriers to taking the risk to<br />

trust people again. Current <strong>Panyappi</strong> staff were aware that the trust they built with<br />

young people can be fragile. Not keeping a commitment – even just being a few minutes<br />

late without the young person knowing – could damage any progress that had been made.<br />

MAYT workers identified that: “You have to be honest to that young person because<br />

they have been lied to so many times….[Its] a complete challenge of the family accepting<br />

you and the client accepting you. The hardest part is building the trust. You have to do<br />

what you say you will do.” Family members emphasised the impact of this issue: “Lots of<br />

agencies let kids down. If you get someone like [mentor] on a regular basis then kids<br />

start to trust again and parents know what is happening.”<br />

One of the collaborating agency workers explained what issues of trust meant for the<br />

mentor’s relationship with young people:<br />

They don’t need to be super knowledgeable about health or mental health and<br />

welfare. They don’t have to know everything. What they do need to know is who<br />

to talk to if they need i t,<br />

but they have to be there for the kid. So the young<br />

person can have a yarn to them, talk abou t what’s going on. Most of our kids are<br />

really angry about life, the universe, they don’t really know what. They need<br />

someone to relate to, to talk to….the young person may start sharing a little bit<br />

and get the help that they might not have at home or at school. The mentor is<br />

trustworthy, just listening and being there. (<strong>Program</strong> collaborator)<br />

This person gave examples of this occurring for young people with <strong>Panyappi</strong>:<br />

They would talk in a positive way about their mentor. They would tell us where<br />

they were goi ng. They would say ‘I need to tal k to my mentor about that’. They<br />

would identify another significant adult, which is what we are looking for, who is<br />

going to be consistent and in their life to sort something. (<strong>Program</strong> collaborator)<br />

The importance of this relationship was evident in straightforward comments from<br />

young people who reported that being in <strong>Panyappi</strong> was good and they “felt good” about<br />

seeing their mentor. There were excited about someone visiting and giving them focused<br />

time where the mentor was “listening to me and I would listen to him.” There was a sense<br />

of belonging and being special. This was expanded in family member comments, such as:<br />

He knows that [the mentor] won’t give up on him. (Family member)<br />

- 44 -


<strong>Panyappi</strong> <strong>Indigenous</strong> <strong>Youth</strong> <strong>Mentoring</strong> <strong>Program</strong> <strong>Evaluation</strong><br />

Mentors are like a big brother and they look forward to them coming and doing<br />

the big brother thing. They had a very good relationship the boys. (Family<br />

member)<br />

He looks forward to when [the mentor ] comes. He has got something to do, play<br />

games, can be with someone older that he tends to look up to….It was like a big<br />

brother who is involved in his life and will pick him up and help him, like a normal<br />

big brother does, take him to appointments, study, anything. He really fully<br />

trusts [the mentor] no matter what the situation. (Family member)<br />

<strong>Program</strong> collaborators also identified that the connection between young people and<br />

their mentors is usually strong, for example:<br />

[One young person] was presenting…a whole range of [difficult] issues. His Mum<br />

was saying one day that [the mentor] came around to see him, but [the young<br />

person] was a transient and not at home, but she was home and [the mentor] had<br />

a bit of a yarn with her….When [the young person] came home he was so<br />

disappointed that he had mi ssed [his mentor] . His face lights up when he sees<br />

[his mentor] arriving. (<strong>Program</strong> collaborator)<br />

An unexpected change of mentor when the mentoring relationship has been good does<br />

create the risk of going backwards or repeating traumatic and damaging experiences<br />

where young people feel rejected and lose a sense of positivity and hope. “ I t is critical<br />

that if somebody says that they will do something for our young people that they do it.<br />

Some of our kids are let down everywhere so if we let them down in this where we are<br />

supposed to be helping them then there is nothing left” (<strong>Program</strong> collaborator). If that<br />

does not occur, then the word “mentor” gets a bad reputation among the young people<br />

and they will reject offers to have a mentor.<br />

Unexpected change occurred on a few occasions during <strong>Panyappi</strong>’s life, either due to<br />

overall disruption in the service with changes of staff (as described earlier), or when a<br />

mentor left abruptly and had not prepared the young person for this change. Although<br />

risk management plans are now in place to deal with this, understandably this draws<br />

criticism from young people, families and program collaborators, which may dissuade<br />

them from being involved in <strong>Panyappi</strong>.<br />

One family member described the disruption when her young person was offered a<br />

service in the early stages of <strong>Panyappi</strong>. They initially met with a mentor but services<br />

were not consistently delivered and after a short time the mentor left. Many months<br />

later, after the young person was involved in further offending behaviour and another<br />

recommendation for referral to mentoring was made, the young person was completely<br />

opposed to it. With the encouragement of a FAYS worker and this family member, the<br />

young person gave it one last try, making it quite clear to the mentor that if<br />

commitments were not kept, it was over! This mentor was able to keep commitments,<br />

providing an alternative to previous experiences, and win this young person’s trust and<br />

respect.<br />

- 45 -


<strong>Panyappi</strong> <strong>Indigenous</strong> <strong>Youth</strong> <strong>Mentoring</strong> <strong>Program</strong> <strong>Evaluation</strong><br />

One program collaborator reported that another young person “really looked forward to<br />

[the mentor] coming in but once [the mentor] moved on [the young person] was pretty<br />

disappointed about that because they had a very strong relationship.” This program<br />

collaborator, along with the young person and caregiver, reported that although this was<br />

yet another loss for this young person and grief is still expressed about it, the<br />

relationship is remembered fondly. Further, they described how <strong>Panyappi</strong> buffered this<br />

loss through support from the Coordinator who made regular phone calls and visits until<br />

a new mentor could be allocated, and included the young person in large group outings.<br />

Family members often commented on changes in relationships with their young people.<br />

Either they had smoother and more frequent communication, or they noticed a change in<br />

attitude and confidence. For example:<br />

I have changed my tactics with him. I am not so angry now, listen more and I am<br />

starting to see results. He is coming to me more often, we are relating better.<br />

Its good, I like it, rather than always being at him. (Family member)<br />

He was very withdrawn to start with but he has built up in confidence and he is<br />

very happy now. (Family member)<br />

Other relationships that are influenced are young people’s connections with other<br />

workers. “It’s a great vehicle with [the mentor] being the link person and building that<br />

bridge between us and the client, and even with the family – the program is a bridge<br />

building thing” (<strong>Program</strong> collaborator). Young people, and the family, may be more open to<br />

the presence of these workers in their lives and through their collaboration with<br />

<strong>Panyappi</strong> staff, be happier about these workers knowing more about them. The MAYT<br />

juvenile justice team workers identified that this can create a complimentary situation.<br />

The juvenile justice worker may take up a stronger “disciplinary” role in helping young<br />

people see through their court obligations, while the young person sees the mentor as<br />

having the personal support role. Although the mentor has less authority in the wider<br />

human services context, they still have plenty of authority to the young person. In<br />

addition to the different nature of their roles, this can also relate to available time to<br />

work with young people:<br />

I believe the youth that we work with are basically in a vicious circle and there<br />

is no role model within the family structure. Without a one-on-one mentor with<br />

them to try and break that cycle there isn’t any way out of it. Without the<br />

mentoring we can have a lot of trouble working with the families and the other<br />

kids. We don’t have the time or the resources. We cannot do the mentoring or<br />

have the time to do one-on-one with the kids. (<strong>Program</strong> collaborators)<br />

Importance of family support<br />

Susie goes on a group outing with all the <strong>Panyappi</strong> mentors, the Coordinator and<br />

some of the other young people. When the Coordinator and Mary run a quick<br />

errand to get something the group needs, Susie asks to go with them. In the car<br />

she asks the Coordinator why they aren’t helping her Mum like they are helping<br />

- 46 -


<strong>Panyappi</strong> <strong>Indigenous</strong> <strong>Youth</strong> <strong>Mentoring</strong> <strong>Program</strong> <strong>Evaluation</strong><br />

her. When they ask her what she means, Susie says that her Mum gets really<br />

sad and she is worried about her. The Coordinator explains that she talks to her<br />

Mum by phone almost every week and has done a few home visits too. Susie was<br />

surprised – she knew this happened but didn’t realise how much.<br />

Mary reminds Susie that they were going to review her case plan with the<br />

Coordinator and her Mum in a couple of weeks. Maybe she could take part this<br />

time because she didn’t want to at first. The Coordinator suggests that Mary<br />

and Susie could work on what Susie wants to say at the meeting about how she is<br />

going and any other worries that she has about herself or the family. They will<br />

support Susie and also talk with her Mum about what else they could do to<br />

provide support to her, now that she has made sure Susie is being looked after.<br />

Young people commented that their mentors often talked with their family members or<br />

carers: “I try and get involved with all the family not just [the young person], it makes it<br />

a lot easier if everyone knows who I am” (<strong>Panyappi</strong> staff). They were not bothered by<br />

this and treated it as quite ordinary. Young people also knew that the Coordinator was<br />

involved with talking to their families, and gets to know each young person personally.<br />

They knew they could speak to her if their mentor was not available, which happens when<br />

young people start to initiate contact with their mentors once the relationship has<br />

strengthened, rather than waiting for mentors to do this.<br />

It was apparent from family members’ comments that they understood that <strong>Panyappi</strong><br />

saw them as part of the solution and involved them in identifying activities, options and<br />

goals. They identified how <strong>Panyappi</strong> was supportive of them as well as the young people.<br />

For example:<br />

[The mentor] and I get along well. We discuss things well. (Family member)<br />

It’s really a whole family thing anyway. It’s about [my child] but I feel<br />

supported , I don’t feel left out on my own . It’s gi ven me hope, a bit of hope for<br />

my family. (Family member)<br />

I’ve got to give lots of credit to [the mentors and the Coordinator]. They went<br />

out, talked to kids and parents and then came through [with what they said they<br />

would do ] . (Family member)<br />

Panyapp i became like a second family to us because he al ways looks forward to<br />

[the Coordinator or mentor] coming up. They are like a second family. It’s great.<br />

They show their concerns like family. (Family member)<br />

Witnessing changes in their young people, particularly seeing their young person<br />

disconnect from offending behaviour, reduced the anxiety and stress that family<br />

members had been experiencing for extended periods of time. One family member<br />

commented that: “We don’t get no knock on the door any more. We used to get that all<br />

the time with the police.” A mentor reported feedback they received from a family<br />

- 47 -


<strong>Panyappi</strong> <strong>Indigenous</strong> <strong>Youth</strong> <strong>Mentoring</strong> <strong>Program</strong> <strong>Evaluation</strong><br />

member about their relief to see their young person make a u-turn and become<br />

motivated to do other things: “One parent said to me, ‘I’ve had a really bad experience<br />

within the Department (ie Family and <strong>Youth</strong> Services) and I thought you would jus t be<br />

like the rest of the workers we’ve had, but you have really made a difference’ and<br />

thanked me” (<strong>Panyappi</strong> staff).<br />

Schools commented and appreciated the family-focused and supportive approach of<br />

<strong>Panyappi</strong>, as it often created a link between home and school that they were not always<br />

able to establish:<br />

When the mentor was tuned into the child they became an extra staff member<br />

for me. Not that they were doing things I wanted, [but] they were supporting<br />

the child in the link between us and home. The mentor could provide the link in<br />

special ways if the person was an Aboriginal person particularly, so then we could<br />

be doing that home school link and society link that is harder for us to establish.<br />

(<strong>Program</strong> collaborator)<br />

They also valued sharing the family support role with an outside group, particularly when<br />

they perceived that other services had not met their obligations to provide support:<br />

I think the other side of the mentor program is the Coordinator’s relationship<br />

with [the young person’s carer]. She at times gets to her wits end with him and I<br />

think [her] relationship with the Coordinator is very important. [The carer]<br />

knows she has someone other than me to contact. I’ve got to say I think FAYS’<br />

role with supporting [the young person] has been pretty ordinary. We are trying<br />

to kick that into gear a bit. I think they really need to be giving [the carer]<br />

heaps more support. (<strong>Program</strong> collaborator)<br />

<strong>Panyappi</strong> staff were aware that their work was limited without engagement with families,<br />

even though many problems seemed entrenched and difficult to change:<br />

We can’t just make decisions for this young person without their family. The<br />

information does tend to filter through the family. So I think this is a very<br />

important part of the project. I would like to see <strong>Panyappi</strong> develop this more.<br />

We would like to start taking the families away with us on camps. We are doi ng<br />

the genealogy program, which is built around the family, and so everybody gets<br />

to know ‘this is who you are.’ Even the art program we have told families that<br />

they are very welcome to join. Unless you’re going to make changes in the family<br />

home there is no point working with the young person. We need to understand<br />

what is going on in their li fe . We need to support the famili es so that changes<br />

can be made. (<strong>Panyappi</strong> Coordinator)<br />

When they are here with <strong>Panyappi</strong> they are trying to make a difference and they<br />

are going out. They are making the effort and they are such a changed young<br />

person, but when you see them in the community with their friends or family<br />

they are a totally different person. You can only do so much and what needs to<br />

change is the home. (<strong>Panyappi</strong> staff).<br />

- 48 -


<strong>Panyappi</strong> <strong>Indigenous</strong> <strong>Youth</strong> <strong>Mentoring</strong> <strong>Program</strong> <strong>Evaluation</strong><br />

At the same time, they were aware the effort was worth it once they got past families’<br />

initial cautiousness and trust started to build: ”I find that a lot of the families are really<br />

funny about FAYS because they have had a lot of bad experiences with them, so you<br />

really have to work with the family members because they see us all as one, not<br />

individuals. For the first couple of weeks working with the client, it’s really hard to<br />

engage with the family members, let alone the client, but when you start building a good<br />

relationship with them it’s excellent” (<strong>Panyappi</strong> staff).<br />

Other program collaborators and Advisory Group members talked about the importance<br />

of “respite” for families who are often stressed and in crisis while trying to support<br />

young people whose behaviour is difficult, often in response to family stress and crises.<br />

It can create a break in the vicious cycle they are in. They reinforced the value of a<br />

family-inclusive approach, for example: “It is good for the family as well, getting the<br />

young person back to school, getting the family involved and bringing the family back<br />

together.” Some recognised that there are times when <strong>Panyappi</strong> can engage families<br />

better than they can, and were happy to support that and take a background role in<br />

order to facilitate a more culturally appropriate response.<br />

Connections with schooling<br />

Although Susie is attending school more regularly she has frequent clashes with<br />

teachers about completing her work and her level of attention in classes. Susie<br />

agrees for her mentor and the Coordinator to meet with the School Principal,<br />

AEW and her main teacher. Susie doesn’t want to be at the meeting but asks her<br />

Mum to go, who agrees, and <strong>Panyappi</strong> helps to organise childcare for the younger<br />

ones. The school gains more information about the situation for Susie and what<br />

is getting in the way of her learning and ability to complete or concentrate on<br />

her work. They also learn about the racist teasing that Susie receives from<br />

other kids in the yard. They find out that Susie has started to see a counsellor<br />

and that through <strong>Panyappi</strong>’s work, her Mum is also receiving personal support<br />

from another service so she copes better and can move forward with addressing<br />

the violence at home.<br />

This expanded understanding helps the teacher and School Principal to agree on<br />

a different approach to responding to Susie in class, rather than assuming she is<br />

lazy or incapable, and avoid her getting suspended. They also agree to use some<br />

of their curriculum materials around bullying to help address the issues in the<br />

yard. In this way Susie may experience the teachers being more supportive and<br />

understanding. <strong>Panyappi</strong> offers to arrange access to a tutorial program<br />

connected to MAYT, their auspicing agency, to help Susie catch up on work that<br />

she has missed over the last two years so that she can have more positive<br />

experiences in class and feel like she is able to complete class work and<br />

homework.<br />

Every young person involved with <strong>Panyappi</strong> has had a difficult time with mainstream<br />

schooling. The disconnection from schooling may have been due to schools not identifying<br />

specific learning difficulties earlier in a child’s schooling, or reading them as behavioural<br />

problems and offering the wrong response. Young people get further and further behind<br />

- 49 -


<strong>Panyappi</strong> <strong>Indigenous</strong> <strong>Youth</strong> <strong>Mentoring</strong> <strong>Program</strong> <strong>Evaluation</strong><br />

and in response to feeling alienated from the curriculum develop erratic and disruptive<br />

behaviour, reinforcing misconceptions about the cause of their behaviour. In addition,<br />

the curriculum has often not represented Aboriginal people’s experiences or<br />

represented them poorly. <strong>Indigenous</strong> young people may be bullied in the yard and cope by<br />

withdrawing or fighting back, so they are then named as the troublemakers. Schools<br />

interact with family members mainly when there are problems, may assume that family<br />

members will not connect with schools or misunderstand why they may not get good<br />

responses when they do try and connect. These are examples of institutional and cultural<br />

racism that continue to be reported in the education system despite a desire and<br />

increasing efforts since the 1990s to minimise them. 60,61,62<br />

Upon referral some young people in <strong>Panyappi</strong> are no longer connected to any schooling<br />

and others attend alternative schooling options offered by the education department. If<br />

they are at mainstream schools, then often there are still issues in both the class and<br />

yard to address. Schools’ understanding of this situation can be variable. Although they<br />

are keen to have the <strong>Panyappi</strong> mentors involved, <strong>Panyappi</strong> staff reported that they can<br />

have unrealistic expectations of their role, such as expecting them to be like an<br />

Aboriginal Education Worker (AEW) or to attend classes with young people.<br />

As indicated in the themes above, young people in <strong>Panyappi</strong> have made significant<br />

changes in their attitude and connection to schooling. Family members have commented<br />

that working with a mentor has made their young person want to go back to school or<br />

take another educational option to learn more. MAYT workers identified young people<br />

with whom they previously worked who were “really clearly disengaging” from school but<br />

were now “going to school who haven’t been to school in a long time.”<br />

The young people are taking up different options suitable to their age and interest, such<br />

as full-time mainstream schooling, part-time mainstream schooling with on-the-job<br />

experience of vocational education and training (VET), full or part-time alternative<br />

education options within the education system, or straight VET options. Some have<br />

participated in the MAYT-based Tutorial <strong>Program</strong> as either a first step back into<br />

schooling or as an additional support. Most participate in the cultural awareness training<br />

and experiences offered through a joint program by MAYT and Taoundi College.<br />

In collaborating with <strong>Panyappi</strong>, schools are also considering what they do to support<br />

young people in having positive experiences at school. For example:<br />

Right from the word go I said to [the young person] ‘this is a fresh start so how<br />

you behave will set the reputation you are going to get as a student here.’ We<br />

have a lot of staff members here who have a great awareness of the needs of<br />

Aboriginal kids too. So I think he knows that out in the yard if a teacher comes<br />

along he is going to get a fair hearing…. I’m determined that I want to see him<br />

60 Rigney, L. (1995). <strong>Indigenous</strong> Australians: Addressing racism in education. Dulwich Centre Newsletter, 2&3,<br />

5-15.<br />

61 Thorsen, B. (1995). Being <strong>Indigenous</strong> in Australian schools. Proceedings of the Asia-Pacific Human Sciences<br />

Research Conference, Churchill, Victoria.<br />

62 Social Inclusion Unit. (2003), op cit, pp.19-20, 24-26, 31, 45.<br />

- 50 -


<strong>Panyappi</strong> <strong>Indigenous</strong> <strong>Youth</strong> <strong>Mentoring</strong> <strong>Program</strong> <strong>Evaluation</strong><br />

be successful, just the same as all kids, but I guess I’m keeping a bit of an eye<br />

on him to make sure resources are here to support him and his needs. (<strong>Program</strong><br />

collaborator)<br />

One family member said that the mainstream school her young person attended was<br />

“doing reconciliation with the other kids and they all want to be involved. The racism<br />

gets dealt with and he is doing great.”<br />

An issue important to schools is when mentoring work occurs. If young people attend<br />

school they would prefer them to not have too much time out unless it is educationally<br />

focused. Options for lunchtime or after-school support are preferable and they<br />

negotiate with <strong>Panyappi</strong> to offer this wherever possible.<br />

Looking to the future<br />

A few months into her time with <strong>Panyappi</strong>, Susie makes the transition to high<br />

school. Only a couple of her friends go with her and she feels isolated and<br />

worried about how she will get on with teachers who don’t know or understand<br />

her situation. She has made many changes by this stage, such as better<br />

relationships with her Mum, rare visits to the inner city but with permission<br />

from her Mum , no use of yarnd i or alcoho l, feeling more positive at schoo l and<br />

catching up with work. However, this proves to be a rocky time and she starts<br />

skipping school and catching up with her old friends from the inner city either<br />

there or at the current popular hang-out. The school calls <strong>Panyappi</strong> to ask them<br />

to find Susie when she hadn’t been for two days. When Mary does locate her,<br />

Susie tells Mary that she thinks <strong>Panyappi</strong> won’t continue with her now that she<br />

has mucked up. Mary reassures her that won’t happen – slip-ups happen. They will<br />

help her work out things at school so she can stay on track and they will stick by<br />

her until Susie is more confident of this.<br />

When asked what would happen after their time with <strong>Panyappi</strong>, it was apparent that<br />

most young people had the positive expectation that they would stay with <strong>Panyappi</strong>, and<br />

therefore their mentor, for some time. Some also expressed that they needed this, for<br />

example: “I should be right when <strong>Panyappi</strong> finishes - not for a while though.”<br />

Family members were more direct in their thoughts about this. There was a sense that<br />

their young people would be OK after <strong>Panyappi</strong>, coupled with the hope that there would<br />

be ongoing support. For example, “hopefully after all this work we are doing he will cope<br />

on his own.” Another comment was: “He will keep on going, he won’t look back, he doesn’t.<br />

He wi ll make it. I am pretty confident he is on a good track.” Others were concerned<br />

about <strong>Panyappi</strong> not stopping too soon, or about being there for the young person through<br />

a second stage where support was still present even if not as intensive. For example:<br />

It would be too soon for him because he has only just started all this (4 months<br />

ago ) and all of it is because of [the mentor ], so if he lost him I think everything<br />

woul d be lost . I thi nk it wil l be awhil e before he is ready to go it alone. (Famil y<br />

member)<br />

- 51 -


<strong>Panyappi</strong> <strong>Indigenous</strong> <strong>Youth</strong> <strong>Mentoring</strong> <strong>Program</strong> <strong>Evaluation</strong><br />

I think with <strong>Panyappi</strong> once they get him to this stage of the help, there should<br />

be a second stage of help for them when they leave. Help them to survive, keep<br />

on track with those kids so that they don’t get lost. It needs to go on. ( Family<br />

63<br />

member)<br />

Young people and families were not alone in their opinions on this. <strong>Program</strong> collaborators<br />

were concerned for the future of the program and the young people if the program was<br />

not available. They commented that the concept was excellent, but needed to be funded<br />

appropriately and over a sufficient length of time to allow the program to become<br />

established, offer job security to avoid losing staff, maintain continuity of support to<br />

young people, and for the mentoring role to be appropriately understood by program<br />

collaborators so there are reasonable expectations. They were confident that under<br />

these conditions ongoing evaluation of <strong>Panyappi</strong> would demonstrate outcomes with enough<br />

young people to substantiate those outcomes that had already been achieved.<br />

<strong>Program</strong> management themes<br />

Similarly to the young people and family themes, there is mutual influence between the<br />

themes named here. They reflect issues that typify the establishment and management<br />

of program initiatives that have uncertain futures beyond their initial funding grant.<br />

Establishing a new program<br />

It was apparent from talking with program collaborators, program funders and advisory<br />

group members that they appreciated the effort needed to establish a new program<br />

such as <strong>Panyappi</strong>. Many acknowledged that the program had a difficult start with three<br />

Coordinators to date and the second one leaving very suddenly. This had a negative<br />

impact on staff, resulting in them also leaving, and caused breaks in program continuity<br />

and mentor recruitment. Four months into the program the first Coordinator and MAYT<br />

management, who had a shared understanding of the program focus, were informed by<br />

program funders that they must maintain clearer distinctions between their client<br />

groups, with <strong>Panyappi</strong> having a strictly inner city focus on young people who may or may<br />

not be FAYS clients. This created problems in redefining auspicing arrangements (see<br />

below) and slowed the establishment process.<br />

<strong>Program</strong> funding was also not entirely secure, with a $90K shortfall that was not<br />

directly provided by FAYS as initially promised. FAYS decided to recover this through<br />

establishing most mentor positions as traineeships, reducing mentor numbers to 6 and<br />

removing car access. This was not a straightforward process and slowed program<br />

progress. It meant recruiting people with little or no experience in the workplace or in<br />

human services, resulting in the first Coordinator spending considerable time supporting<br />

and mentoring staff who did not always make good decisions in how to mentor young<br />

people or manage their time. The Coordinator often directly mentored young people to<br />

maintain support for them when mentors were inconsistent or tried to “save” the young<br />

63 This comment refers to the idea of providing support “beyond the trouble zone” as noted on<br />

page 18 in the “How <strong>Panyappi</strong> works” section.<br />

- 52 -


<strong>Panyappi</strong> <strong>Indigenous</strong> <strong>Youth</strong> <strong>Mentoring</strong> <strong>Program</strong> <strong>Evaluation</strong><br />

people rather than “teach” them life skills. Despite requests from the program, FAYS<br />

offered minimal support in managing these human resource and industrial problems.<br />

Although referrals began in the early stages, they were not actively encouraged and<br />

many went on hold “because the mentors were new and very young” (please also see<br />

“Becoming a human services worker: Being a Mentor” below.)<br />

[The first coordinator ] didn’t get a lot of referrals because he was pretty well<br />

flat out trying to put everything together and formulate how the program would<br />

operate. It was just getting the mentors together, organising training, and<br />

getting them to work in partnership with MAYT. See how that would all fit…and<br />

the paperwork that goes with it. (<strong>Program</strong> collaborator)<br />

<strong>Evaluation</strong> participants said that the establishment phase is the best time for bumps to<br />

occur in order to clarify issues, gain valuable learning, and set a strong foundation that<br />

supports programs in travelling smoothly - this certainly occurred for <strong>Panyappi</strong>. They<br />

viewed that <strong>Panyappi</strong> became a functioning program in early 2003 when the third and<br />

current Coordinator started, following a 5-month period of the position being vacant and<br />

MAYT oversaw it in addition to their own work. New mentors were recruited and<br />

establishment work was completed. Participants believed program impact could only be<br />

determined on the basis of the last 12 months - most evaluation interviews occurred in<br />

Feb-Mar 2004.<br />

There was pressure to provide services before the training of new mentors was<br />

complete in 2003. On the one hand this was positive in terms of responding to high level<br />

need, the waiting list and the repeated delays in service delivery moving to full capacity,<br />

but one program collaborator identified the downside: “Training should have been<br />

separate from the doing. Some may not have been ready for what was expected of<br />

them.” Shortcuts into program delivery may slow progress down in the long run if people<br />

are not sufficiently prepared for the varied aspects of their role. This was most<br />

apparent in the early phase of <strong>Panyappi</strong>, but still occurred in 2003.<br />

These views concur with evidence in the literature that mentoring program targeting<br />

young offenders often have longer than expected development times and require<br />

dedicated effort to create and maintain partnerships that help access young offenders<br />

through the juvenile justice system while keeping the program voluntary. This can<br />

increase the pressure on staff, leading to frustration and turnover of mentors,<br />

especially if they are unprepared for the effort required to engage young people. 64<br />

The role of the Advisory Group<br />

<strong>Panyappi</strong>’s Advisory Group included representatives from program funders, community<br />

representatives, and program collaborators (see Figure 4 on page 16). Meetings have<br />

been between one and five months apart across the duration of the program.<br />

64 ARTD (1999/2001) op cit, p.19.<br />

- 53 -


<strong>Panyappi</strong> <strong>Indigenous</strong> <strong>Youth</strong> <strong>Mentoring</strong> <strong>Program</strong> <strong>Evaluation</strong><br />

Attendance has been variable and with declining attendance meetings became infrequent<br />

during 2003. Advisory Group members identified that their role was to:<br />

ω<br />

ω<br />

ω<br />

ω<br />

offer the <strong>Panyappi</strong> program support and guidance in program implementation<br />

assist with exploring issues and identifying possible solutions<br />

provide feedback about program impact and progress<br />

facilitate networking and awareness among agencies likely to be involved with the<br />

young people and families serviced by <strong>Panyappi</strong><br />

Advisory Group members believed the group had not functioned optimally due to<br />

inconsistent attendance and meetings. For some this was due to managing multiple<br />

commitments and difficulty in dedicating time to this role. One member believed that<br />

members could be more proactive in contacting <strong>Panyappi</strong> staff to stay updated, offer<br />

support and network: “The Advisory Group need to support the Co-ordinator so that she<br />

can take the initiative - she also needs support.” Some reported that the <strong>Panyappi</strong><br />

Coordinator had contacted them to network and gain opinions on program developments.<br />

Others identified that differences in opinion about auspicing arrangements and issues<br />

that pre-existed the program had created fractures in the group that prevented<br />

constructive conversations and consistent support for <strong>Panyappi</strong>. They saw this as<br />

working against the program and the overall goals it was trying to achieve, and something<br />

that needs to be transcended. These issues appear to have led to few meetings during<br />

late 2003. Members made comments such as:<br />

I think more than enough information has been fed into the group but getting<br />

something back has been very disappointing. I think the project has<br />

demonstrated now that it doesn’t need an Advisory Gr oup. I would be looking at<br />

ways of translating the information to key stakeholders in different ways,<br />

through a newsletter or when you have events invite stakeholders rather than<br />

sitting around a table. (Advisory group member)<br />

So whether there is a lot of worth to having an advisory group now, perhaps not.<br />

The program is up and running efficiently and doesn’t need an advisory group<br />

anymore. (Advisory group member)<br />

I think we need to think about the standard Advisory Group differently. We<br />

should separate two functions. Community connections can be done at a more on<br />

the ground level rather than with workers in other services. The operational<br />

work is best done by the trage i group, like theInner City Triage Group that<br />

looks at the practical issues of working with the young people and collaborating<br />

on this – who should see them to do what. (Advisory group member)<br />

This situation raises questions about what are appropriate and effective support<br />

structures for the program and whether an Advisory Group is the option of choice.<br />

Trying to achieve and sustain an engaged and effective Advisory Group is a common issue<br />

- 54 -


<strong>Panyappi</strong> <strong>Indigenous</strong> <strong>Youth</strong> <strong>Mentoring</strong> <strong>Program</strong> <strong>Evaluation</strong><br />

in pilot programs in human services – it is not unique to <strong>Indigenous</strong> programs. Despite<br />

these issues, there is consistent evidence from Advisory Group members and other<br />

evaluation participants that the program is currently well managed, has dealt with many<br />

issues related to the earlier life of the program, and has made good progress toward<br />

program goals. Most agree that further outcomes could be achieved with more<br />

consistent support and committed funding (see below).<br />

Auspicing arrangements<br />

Any auspicing arrangement must tackle issues such as: infrastructure support, access to<br />

resources (shared or independent), communication agreements, role clarification, service<br />

philosophy, and levels of collaboration in management and service delivery. Similarities<br />

and differences in approaches and values will determine whether mutually supported<br />

arrangements are achieved. The questions surrounding the auspicing arrangement were<br />

described in “History of <strong>Panyappi</strong>: Deciding on the auspicing agency” above.<br />

In the early stages of <strong>Panyappi</strong> the program was taken in a more independent direction,<br />

which did not fit with MAYT’s hopes as the auspicing body. Together with the issues<br />

facing MAYT at that time this may have contributed to some of <strong>Panyappi</strong>’s teething<br />

difficulties. MAYT underwent a transition in staff and management, as well as dealing<br />

with crowded office facilities. The situation improved by late 2002, and then further<br />

throughout 2003 with their shift to The Parks location. This contributed to more stable<br />

support for <strong>Panyappi</strong> and increased collaboration between MAYT and <strong>Panyappi</strong> staff,<br />

first at the management level and subsequently at a worker level.<br />

Throughout 2003, evidence that the auspicing arrangement was effective, as well as<br />

appropriate, started to emerge more clearly. The shift to The Parks meant <strong>Panyappi</strong> had<br />

good access to space, cars, phones, computers and other infrastructure. This may have<br />

been less visible to Advisory Group members, as there were fewer meetings in 2003 and<br />

those that occurred were not well attended, so opinions may be not be based on the<br />

current situation. <strong>Program</strong> funders at the state level felt confident that <strong>Panyappi</strong>’s<br />

location was appropriate, particularly from an infrastructure point of view.<br />

Some program collaborators were concerned about access, with <strong>Panyappi</strong> based at The<br />

Parks in the western suburbs while its main brief was the Inner City. Although in an area<br />

with a significant Aboriginal community, other areas were named. Not all program<br />

collaborators realised that the workers were highly mobile and most mentoring occurs in<br />

young people’s homes, schools or communities, not at the <strong>Panyappi</strong> office. Although some<br />

group programs are located in The Parks and Port Adelaide, mentors provide transport<br />

for young people to get there. For a couple of evaluation participants, the long-held<br />

concern about whether <strong>Panyappi</strong> is sufficiently community based remains. Their opinions<br />

favour a non-government location with an inner city youth service as the auspicing body.<br />

Alternatively, if <strong>Panyappi</strong> continued and expanded they would support <strong>Panyappi</strong> remaining<br />

where it was as an umbrella body, provided it placed outreach workers in <strong>Indigenous</strong><br />

community agencies across the northern and western suburbs. The core issue that all<br />

evaluation participants shared was ensuring that it met the needs of <strong>Indigenous</strong> young<br />

people, whether they frequented the inner city or other suburban locations.<br />

- 55 -


<strong>Panyappi</strong> <strong>Indigenous</strong> <strong>Youth</strong> <strong>Mentoring</strong> <strong>Program</strong> <strong>Evaluation</strong><br />

All program collaborators indicated their support for <strong>Panyappi</strong> being located with and<br />

run by Aboriginal people in an Aboriginal agency. For some the location had limited<br />

impact as most contact was through phone, email or mentors visiting the agency with the<br />

young person. It was important “knowing the people work there with similar beliefs,<br />

attitudes and goals.” A comparison was made with the FAYS general mentoring pool:<br />

I am not sure what that would be worth. Whether those sorts of mentors would<br />

be able to engage these kids. I think the fact that it is an Aboriginal service for<br />

Aboriginal people, with the other stuff being more mainstream I don’t think it<br />

would be so effective, or the people I’m referring would be as open to their<br />

assistance as they are to <strong>Panyappi</strong>. (<strong>Program</strong> collaborator)<br />

While acknowledging the rocky journey <strong>Panyappi</strong> travelled to its current point, a MAYT<br />

staff member reported that:<br />

I think the reason why <strong>Panyappi</strong> can be so successful is it’s co-location. It’s<br />

auspicing under something like MAYT where you’ve got the support network, the<br />

career pathways and you’ve got training and all of the things that young mentors<br />

are going to need to learn and know so they can work credibly alongside [other<br />

workers involved with the young person and family]. (<strong>Program</strong> collaborators)<br />

MAYT staff identified the importance of having <strong>Panyappi</strong> at an Aboriginal agency that<br />

was sufficiently resourced and committed to culturally appropriate practice and working<br />

in partnership with mainstream agencies: “It’s about head sets and infrastructure too.<br />

We can always wriggle the infrastructure to fit another desk in but it’s hard to wriggle<br />

people’s brains to get another thought in or a different track” (<strong>Program</strong> collaborators).<br />

<strong>Panyappi</strong> mentors were mostly supportive of the co-location although they hoped that<br />

<strong>Panyappi</strong> could be more independent if it continued and expanded, as this would help<br />

distinguish it from MAYT and build its profile:<br />

It’s been a good location for the program and MAYT has been really supportive<br />

of <strong>Panyappi</strong>. I think we might have run into a brick wall if MAYT wasn’t here in<br />

terms of understanding what we are on about. I know with some of the programs<br />

that MAYT do we combine and bring all our clients in together. (<strong>Panyappi</strong> staff)<br />

MAYT believed their existing history of managing mentoring programs was valuable.<br />

FAYS fund this mentoring capacity as part of the larger pool of mainstream mentoring<br />

funds. It has been inadequate funding, ~ $33K/year which is less than one full-time<br />

position, but with a broad scope to provide mentoring for any young person involved in<br />

the juvenile justice system. Although <strong>Panyappi</strong> has a different focus, they have placed<br />

the casual mentor pool under <strong>Panyappi</strong>’s management to provide a consistent training,<br />

support, policy and practice environment for all <strong>Indigenous</strong> youth mentoring.<br />

The main concern that <strong>Panyappi</strong> faced in 2003 was developing effective partnerships<br />

with MAYT youth workers so the different roles of youth workers and mentors were<br />

- 56 -


<strong>Panyappi</strong> <strong>Indigenous</strong> <strong>Youth</strong> <strong>Mentoring</strong> <strong>Program</strong> <strong>Evaluation</strong><br />

understood and they could collaborate effectively. This proved more challenging than<br />

working with the MAYT family workers. Progress has been made in this area, e.g. “we<br />

know more and have more of an understanding [of what mentoring involves].” MAYT<br />

youth workers reported they were committed to building closer working relationships<br />

with mentors, and <strong>Panyappi</strong> mentors indicated they were keen to work in buddy systems<br />

with youth workers to strengthen collaboration and contribute to on-site training. MAYT<br />

Management has lead the way for collaboration, as it includes the <strong>Panyappi</strong> Coordinator<br />

in MAYT Management meetings, planning and decision-making processes. MAYT is aware<br />

that they also gain from the auspicing arrangement. MAYT Management reported that:<br />

<strong>Panyappi</strong> also offers MAYT support. It is another avenue at looking at different<br />

programming and ideas for the kids. There may be different ways of working<br />

together. They take the pressure off some of the main staff because they can<br />

do what the youth worker’s can’t do in relation to their time. (<strong>Program</strong><br />

collaborators)<br />

Funding partnerships<br />

<strong>Panyappi</strong> staff reported that the program gained strong support from the Crime<br />

Prevention Unit, State Attorney General’s Department. The Senior Project Officer<br />

assigned to supporting <strong>Panyappi</strong> was the key link with the Commonwealth Attorney<br />

General’s Department. As the local level of the Department of Human Services, <strong>Panyappi</strong><br />

staff perceived that MAYT offered high level support in terms of the in-kind resources<br />

and direct funding they contributed, and their consistent advocacy for funding support<br />

at a central level.<br />

Questions were raised about the level of support and leadership provided by the central<br />

office of DHS throughout the program’s history. A few people reported that the minimal<br />

support and interest for <strong>Panyappi</strong>’s work, and its vision for how that could be enhanced<br />

and expanded, has had a detrimental and constraining effect on program recognition and<br />

development in DHS. <strong>Program</strong> monies were shifted without consent, responses to budget<br />

queries were slow, and considerable work was required to get accurate budget figures<br />

and recover monies. Information was not passed on to senior management levels so they<br />

could fully appreciate what <strong>Panyappi</strong> offered. This was also seen as stepping away from<br />

responsibility when <strong>Panyappi</strong> is often involved with young people who are part of the<br />

Department’s core business through Family and <strong>Youth</strong> Services. For example, a person<br />

who is independent of <strong>Panyappi</strong> and MAYT staff commented:<br />

If we had more support from DHS we would have had a better platform to really<br />

raise the profile of <strong>Panyappi</strong> through DHS and through that, better advocate on<br />

behalf of young <strong>Indigenous</strong> kids invol ved in the program and [have] more people<br />

knowing and being aware of the program and where it’s trying to head.<br />

<strong>Program</strong> collaborators, particularly those in community-based agencies that often<br />

depend upon project grants to survive, were particularly frustrated with <strong>Panyappi</strong>’s<br />

short-term funding situation. They viewed this short-term approach as disrespectful; it<br />

allows something to get started but then fails to support it to become sustainable,<br />

rather than using a “capacity building” model where the funding body plays an active role<br />

- 57 -


<strong>Panyappi</strong> <strong>Indigenous</strong> <strong>Youth</strong> <strong>Mentoring</strong> <strong>Program</strong> <strong>Evaluation</strong><br />

in supporting project sites to develop sustainability plans and fund them for a sufficient<br />

length of time so they can be successfully implemented. 65 As one of the funding bodies,<br />

the Crime Prevention Unit, State Attorney Generals’ Department, was active in providing<br />

support and developing sustainability plans but this was not matched by the two other<br />

funding partners.<br />

We are sick of the merry-go-round. People get angry and frustrated at another<br />

short-term handout that makes the government look like they are doing<br />

something but little is left with the community as there is no ongoing support.<br />

This is disappointing with a program like <strong>Panyappi</strong> that can offer important<br />

things to young people who often have no one else to turn to, to tutor them in<br />

life like a tutor does with schoolwork. (<strong>Program</strong> collaborator)<br />

This situation raised the issue of whether, “these programs get set up to fail. I see that<br />

as not only failing ourselves, but the community and failing the young people. If programs<br />

are set up like this it’s really important to keep them running. To make a change, we need<br />

successful programmes like this. If funding runs out, where is it going to leave the young<br />

people?” (<strong>Panyappi</strong> staff).<br />

<strong>Program</strong> collaborations<br />

A central location for program collaborations was established through the Inner City<br />

Triage group set up by <strong>Panyappi</strong> and the State Attorney General’s Department, Crime<br />

Prevention Unit in the latter half of 2003. However the intention was to use it for<br />

identifying young people and determining immediate referral options, and less for<br />

ongoing service delivery. A program funder believed that creating the Inner City Triage<br />

Group has, “brought to the attention of many people and government agencies that there<br />

are some issues with young Indgenous i kds i especially withn i the city. It has aso l put<br />

these issues on the table…an outcome that we weren’t expecting. We had a lot of<br />

participation from other [youth and government] agencies in town. That level of<br />

communication wasn’t there before. <strong>Panyappi</strong> has been the driver.” Unfortunately, in<br />

May 2004 the Inner City Triage group was disbanded as the Department of Human<br />

Services supported an alternative group for inner city workers that focused more on<br />

networking, losing the interagency case discussion and decision focus.<br />

Most other program-based collaborations occur with schools, FAYS, MAYT youth and<br />

family workers, juvenile justice, and other family support programs. Schools have both<br />

referred to and directly benefited from <strong>Panyappi</strong>’s work. One school with a high number<br />

of Aboriginal students said that their enthusiasm for gaining mentoring support meant<br />

they nominated more young people than could be absorbed, and realised it was easy to<br />

overload <strong>Panyappi</strong> due to the intensive nature of the work and therefore small caseloads<br />

required. Their experience of the program once a referral was accepted “really<br />

depended on the nominated mentor after that. Some of the mentors were very good and<br />

some were not very good at all” (<strong>Program</strong> collaborator).<br />

65 The Foundation for Young Australians (http://www.youngaustralians.org/) has developed this approach over<br />

the past two years, which is also known as “venture philanthropy.”<br />

- 58 -


<strong>Panyappi</strong> <strong>Indigenous</strong> <strong>Youth</strong> <strong>Mentoring</strong> <strong>Program</strong> <strong>Evaluation</strong><br />

When young people attended school, the schools expected flexibility from mentors in<br />

offering after-school options to support young people’s engagement with education.<br />

When they gain this flexibility, then “schools are wrapped with <strong>Panyappi</strong> because of the<br />

work they do in the schools” (<strong>Program</strong> collaborators). When mentors were appreciated,<br />

they stayed in regular contact with school staff, negotiated visit timing as well as time<br />

away to help young people attend other appointments, supported schools in getting young<br />

people to attend and complete work, and provided links between home and school to<br />

facilitate that relationship. A non-school based education worker reported:<br />

It’s been a real partnership in terms of my role. There are certain things I can<br />

and can’t do in relation to the young person….There is regular dialogue in terms<br />

of where the young person is at, trying to work out the best outcomes for the<br />

young person as well. [The Coordinator] and [mentor] have been really supportive<br />

in terms of the work they have been doing. (<strong>Program</strong> collaborator)<br />

A different program collaborator described <strong>Panyappi</strong>’s work as a holistic, familyinclusive<br />

and culturally appropriate approach, while their agency stayed involved in a case<br />

management role with regular communication with the mentor as the “frontline” worker.<br />

Although this agency is used to doing the frontline work, they believed this arrangement<br />

works effectively in situations where the issues are serious, confronting and long-term:<br />

Its working with the kids that are falling through the gaps and trying to make<br />

the services available, getting kids to appointments, being creative with their<br />

service in some respect, working quite intensely with the family, the mentor<br />

being the role model for the kid and getting them on board with engaging the<br />

parents…With . this family (2 kids) we’ve linked in the MAYT Drug and Alcohol Counsellor so its been quite a holistic approach in terms of MAYT doing a broad<br />

range of things with the family, as well as involving a family support worker from<br />

[another agency]. (<strong>Program</strong> Collaborator)<br />

<strong>Youth</strong> or family workers at MAYT also reported high satisfaction when mentors engaged<br />

in collaborative work, for example:<br />

The family is interested in what is happening. It is a relief knowing that a<br />

mentor is working with that young person because we just don’t have the time.<br />

The mentor gives the workers time out and also the family. (<strong>Program</strong><br />

collaborators)<br />

We had a boy [with] a carer, social worker, MAYT worker and a mentor - also a<br />

family worker. There were a lot of people involved but with everybody talking<br />

and communicating i t worked pretty well for him. (<strong>Program</strong> collaborators)<br />

Although other services expressed some dissatisfaction with collaboration, it appears<br />

this was due to: unrealistic expectations of <strong>Panyappi</strong>’s capacity, misconceptions about<br />

the mentoring role (see below), and different opinions on the auspicing arrangements<br />

which may detract from collaboration and focusing on the work itself.<br />

- 59 -


<strong>Panyappi</strong> <strong>Indigenous</strong> <strong>Youth</strong> <strong>Mentoring</strong> <strong>Program</strong> <strong>Evaluation</strong><br />

Some program staff, funders and advisory group members acknowledged that, “there<br />

has been some really strong links forged with the police.” As part of their commitment<br />

to supporting <strong>Panyappi</strong>’s work and acknowledging their shared concerns about the<br />

wellbeing of <strong>Indigenous</strong> young people, SAPOL are finalising a Memorandum of Agreement<br />

with <strong>Panyappi</strong>. This stands out given the experiences that most young people in <strong>Panyappi</strong><br />

may have had with police.<br />

I’ve made a point of building very strong relationships wi th Police so that we can<br />

maybe make some changes in the way they feel and look at how they pick up our<br />

kids. I’ve done a lot of training, especially the inner city around what <strong>Panyappi</strong><br />

does and how we can involve the Police and they can be a referral point for us.<br />

They were so receptive and really wanted to know what they coul d do , as they<br />

didn’t feel that they had enough understanding to do the right thing by the kids<br />

whether they were victims or offenders. (<strong>Panyappi</strong> Coordinator)<br />

Scope – geography and age<br />

Schools working closely with the young people that <strong>Panyappi</strong> target are aware that they<br />

do not always frequent the inner city, but often spend time in their own communities and<br />

other suburban locations. Similarly to other program collaborators they appreciated that<br />

<strong>Panyappi</strong> had a brief to address the inner city, but were keen to see this expand to<br />

respond to the realities of these young people’s lives.<br />

I would certainly like to see that there are no boundary lines in future projects<br />

because our kids don’t follow them….There might be a rush of 3 or 4 weeks<br />

where they hit the city all the time and then all of a sudden they are hanging at<br />

Mansfield Park. They’re not going anywhere. They are wandering around at night<br />

looking for stuff to do, so it’s fairly variable. (<strong>Program</strong> collaborator)<br />

Such expansion would prevent the large gaps in service that occurred in their early<br />

contact with <strong>Panyappi</strong>. Contact is now more regular as <strong>Panyappi</strong> gained support to<br />

broaden its brief. In fact, several evaluation participants advocated a “no borders”<br />

approach. They emphasised that it should be irrelevant whether young people had FAYS<br />

involvement (this is not a current eligibility criterion), and although Inner City youth<br />

were a focus, the program could go beyond this group. This is recognised within MAYT:<br />

<strong>Panyappi</strong> [needs] to be flexible and shift with the trends of what is happening<br />

with young people. Originally it was set up for kids who frequent Hindley Street<br />

on a regular basis, but we know that the shift is now out into the community and<br />

the Parks area. MAYT and <strong>Panyappi</strong> need flexibility to go with it. (<strong>Program</strong><br />

collaborators)<br />

This flexibility also includes age. It has become increasingly evident to <strong>Panyappi</strong> staff,<br />

and some Advisory Group members, that there is both a need and wisdom in targeting a<br />

younger group. “There is nothing for the 7-9 year olds who often need some direction<br />

and support at this point but can’t access services easily for them as they don’t fall<br />

under FAYS.” Responding to these issues would also encourage <strong>Panyappi</strong> to target other<br />

- 60 -


<strong>Panyappi</strong> <strong>Indigenous</strong> <strong>Youth</strong> <strong>Mentoring</strong> <strong>Program</strong> <strong>Evaluation</strong><br />

geographical areas where problems with younger children are more evident, e.g.<br />

Mansfield Park. A program collaborator working with the younger children said:<br />

Its clear from the Layton Report 66 that our whole care system is falling apart<br />

miserably. The kids that I am working with will never go into the care system, as<br />

they will just run into placement breakdown after breakdown. We are not even<br />

trying to get them into alternative care. Relative options are diminishing and it’s<br />

just not possible, so we need something else for these sorts of kids. A long-term<br />

worker or service that will engage this family until they are back on track and<br />

try to get them back on track is what’s needed, and we are not seeing that.<br />

There is no ongoing service at the moment [elsewhere]….Its just a vicious circle<br />

really. (<strong>Program</strong> collaborator)<br />

Without this, some program collaborators believed that “its only a matter of time<br />

before they are 10 and can get charged” and then go on FAYS youth team caseloads as<br />

young offenders. People were keen to see a consistent and committed effort to start<br />

breaking this cycle and believed <strong>Panyappi</strong> could play a part in this.<br />

Alternative services<br />

Linked to the issue of scope was the consistent message from all evaluation participants<br />

about the poor availability of alternative services if <strong>Panyappi</strong> did not exist. Although<br />

people would use anything available, including existing <strong>Indigenous</strong> and non-<strong>Indigenous</strong><br />

youth and human service agencies, there was no equivalent service to <strong>Panyappi</strong>. As noted<br />

in quotes in the Young people and family themes section above, program collaborators<br />

and family members were equally concerned about outcomes for their young people if<br />

<strong>Panyappi</strong> was not available, and questioned if their own resources would be sufficient to<br />

achieve sufficient change: “If we hadn’t had that sort of stuff then it would have been<br />

up to [the carer] and myself and the resources we have between the two of us. ” They<br />

did not consider that it was only <strong>Panyappi</strong> they needed, but it made a substantial<br />

difference through enabling young people to gain greater benefit from other services or<br />

supports with which they may not be engaging.<br />

This situation gave rise to frustration regarding short-term funded initiatives where<br />

long-range planning for sustainability is not built into the budget. As noted above,<br />

although short-term pilot initiatives occur in all human service areas, Aboriginal<br />

communities are often serviced on the basis of such projects. This disrespects the<br />

issues they face, the services they deserve and shows poor appreciation of the realities<br />

of historical legacies on their lives.<br />

The consensus was that if you are going to support this work, then make it possible to do<br />

it well by resourcing it appropriately. You will retain more of your staff and provide a<br />

consistent service in situations where that consistency can make or break young people’s<br />

willingness to engage with support services at all. In cross-portfolio areas, such as the<br />

66 The Layton report was a report commissioned by the State Government to review the South Australian child<br />

protection system. It reported its findings in 2003 and recommended major changes to many areas of child<br />

protection and alternative care system.<br />

- 61 -


<strong>Panyappi</strong> <strong>Indigenous</strong> <strong>Youth</strong> <strong>Mentoring</strong> <strong>Program</strong> <strong>Evaluation</strong><br />

work of <strong>Panyappi</strong>, funding commitments are usually required by more than one agency or<br />

department to break the short-term funding cycle and sustain initiatives so they can<br />

build on their foundations and work toward their long-term goals.<br />

Being a mentor<br />

Becoming a human services worker<br />

For many of the mentors, <strong>Panyappi</strong> was their first experience of being a human services<br />

worker and they tended to be a younger group (20-30 years), in part due to the early<br />

funding dilemma addressed by employing people on traineeships where the age criteria<br />

was 18-28 years. Current and previous mentor staff reported that they had a strong<br />

personal interest to work with Aboriginal young people, “I have a passion for this sort of<br />

work.” <strong>Panyappi</strong> was their first formal opportunity: “I’ve wanted to be a youth worker<br />

and it was my first experience of doing this.” This was also evident to program<br />

collaborators: “He’s so keen. His heart’s so in his work….He’s pretty dedicated.”<br />

The initial focus for all mentors was training for their role in working with young people,<br />

families and other agencies, but becoming a human services worker requires learning<br />

about the cultural and administrative protocols of the sector. This was an additional<br />

learning curve to scale, and required support from the Coordinator, as well as the<br />

auspicing agency, which proved to be a more time intensive task than anticipated for all<br />

concerned. Not all mentors employed managed to learn and put into practice all aspects<br />

of the job, and either left, or where it was required were dismissed. It appears that the<br />

“traineeship only” employment approach advocated by FAYS to resolve the earlier<br />

funding dilemma set up the program and some of its workers to fail, as it did not<br />

recognise the knowledge and skills required for the role.<br />

The first main recruitment drives occurred during <strong>Panyappi</strong>’s early stages while it was<br />

establishing its identity, clarifying its focus, identifying what were reasonable<br />

expectations when mentoring involves time-intensive work with young people, and<br />

developing appropriate policies and practices. The second drive occurred early in 2003<br />

once the third Coordinator started when all of these areas needed to be revisited and<br />

revised. This situation should be more manageable in the future, as new staff would<br />

come into an existing staff team where there is stronger peer support in addition to<br />

supervision.<br />

Roles and responsibilities<br />

Most people actively involved with <strong>Panyappi</strong> were able to articulate the role of mentors,<br />

particularly the Coordinator, mentors, MAYT staff, and those program collaborators<br />

who worked in partnership with the <strong>Panyappi</strong> program, rather than just sending referrals<br />

to them. Some of these descriptions were provided above in the Young people and family<br />

themes section, but others included:<br />

My rol e is to stay in regular contact with my clients because what I am trying to<br />

do is give them a different direction, something else that is going to be<br />

interesting in their life so that they don’t get drawn back to hanging around the<br />

- 62 -


<strong>Panyappi</strong> <strong>Indigenous</strong> <strong>Youth</strong> <strong>Mentoring</strong> <strong>Program</strong> <strong>Evaluation</strong><br />

inner city a lot of the time and getting involved with whatever could be<br />

happening there, which might connect them up with the justice system. I make<br />

sure that I have a good connection with people at school, particularly the<br />

Aboriginal Education Workers in terms of how they are going, how they are<br />

managing at the school and how I can support that. (<strong>Panyappi</strong> staff)<br />

That you are a friend, you create a relationship with that young person whereby<br />

you are their big brother, big sister, confidant, their friend, the person that<br />

they build some sort of trust with, that feels like that person is there for them,<br />

to support them in their choices, helping them to get to them, whether it’s<br />

school or training. A role model for that person - helping them to make good<br />

choices…take them by the hand and lead them through life. I t is about teaching<br />

the kids to think for themselves, looking at what their options may be and<br />

thinking those options through before taking any steps. (<strong>Program</strong> collaborators)<br />

Mostly about getting the young person a voice in a world that often or doesn’t<br />

listen to young people. (<strong>Program</strong> collaborators)<br />

Connecting with him, having a relationship, someone he can look up to, be an<br />

appropriate model, someone he can confide in who is not going to be on his case<br />

as opposed to a statutory role, giving him some other things in hi s life that are<br />

more positive than wanting to go out and do crime or hang around the streets<br />

(<strong>Program</strong> Collaborator)<br />

Although it was important that mentors develop friendships with young people, some<br />

program collaborators emphasised that “A mentor needs to be the adult and needs to<br />

see the difference between what is a good thing and a bad thing.” Mentors emphasised<br />

the importance of trust, “I try to keep it confidential, just between me and him and I<br />

think he likes that,” but also understood their adult role. “He says things that he tells<br />

me not to tell Mum, but I’ve told him if it’s really bad I need to tell her. He understands<br />

and expects that” (<strong>Panyappi</strong> staff). They were aware of their responsibility to do the<br />

right thing by young people and set a good example.<br />

I never make promises. If you make an appointment, stick to it. Be honest, be<br />

responsible for your own actions, make sure you’re there. All this can make it or<br />

break it. If you don’t turn up…it’s the parents that have to deal with this kid<br />

going off. It’s just all these things. Confidentiality as well is a big thing and<br />

builds the trust…. The parent needs to know that you are responsible and you’re<br />

a good person and that their child is going to be looked after while they are in<br />

my care and that we can work together as well. (<strong>Panyappi</strong> staff)<br />

Mentors found short-term change inspiring, but indicated they were aware of the longterm<br />

impacts of their work. I like “the success that you see out of what I have done<br />

being the worker, seeing a difference in the youth that I work with. They open up to you<br />

and come to you when they are in trouble. There are no secrets. Something that I do<br />

now might affect them in years to come and maybe make a change in their life” (<strong>Panyappi</strong><br />

staff). This, of course, may be positive or negative and is why issues of consistency,<br />

- 63 -


<strong>Panyappi</strong> <strong>Indigenous</strong> <strong>Youth</strong> <strong>Mentoring</strong> <strong>Program</strong> <strong>Evaluation</strong><br />

responsibility, and continuity are emphasised in <strong>Panyappi</strong>. The focus is on what young<br />

people can learn and make part of their life both while they have <strong>Panyappi</strong>’s support and<br />

once they are on their own:<br />

All my kids have got into school and they are looking at their family life<br />

differently. They know they have the support out here and they have someone<br />

to talk to if things aren’t going so well in thei r family life. They have resources<br />

to go to other services as far as health and things like that. I have informed<br />

them of these services and resources that they can go to if I’m not<br />

available….[At first they won’t go and] want me there beside them because they<br />

feel more comfortable because they feel that there is someone they can trust,<br />

someone that will support them. That is only for the first couple of visits but<br />

once they form a relationship with, for example Second Story, where they have<br />

a lot of services in that one building, I find that the kids go there themselves.<br />

Once it builds their self-esteem and confidence and they get the guidance they<br />

need, they go on and do it themselves. (<strong>Panyappi</strong> staff)<br />

Despite program collaborators’ ability to give good descriptions of the mentor’s role,<br />

there were several reports about other agencies misunderstanding the mentor’s role and<br />

the personal and time-intensive level of engagement required. This was apparent to<br />

people beyond the <strong>Panyappi</strong> team, mostly MAYT staff, for example:<br />

I think a lot of the time other people view mentors as a run around, so things we<br />

can’t do, a taxi service, take him to school, whatever….District centres don’t<br />

understand the effort it takes or the time it takes to build relationships with<br />

the young people, so they are never going to understand or comprehend that,<br />

where as we know more and have more of an understanding. (<strong>Program</strong><br />

collaborators)<br />

I think if we are serious about the whole methodology about using mentors then<br />

it needs to be expanded. It is intensive one-on-one. I don’t think the rest of the<br />

system really understands mentoring. Because of the overload in the register<br />

system they basically see mentoring as babysitting and a transport service, a gap<br />

filler rather than a specific role on it’s own. I don’t think it’s valued for the role.<br />

(<strong>Program</strong> collaborators)<br />

This misunderstanding led to inappropriate requests of mentors, and expectations that<br />

the program could accept many referrals and provide immediate services. It also has the<br />

potential to distort people’s perceptions of program outcomes, including the evaluation<br />

outcomes. Some of these requests included hoping that the mentor would engage in<br />

investigative work with young people when there was reasonable suspicion they had<br />

engaged in criminal activities, and report their findings back to other workers to assist<br />

them in their role (the workers making this request were not police). Yet these workers<br />

noted that “they [mentors] aren’t the police” and it could risk destroying the<br />

relationship. Although very complimentary about the mentors’ work, a few program<br />

collaborators commented that they found it frustrating when <strong>Panyappi</strong> staff were<br />

reluctant to do this investigative work, or they were told by <strong>Panyappi</strong> this was not the<br />

- 64 -


<strong>Panyappi</strong> <strong>Indigenous</strong> <strong>Youth</strong> <strong>Mentoring</strong> <strong>Program</strong> <strong>Evaluation</strong><br />

mentor’s role, and wondered if this leaned toward “rescuing the kid, rather than<br />

acknowledging it’s a reality.”<br />

It was apparent there was some confusion between what constituted communication,<br />

information sharing and the overall best interests of the young person, and what actions<br />

compromised the mentoring work by achieving a short-term gain for a long-term loss.<br />

Clarifying roles and developing effective communication was not always seen as a mutual<br />

responsibility, but something that <strong>Panyappi</strong> should lead rather than other agencies ask<br />

about. This also reflected some frustration that “they look like the good guys and we<br />

look li ke the bad guys , as we have to tell them [young people] off for different things.”<br />

In contrast, other program collaborators said that:<br />

I know when I have issues that I want to raise with these kids I’ve struggled to<br />

confront them [as a professional worker]. I don’t think getting a mentor to do<br />

that is right, as I think that the rapport building that they have spent so much<br />

time on will go down the drain. I think if it is clear child protection, guardianship<br />

and court stuff…it needs to be coming from statutory [workers]…I think it<br />

needs to be kept separate from the mentor’s role. (<strong>Program</strong> collaborator)<br />

Facing the realities of the work – opportunities for personal growth<br />

Some of the mentors have been there a bit themselves or seen others or have<br />

siblings in similar situations. Aboriginal mentors come with a whole different<br />

concept than others I’d have to say because of that connection there. It’s<br />

already in the forefront of their mind about the family being important [as well<br />

as the young person]. (<strong>Program</strong> collaborators)<br />

This situation gives the <strong>Panyappi</strong> mentors considerable advantage in trying to engage<br />

young people who are not always keen to be involved with (yet another) service. At the<br />

same time, some mentors were not fully aware of the realities of these young people’s<br />

lives and therefore what they would face in the work.<br />

I guess it has opened their eyes to what our young kids are going through. The<br />

issues that they face on a regular basis, the stuff they deal with at home, the<br />

stuff they deal with the Police. The basic everyday life of a young person, all the<br />

emotions everything they go through each day. Sometimes they are very<br />

shocked. They really haven’t experienced being with kids that are hard core,<br />

that have witnessed and experienced drugs, alcohol, abuse, domestic violence. A<br />

lot of the mentors haven’t experienced that. When they do see that or are<br />

confronted they don’t have the skills to deal with this and it affects them in a<br />

strong way [so] that some don’t want to work here. (<strong>Program</strong> collaborators)<br />

On two occasions, when young people mentors were confronted with “hard end” issues or<br />

mandatory reporting responsibilities they decided to leave. Although support was<br />

provided and offered on an ongoing basis, mentors did not always experience it as<br />

sufficient or did not request further support when they needed it, which may have<br />

prevented them from leaving and then later regretting the decision (also see “Support<br />

- 65 -


<strong>Panyappi</strong> <strong>Indigenous</strong> <strong>Youth</strong> <strong>Mentoring</strong> <strong>Program</strong> <strong>Evaluation</strong><br />

for mentors” next). It is possible they may have blamed themselves for situations that<br />

are complex and need long-term solutions where mentoring is only one of several<br />

strategies required:<br />

I’ve told the mentors that if we’re not achieving some of the things we have<br />

written down then we need to try something different. What I’ve tried to tell<br />

the mentors is that ‘don’t ever think it’s you’, because these kids have got far<br />

more issues than what we could ever deal with. (<strong>Panyappi</strong> Coordinator)<br />

Others have used these situations to develop their resilience and capacity as workers,<br />

chalking it up to experience and therefore, gaining valuable learning.<br />

I think it has helped me understand a little more about our youth. It has<br />

cemented my general knowledge and helped me learn how to deal with them.<br />

Going to TAFE has helped a tremendous amount. It has made me want to get out<br />

there more and help as many kids as possi ble. I know now this is what I want to<br />

do and makes me fee l really good knowing that. Seeing my cli ent change is just<br />

wonderful to see and is so rewarding. It has done a lot for me. (<strong>Panyappi</strong> staff)<br />

MAYT staff have witnessed this shift in mentors, for example: “I have seen them grow<br />

in confidence and their ability to advocate for themselves as well as for other people,<br />

young people. I’ve seen them have an avenue to put their passion around young Aboriginal<br />

kids and their families and have a place to bring them to” (<strong>Program</strong> collaborators).<br />

Mentors could identify areas of personal development from working at <strong>Panyappi</strong>, such as<br />

confidence, skills in working with young people, communication, teamwork, and identifying<br />

goals for further training and study so they could move into other human services<br />

positions. For example:<br />

I’ve learnt a few thi ngs from Panyapp i. I al ways used to be shy . I thi nk by the<br />

meetings we have I have come out of my shell and that’s one good thing that<br />

<strong>Panyappi</strong> has done for me. I can talk to anyone now. It’s been a good<br />

improvement….I feel I can get along with younger people a lot better than I used<br />

to in my persona l life, like with my cousins….My own fami ly has seen a change in<br />

me also. I’m learning to manage my temper better as we ll, I have to keep calm<br />

with the kids here and can’t lose my temper and it’s carried over into my<br />

personal life. My family think it’s opened up my mind, instead of being so narrowminded….I’ve<br />

got a lot out of this personally. (<strong>Panyappi</strong> staff)<br />

I think being in this position, and because I need to think about what I want to<br />

do for the rest of my career, my next step if not still being here would be<br />

working in the schools as a teacher or working with <strong>Indigenous</strong> students at<br />

schools, just keeping them at school. I think school is really important for any<br />

child. (<strong>Panyappi</strong> staff)<br />

- 66 -


Support for mentors<br />

<strong>Panyappi</strong> <strong>Indigenous</strong> <strong>Youth</strong> <strong>Mentoring</strong> <strong>Program</strong> <strong>Evaluation</strong><br />

All mentors reported receiving supervision, training and personal support for their role -<br />

part of the two levels of mentoring built into the program (see page 18 in the “How<br />

<strong>Panyappi</strong> works: Support for mentors” section). Some program collaborators recognised<br />

this, for example: “The fact that the program is attached to a Certificate in <strong>Youth</strong><br />

Work is fantastic as well. So we are providing a program where they are getting<br />

employed, and also getting further education from it.” All mentors highly valued the<br />

range of training opportunities and believed they were fundamental to assisting them in<br />

their role. For some it was an opportunity to prove that they could do something that<br />

they never believed of themselves, and it has inspired them to study for a higher<br />

qualification.<br />

Some mentors were very positive about the supervision and personal support, “I have<br />

never experienced this support anywhere I’ve worked before.” They felt it was<br />

consistent, helpful and readily available when they asked for it. Others were not<br />

satisfied that supervision and personal support was sufficiently frequent and evenhanded,<br />

questioning whether the Coordinator demonstrated a similar level of interest<br />

for the work of all mentors. They wanted more encouragement and one-to-one training.<br />

They felt the current team still had some distance to go in having a team focus.<br />

Although additional training strategies were implemented early in 2004 to help mentors<br />

work their way out of difficult situations they may face, the current Coordinator<br />

recognised that having trainees and less experienced workers created support demands<br />

that were difficult to meet consistently with her numerous other roles. These roles<br />

included the work to gain support and funding for the program’s future. Although having<br />

the OPS3 position since September 2003 certainly made a difference, “at the moment I<br />

don’t have enough time to spend with these people. Maybe in the future I can look at<br />

some more trainees but I think for the moment I need to look at some other core<br />

positions that we can stabilise first” (<strong>Panyappi</strong> Coordinator).<br />

A few weeks following their evaluation interviews, all <strong>Panyappi</strong> staff participated in a<br />

MAYT team review and planning day that focused on communication, team building, and<br />

strengthening opportunities for collaboration within and between MAYT and <strong>Panyappi</strong>.<br />

The team reported that they made good progress in these areas, and have been<br />

committed and enthusiastic to continue this work so their team cohesion improves.<br />

MAYT staff had mixed views on the support provided to mentors. Some identified that<br />

there was strong and consistent support available: “All the support is here. If the<br />

Coordinator notices that a mentor is down, she tries to talk to them, offers support. If<br />

they say no, she lets them go for a bit, but if she can see it hasn’t been resolved she<br />

cal ls [the MAYT Manager ] in and…they get [the mentor] to talk about issues and what is<br />

bothering them.” Others wondered if there was sufficient support to assist the mentor<br />

in their role at times: “I think the Co-ordinator needs to be directing or supporting the<br />

mentor to know what to do with the young person as well. Sometimes that doesn’t<br />

happen.” Still others wondered if there is too much support and protection that may<br />

prevent mentors gaining more learning from experience. They advocated:<br />

- 67 -


<strong>Panyappi</strong> <strong>Indigenous</strong> <strong>Youth</strong> <strong>Mentoring</strong> <strong>Program</strong> <strong>Evaluation</strong><br />

…letting the mentors fall a little. Letting them practice and not waiting for them<br />

to be fully trained and perfect before letting them experience. I would have let<br />

them go and fall on their knees and get up again. Support them totally, but let<br />

them go and give it a go. (<strong>Program</strong> collaborators)<br />

Differences in opinion about what “good support” and “appropriate direction” mean for<br />

workers relate to a combination of personality, confidence, maturity, work approach,<br />

initiative and experience. As described above, mentors are often new to and confronted<br />

by the issues in the lives of these young people and families. At the same time they are<br />

trying to absorb both the explicit and unspoken culture of human services work. They<br />

are keen to work with more clients, but as already identified, funding issues have<br />

prevented the program from taking on clients due to sustainability questions.<br />

Alternatively, they must demonstrate the initiative that would indicate they could<br />

manage working with more clients.<br />

When these areas are out of balance mentors may perceive a need for even more<br />

support than is consistently offered. In particular, they may want it to always be<br />

offered rather than learning that they can ask for it. They may not yet perceive that<br />

directly asking is not shameful and they will not be judged negatively. In fact, it is a sign<br />

of good practice in human services to recognise limits and seek support, or gain support<br />

for stretching your limits even if this involves possible “mistakes.”<br />

Caseloads<br />

As all mentors needed to complete in-class and on the job training in studying for their<br />

Certificate III, as well as complete other training requirements or opportunities, this<br />

limited their caseload capacity in the first few months of their work to ensure they had<br />

sufficient time to spend with a young person. All mentors have small caseloads initially.<br />

As they complete their training and also demonstrate greater confidence, ability and<br />

independence in the role, their caseloads were increased. People beyond the program did<br />

not always understand this process.<br />

One impact of misunderstanding the role and nature of mentoring for these young people<br />

is the judgement about “how many” young people can be serviced at any point in time and<br />

over what length of time. Some program collaborators questioned whether the program<br />

should have a higher caseload capacity, for example:<br />

None of mine have been picked up because they don’t have enough mentors. I<br />

think they could have 3 clients each, rather than just one per mentor. We are on<br />

a waiting list and this can be frustrating. There is a lack of communication there<br />

and we don’t really know what they are doing or why there is only one client per<br />

mentor in some cases. (<strong>Program</strong> collaborator)<br />

Some advisory group members also suggested that the numbers involved may be<br />

perceived poorly by other agencies who see the number of young people in need and<br />

wonder about the worth of a program that has a slow uptake and then discharge of<br />

clients. In these comments it was apparent that some program collaborators thought<br />

- 68 -


<strong>Panyappi</strong> <strong>Indigenous</strong> <strong>Youth</strong> <strong>Mentoring</strong> <strong>Program</strong> <strong>Evaluation</strong><br />

more mentors were available. Alternatively they acknowledged the resources were very<br />

limited given the need.<br />

At times the intensive nature of the work was not always appreciated, and neither was it<br />

acknowledged that many young people <strong>Panyappi</strong> works with have already been through a<br />

number of workers within a single service, or several previous services that have failed<br />

to engage them or support the family. Quick success is highly unlikely in this<br />

circumstance. Moving young people on too soon can risk sending the young person back<br />

into a repeat cycle before new patterns and family/community supports are established.<br />

Choosing to “mentor beyond the trouble zone” in order to make sustainable gains will<br />

have an impact on caseloads at any point in time, as well as over a period of time.<br />

Another external factor was that in the last 12 months mentors have been ready to<br />

increase their caseload capacity on at least two occasions, and were very keen to do so,<br />

but were faced with a dubious future regarding an accurate accounting of their budget<br />

within DHS and whether there would be further funding for the program. These<br />

situations compromised <strong>Panyappi</strong>’s ability to respond to need, and its reputation with<br />

other workers and services. It could not risk increasing caseloads when it was not<br />

possible to guarantee young people and families an ongoing service. They were aware of<br />

frustration from other program collaborators:<br />

If I don’t have a good mentor or I don’t have any mentors there is nothing I can<br />

do about it and I would rather give no mentor than give one that is not going to<br />

do the job properly because I am only damagi ng that chil d . Some departments<br />

don’t understand that. I look at the bigger picture of the effects that we may<br />

be causing so I think very seriously when I get my referrals in. I’m waiting to do<br />

a recruitment drive, but i t’s<br />

funding again. (<strong>Panyappi</strong> Coordinator)<br />

A range of mentors<br />

There was a consistent theme that having the “right staff” is critical to the success of a<br />

program that is strongly relationship based, such as mentoring. When this did not occur<br />

people told stories of relationship breakdowns and poor staff performance. When this<br />

did occur, then stories reflected all of the themes outlined in the Young people and<br />

family themes section above.<br />

Most of the mentors to date have been relatively young. This has benefits because they<br />

may have better awareness of young people’s issues, being less distant from that stage<br />

in their life, and young people may be more willing to relate to them.<br />

I think it is good having young people working with young people. They know what<br />

these young people are going through. They relate better. It’s important to have<br />

a balance. I think it would be nice to have a varied age group as mentors.<br />

(Advisory Group Member)<br />

It also may have disadvantages when young people would respond better to an older<br />

person or benefit from their increased life wisdom. Exposure to this wisdom may assist<br />

- 69 -


<strong>Panyappi</strong> <strong>Indigenous</strong> <strong>Youth</strong> <strong>Mentoring</strong> <strong>Program</strong> <strong>Evaluation</strong><br />

young people develop some of the strategies they need to cope with their situations:<br />

“Our kids are professiona l at tel lingpeopl e what they want to hear because they have<br />

been doing that to agencies all over the place forever. So they need people who are a<br />

little bit wise, a little bit smarter and sensitive to what the kids need still. So our<br />

experience has been fairly variable” as not all of the mentors have been like this<br />

(<strong>Program</strong> collaborator).<br />

<strong>Mentoring</strong> that occurs naturally through the significant relationships developed as part<br />

of Aboriginal cultural practices encourages young people to have strong connections to<br />

people across a range of ages. “Mentors need resilience and we need a whole range of<br />

mentors like peer age mentors, seniors, elders, mothers, fathers. We need a range of<br />

different types of mentors for different types of kids and different types of stages<br />

that they are at and to meet all of those needs” (<strong>Program</strong> collaborators).<br />

The <strong>Panyappi</strong> Coordinator reported that any future recruitment would aim to gain a<br />

broad range of mentors to achieve this greater diversity. “I have quite a young team and<br />

it would be good to have some maturity in the team, like 40-45 year olds.”<br />

- 70 -


Weaving the Threads Together<br />

Achieving desired program outcomes<br />

<strong>Panyappi</strong> <strong>Indigenous</strong> <strong>Youth</strong> <strong>Mentoring</strong> <strong>Program</strong> <strong>Evaluation</strong><br />

The <strong>Panyappi</strong> outcomes hierarchy in Appendix 1 identifies the thirteen desired outcomes<br />

of the program. The overall goal of a long-term reduction in offending by the client<br />

group cannot be determined at this point for the following reasons:<br />

ω<br />

ω<br />

ω<br />

ω<br />

ω<br />

<strong>Panyappi</strong> was not funded at a level that made it accessible to all young people who<br />

met the target group criteria, as it had a limited number of staff each doing timeintensive<br />

work with a small caseload of young people.<br />

It was also not funded to reach a slightly younger age group where it is possible to<br />

engage in earlier and potentially more effectively preventive efforts that would<br />

intervene in pathways that lead to offending behaviour in young people.<br />

As a pilot program it was also not funded for a sufficient period of time to ensure<br />

that shorter-term success could be sustained through the provision of ongoing,<br />

although gradually reducing, support while further referrals were accepted, ie<br />

“mentoring beyond the trouble zone.” Therefore, it would be difficult to interpret<br />

any changes in the level of offending behaviour evident in available state or regional<br />

statistics as being attributable to the program.<br />

Recommendation 1<br />

Recommendation 2<br />

A longer period of time needs to elapse before this goal can be judged, i.e. three to<br />

five years after the program is functioning at an optimal level, particularly as it is<br />

based on a developmental crime-prevention perspective. 67<br />

An appropriate evaluation framework needs to be agreed and funded in order to<br />

track changes in offending behaviour by the client group that accounts for other<br />

contributing factors that may work for or against that goal – this includes a<br />

consistent and agreed method of defining offending behaviour and a reliable system<br />

of recording it based on this definition that has the cooperation and support of<br />

relevant government departments or agencies. To date, formal and external<br />

evaluation of mentoring programs has been infrequent, limiting what can be learnt. 68<br />

Recommendation 6<br />

Outcomes 1 through 9 are about formative or process issues and have been explored<br />

through the process evaluation work. Outcomes 10 through 13 relate to the impact<br />

evaluation work outcome areas. Achievement of these desired outcomes are described<br />

below based on the evaluation stories.<br />

67 Homel, R. (2000). Blazing the developmental trail: The past, the future and the critics. <strong>Youth</strong> Studies<br />

Australia, 19(1), 44-50.<br />

68 Wilczynski, Culvenor, et al. (2003), op cit, p. 82 & 86.<br />

- 71 -


<strong>Program</strong> process<br />

Interagency collaboration through an Advisory Group<br />

<strong>Panyappi</strong> <strong>Indigenous</strong> <strong>Youth</strong> <strong>Mentoring</strong> <strong>Program</strong> <strong>Evaluation</strong><br />

Interagency collaboration is variable at the Advisory Group level due to differences of<br />

opinion about the location and auspicing arrangements for <strong>Panyappi</strong>, and the disruption<br />

this creates when meetings are held, detracting from commitments to collaboration<br />

made in the early stages of the program. Advisory Group meetings have become<br />

infrequent, especially since mid-2003, and the <strong>Panyappi</strong> Coordinator initiated most<br />

liaisons with Advisory Group members at an individual level on an “as needs” basis. The<br />

viability of the current Advisory Group structure is uncertain and alternatives could be<br />

considered.<br />

Referrals<br />

Since <strong>Panyappi</strong> commenced it has consistently received referrals, although assessments<br />

and service delivery has increased since early 2003. The young people assessed and<br />

considered by <strong>Panyappi</strong> for mentoring support fit the profile originally identified in the<br />

planning of the program back in 2001. Therefore, <strong>Panyappi</strong> has addressed the intended<br />

target group, while also expanding the inner city focus in response to the location shifts<br />

of this group of young people. They arrive with multiple and often serious problems, both<br />

personally and in their immediate networks. Responding to these needs requires multiagency<br />

collaboration (see below), although young people and families can be reluctant to<br />

engage with other services beyond the statutory ones with whom they are obligated to<br />

be involved.<br />

Project Coordinator role<br />

Over the course of the program, three Coordinators were appointed, with the second<br />

Coordinator staying a very brief time. There was a 5 month gap before the third<br />

Coordinator started in February 2003. The opinion of both Advisory Group members and<br />

program funders was that the program was currently managed quite well and gained<br />

strong support from its auspicing agency.<br />

Most criticism related to issues known to be beyond the current program’s control, such<br />

as ensuring sustainability, ongoing effects from previous disruptions in staff, and<br />

limitations on how many young people they can work with due to the time needed to train<br />

staff, and uncertain funding arrangements that compromise any guarantee of an ongoing<br />

service.<br />

Mentors: Recruitment, training and linking with young people<br />

Mentors were recruited and appointed in two main phases. All mentors received several<br />

forms of training:<br />

ω<br />

ω<br />

The Certificate III in Community Services (<strong>Youth</strong> Work) qualification<br />

Orientation training program for new workers in FAYS<br />

- 72 -


ω<br />

ω<br />

ω<br />

<strong>Panyappi</strong> <strong>Indigenous</strong> <strong>Youth</strong> <strong>Mentoring</strong> <strong>Program</strong> <strong>Evaluation</strong><br />

Several training programs relevant to their work area run by the FAYS in-house<br />

training unit, eg mandatory reporting, conflict management<br />

Work placements in other areas of family, youth and juvenile justice services<br />

On-the-job training and mentoring in their work role<br />

Mentors consistently reported that this training was highly valuable and crucial in<br />

ensuring they could perform their work role. They were keen for more opportunities to<br />

do on-the-job training and further work placements to deepen their knowledge of the<br />

services and systems in which their clients are involved. All mentors were linked with<br />

young people, with caseloads varying from 1 to 4 clients depending on confidence,<br />

experience, initiative and capacity.<br />

Case plans<br />

The <strong>Panyappi</strong> Coordinator develops a case plan for all <strong>Panyappi</strong> clients by working with<br />

the mentor, family and other program collaborators where relevant. If another involved<br />

agency has an existing case plan, then the <strong>Panyappi</strong> Coordinator collaborates with this<br />

group and attends case meetings. This plan is reviewed with all parties at regular<br />

intervals to check progress, ensure that goals are suitable and identify alternative or<br />

additional goals. Occasionally some program collaborators felt uncomfortable that<br />

<strong>Panyappi</strong> was stepping into their territory with case planning, a situation that was or<br />

could be resolved through agreement to do mutual case planning.<br />

Relationships between young people and mentors<br />

There was strong evidence from a range of stakeholders that young people valued their<br />

relationships with mentors and grew to trust them, often in ways their family members<br />

or program collaborators had not previously witnessed. This was not always<br />

straightforward to achieve, particularly when there was a history of rejection, poor<br />

treatment or losses for young people, and it was important to allow time for this trust to<br />

develop.<br />

When established, relationships were critical in creating the possibility of change and<br />

building young people’s belief in and motivation to achieve the goals that had been<br />

negotiated with them. With some young people, considerable effort was needed to<br />

maintain good relationships when young people went through difficult times, slipped back<br />

into offending, and became distanced or disheartened.<br />

Where matches were inappropriate a change of mentor was organised. On the occasions<br />

when mentors did not perform their role appropriately, putting the relationship and the<br />

young person’s progress at risk, mentors received assistance to improve their ability to<br />

meet their responsibilities. On the occasions this was not possible, mentors either left<br />

or were dismissed after all human resource processes had been followed. In these<br />

circumstances, the <strong>Panyappi</strong> Coordinator (in particular the first and current one)<br />

stepped in to work with the young person to bridge the gap until another mentor could<br />

be provided.<br />

- 73 -


<strong>Program</strong> outcomes<br />

Multi agency collaboration develops around the young person<br />

<strong>Panyappi</strong> <strong>Indigenous</strong> <strong>Youth</strong> <strong>Mentoring</strong> <strong>Program</strong> <strong>Evaluation</strong><br />

<strong>Panyappi</strong> played a key role in establishing the Inner City Triage Group in order to better<br />

coordinate a response to young people who frequent the inner city area. Although one of<br />

the referral sources for <strong>Panyappi</strong> that could provide useful information on the key<br />

target group, it has been disbanded in favour of a general inner city youth forum which<br />

focuses more on networking rather than cases, although an inner city Aboriginal workers<br />

group is also being supported.<br />

Collaboration in the delivery of direct services appears to be strong in <strong>Panyappi</strong>. <strong>Program</strong><br />

collaborators greatly appreciate access to a unique service that provides a high level of<br />

input into young people who are otherwise likely to disconnect from education and<br />

support services, and further increase the risk they will engage in or be a victim of<br />

crime. <strong>Panyappi</strong> has developed strong relationships with schools in providing everyday<br />

support for young people, and with family support services, especially through MAYT,<br />

but also other government and non-government agencies.<br />

<strong>Panyappi</strong> has also made good use of the MAYT Tutorial Centre for those who do not<br />

attend school, or attend inconsistently. They have worked closely with Tauondi College<br />

at Port Adelaide and Nunga IT at The Parks to provide culturally relevant programs that<br />

build young people’s skills and cultural identity, and, where appropriate, have<br />

collaborated with or utilised MAYT run programs.<br />

Despite these achievements there is still some confusion about the roles and<br />

responsibilities of mentors, the long-term and intensive nature of mentoring, and the<br />

extent of the program resources. This was reflected through reports about and from<br />

program collaborators of unrealistic expectations and inappropriate requests of<br />

mentors, and poor clarification of communication and information-sharing protocols. This<br />

may be restraining the achievement of best possible outcomes in some circumstances.<br />

Positive shift in the young person’s behaviour and attitude regarding offending<br />

<strong>Panyappi</strong> works with young people where there is often an entrenched pattern of<br />

behaviour, even at an early age (by or before 10 years). Both young people and family<br />

members reported a marked change in young people’s offending behaviour. This is clearly<br />

evident in the decreased incidence of offending recorded within the state justice<br />

system’s database for almost all young people (see Figure 9). Where this did not occur it<br />

was because young people could not regularly engage in mentoring as they lived outside<br />

the metropolitan area and only visited it occasionally, or the offending occurred during<br />

their early involvement before they became fully engaged with <strong>Panyappi</strong>. Some young<br />

people with strong histories of offending and incarceration had not offended at all or<br />

only small incidents had occurred in a six-month period. The young people and their<br />

family members considered this remarkable and were proud as well as slightly surprised.<br />

Mentors and program collaborators supported these statements. Along with family<br />

members, they also indicated that young people’s attitudes had started to shift as they<br />

- 74 -


<strong>Panyappi</strong> <strong>Indigenous</strong> <strong>Youth</strong> <strong>Mentoring</strong> <strong>Program</strong> <strong>Evaluation</strong><br />

realised they could succeed in other areas and had other options they could take, apart<br />

from offending. At the same time, program collaborators and <strong>Panyappi</strong> staff reported<br />

and expected there would be hiccoughs and thought it was unreasonable to expect that<br />

young people would turn a corner and never look back within a few months. There was<br />

strong support for ensuring investment in a long-term support program, like <strong>Panyappi</strong>,<br />

that would stay with young people through the ups and downs involved in getting back<br />

and staying on track.<br />

Decreased contact with the juvenile justice system<br />

Anecdotal reports, corroborated from one or more sources, indicated that <strong>Panyappi</strong><br />

clients decreased their contact with the juvenile justice system in terms of their level<br />

of and frequency of offending. This was confirmed through system data with substantial<br />

decreases in formal cautions, orders, family conferences, convictions and detentions,<br />

especially when young people had been involved for 6 or more months. Due to a previous<br />

history of offending it was common that they were still involved in court appearances or<br />

orders. <strong>Panyappi</strong> supported them through and, wherever possible, beyond this period.<br />

Whether this decreased contact is maintained will depend on the capacity to track these<br />

young people’s progress over a longer period of time, which will require ongoing program<br />

and evaluation funding. It is not possible to identify this from the existing data and<br />

many of the young people who have received consistent service in the last year have only<br />

recently left the program or still require further support.<br />

Development of self-discovery and self-determination by the young person and<br />

family<br />

There were consistent reports from a range of stakeholders that young people<br />

developed in their self-belief, and personal and cultural identity during their involvement<br />

with <strong>Panyappi</strong>. Many young people re-engaged with education, whether through schooling<br />

or VET options, started to develop other interests and friendships, and were developing<br />

better relationships with their families.<br />

Family members agreed to be involved with other support agencies to address personal<br />

or family issues, started to improve their skills in responding constructively to their<br />

young people, and became more convinced that their young person was making substantial<br />

changes. They reported experiencing a decrease in stress over time, although they still<br />

had some worries about whether there would be continuing progress, particularly if the<br />

<strong>Panyappi</strong> program was not available.<br />

Due to the initial disruptions in establishing a stable program, most young people have<br />

only had mentoring for a few months (since April 2003 or later), so the work was not<br />

seen as a “complete” process. Young people were hopeful that support would continue for<br />

some time. Family members, mentors and program collaborators believed that if young<br />

people were going to maintain belief in their ability to cope, stay motivated and achieve<br />

their goals, it would depend on further support from <strong>Panyappi</strong> at a similar or reduced<br />

intensity for a further period of time (i.e. at least 6-12 months). If this occurred, they<br />

were more confident that young people would become self-determining.<br />

- 75 -


<strong>Panyappi</strong> <strong>Indigenous</strong> <strong>Youth</strong> <strong>Mentoring</strong> <strong>Program</strong> <strong>Evaluation</strong><br />

Implications for <strong>Indigenous</strong> youth mentoring programs<br />

The evaluation outcomes reinforce many of the issues raised previously in the “A brief<br />

review of mentoring” section that were critical to successful mentoring programs in<br />

general. These include the importance of a clear role for mentoring programs, supporting<br />

mentors so that they are well qualified for their role, positioning mentoring programs<br />

within or at least closely collaborating with youth and family services, building<br />

connection with and supporting young people’s families, targeting geographical areas, and<br />

the role of the <strong>Program</strong> Coordinator. They reinforce the conclusions that were drawn<br />

about the effectiveness of mentoring in a recent national overview of mentoring for<br />

young people at risk of offending. 69 These outcomes also identify issues that are<br />

instructive for <strong>Indigenous</strong> youth mentoring programs such as <strong>Panyappi</strong>.<br />

What mentoring can offer<br />

<strong>Panyappi</strong> highlights that features of an effective mentoring relationship include offering<br />

young people: 70<br />

ω<br />

ω<br />

ω<br />

ω<br />

ω<br />

Personalised attention and care through a one-to-one relationship with an adult who<br />

is willing and able to gain the young person’s trust, demonstrate genuine care and<br />

encourage them to pursue their personal interests<br />

Maintaining this relationship over a significant period of time - the amount of<br />

time/week may slowly reduce based on needs and progress<br />

Resources through access to information, people, opportunities and new experiences<br />

that may be cultural, social or vocational<br />

Support and challenge by having an expectation of young people that they can try to<br />

do things and be successful<br />

Opportunities for reciprocity where young people are active participants in the<br />

relationship by developing goals with mentors, working in small groups where they<br />

support their peers, or even working with those younger than them to share their<br />

learning and skills (although the latter strategy has not yet been trialled through<br />

<strong>Panyappi</strong>).<br />

Recent proposals for supporting <strong>Indigenous</strong> young people via mentoring have focused on<br />

short-term strategies offered as summer holiday programs. 71 These programs are not<br />

necessarily focused on young people who are engaged in or vulnerable to crime, but do<br />

aim to encourage school retention. Although it is likely that these will be valuable, they<br />

will not provide a committed and sustained relationship over a longer period of time that<br />

is required to effectively support the young people with the highest and most complex<br />

needs, such as those in <strong>Panyappi</strong>’s target group (with or without the inner city focus).<br />

69 Wilczynski, Culvenor, et al. (2003), op cit, p. 83.<br />

70 Benard, B. (1992) op cit.<br />

71<br />

South Australian Government (2004). Making the connections: The South Australian Government’s action<br />

strategy to keep young people connected to learning and opportunities. Social Inclusion Unit, Department of<br />

Premier & Cabinet: Adelaide.<br />

- 76 -


<strong>Panyappi</strong> <strong>Indigenous</strong> <strong>Youth</strong> <strong>Mentoring</strong> <strong>Program</strong> <strong>Evaluation</strong><br />

If long-term change is desired in areas such as offending behaviour or engagement with<br />

education, then close attention must be paid to matching the target group to a suitable<br />

mentoring strategy where there is a stronger likelihood of sustainable gains. Experts in<br />

the juvenile justice field believe there is a case for intervention with young offenders –<br />

mentoring is one of the options. 72 Further, consideration must be given to when to<br />

intervene (age), therefore which young people, how many need support, and where they<br />

are based if significant and constructive change is to be achieved.<br />

Working collaboratively – enabling change<br />

Recommendation 1<br />

Recommendation 2<br />

Many evaluation participants identified how <strong>Panyappi</strong>’s work enabled other services to<br />

either become involved or make more headway with the young person and family. This<br />

was an outcome of the mentoring relationship itself, but also a collaborative approach to<br />

the work. The literature on mentoring already points toward greater success from<br />

mentoring when it occurs in conjunction with a range of other health, community, family<br />

and/or education programs.<br />

<strong>Panyappi</strong> has done this through setting up collaborative work with its auspicing body<br />

(MAYT), and by actively building effective working relationships with the other services<br />

and/or people involved in young people’s lives. Future <strong>Indigenous</strong> youth mentoring<br />

programs should consider their auspicing arrangements, location and working<br />

relationships, including Memorandums of Agreement where relevant, in order to set<br />

themselves up for both short-term success and sustainable change.<br />

Gaining advice and support<br />

Recommendation 3<br />

<strong>Evaluation</strong>s of community-based human service programs in <strong>Indigenous</strong> and non-<br />

<strong>Indigenous</strong> areas commonly report problems with standard Advisory Groups, Reference<br />

Groups or Steering Committees that are meant to continue over the life of the program.<br />

The issue is in adopting a “one size fits all” attitude. <strong>Indigenous</strong> youth mentoring<br />

programs should be encouraged to think broadly about different sources and forums for<br />

advice and support, while paying attention to cultural protocols and community issues<br />

that may influence who should be included and how people come together.<br />

Family connections and support<br />

Recommendation 4<br />

All evaluation participants provided consistent endorsement of the value of a program<br />

that supports both young people and families. Not only was this considered culturally<br />

appropriate practice, it was seen as good practice in general to have a connection to and<br />

72<br />

Keogh, T. (2002). Juvenile recidivism: New and surprising possibilities for mental health promotion and<br />

prevention (pp.230-244). In L. Rowling, G. Martin & L. Walker (Eds.). Mental health promotion and young people:<br />

Concepts and practice. Sydney: McGraw Hill.<br />

- 77 -


<strong>Panyappi</strong> <strong>Indigenous</strong> <strong>Youth</strong> <strong>Mentoring</strong> <strong>Program</strong> <strong>Evaluation</strong><br />

impact on families – understanding and influencing young people’s everyday environments.<br />

<strong>Indigenous</strong> youth mentoring programs would be well advised to adopt and promote a<br />

family-inclusive approach, arguing for it in any funding application and ensuring they<br />

were resourced sufficiently to be family-inclusive.<br />

Leadership opportunities<br />

Recommendation 5<br />

<strong>Panyappi</strong> has developed two levels of mentoring, a primary focus on young people and a<br />

secondary focus on the mentors. This has highlighted the importance of supporting new<br />

<strong>Indigenous</strong> workers to develop the confidence and skills to continue with a career in<br />

human services. This may involve formal and informal study, gaining experience in several<br />

human service areas, learning advocacy skills and applying for more senior positions. The<br />

mentors currently with <strong>Panyappi</strong> indicated a desire to contribute to their communities in<br />

this way. It is an example of younger people, the mentors, being supported by more<br />

senior community members in starting to develop the skills to become leaders for their<br />

communities. In turn, the mentors provide a role model to their clients of what could<br />

take place in their future, which brings them back to cultural identity and commitments<br />

and away from destructive behaviour. Although recruitment of <strong>Indigenous</strong> workers was a<br />

deliberate program strategy, the development of leadership skills was not planned and is<br />

an unexpected but welcome outcome.<br />

Building and sustaining Aboriginal employment and leadership in human services is<br />

important for at least three reasons. The Department of Human Services has<br />

acknowledged that they have insufficient Aboriginal workers and need to recruit them.<br />

Aboriginal workers do not always stay in their positions due to a lack of support and<br />

cultural understanding in workplaces, especially if they are isolated workers or small<br />

teams in mainstream organisations. Those people who are current workers tend to be<br />

older, especially those in senior positions, and have been involved for a long period of<br />

time. This results in a gap in the 20-40 year age group, a time when foundations are<br />

created for people to move into leadership and advocacy positions within the human<br />

services and the community.<br />

Recommendation 7<br />

Establishing a new program<br />

Similar to the experience of many Australian mentoring programs, and as a very new<br />

initiative for youth-focused <strong>Indigenous</strong> services in South Australia, it took some time to<br />

establish credibility, build needed partnerships, gain cooperation from key stakeholders,<br />

and consolidate a stable and appropriately skilled staff base. 73 The time and energy<br />

required to do this was recognised by all stakeholders. Once that occurred and <strong>Panyappi</strong><br />

achieved a stable position, it was able to move forward as a program.<br />

73 ibid, p.66.<br />

- 78 -<br />

Recommendation 8


Recommendations<br />

<strong>Panyappi</strong> <strong>Indigenous</strong> <strong>Youth</strong> <strong>Mentoring</strong> <strong>Program</strong> <strong>Evaluation</strong><br />

These outcomes lead to the following recommendations. Recommendations 1 through 6<br />

specifically focus on the <strong>Panyappi</strong> program, while recommendations 7 and 8 apply to<br />

future <strong>Indigenous</strong> youth programs.<br />

Recommendation 1: Ongoing commitment to the program<br />

ω<br />

ω<br />

ω<br />

ω<br />

ω<br />

ω<br />

ω<br />

Develop a long-term funding strategy for <strong>Panyappi</strong> involving two or more partners<br />

from the juvenile justice, crime prevention, and family and community service<br />

sectors, including <strong>Indigenous</strong> based agencies.<br />

Support <strong>Panyappi</strong> to document its model of work to be used as an example of good<br />

practice for both <strong>Indigenous</strong> and non-<strong>Indigenous</strong> youth mentoring programs, as well<br />

as a training tool within and beyond <strong>Panyappi</strong>.<br />

Recommendation 2: Extension of program scope<br />

Sustain the program and expand the funding base so that <strong>Panyappi</strong> has the capacity<br />

and flexibility to respond to a greater range of young people, specifically:<br />

� in other geographical areas of high need, and<br />

� across a wider age group, ie the 6-9 year old group.<br />

Recommendation 3: Strengthening collaborative work<br />

Continue to foster collaborative work with program collaborators beyond the<br />

auspicing agency, including formal memorandums of agreement where relevant.<br />

Develop a training strategy to inform and educate workers in FAYS and those in<br />

other collaborating agencies (government and non-government) to ensure they<br />

understand the:<br />

� role of mentoring,<br />

� responsibilities of mentors,<br />

� contrasts with other areas of work (statutory, education, counselling, etc), and<br />

� implications this has for effective communication and working relationships with<br />

<strong>Panyappi</strong>.<br />

Recommendation 4: An advisory and support function<br />

Explore alternative advisory and support models to the standard Advisory Group, eg<br />

regular information systems to a wider group of interested parties, buddy systems<br />

with one or more key stakeholders, occasional workshop or forums on specific issues,<br />

or invitations to program events or celebrations where discussion forums are built in.<br />

Recommendation 5: Family-inclusive approaches<br />

Maintain a family-inclusive approach in line with culturally appropriate practice.<br />

- 79 -


ω<br />

ω<br />

ω<br />

ω<br />

ω<br />

ω<br />

<strong>Panyappi</strong> <strong>Indigenous</strong> <strong>Youth</strong> <strong>Mentoring</strong> <strong>Program</strong> <strong>Evaluation</strong><br />

Further explore, document and evaluate this approach to assist in understanding its<br />

impact on program outcomes, and as a contribution to the literature on youth<br />

mentoring programs.<br />

Recommendation 6: <strong>Evaluation</strong><br />

Include a budget for evaluation in any future funding of <strong>Panyappi</strong> as it is a unique<br />

program in Australia - there are few independently evaluated youth mentoring<br />

programs and none have been both <strong>Indigenous</strong> run and focused apart from <strong>Panyappi</strong>.<br />

Develop an appropriate evaluation framework that:<br />

� tracks changes in offending behaviour by the client group over time,<br />

� accounts for other contributing factors, and<br />

� uses a consistent and agreed method of defining offending behaviour with a<br />

reliable system of recording it that has the cooperation and support of relevant<br />

government departments or agencies.<br />

Recommendation 7: Encouraging future <strong>Indigenous</strong> leaders<br />

Ensure that a formal mentoring process is provided for <strong>Indigenous</strong> workers taking up<br />

entry-level positions within human service organisations<br />

Develop a process for mentoring of workers at all levels within human service<br />

organisations and offer <strong>Indigenous</strong> workers the option to participate<br />

Recommendation 8: Establishment phase for future <strong>Indigenous</strong> youth programs<br />

Ensure that an establishment phase is built into the budget and plan in the funding<br />

of any future <strong>Indigenous</strong> youth program, and sufficient time is allowed for<br />

establishment to occur before service delivery commences.<br />

- 80 -


Outcome<br />

Formative<br />

or process<br />

Appendix A: <strong>Panyappi</strong> outcomes hierarchy<br />

10. Multi<br />

agency<br />

collaboration<br />

develops<br />

around the<br />

young person<br />

8. Case plan developed<br />

<strong>Panyappi</strong> <strong>Indigenous</strong> <strong>Youth</strong> <strong>Mentoring</strong> <strong>Program</strong> <strong>Evaluation</strong><br />

Long-term reduction in offending by the<br />

client group<br />

11. Positive<br />

shift in the<br />

young persons<br />

behaviour and<br />

attitude reoffending<br />

9.Young people establish trust and value<br />

their relationship with the mentor<br />

7. Mentors linked with young people<br />

6. Mentors training initiated<br />

5. Mentors recruited and<br />

appointed<br />

3. Coordinator appointed<br />

12. Decrease<br />

contact with<br />

the juvenile<br />

justice<br />

system<br />

2. Multi agency commitment and collaboration established -<br />

Advisory Group<br />

1. Need identified and structured into project design - IYMP. Funding<br />

secured<br />

- 81 -<br />

13. Development<br />

of self-discovery<br />

and self<br />

determination by<br />

the young person<br />

and family<br />

4. Referrals<br />

for young<br />

people are<br />

received


Appendix B: Glossary<br />

<strong>Panyappi</strong> <strong>Indigenous</strong> <strong>Youth</strong> <strong>Mentoring</strong> <strong>Program</strong> <strong>Evaluation</strong><br />

Developmental crime prevention: 74,75 Development crime prevention occurs when you<br />

take action to prevent people from being involved in criminal activities by influencing the<br />

attitudes and behaviour of those people most likely to offend. You may reduce the risk<br />

factors that can lead to offending behaviour and increase protective factors that stop<br />

people from being involved in offending. Action often occurs at “transition points” in<br />

young people or people’s lives when they may be more vulnerable to negative influences<br />

or when they need more support and assistance in taking their next step in life.<br />

Actions are more effective if they occur early in the pathway of offending, which may<br />

be earlier in life or early in a person’s contact with the criminal justice system. Actions<br />

are also more effectively if they deal with several different risk or protective factors<br />

at the same time, and work at different levels, such as individuals, families and<br />

communities, including schools. These actions can include parenting programmes, school<br />

enrichment and youth prevention projects, mentoring and helping young people into<br />

training and work.<br />

Early intervention: Service responses that specifically target people who are showing<br />

early signs of a particular health, personal and/or social problem. Without this<br />

intervention, these problems are likely to become increasingly serious and entrenched,<br />

and require long-term services and support, often at high personal, social and financial<br />

costs to individuals, families, communities and societies.<br />

Formal mentoring: Relationships that are arranged through a program or service that<br />

are designed to build trust and offer young people support, care and encouragement<br />

from adults or older peers. This usually occurs when such relationships are not<br />

consistently or sufficiently available in young people’s existing networks in a way that<br />

meets their needs.<br />

Mainstream: When the word “mainstream” is used in this report it refers to human<br />

services, community programs or educational programs/schools that are directed at the<br />

needs of the dominant culture and/or the majority of the population and may not always<br />

take account of specific needs on the basis things such as cultural identity or<br />

ability/disability.<br />

Naturalistic mentoring: Supportive, trusting and caring relationships that young people<br />

develop with older peers or adults in their everyday networks, and may include close or<br />

extended family members, teachers, neighbours, coaches or other community members.<br />

74<br />

National Crime Prevention (1999). Pathways to prevention: Developmental and early intervention approaches<br />

to crime in Australia - Summary volume. National Crime Prevention, Attorney-General’s Department: Canberra.<br />

75<br />

Crime Prevention Unit, SA Attorney Generals’ Department (2002). Early Intervention in Crime Prevention in<br />

South Australia: <strong>Program</strong> Information. http://www.cpu.sa.gov.au/ei_article.pdf<br />

- 82 -

Hooray! Your file is uploaded and ready to be published.

Saved successfully!

Ooh no, something went wrong!