Offshore Quality Assurance - National Skills Standards Council
Offshore Quality Assurance - National Skills Standards Council
Offshore Quality Assurance - National Skills Standards Council
Create successful ePaper yourself
Turn your PDF publications into a flip-book with our unique Google optimized e-Paper software.
Contact<br />
NQC Secretariat<br />
TVET Australia<br />
Level 21/390 St Kilda Road Melbourne Vic 3004<br />
Telephone: +61 3 9832 8100<br />
Email: nqc.secretariat@tvetaustralia.com.au<br />
Web: www.nqc.tvetaustralia.com.au<br />
Disclaimer<br />
This work has been produced on behalf of the <strong>National</strong> <strong>Quality</strong> <strong>Council</strong> with funding provided through the<br />
Australian Government Department of Education, Employment and Workplace Relations and state and<br />
territory governments. The views expressed herein are not necessarily those of the Australian Government or<br />
state and territory governments.<br />
The recommendations are under consideration by the <strong>National</strong> <strong>Quality</strong> <strong>Council</strong> but it should not be assumed<br />
that they will necessarily be implemented in the future.<br />
Acknowledgement<br />
Prepared for the <strong>National</strong> <strong>Quality</strong> <strong>Council</strong> by Sue Foster and Moira Schulze.<br />
© Commonwealth of Australia 2010<br />
This document is available under a “Preserve Integrity” licence – for details: http://www.aesharenet.com.au/P4<br />
All other rights reserved. For licensing enquiries contact sales@tvetaustralia.com.au.
CONTENTS<br />
CONTENTS ....................................................................................................................................................... I<br />
EXECUTIVE SUMMARY ..................................................................................................................................... I<br />
BACKGROUND AND INTRODUCTION................................................................................................................5<br />
External context ...........................................................................................................................................5<br />
Review of the literature ................................................................................................................................5<br />
Current arrangements for quality assurance of VET delivery and assessment ................................................7<br />
Challenges in offshore provision ...................................................................................................................9<br />
Approaches to managing quality frameworks ............................................................................................. 11<br />
METHODOLOGY ............................................................................................................................................. 17<br />
Research questions .................................................................................................................................... 17<br />
Data collection ........................................................................................................................................... 17<br />
DISCUSSION OF FINDINGS .............................................................................................................................. 19<br />
Issues from the perspective of industry ...................................................................................................... 19<br />
Issues from the regulators’ perspective. ..................................................................................................... 19<br />
Issues from the providers’ perspective. ...................................................................................................... 20<br />
THE PROPOSED MODEL ................................................................................................................................. 28<br />
The <strong>National</strong> policy context ........................................................................................................................ 28<br />
Locus of control.......................................................................................................................................... 28<br />
<strong>Quality</strong> monitoring ..................................................................................................................................... 31<br />
ELEMENTS OF PROPOSED MODEL: OPTION B ................................................................................................ 35<br />
Element 1: Improved information to the offshore market .......................................................................... 35<br />
Element 2: Compulsory national annual data collection of all offshore VET ................................................. 36<br />
Element 3: Initial Enhanced Risk Assessment .............................................................................................. 37<br />
Element 4: <strong>Offshore</strong> site visits .................................................................................................................... 37<br />
Element 5: Publication of Audit Results ...................................................................................................... 38<br />
Element 6: Results provided to national accrediting body ........................................................................... 39<br />
Three ways of reading the 6 elements ........................................................................................................ 39<br />
Concluding Comment ................................................................................................................................. 40<br />
Recommendations ..................................................................................................................................... 40<br />
REFERENCES ................................................................................................................................................... 41<br />
APPENDIX A QUESTIONS POSED IN CONSULTATION ................................................................................. 42<br />
APPENDIX B PARTICIPANTS IN CONSULTATION ........................................................................................ 44<br />
APPENDIX C NOTIONAL COSTING OF OFFSHORE PILOTS ........................................................................... 47
EXECUTIVE SUMMARY<br />
<strong>Offshore</strong> delivery of accredited training is growing in size and spread for both public and private providers. This<br />
activity provides both commercial opportunities for providers and considerable financial and reputational<br />
risks. These risks apply to both individual providers and the Australian VET system as a whole. The <strong>National</strong><br />
<strong>Quality</strong> <strong>Council</strong> (NQC) commissioned this project to bring together the findings of previous work with current<br />
research on quality assurance of offshore VET. The project considered:<br />
• current arrangements for quality assuring offshore delivery by Australian Registered Training<br />
Organisations against the Australian <strong>Quality</strong> Training Framework (AQTF)<br />
• challenges encountered by providers when resolving the requirements of the AQTF with VET quality<br />
systems in the countries of offshore provision<br />
• how the VET sector might benefit from the experiences of Higher Education (i.e. through AUQA) in<br />
monitoring Higher Education quality offshore, and<br />
• a possible model for quality assuring (or monitoring) offshore delivery, including the cost and<br />
workforce development implications of implementing the model.<br />
This research should be viewed in the context of changes to the VET regulatory environment that are likely to<br />
involve a transition stage to a national system. The approach to research involved a literature review,<br />
consultation with key stakeholders through interviews and consultation forums to test the preliminary<br />
findings. A sample of 101 respondents from national and state departments and regulators, peak provider<br />
bodies and public and private providers contributed to the consultation process. In summary, the research<br />
found that:<br />
• there is limited information on the nature of offshore delivery<br />
• there is no state-based offshore monitoring except via desktop processes in existing onshore AQTF<br />
audits, which is auditing at a distance. Different jurisdictions have different approaches to monitoring<br />
offshore delivery.<br />
• AUQA conducts offshore audits in the higher education sector, which provides a potential model for<br />
monitoring offshore delivery in VET. This system will change with the implementation of a new<br />
national approach to regulation through the Tertiary Education <strong>Quality</strong> and <strong>Standards</strong> Agency<br />
(TEQSA).<br />
• The Transnational <strong>Quality</strong> Strategy’s approach to providing better information to offshore clients is<br />
available on a voluntary basis, but is not widely used by VET sector providers. It is not generally<br />
viewed as a badge of VET provider quality.<br />
• The approach to offshore delivery has matured as providers have recognised the potential financial<br />
and reputational risks inherent in offshore VET. This has resulted in improved, robust internal quality<br />
systems by large public and private providers<br />
• Providers fear approaches to monitoring that involve culturally inappropriate practices that may<br />
destroy relationships with offshore partners and business arrangements<br />
• There is strong support for a national approach to monitoring offshore delivery. A national approach<br />
was seen to provide greater consistency for local providers and a simpler system for offshore partners<br />
and regulators in host countries.<br />
• Providers would prefer an approach to monitoring offshore VET that is not onerous and recognises<br />
their efforts toward quality assurance.<br />
1
The research identified 17 challenges to providers operating in offshore markets. These challenges may also be<br />
seen to constitute the major risks that apply in this form of activity. When managed effectively, the challenges<br />
become the basis of good practice examples for the system. These challenges relate to the key phases of<br />
planning and implementation as described in Figure 1. Effective practice in offshore activity also involves<br />
strategies to manage providers’ exit from offshore markets. These strategies need to manage the strategic<br />
interests of the provider following an initial evaluation of the offshore market as well as the moral and ethical<br />
responsibility to protect the interests of students for completing their courses.<br />
Figure 1<br />
17 challenges: Risks to good practice<br />
Exit strategy<br />
<strong>Quality</strong> assurance<br />
17. Monitoring, review &<br />
continuous improvement<br />
Preparation<br />
1. Strategic fit/ Business<br />
planning<br />
2. Understanding in country<br />
laws & regulations<br />
3. Partner choice<br />
4. Detailed partner contracts<br />
5. Developing exit strategies<br />
Assessment<br />
15. Assessment standards &<br />
moderation<br />
16. Certification<br />
Exit strategy<br />
Delivery<br />
6. Appropriate offshore<br />
delivery models<br />
7. <strong>Quality</strong> of offshore<br />
facilities<br />
8. Teacher/trainer skills &<br />
qualifications<br />
9. Student destination &<br />
selection<br />
10. English language<br />
competency<br />
11. Contextualisation of VET<br />
programs<br />
12. Learning resources<br />
13. Student support<br />
14. Educational leadership,<br />
coordination & support<br />
The proposed model for managing regulation of offshore VET activity seeks to balance central control with<br />
provider responsibility and compliance approaches to quality assurance with continuous improvement<br />
approaches. The preferred option involves:<br />
• information to the market and voluntary accreditation, and<br />
• risk based quality assurance.<br />
The notion of a voluntary accreditation process is consistent with the current AusLIST arrangements, except<br />
that the emphasis on quality providers is strengthened through the extent to which demonstrated quality<br />
performance is required for membership.<br />
The risk based quality assurance option is consistent with anticipated change to a national approach to quality<br />
assurance through TEQSA and the current risk based approach of the AQTF 2007. It extends the approach to<br />
include consideration of providers’ deployment of their policies and processes offshore through site reviews.<br />
The model consists of six elements, which are consistent with the proposed TEQSA approach. It is based on<br />
three central elements along with three elements that support the overall approach (Figure 2). The model is<br />
independent of which organisation is to implement it. That is, whether the accrediting body is a government<br />
department, an industry body or a professional association.<br />
2
Figure 2<br />
Proposed model: Option B<br />
1. Improved information and badging to the offshore market – voluntary membership listing with strong<br />
incentives to achieve listing (supporting element).<br />
2. Compulsory national annual data collection from all public and private providers regarding programs,<br />
enrolments and location of offshore delivery (central element).<br />
3. Initial enhanced risk assessment – desktop audit based on enhanced/more detailed guidelines. High,<br />
medium and low risk offshore providers identified (central element).<br />
4. Detailed offshore site visits of high risk providers as per enhanced risk guidelines (central element).<br />
• strong quality improvement focus, not only AQTF compliance<br />
• supplemented by AEI/AUSTRADE offshore intelligence<br />
• conducted by experienced specialist national audit team.<br />
5. Results of offshore visits in public domain, as per current AUQA model (supporting element).<br />
6. Membership / badging informed by site visit results, e.g. major noncompliance as a provider<br />
(supporting element).<br />
It is suggested that these elements can be viewed through any one of three lenses,<br />
1. As a linear and sequential process in which each element is interdependent on the others. In this<br />
view the model would be implemented in its entirety.<br />
2. As a weighted set of elements that were weighted according to the risk based judgements required.<br />
It would provide, for example, for stronger barriers to entry combined with professional<br />
continuous improvement approaches to monitoring offshore delivery. Alternatively, broader<br />
accreditation approaches could be supported through strong compliance based approaches to<br />
managing risk.<br />
3. As a set of elements that are central to risk identification and mitigation and those that support the<br />
central purpose of a centrally coordinated, risk based quality assurance model.<br />
There are a variety of views on the elements of the model. Indeed it is unlikely that there could be complete<br />
agreement given the diversity of the Australian VET system. The issue is which approach affords the greatest<br />
protection to the quality and reputation of the Australian VET qualifications and those responsible for<br />
delivering them.<br />
3
Recommendations<br />
It is recommended that the NQC:<br />
1. Supports the proposed 6 elements of the model as a basis of monitoring and managing the risks of<br />
offshore delivery of Australian VET qualifications.<br />
2. In order to identify and mitigate immediate risk, a pilot and evaluation of the three central elements<br />
of the model is conducted and evaluated in 2010. Estimated costs are attached (Appendix C).<br />
3. That an implementation plan is developed which:<br />
a. Facilitates commencement of the pilot as early as possible in 2010.<br />
b. Assesses the costs and practicality associated with progressively implementing the three<br />
support elements (information to the market and/or strengthened accreditation, publication<br />
of results, informing accreditation body) to the model.<br />
c. Identifies any potential changes to current regulations needed to implement the three<br />
supporting elements.<br />
d. Takes into account the effect of impending changes to the VET regulatory arrangements via<br />
TEQSA.<br />
e. Takes into account the effect of any other changes to roles and responsibilities as a result of<br />
reviews that are currently underway or are planned.<br />
f. Ensures that the NQC is provided with the evaluation results of the 2010 pilot by October<br />
2010 so that future action can be recommended.<br />
4. Develops a VET specific offshore delivery manual/guide that includes examples of best practice in<br />
offshore delivery.<br />
4
BACKGROUND AND INTRODUCTION<br />
External context<br />
<strong>Offshore</strong> delivery of accredited VET training by both public and private providers is growing in quantum of<br />
delivery, provider numbers and geographic spread. This trend is likely to continue as offshore markets and<br />
their education and training systems ‘mature’. This presents both opportunities for individual providers and<br />
for the VET system more broadly. The opportunity to deliver commercially viable fee-for-service activity is<br />
growing, particularly in those densely populated countries that do not yet have a strong vocational education<br />
and training system, for example, the People’s Republic of China and Vietnam.<br />
Providers are aware of the commercial opportunities and the financial and reputation risks involved in<br />
offshore delivery. Reputational risks are invariably related to the quality of program delivery. This risk applies<br />
to individual providers and the Australian VET system as a whole.<br />
This project builds on initial work conducted by the <strong>National</strong> <strong>Quality</strong> <strong>Council</strong> (NQC). The NQC has identified<br />
international VET quality as a priority for 2009. The <strong>Council</strong> established an international VET Action Group to<br />
progress its work in this area and endorsed an Action Plan which presents four broad strategies for<br />
implementing the reference from the NQC.<br />
• <strong>Quality</strong> assure off-shore delivery of VET by Australian RTOs.<br />
• <strong>Quality</strong> assure on on-shore delivery of VET by Australian RTOs.<br />
• <strong>Quality</strong> assure the use and standing of Australian VET qualifications internationally.<br />
• Implementation and change management.<br />
This project relates to the first strategy. It considers:<br />
• current arrangements for quality assuring off-shore delivery by Australian Registered Training<br />
Organisations against the Australian <strong>Quality</strong> Training Framework (AQTF)<br />
• challenges encountered by providers when resolving the requirements of the AQTF with VET quality<br />
systems in the countries of off-shore provision<br />
• how the VET sector might benefit from the experiences of Higher Education (i.e. through AUQA) in<br />
monitoring Higher Education quality off-shore, and<br />
• a possible model for quality assuring (or monitoring) offshore delivery, including the cost and<br />
workforce development implications of implementing the model.<br />
This research needs to be viewed in the context of changes to the VET regulatory environment that are likely<br />
to involve a transition stage to a national system.<br />
Review of the literature<br />
The definition of offshore delivery taken in this report is, “VET which leads to an Australian qualification<br />
(award courses) and non-award courses, and is delivered to students located in another country (and who are<br />
not normally based in Australia)”. (DEEWR, 2007: 6). An Australian or an Australian-approved provider<br />
undertakes the delivery and assessment services.<br />
There is a range of approaches to service delivery that fall under the banner of offshore delivery. These include<br />
models such as: full delivery, articulation, franchising, branch campus, distance learning or corporate<br />
institutions (International Education Association Australia, IEAA, 2008). A brief summary of these<br />
arrangements is provided in Table 1.<br />
5
Table 1 Models of offshore delivery (IEAA, 2008)<br />
Model<br />
Full delivery<br />
Articulation<br />
Franchising<br />
Branch campus<br />
Distance learning<br />
Corporate institutions<br />
Description<br />
The Australian provider provides all offshore delivery and assessment.<br />
Joint study programs are negotiated between two or more providers. These<br />
include negotiated provision for study credits, credit transfers and advanced<br />
standing in another institution’s award program.<br />
One tertiary institution authorises another institution to offer part or whole of an<br />
approved study program using pre-developed training and assessment material.<br />
A tertiary institution in one country establishes a campus in another country to<br />
offer programs and qualifications.<br />
Students are provided with training and assessment material via the web or post.<br />
They complete these activities under guidance of home-based staff and may be<br />
supported by some face-to-face delivery.<br />
Higher education institutions or award programs that are set up by large<br />
transnational corporations that operate outside national education systems.<br />
The extent to which these models are implemented will vary between providers, the host countries, the<br />
nature of the qualification and its potential to lead to a higher AQF qualification.<br />
The Scope of offshore delivery<br />
Comprehensive and accurate data on offshore delivery is limited. While RTOs are required to notify their<br />
registering body that they are delivering offshore there is no formal central reporting of data on offshore<br />
delivery. Indeed the tool established to provide data on delivery to offshore locations, AusLIST, is largely<br />
restricted to listing higher education providers. There is very little data on VET providers and courses delivered<br />
offshore. The data that is available is confined to the activity of public providers of VET.<br />
The Department of Education, Employment and Workplace Relations (DEEWR) commissioned a study of<br />
offshore delivery of VET (DEEWR, 2007). This research found that Victorian providers dominated offshore VET<br />
with more than two-thirds (61.5%) of providers, followed by NSW (22.4%). Just under two thirds (64.9%) of<br />
courses in 2007 were delivered through partnership arrangements.<br />
The majority of Australian public providers with offshore operations deliver in China, followed by Indonesia,<br />
Hong Kong and Papua New Guinea. China is also the largest student market with 35,475 students (80%)<br />
studying with Australian public providers. The next largest markets are in Fiji (1964 students) and Vietnam<br />
(1320 students).<br />
In 2007, the overall number of offshore students with Australian public providers grew by 42.3%. This growth<br />
was strongest in China, Vietnam, South Korea, Mauritius, Kuwait, Iran and Fiji. The majority of growth was in<br />
courses at Diploma and above levels, followed by certificates III and IV. Management and commerce programs<br />
represented over half (56.1%) of enrolments. The majority of courses enabled articulation to Australian higher<br />
education (86.7%) and VET (75.1%) courses (DEEWR, 2007).<br />
The key message from this data is that, for public providers, the extent of offshore delivery is focussed on a<br />
few markets and it is growing. However, the full extent of offshore activity is not known as the data on the<br />
offshore training and assessment services delivered by private RTOs is limited to voluntary surveys conducted<br />
by the Australian <strong>Council</strong> for Private Education and Training (ACPET) and the Office of the <strong>Skills</strong> Commission,<br />
South Australia.<br />
6
Current arrangements for quality assurance of VET delivery and<br />
assessment<br />
Providers delivering AQF vocational education and training qualifications do so under the provisions of the<br />
AQTF 2007 Essential standards for registration. These provisions apply to both on- and offshore delivery of<br />
accredited Australian qualifications. The AQTF 2007 includes three components:<br />
• Essential <strong>Standards</strong> for Registration, which outlines the standards that registered training<br />
organisations (RTOs) must meet to deliver and assess nationally recognised training and to issue<br />
nationally recognised qualifications. They include three standards for registration relating to training<br />
and assessment, client services and management; a requirement for RTOs to gather information on<br />
their performance against three quality indicators to assist their continuous improvement processes<br />
and system monitoring; and nine conditions of registration to be met while operating as a training<br />
organisation (Table 2).<br />
• <strong>Standards</strong> for State and Territory Registering Bodies, which outline the parameters for registering<br />
training organisations and for quality assuring the training that they provide under the AQTF 2007 and<br />
relevant legislation. The standards include operational protocols to ensure national recognition of<br />
registration decisions, that regulatory services meet the needs of industry and clients, and that<br />
management systems are responsive to the needs of the VET sector.<br />
• Excellence Criteria – that RTOs may use in improvement of training and assessment and to gain<br />
recognition of their performance. Use of the criteria is voluntary. The Excellence Criteria provide<br />
national and international recognition. They encourage a focus on quality and continuous<br />
improvement. There are five interrelated criteria of: leadership; learning and assessment; people<br />
development; relationship management; and integrated information management (DEST, 2007).<br />
Table 2 The AQTF Essential standards for registration as an RTO (DEST, 2007)<br />
Three standards for registration Three quality indicators Nine conditions for registration<br />
1. The Registered Training<br />
Organisation provides quality<br />
training and assessment<br />
across all of its operations.<br />
2. The Registered Training<br />
Organisation adheres to<br />
principles of access and equity<br />
and maximises outcomes for<br />
its client.<br />
3. Management systems are<br />
responsive to the needs of<br />
clients, staff and stakeholders<br />
and the environment in which<br />
the Registered Training<br />
Organisation operates.<br />
1. Employer satisfaction – with<br />
competency development, and<br />
training and assessment quality<br />
2. Learner satisfaction – learner<br />
engagement and competency<br />
development including<br />
perceptions of the quality of<br />
support from RTOs.<br />
3. Competency completion rate –<br />
calculated for qualifications and<br />
units of competency/modules<br />
delivered.<br />
1. Governance – ensure that the RTO<br />
complies with the AQTF 2007.<br />
2. Interactions with the registering body<br />
– re. cooperation with the registering<br />
body on audits, performance and<br />
operational data and records<br />
management and archiving.<br />
3. Compliance with legislation – relevant<br />
legislation and regulatory<br />
requirements.<br />
4. Insurance – for public liability.<br />
5. Financial management – of advance<br />
payments, refunds and annual<br />
accounts certification.<br />
6. Certification and issuing of<br />
qualifications and statements of<br />
attainment as per AQF requirements<br />
and retention of records of attainment.<br />
7. Recognition of qualifications issued by<br />
other RTOs.<br />
8. Accuracy and integrity of marketing<br />
9. Transition to Training Packages/ expiry<br />
of accredited courses – to be managed<br />
within 12 months of publication.<br />
7
The <strong>National</strong> Guidelines for Risk Management provide a framework for nationally consistent management of<br />
monitoring the performance of RTOs against the AQTF using a nationally agreed risk assessment process. The<br />
risk assessment process is based on performance risk indicators to gain a risk rating, and supplementary<br />
indicators that include having multiple sites and delivery of training offshore. Delivery of training offshore<br />
must be assessed for evidence of compliance at least once during the registration period.<br />
The registration requirements for RTOs are described in Figure 3. The diagram highlights that the registration<br />
requirements for delivery offshore are minimal. In addition to their normal registration requirements RTOs<br />
merely notify the relevant registration body of their intention to operate offshore. They must also operate<br />
within the regulatory frameworks of the host country. These regulatory frameworks vary from country to<br />
country and require different practices by RTOs.<br />
Figure 3<br />
Current registration and monitoring requirements for RTOs<br />
RTO Regulatory authority –<br />
state & territory and NARA<br />
Registration to deliver & issue If delivering to international<br />
Australian qualification students • Register RTOs<br />
• Accredit courses<br />
Apply to regulator<br />
• Monitor and review RTOs<br />
Onshore:<br />
according to risk including<br />
• Comply with ESOS Act<br />
offshore delivery and delivery<br />
Comply with AQTF – 3<br />
• Register on CRICOS<br />
to multiple sites, etc.<br />
standards:<br />
• Apply state/territory<br />
• <strong>Quality</strong> training &<br />
legislation<br />
assessment<br />
• Join a Tuition<br />
Assess risk using:<br />
• Principles of access &<br />
Assistance Scheme<br />
• history of compliance<br />
equity, maximising<br />
• Maintain PRISM<br />
• quality indicator data<br />
outcomes for clients<br />
records<br />
• history of complaints<br />
• Responsive<br />
management systems<br />
<strong>Offshore</strong>:<br />
9 conditions of registration • Notify regulatory<br />
Manage audit work program for<br />
authority<br />
initial, post initial, re-registration,<br />
Full reporting <strong>Quality</strong><br />
extensions to scope, strategic and<br />
Indicators as of July 2010<br />
If multi-sector:<br />
complaints audits<br />
• AUQA – negotiated<br />
process based on<br />
Observe Australian State &<br />
deployment of<br />
AEI – Transnational <strong>Quality</strong><br />
Territory laws re training,<br />
intended QA<br />
Strategy<br />
OHS, etc.<br />
• May include audits of • Web portal<br />
offshore sites<br />
• Liaison with overseas<br />
Optional – Forthcoming<br />
authorities<br />
AQTF Excellence Criteria<br />
• Promotion of Australia’s TNE<br />
Assessing offshore delivery of training and assessment services by Registering Bodies (national, state and<br />
territory) is largely a desktop process conducted as part of the AQTF 2007 audit program. The intentions of the<br />
RTO are reviewed within an AQTF 2007 audit if the RTO has notified the regulator of its offshore delivery.<br />
However, the deployment of these policies and procedures offshore is not assessed.<br />
An exception to this was a pilot study of auditing offshore delivery and assessment that was conducted by the<br />
Training Accreditation <strong>Council</strong> of Western Australia against the previous AQTF 2005 standards for registration.<br />
The <strong>Council</strong> conducted a strategic industry audit of the delivery and assessment of AQF qualifications offshore<br />
(Department of Education Services, 2007). The audit included a three-phase approach of:<br />
• A survey of all Western Australian RTOs to identify the level of delivery offshore. The survey looked at<br />
whether or not the RTO was delivering offshore; size of the overseas operation (number of students);<br />
frequency of delivery; type and level of qualification being delivered; delivery and staffing<br />
arrangements; customization; and intentions for the future. The survey provided a basis for<br />
8
understanding the scale and nature of offshore delivery of AQF qualifications. It also identified which<br />
RTOs would be examined in terms of the risk associated with their offshore activity.<br />
• A desk audit of RTOs identified as conducting offshore audits. This was found to be essential for<br />
collecting information to inform the decision of whether to conduct a site audit and, where one was<br />
required, to ensure that the process was conducted efficiently and cost effectively.<br />
• A site audit of the offshore operations of a selected RTO based on a risk assessment informed by the<br />
risks of the proportion of the delivery profile conducted overseas; partnership arrangements;<br />
outcomes of previous audit; and that the RTO delivered a high risk qualification. This step added value<br />
to the general approach to monitoring RTO’s compliance to the AQTF 2007 as it went beyond a desk<br />
audit to examine the RTO’s deployment of their stated policies and procedures.<br />
Other jurisdictions reported that they had undertaken individual site reviews, but these were not against the<br />
AQTF 2007 and were concerned with ensuring that delivery arrangements met with industry requirements for<br />
resources and practices.<br />
The WA pilot provided a model based on evidence based risk management and that included offshore<br />
appraisal of the quality of delivery and assessment of VET in an offshore context. It examined the deployment<br />
of the RTO’s policies and processes, management of partnership arrangements; management of delivery and<br />
assessment across multiple sites; and mechanisms to assure quality of training and assessment offshore is<br />
consistent with training and assessment delivered in Australia. While the potential risks of offshore delivery<br />
were extensive, the overall findings were positive. The pilot concluded that<br />
the majority of Western Australian RTOs endeavoured to provide a high quality of delivery<br />
and catering specifically to the needs of the client (Department of Education Services,<br />
2007: 1).<br />
The recommendations of the trial audit were for,<br />
• national guidelines and production of audit tools and resources;<br />
• holistic auditing of RTO’s on- and offshore operations to ensure vertical comparisons and to minimise<br />
the impact on the RTO’s business operations;<br />
• strategies to maximise resources including a phased approach: initial survey, desk audit of a<br />
comprehensive set of evidence to identify need for an offshore site audit; offshore site audit to<br />
targeted evidence and auditing a number of RTOs in the same visit.<br />
Challenges in offshore provision<br />
Providing training and assessment in Australian qualifications in an offshore context can be problematic for<br />
providers. While the overall findings of the WA pilot were positive in its assessment of the quality of offshore<br />
delivery and assessment of VET (Department of Education Services, 2007) the project also identified a range of<br />
areas of risk for AQTF compliance including,<br />
• a lack of understanding by overseas teaching staff of the competency based system. This was a<br />
particular risk where the partner is an offshore higher education institution that requires a graded<br />
score assessment.<br />
• the challenge of ensuring that overseas staff qualifications, experience and expertise in the relevant<br />
course is appropriate to the AQTF requirements<br />
• maintaining compliant record keeping processes at the off-shore delivery site<br />
• ensuring valid, fair, reliable assessment in a competency based context. There were risks associated<br />
with protecting the integrity of AQF qualifications when the offshore partner was delivering a noncompetency<br />
based program, which is then mapped to the Australian qualification. The validity and<br />
reliability of assessment must be ensured.<br />
• ensuring accurate translation and full understanding of requirements of training and assessment in a<br />
competency based system in countries where English is not the first language<br />
9
• a danger of double standards where off-shore and on-shore delivery are separated. That is, difficulty<br />
in providing equivalence to on-shore delivery when trying to provide training and assessment that is<br />
customised to the client’s requirements and cultural context. Noncompliance was often a result of<br />
attempts to customise delivery and support services to the requirements of the international clients<br />
• demonstrating industry validation of delivery and assessment offshore<br />
• deficiencies in approaches to planning, delivery, moderation and validation of training conducted<br />
overseas.<br />
Many of these risks were also reflected in research into good practice in offshore delivery and quality<br />
assurance in the VET sector (Bateman, 2007) and in transnational education conducted by universities<br />
(International Education Association Australia, 2008). The challenges of offshore activity identified in these<br />
research activities were,<br />
• selecting partners and managing risk including relationship development and communication<br />
• the availability of suitably qualified teachers with appropriate qualifications, involvement and<br />
experience<br />
• equivalence and comparability of nationally recognised quality assurance arrangements, processes<br />
related to delivery and delivery standards and course outcomes<br />
• financial pressures, for example, that arise from variations in the exchange rate<br />
• the implications of the different offshore context for implementing the requirements of Australian<br />
Training Packages, eg. workplaces, regulatory context<br />
• different policy approaches to quality between the Australian and offshore partners<br />
• cultural differences and awareness of both parties<br />
• knowledge of the VET system of both on- and offshore providers<br />
• understanding of competency based training and assessment<br />
• English language skills of both students and the offshore teachers<br />
• Effective communication processes<br />
• Availability of suitably trained auditors in Australian providers<br />
• Stable technology.<br />
• The complexity of these challenges grow for multisector institutions that operate across both higher<br />
education and VET external quality assurance regimes (Silver and Yang, 2008).<br />
• The need for carefully designed and executed exit strategies during the initial planning stages as well<br />
as exit strategies from existing training arrangements offshore was identified in the AUQA process<br />
and in a recent forum on international delivery by the University of South Australia The University of<br />
South Australia highlighted the need to review operations in transnational education and, in some<br />
cases, to withdraw from its operations in some offshore markets. This required implementation of a<br />
phased withdrawal process to ensure that the interests of students were protected (Ciccarelli, 2009).<br />
• Careful planning along with monitoring and auditing programs were seen to be critical to<br />
management of these challenges. Planning that integrated quality frameworks across the onshore<br />
and offshore activities of the provider rather than seeing offshore activity as separate to core business<br />
was also critical (Bateman, 2007; IEAA, 2008). The key messages from case studies of good practice<br />
for VET practitioners (Bateman, 2007) were:<br />
• a need to balance the requirements of Training Packages with client needs and expectations<br />
• careful selection of appropriate offshore institutions is critical<br />
• providers need a ‘well documented, flexible and fit-for-purpose quality management system’ (p. i)<br />
10
• a need for flexible, adaptable learning and assessment by trainers that champion competency based<br />
training and assessment and contextualisation of resources and instruction<br />
• careful planning that involves negotiation, communication and relationship development, tolerance<br />
of difference, flexibility and respect.<br />
• These reviews of good practice in offshore delivery identified a range of key messages for practice<br />
that relate to areas of activity including planning, equivalence, trainer qualifications, learning,<br />
teaching and student experience, associate selection and relationship management and business<br />
management.<br />
Approaches to managing quality frameworks<br />
Australian initiatives<br />
Transnational <strong>Quality</strong> Strategy<br />
There are also challenges for system regulators in managing the implications of offshore delivery for Australian<br />
quality frameworks and the reputation of the education and training system. To date, the parameters for<br />
quality assurance are against the Australian Qualifications Framework (AQF). The AQF defines nationally<br />
consistent outcomes irrespective of location or mode of delivery. The AQF applies across each of the<br />
educational sectors including schools, VET and higher education.<br />
A recent national initiative was directed to offshore, or transnational, delivery of AQF qualifications across all<br />
sectors. The Transnational <strong>Quality</strong> Strategy (TQS) was agreed in 2005 as a framework for promoting the quality<br />
of Australian education delivered offshore by schools, higher education, VET, English language and foundation<br />
providers. The TQS was directed to improving understanding and international regard of Australia’s quality<br />
assurance. It was designed to improve accountabilities in delivery and quality assurance of transnational<br />
education and training, through effective and efficient approaches that minimise bureaucratic processes and<br />
costs. It is directed to assuring the quality of transnational education through three areas of activity:<br />
• Communication and promotion of Australia’s quality assurance arrangements to improve overseas<br />
understanding of the Australian education and training system<br />
• Improved data collection on the scale and scope of offshore delivery, and<br />
• A stronger national quality framework that protects and promotes the quality of Australian<br />
transnational education and training (IEAA, 2008).<br />
Implementation of the TQS is through:<br />
• a portal publishing details of institutions delivering nationally accredited courses or qualifications<br />
overseas based on voluntary registration by providers countries (AusLIST)<br />
• a declaration of what stakeholders can expect from Australian providers offshore<br />
• more effective and efficient approaches to quality assessment, and<br />
• publication of host country regulatory fact sheets to assist Australian providers and supporting good<br />
practice in quality transnational delivery including developing best practice models and case studies.<br />
The strategy includes liaison with overseas governments and qualifications recognition bodies to promote<br />
improved understanding of the Australian education and training system.<br />
Australian Universities <strong>Quality</strong> Agency<br />
Key quality assurance frameworks and arrangements in higher education are also outlined in the <strong>National</strong><br />
Protocols; AVCC Guidelines and Code of Practice; AQF and the processes of the Australian Universities <strong>Quality</strong><br />
Agency (AUQA), which promotes, audits and reports on quality assurance in Australian higher education<br />
including for delivery offshore. AUQA is an independent, not-for-profit national agency for quality assurance<br />
in higher education. As stated above, AUQA promotes, audits and reports on quality assurance in Australian<br />
higher education including for delivery offshore.<br />
11
The AUQA approach is based on quality improvement, with the educational organisation’s own objectives<br />
providing the basis for review rather than an externally prescribed set of standards. This is a ‘quality audit’<br />
approach,<br />
<strong>Quality</strong> audit’ is defined as ‘a systematic and independent examination to determine<br />
whether activities and related results comply with planned arrangements and whether<br />
these arrangements are implemented effectively and are suitable to achieve objectives’<br />
(<strong>Standards</strong> Australia & <strong>Standards</strong> New Zealand Joint Technical Committee QR/7 1994).<br />
This definition has been adopted by AUQA as the foundation of its approach to audit.<br />
(AUQA, 2009)<br />
The test applied is the extent to which institutions are meeting their objectives and how they monitor and<br />
improve their performance in relation to the dimensions of objectives, approach, deployment, results and<br />
improvement or OADR. The process is one of a critical self-review as well as judgement against external<br />
academic and professional points of reference,<br />
“It is the responsibility of the auditee to devise a systematic process for evaluating its<br />
objectives with respect to criteria which may include relevance, desirability, feasibility,<br />
distinctiveness, and measurability … Audit panels do not investigate the absolute value of<br />
these strategies but the extent to which they support the auditee in achieving its<br />
objectives, including the ones related to internationalisation” (Stella and Liston, 2008: 1)<br />
Two cycles of audits have been conducted since 2001. The first round cycle between 2001 and 2007, included<br />
site visits of offshore campuses. The second round cycle began in 2008 with a focus on academic outcomes<br />
and standards.<br />
The AUQA approach to site auditing of transnational education involves sampling TNE sites based on seven<br />
tests of:<br />
• materiality – the quantum or scale of operations<br />
• significance – that the institution sees the site as strategic, eg. discipline area, region, relationships<br />
• risk management – high risk site<br />
• risks to students – high risks<br />
• other quality arrangements such as MoUs, local regional requirements<br />
• necessity – do you need face-to-face data collection or can it be via a teleconference<br />
• practicality – can it be done (Carmichael, 2009).<br />
As at December 2008, AUQA had conducted visits to 127 partner/transnational campuses across South East<br />
Asia, the Pacific, Africa and the Middle East. The process of conducting audits includes extensive data<br />
collection from the offshore partner’s staff and students, agents and the local quality assurance agency. The<br />
audit framework addresses seventeen areas of investigation rather than standards: Philosophy; Partner<br />
selection; Contract/Agreement; Host country approvals; Governance; Research; Curriculum; Marketing and<br />
promotion; Student standards; Language; Teaching; Assessment; Academic support; Pastoral support;<br />
Community links; and Evaluation and review.<br />
The AUQA audit approach included a focus on the theme of internationalisation and offshore delivery. The<br />
findings against the theme of internationalisation from the Cycle 1 audits that<br />
‘services to international students’ emerges as an area of commendation while ‘quality<br />
assurance systems for international programs’ and ‘internationalization strategy’ emerge<br />
as areas that need improvement. ‘<strong>Standards</strong> and quality of offshore teaching’ was high on<br />
both Commendations and Recommendations, implying that audit panels have found both<br />
areas of weaknesses as well as exemplary practices in this aspect (Stella, et al., 2008).<br />
12
Areas that required more attention included: management of off-campus programs; monitoring offshore<br />
partners; clear lines of responsibility and accountability; systems for review of transnational programs; internal<br />
audit reporting of international arrangements; staff orientation; policies for entrance and advanced standing<br />
and consistency in standards. Effective management of partnerships were characterised by: enrolment<br />
decisions were made at the Australian institution; excellent materials as the basis of quality distance provision;<br />
quality of support staff; professionalism of the offshore partner’s staff; all assessment is conducted by the<br />
Australian institution; and there is explicit mechanisms for cross-mode and cross-location consistency in<br />
admissions, curriculum, teaching and assessment (Stella, et al., 2008). Analysis of Cycle 1 outcomes also found<br />
that:<br />
• provider behaviour is influenced by commercial interests<br />
• recent activity is less ad hoc than early growth in TNE; and non-viable or poor quality activities were<br />
discontinued by the provider.<br />
Findings from Cycle 2 audits to date are that:<br />
• TNE activities are often run as a ‘commercial’ rather than ‘academic’ activities<br />
• universities are increasingly using private corporate arms to manage TNE activities in a commercial<br />
manner<br />
• use of private corporate arms may tighten commercial risk management, but this may be at the cost<br />
of potentially disenfranchised academic governance<br />
• quality assurance arrangements for transnational activities range widely in effectiveness<br />
• a university’s usual quality assurance system may not be enough for its transnational activities<br />
• there is scope for more explicit standards in offshore education<br />
• there is a shift in thinking away from Australian education provided overseas, to locally-relevant<br />
education provided by an Australian university. That is, customising to the local requirements<br />
• the relationship between customising provision and ‘comparability’ needs to be clearer<br />
• unfavourable audit reports may affect a university’s ability to recruit; but sensitivity to this concern<br />
should not compromise audit responsibilities (Carmichael, 2009).<br />
The fundamental difference between the AQTF 2007 approach to auditing a providers’ offshore delivery and<br />
that of AUQA is that the latter process is guided by the providers’ approach to quality assurance rather than<br />
compliance to standards and that there is a site visit involved in the process. <strong>Offshore</strong> data collection from a<br />
range of sources including in-country regulators, local agents, students and in-country staff is also a feature<br />
that strengthens the basis of the AUQA findings.<br />
NSW TAFE model<br />
In the past three months NSW TAFE has acted to strengthen its internal monitoring and review of offshore<br />
delivery by public TAFE Institutes in NSW. This is in recognition of the risk that offshore provision poses to the<br />
reputation of NSW public providers. The process commenced in August 2009 under instruction from the<br />
Deputy Director General, NSW TAFE and Community Education. The approach consists of three stages,<br />
• AQTF 2007 audit processes - Current processes for reviewing Institutes’ compliance against the AQTF<br />
2007 by the State regulator (VETAB) will continue.<br />
• Notification of intention to deliver offshore - All public providers who deliver offshore are required to<br />
provide the details of the delivery to TAFE NSW. The Deputy Director General signs off on all offshore<br />
contracts.<br />
• <strong>Offshore</strong> Review Panel - TAFE NSW have established an <strong>Offshore</strong> Review Panel to focus on risk<br />
identification and management, and continuous improvement. The work of the Review Panel is<br />
consistent with that of the AQTF 2007, but does not duplicate it. The Panel comprises senior<br />
practitioners, such as CEOs of TAFE Institutes who contribute their time as a collegiate contribution to<br />
the NSW TAFE system. A risk template assists the Review Panel.<br />
13
• The Review Panel conducts onsite review visits and prepares reports for the Deputy Director General.<br />
TAFE NSW intends to review the offshore activities of eleven public TAFE Institutes by the end of<br />
December 2009 (TAFE NSW, 2009).<br />
The TAFE NSW approach recognises the inherent risks in offshore delivery. It addresses these risks through<br />
existing arrangements for the AQTF 2007 together with an appraisal of institutes’ deployment of continuous<br />
improvement processes by personnel with experience in senior management. It combines an ethicalprofessional<br />
approach to accountability by experts and educational leaders with accountabilities associated<br />
with compliance requirements of registration. It is both educative and cost efficient and addresses outcomes<br />
as well as the processes that lead to them. The focus of the model is on system improvement, enhanced<br />
reputation and confidence in the quality of training services provided to clients. The question is whether such<br />
a model could provide guidance to a national system of offshore quality monitoring.<br />
The lesson that can be learnt from this is that the regulatory body need not necessarily drive monitoring. A<br />
professional association could provide oversight of an accreditation and quality assurance process, as is<br />
discussed in the next section.<br />
International examples<br />
The United Kingdom is a key competitor in offshore delivery of training qualifications internationally. Table 3<br />
outlines two approaches to registration and monitoring of offshore delivery in Scotland through the Scottish<br />
Qualifications Authority and in England through the City and Guilds approach. Both examples address<br />
monitoring and managing delivery of qualifications frameworks for vocational education and training in an<br />
offshore location. One is concerned to represent the interests of government in managing a national<br />
qualifications framework (SQA), the other is interested in managing commercial risks associated with a<br />
corporate institutions’ qualifications framework.<br />
The researchers were also referred to the Hong Kong and Malaysian systems. In Hong Kong registration<br />
processes were directed to provision of non-local qualifications. The Malaysian approach was concerned with<br />
providing an education hub to provide marketing and liaison services to member RTOs. Neither of these<br />
approaches related to the challenges of protecting the reputation and implementation of a qualifications<br />
framework or of a national education system.<br />
Table 3<br />
Approaches to quality assurance of qualifications frameworks.<br />
Organisation Registration <strong>Quality</strong> assurance<br />
Scottish<br />
Qualifications<br />
Authority<br />
(SQA)<br />
Approval to deliver Scottish<br />
qualifications as a SQA Centre is<br />
processed through the SQA. The SQA<br />
requires Centres to notify it of all sites<br />
of delivery and assessment, including<br />
offshore sites.<br />
Monitoring services through audit. The audit process<br />
included provision for offshore site visits with costs of<br />
the process charged to the provider.<br />
The audit process is conducted against five areas or<br />
‘statements of excellence’.<br />
• Leadership and management<br />
• A robust quality framework<br />
• Administration and support<br />
• Experience and ability to design and deliver<br />
qualifications including assessment<br />
• Methods of verification, which are required to be<br />
the same at all sites.<br />
In 2007/08 only 20 awarding bodies were audited,<br />
seven for self-assessment (all are required to conduct<br />
a self-assessment) and 75 centres for centre<br />
monitoring (Scottish Qualifications Authority, 2009).<br />
14
Organisation Registration <strong>Quality</strong> assurance<br />
City and<br />
Guilds<br />
This is a UK provider of vocational<br />
qualifications with over 8500 centres in<br />
100 countries.<br />
Registration is for two years against<br />
four areas of operation<br />
- management and<br />
administrative systems<br />
- physical and staff resources<br />
- assessment<br />
- quality assurance<br />
An initial assessment is conducted for<br />
registration to ensure that the<br />
organisation has the overall systems in<br />
place to deliver City and Guilds<br />
qualifications.<br />
Separate approvals are required for<br />
qualifications, such as International<br />
Vocational Qualifications (IVQs).<br />
A separate compliance assessment is conducted at all<br />
sites at which assessments or examinations are<br />
undertaken. Reapplications are largely through desk<br />
based procedure, but there is provision for offshore<br />
site audits. A separate compliance assessment is<br />
undertaken of ALL sites at which assessments or<br />
examinations are undertaken.<br />
<strong>Quality</strong> Inspectors are appointed to ensure<br />
compliance regarding systems and quality assurance<br />
rather than qualifications and assessments<br />
requirements which are conducted separately.<br />
External verifiers also examine specific resources<br />
relevant to qualifications, such as staff qualifications<br />
and expertise and physical resources.<br />
All sites at which assessments/examinations are to be<br />
conducted are visited to ensure compliance with the<br />
approval criteria.<br />
There is provision for unannounced visits to check<br />
the conduct and integrity of City and Guilds<br />
examinations (City and Guilds, 2009).<br />
It is notable that both the public (SQA) and private agency (City and Guilds) approaches involved similar<br />
processes. Each required member organisations to satisfy externally set benchmarks of performance. They<br />
were both compliance-based approaches that were directed to ensuring that providers of the qualifications<br />
provided quality services irrespective of the location of delivery. Each approach involved audit visits by<br />
external auditors to offshore sites either on registration or during a re-registration process. Both models<br />
examined a range of performance areas including administration, resourcing, assessment services and quality<br />
assurance. The SQA approach included verification processes employed across sites as well as performance in<br />
relation to ‘statements of excellence’. This model extends a compliance focus to concern with system<br />
capability and improvement. These interests do not feature in the City and Guilds approach, as its registered<br />
members are responsible for their own commercial risks.<br />
The Scottish approach may also reflect recognition that compliance is not enough to assist in system<br />
improvement. A system driven solely by compliance might provide policymakers with greater confidence that<br />
they are intervening with a view to managing risks, but this may be naïve and is unlikely to lead to system<br />
improvement. Merely monitoring practice does not necessarily lead to change in a positive sense. While<br />
Skilbeck (1988) was referring to the perceived limitations of testing programs in the school sector, the<br />
following statement may be extrapolated to describe the relationship between monitoring processes and<br />
improvement. That is, the belief that,<br />
if we weigh the pig often enough it will get fat, or if we count enough pigs they will<br />
multiply themselves … *this+ gives us no clues as to how we might effect improvements in<br />
the case or even what an improvement might consist of in any particular case (Skilbeck,<br />
1988).<br />
In summary, approaches to monitoring offshore delivery of qualifications frameworks exist, but they vary in<br />
the strategies used. In the university sector the AUQA approach is based on quality assurance through<br />
continuous improvement processes, although recent evaluation suggests that the model would be improved<br />
through more compliance oriented elements (Carmichael, 2009). The recent offshore models examined<br />
approach quality assurance through a compliance orientation. However, these approaches may benefit from<br />
an interest in fostering continuous improvement to assist system capability rather than system control. It<br />
seems that there needs to be a balanced approach to quality assurance that takes account of both dimensions<br />
of compliance and improvement.<br />
15
Silver, et al. (2008) summarised the major trends in quality assurance of transnational education as follows.<br />
• the process of overseeing and regulating the development and operation of offshore programs by<br />
universities/colleges has generally become more centralized and controlled.<br />
• more aggressive risk management strategies with an emphasis on fewer but stronger partnerships in<br />
a range of markets.<br />
• AUQA has had a major impact on Australian universities [sic] activities offshore since its establishment<br />
in 2000.<br />
• balancing the quality and profit motives when operating offshore is a constant challenge for<br />
universities/colleges.<br />
• Having a quality system is a competitive necessity and is required as the cost of entry to the global<br />
marketplace (p. 7)<br />
The research by Silver, et al (2008) was primarily concerned with the higher education sector, but was also<br />
concerned with research into good practice quality assurance in transnational education by community<br />
colleges in the USA and a specific focus on an Australian multisector institution. It is relevant to transnational<br />
activity by the VET sector.<br />
16
METHODOLOG Y<br />
The objective of this project was to provide a report and recommendations to the NQC and the International<br />
VET Action Group about:<br />
• current arrangements for quality assuring offshore delivery by Australian Registered Training<br />
Organisations against the Australian <strong>Quality</strong> Training Framework (AQTF); and<br />
• challenges encountered by providers when resolving the requirements of the AQTF with VET quality<br />
systems in the countries of off-shore provision.<br />
Research questions<br />
The project investigated the following research questions:<br />
• What are the current arrangements for quality assuring offshore delivery within (or against) the AQTF<br />
2007?<br />
• What challenges are encountered by providers in resolving AQTF 2007 requirements with VET quality<br />
systems in countries of offshore provision?<br />
• How is this affected by delivery of VET through foreign partner providers or franchisees?<br />
• How might the VET sector benefit from the experiences of Higher Education in monitoring Higher<br />
Education quality offshore?<br />
• What are the possible models for quality assuring (or monitoring) offshore delivery?<br />
• What is the preferred model for quality assuring (or monitoring) offshore delivery?<br />
• What are the implications of the preferred model for costs, VET workforce development, equity<br />
groups, implementation by providers and system wide implementation?<br />
Data collection<br />
The approach to data collection included:<br />
• a review of related literature on offshore delivery, registration and quality assurance of providers;<br />
previous research into Australian offshore context for delivering and assessing AQF qualifications<br />
offshore<br />
• Qualitative data collection through telephone and face-to-face interviews with key stakeholders<br />
including national, state and territory training authorities and regulatory bodies, peak provider bodies<br />
and a sample of public and private providers that deliver offshore VET in selected countries. The<br />
questions posed during consultation are provided in Appendix A.<br />
• Consultation forums with public and private providers in New South Wales and Victoria to test the<br />
initial findings and preliminary model for monitoring offshore delivery of VET.<br />
Details of the participants in consultation are provided in Appendix B. The sample of 101 respondents (Table 4)<br />
included:<br />
• Representatives of national regulatory bodies including the <strong>National</strong> Audit and Registration Authority<br />
(NARA); the Australian Universities <strong>Quality</strong> Agency (AUQA); and Australian Education International<br />
(AEI)<br />
• Representatives of State and Territory training authorities and regulatory bodies in New South Wales,<br />
Victoria, Queensland, South Australia, Western Australia and the Australian Capital Territory<br />
• Peak provider bodies of TAFE Directors Australia and the Australian <strong>Council</strong> for Private Education and<br />
Training<br />
17
Table 4<br />
Stakeholder<br />
group<br />
Sample groups by location of the head office<br />
ACT NSW Vic Qld SA WA <strong>National</strong> Total<br />
Public provider 2 15 2 1 1 21<br />
Private provider<br />
- Interviews<br />
Private provider<br />
– consultation<br />
forums<br />
Government<br />
department /<br />
regulatory body<br />
Peak provider<br />
body<br />
2 4 6<br />
27 20 47<br />
2 1 2 4 2 1 9 21<br />
1 5 6<br />
TOTAL 2 30 39 6 3 6 14 101<br />
18
DISCUSSION OF FINDIN GS<br />
The consultation process was conducted in two phases. Phase One involved interviews with representatives of<br />
public and private providers offering VET qualifications offshore, state regulators and officers from state and<br />
commonwealth government departments. Interviews were also held with provider professional associations<br />
and the Australian Universities Qualifications Authority (AUQA). Consultation forums were conducted with<br />
public and private providers in Phase Two. These forums explored the general findings regarding the<br />
challenges that providers face when delivering offshore. They also provided an opportunity to test the<br />
preliminary models for monitoring offshore delivery with providers. The following discussion outlines the<br />
issues identified during consultation.<br />
Issues from the perspective of industry<br />
Qualifications provide common skills currency for the system. They offer a measure of comparability of skills<br />
no matter where people are trained. This is the fundamental premise that underpins the notion of recognition<br />
in the Australian vocational education and training system. Fundamental to the quality of the system is that<br />
Australian industry can have confidence that training offshore is equivalent to that provided onshore and not a<br />
lesser qualification. Graduates of Australian qualifications gained through offshore training should be equally<br />
prepared to graduates and workers onshore.<br />
Issues from the regulators’ perspective.<br />
Representatives of state and territory departments and regulatory bodies were consulted. They provided<br />
consistent viewpoints on the nature of offshore delivery, its size and associated risks along with their<br />
approaches to monitoring offshore training and assessment services.<br />
Small market<br />
State and territory representatives highlighted the small scale of the offshore market. Each jurisdiction<br />
identified very small numbers of providers who have notified regulators that they operate offshore. This is<br />
contrary to unpublished data collected by ACPET from their membership (Quirk, 2009), which suggest that the<br />
market for private providers is high at approximately 40,000 offshore students and growing. The final report of<br />
this survey has not been released publicly. Regulators also highlighted that Australian providers access a small<br />
share of the offshore market in terms of the proportion of the potential number of students, particularly in<br />
China. However, the actual extent of offshore provision is unknown. The <strong>National</strong> Centre for Vocational<br />
Education Research (NCVER) collects data on public providers’ delivery offshore, but there is no data on<br />
private providers other than that collected through voluntary submissions by ACPET members, in the surveys<br />
conducted in Western Australia and South Australia.<br />
Current arrangements<br />
As described in the literature review, RTOs are required to notify the relevant regulatory authority of their<br />
intention to operate offshore on initial registration or as required under the AQTF for significant changes to<br />
their operation. In NSW those RTOs that indicate their intention to undertake offshore delivery are<br />
interviewed to assist understanding of the nature of the activity.<br />
Monitoring of offshore delivery occurs through the current provisions of the AQTF 2007 as part of the normal<br />
audit process. None of the regulatory authorities conducts off-shore audits as part of their audit program. The<br />
Victorian Qualifications and Registration Authority (VRQA) stated that there was no legislated authority for it<br />
to conduct audits in offshore contexts. The VRQA also questioned whether it was appropriate to conduct an<br />
audit within another authority’s jurisdiction, particularly in offshore contexts. Other authorities believed that<br />
there were no barriers to offshore auditing of RTOs registered within their jurisdictions other than the costs.<br />
For example, NARA has specific direction to conduct offshore audits as part of its Charter.<br />
NSW TAFE recently introduced a quality assurance process for TAFE Institutes that included offshore site<br />
audits, which is described in the literature review. This process includes offshore site audits for all TAFE<br />
19
institutes delivering offshore. It is conducted separately from the processes implemented by the NSW<br />
regulatory authority.<br />
Respondents stated that AusLIST provides a potentially valuable resource for informing the market, but it has<br />
been undersubscribed by VET providers. They believed that the reasons for providers not registering on<br />
AusLIST related to the limited incentives to do so. Disincentives may arise if those registered are singled out for<br />
scrutiny by onshore and offshore regulatory bodies.<br />
Each of the respondents recognized that it is difficult to manage a risk which is unknown. They believed that<br />
increased risk will accompany growth in offshore delivery of Australian qualifications. This risk is difficult to<br />
manage under the current approaches to monitoring offshore delivery as current approaches assess only the<br />
stated intention of providers (where that is known), not their deployment of policies and procedures, which is<br />
different to arrangements for onshore provision. However, based on the current evidence available to them<br />
and current approaches to risk management, there were no reports of evidence of a need for concern<br />
regarding offshore delivery other than some isolated instances where investigation had not supported<br />
complaints.<br />
Preferred approaches and attributes of an approach to regulation<br />
Regulators agreed that the following aspects would be relevant to monitoring offshore delivery:<br />
• Risk management: A risk management approach was stated to be preferable to ‘hairy chested’<br />
compliance approaches. Risk management provided more efficient direction of resources as well as<br />
minimizing the costs and intrusion of compliance to providers’ businesses.<br />
• Improved data: Improved data collection was seen to be essential to improved understanding of the<br />
nature of offshore delivery, to identifying risks and implementing a risk management approach.<br />
However, current data collections were largely voluntary as in South Australia or restricted to data<br />
provided by public institutes as in the NCVER collection. The full quantum of offshore activity by<br />
Australian registered providers was unknown and was unlikely to be identified within the current<br />
<strong>Quality</strong> Indicators data at a level that would assist in monitoring and managing risks.<br />
• Provider capability: Regulators believed that providers delivering offshore should have a<br />
demonstrated history of provision onshore.<br />
• Minimal burden: Any approach taken should be within existing arrangements rather than added on. It<br />
should not add unreasonable burden to regulation and costs for providers.<br />
• Cultural awareness: Cultural sensitivity and liaison with offshore authorities is important if the<br />
approach involved offshore site audits.<br />
• Negotiated approach: The AUQA model of advice to audit teams along with the negotiated peer<br />
appraisal provide useful models for the VET sector.<br />
Issues from the providers’ perspective.<br />
For providers the main issues related to their motivation for offshore delivery, costs, quality and competition.<br />
Motivation.<br />
Both public and private providers had a variety of motivations for engaging in the offshore delivery of VET<br />
programs. Some viewed offshore delivery as the first step in an international student pathway to onshore<br />
delivery. Typically the provider would offer a VET Diploma of Business (or part thereof) with the intention of<br />
recruiting students for full fee paying places onshore. They intended to cover their offshore delivery costs but<br />
did not have high expectations of offshore commercial margins. They expected to gain the commercial return<br />
when the student came onshore. Other providers had clear commercial aims and targets in their offshore<br />
delivery, the largest provider indicating that these commercial margins were only achievable through<br />
economies of scale. Another (public) provider indicated that it was clearly focused on commercial margins so<br />
that it could better service their disadvantaged resident students onshore. Some larger experienced providers<br />
have also been motivated by the desire to win offshore VET training contracts, either those funded by<br />
Australian Government aid agencies and/or Government or industries offshore.<br />
20
Cost Considerations.<br />
Whatever their motivation, all providers were unanimous in stating that the provision of offshore VET<br />
programs was a costly enterprise in all of its phases: preparation, partner engagement, project management,<br />
course delivery and assessment. Those providers who had been operating for a considerable time offshore<br />
indicated that the costs and drain on onshore resources/capacity are frequently underestimated. Their<br />
capacity to recoup costs and deliver a commercial margin is also influenced by local policy and economic<br />
situations. For example China’s recent cap on charges for foreign delivery and its policy to mandate that<br />
Australian teacher/trainers must deliver 30% of course content have had a significant impact on delivery costs.<br />
This is particularly significant as China is the location of over 60% of known Australian VET offshore delivery.<br />
Several experienced providers commented on their need to constantly balance the need to keep costs down<br />
while not compromising on the quality of their delivery.<br />
<strong>Quality</strong> and competition.<br />
All providers were unanimous in their view that ensuring their offshore delivery met or exceeded AQTF<br />
standards was a primary consideration. They are acutely aware of the highly competitive offshore<br />
environment and are aware that offshore governments and educational bureaucracies, and global commercial<br />
companies are ‘shopping around’ for what they consider to be the best international vocational training<br />
credentials they can purchase for their country and/ or workforce. Providers noted that currently the UK and<br />
Canada are strong and growing competitors. Providers are therefore acutely aware that the quality of the<br />
Australian VET qualification must be maintained and enhanced or it will not be a qualification of choice in an<br />
increasingly competitive global environment.<br />
Provider Approaches to <strong>Quality</strong> <strong>Assurance</strong><br />
Challenge and Risk<br />
Providers have learnt from past experience that offshore delivery, particularly when delivered by partners,<br />
presents special challenges in comparison to onshore delivery where they have direct management control of<br />
both delivery inputs and outputs. Several providers also commented on the unfavourable reception they are<br />
experiencing offshore as a consequence of recent issues surrounding the quality of VET provision to onshore<br />
international students. It was stated that some contracts for offshore delivery are now at risk or have been<br />
cancelled. The offshore provider’s need to counter negative publicity, to protect their reputation and that of<br />
Australian VET credentials and clearly demonstrate quality has become more urgent.<br />
Monitoring <strong>Quality</strong><br />
Subsequently the larger and most experienced providers are investing more not less effort in their own<br />
offshore quality assurance measures. They are doing this in a variety of ways. Their approaches appear to be<br />
strongly influenced by commercial imperatives and by their past experience, rather than by any external<br />
regulatory drivers. While in the past some providers seem to have regarded offshore provision as a separate<br />
arm of their business, there is a growing awareness that there is a strong correlation between the quality of<br />
what they deliver onshore with that delivered offshore. In organisational terms many of the larger providers<br />
are therefore taking a more holistic and non geographical approach to quality assurance, often seeking to<br />
replicate their onshore quality assurance practices offshore. For example, many larger providers are now<br />
routinely conducting offshore on-site quality audits as part of their internal audit of AQTF compliance. They<br />
acknowledge that this approach carries with it significant costs.<br />
As a result of the internal audits and of the growing experience and expertise amongst providers, it is evident<br />
that a significant number of providers are constantly reviewing their offshore delivery practices. These reviews<br />
are not only of activities directly involved in teaching and learning, but also include reviews of partner<br />
relationships, contracts for partner delivery, project management, information/data management,<br />
intercultural communication and offshore policy contexts. These reviews are seen as a total organisation wide<br />
approach to continuous improvement in business operations and are not necessarily restricted to reaching<br />
base level compliance with the AQTF requirements.<br />
21
Steps in developing and delivering quality offshore VET delivery.<br />
Providers are unpacking, interrogating and seeking to improve they way in which they address each step in the<br />
complex business of delivering quality VET programs offshore. The steps outlined below (Figure 4) are a<br />
summary and synthesis of information gathered from a number of large and experienced providers. They<br />
describe the challenges of offshore delivery, which in turn become the risks to providers and the system.<br />
Ultimately, effective management of these risks provides examples of good practice for other providers to<br />
draw on and a basis for a risk management approach to monitoring offshore VET delivery.<br />
Figure 4<br />
17 challenges: Risks to good practice<br />
Exit strategy<br />
<strong>Quality</strong> assurance<br />
17. Monitoring, review &<br />
continuous improvement<br />
Preparation<br />
6. Strategic fit/ Business<br />
planning<br />
7. Understanding in country<br />
laws & regulations<br />
8. Partner choice<br />
9. Detailed partner contracts<br />
10. Developing exit<br />
Assessment<br />
15. Assessment standards &<br />
moderation<br />
16. Certification<br />
Exit strategy<br />
Delivery<br />
6. Appropriate offshore<br />
delivery models<br />
7. <strong>Quality</strong> of offshore<br />
facilities<br />
8. Teacher/trainer skills &<br />
qualifications<br />
9. Student destination &<br />
selection<br />
10. English language<br />
competency<br />
11. Contextualisation of VET<br />
programs<br />
12. Learning resources<br />
13. Student support<br />
14. Educational leadership,<br />
coordination & support<br />
1. Strategic fit/business planning.<br />
The decision as to what to deliver and where is the primary and most important decision for the provider.<br />
While in the past providers may have been inclined to embrace offshore opportunities as they presented<br />
themselves, experience has taught them that a more targeted and considered approach to opportunities is<br />
appropriate. This more considered approach takes into account financial considerations, in particular,<br />
assessment of the ‘true’ cost of offshore delivery. This is consistent with their more ‘holistic’ approach to<br />
planning offshore delivery. In the past this delivery may have been regarded as a project(s) separate from the<br />
core business of the provider but, as the level of activity and has grown, and due to the lessons learnt from<br />
experience, providers are now more likely to be examining their offshore activity in the light of their total<br />
institute/ organisation strategic and business directions and/or including global delivery as one of their core<br />
goals.<br />
2. Understanding in-country laws and regulations.<br />
Assessing and understanding the particular legislative, regulatory and policy environment of the countries to<br />
receive the delivery of Australian VET qualifications is a necessary, complex and time consuming precursor to<br />
planning VET delivery. The environments vary greatly between countries and in larger countries, eg. in China,<br />
there is a complex set of national and provincial laws which impact on both the Australian provider and local<br />
22
partner institutions. In the Middle East several countries have sophisticated regulatory regimes for educational<br />
quality assurance which equal or surpass Australian requirements. A culturally respectful understanding of<br />
offshore requirements and, in particular, an assessment of how these impact on AQTF requirements, is<br />
essential.<br />
3. Partner choice.<br />
Almost all offshore delivery is done via offshore partner organisations. The offshore partners might be public<br />
or private universities, vocational colleges, commercial vocational providers or individuals. The nature of the<br />
partnership and the degree of autonomy the partner has in delivery of the Australian qualification varies<br />
enormously. Whatever the arrangement, Australian providers are increasingly aware that their choice of<br />
partner is a crucial determinant in the quality of VET delivery. As a result, experienced providers routinely<br />
review and evaluate their existing partner arrangements and are tightening their due diligence checks of<br />
prospective new partners.<br />
4. Detailed partner contracts.<br />
Providers see negotiating a detailed and mutually understood contract as an important ‘platform’ for delivery.<br />
Most providers are reviewing their current and proposed contracts to make them more specific. Providers<br />
agree that more detailed contracts are required, with several developing a ‘stem plus annexure’ contract<br />
model; the annexure specifically relating to AQTF requirements. In addition, to ensure that contracts are<br />
mutually understood and agreed, contracts are being prepared in bilingual formats.<br />
5. Designing exit strategies<br />
A decision to exit the proposed project if there is not a good strategic fit and/or if it is not financially viable is<br />
an important part of the planning process. The result is a more planned and considered approach to what<br />
providers will, and importantly, will not deliver offshore now and in the future.<br />
Providers also have an ethical / moral responsibility to manage student interests, including through phased<br />
withdrawal, in the event that they decide to withdraw from offshore delivery after a period of operation.<br />
Planning for disengagement should commence at the earliest possible stage in the project to ensure that it is<br />
well managed from the perspective of the student as well as protection of a provider’s reputation.<br />
6. Appropriate offshore delivery models.<br />
Providers have learned that the choice of program delivery model requires careful consideration which takes<br />
into account: the capacity of the host partner, the nature of facilities including IT, the language levels of<br />
students, the skills of teacher/trainers, and the preferred learning style of students. Successful Australian<br />
delivery models cannot simply be exported to offshore environments.<br />
7. <strong>Quality</strong> of offshore facilities.<br />
Providers have learned that a careful evaluation of learning facilities is required prior to delivery to determine<br />
if the offshore facilities meet AQTF requirements. While it is acknowledged that offshore facilities may not be<br />
identical to those in Australia, it is important that AQTF standards are met. This is often challenging,<br />
particularly in developing countries and particularly in certain discipline areas such hospitality and trade<br />
training.<br />
8. Teacher/ trainer skills and qualifications.<br />
As in onshore delivery, offshore providers have realised that the quality of VET teaching has perhaps the most<br />
significant impact on student retention and results. This realisation has presented a major challenge for<br />
providers. Partners undertake most delivery, many of the partners employ local staff who are highly qualified<br />
in their home country. In order to meet AQTF requirements these staff must have the Certificate IV in TAA or<br />
demonstrate equivalence in their teaching qualifications. Many staff therefore have to undergo additional<br />
training, and in particular gain a sound understanding of competency based assessment. In turn Australian<br />
staff who have Certificate IV TAA may lack the intercultural competencies to undertake offshore teaching,<br />
23
course coordination or assessment roles. In both circumstances, ensuring that all teaching staff involved in<br />
offshore delivery have the required skill set involves considerable time and financial investment.<br />
9. Student destination and selection.<br />
Prerequisite requirements for entry into most VET programs are clearly specified. In onshore delivery it is<br />
relatively simple for providers to ensure that students selected for programs meet the entry requirements. In<br />
almost all offshore delivery the partner organisations select students. Monitoring offshore adherence to<br />
student selection guidelines is more difficult but it is a crucial element in determining quality delivery and<br />
positive student outcomes. Providers have realised the need for clear, detailed documentation of entry<br />
requirements and the need to train offshore staff in their application.<br />
Students’ intentions are also an important consideration when designing course content and delivery modes.<br />
That is, whether they are undertaking their VET qualification as a pathway to higher education or whether they<br />
are seeking an Australian VET qualification for local employment.<br />
10. English language competency.<br />
As for student selection most providers have documented English language entry requirements for<br />
international students but as can be seen above, the application of these requirements is challenging to<br />
monitor. In addition the language skills of teaching staff are also challenging to monitor. While it is acceptable<br />
that program content can be delivered in a bilingual mode, it is important that adequate English Language<br />
levels are present or developed, particularly if the Australian VET qualification is issued as to the individual as<br />
having the AQTF competencies within an English language framework.<br />
11. Contextualisation of VET Programs.<br />
Providers are aware that they must ensure that contextualisation of programs meets AQTF requirements while<br />
also striving to meet:<br />
• the cultural, economic and social environments relevant to the country of delivery<br />
• group and individual learner needs<br />
• the work requirements of the program taking into account the working environments prevalent in the<br />
country of delivery.<br />
Providers note that achieving the balance between in-country relevance and AQTF compliance is often<br />
difficult.<br />
12. Learning Resources.<br />
Most providers see the provision of high quality learning resources as an essential element in maintaining the<br />
quality of their delivery. Over time many providers have invested considerable effort and resources in further<br />
developing on-shore learning resources to meet the needs of offshore students. These resources are much<br />
valued and used by offshore teachers and provide the Australian provider with a degree of ‘control’ over the<br />
content of the delivery of the VET training packages.<br />
13. Student Support.<br />
As in any VET learning situation, it is common that a number of students will require additional support to<br />
achieve positive results. In the offshore environment, additional ongoing support in English language is also<br />
often required. Providers report that cultural norms often mean that students do not want to ‘lose face’ by<br />
admitting their needs. If support is not carefully tailored and provided in culturally sensitive ways, there is a<br />
risk that retention rates, completion rates and the integrity of the VET credential are compromised.<br />
14. Educational Leadership, Coordination and Support.<br />
Providers have learnt that the educational leadership provided to onshore teachers/trainers by way of course<br />
coordination, peer meetings and professional development is also made available to offshore<br />
teachers/trainers. Providers have realised that the quality of offshore delivery can be compromised if<br />
24
inexperienced teachers are left to work in isolation. In addressing this risk some providers have recently<br />
implemented staffing arrangements to ensure that onshore course coordinators/leaders also have an offshore<br />
leadership role. In this way they are hoping to achieve a more seamless approach to delivery, regardless of its<br />
geographic location.<br />
15. Assessment <strong>Standards</strong> and Moderation.<br />
Providers note that it is vital that VET assessment methodology is clearly understood by all offshore partner<br />
staff. This is challenging because many staff are unfamiliar with the philosophy and practice of competency<br />
based assessment. Some experienced providers recently acknowledged the need for ongoing professional<br />
development. They have also seen the need to strengthen their testing controls and moderation practices to<br />
ensure that standards are consistent across on- and offshore locations. Anecdotal reports were provided at a<br />
range of forums that some offshore providers are using assessment-only modes of delivery as a means of<br />
avoiding scrutiny through the audit process. This practise would pose a significant risk to the reputation of AQF<br />
qualifications.<br />
16. Certification.<br />
There are associated risks of poorly managed or even fraudulent activity related to issuing certificates.<br />
Providers realise that the integrity of VET credentials issued under their name has the greatest influence on<br />
their reputation and that of the Australian VET system. It is a major risk which can best be mitigated by<br />
ensuring strict onshore control of all credentials which are issued in their name offshore. Several providers, via<br />
their own internal reviews/audits have taken steps to tighten their processes for certification, including<br />
ensuring that the language of assessment is noted on the documentation.<br />
17. Monitoring, Review and Continuous Improvement.<br />
Most large and experienced providers interviewed are working to ensure that offshore arrangements and<br />
programs are subject to the same internal review and continuous improvement policies and practices which<br />
apply to onshore delivery. This occurs in a variety of ways but most frequently within the framework of the<br />
provider’s quality management and internal audit processes. They realise that each of the steps outlined<br />
above represents a delivery challenge and a risk. They realise too that making a ‘graceful and ethical exit’ can<br />
be the consequence of a rigorous review of an offshore program. In the absence of the kind of safety nets<br />
which protect onshore students, it is very important that the provider makes arrangements to ‘teach out’<br />
programs in ways which protect the interests of both students and delivery partners. Their quality assurance<br />
processes therefore seek to address each of these risk elements. The degree to which face-to-face offshore<br />
audits are conducted depends on a variety of factors including provider size and capacity, quantum and<br />
location of offshore provision, internal assessment of risk against AQTF and other internal quality indicators.<br />
The tension between cost factors, AQTF compliance and continuous improvement is a common and ever<br />
present issue. Whatever the model and frequency of offshore monitoring/ audits, it is universally<br />
acknowledged that their internal auditors must have skills in cultural understanding and knowledge of the<br />
particular offshore contexts that they are reviewing. Most have invested in additional training for their internal<br />
auditors. Providers universally commented on the negative consequences of culturally insensitive audits on<br />
offshore partnership and delivery arrangements.<br />
While the description of the 17 steps above suggests a linear process, as represented in the diagram below<br />
(Figure 2) the providers view the process as a program delivery and continuous improvement cycle. In<br />
unpacking and addressing each part of the delivery/quality improvement cycle experienced providers have<br />
provided some valuable insights into what might constitute good practice and also what might guide the<br />
development of an offshore quality monitoring system.<br />
Provider Concerns Regarding <strong>Offshore</strong> <strong>Quality</strong> Monitoring.<br />
i. Culturally Sensitive Auditing<br />
From the above it is clear that many providers are investing significant time and resources in quality assurance<br />
and continuous improvement. It is therefore understandable that they expressed a fear that an externally<br />
imposed system of offshore quality monitoring may impede and/or undermine their current efforts. As the<br />
25
overwhelming majority of external offshore auditing is currently conducted via desktop audits, this is not a<br />
major current fear. If however AQTF compliance offshore is to be conducted via on site audits, there are<br />
concerns that external auditors will have little understanding of the political, economic, social, commercial and<br />
cultural context within which the provider is delivering. There is therefore a fear that external audits will not<br />
help but harm both the business and the partner relationships, which have been carefully built over a period<br />
of time.<br />
ii.<br />
Risk assessment/continuous improvement<br />
Providers are aware that the 2007 AQTF Guidelines clearly outline a strong focus on continuous improvement<br />
as a focus of external AQTF audit activity. A majority of providers commented that despite this, in their recent<br />
experience of onshore audits, there was still in practice, a focus on monitoring and measuring compliance.<br />
Some providers asserted that if this ‘forensic’ audit approach was to be exported to offshore locations it would<br />
not be helpful. Others commented that a ‘one size fits all’ audit approach was not appropriate and that a more<br />
detailed, accurate informed approach to risk assessment should be the primary determinant of onsite offshore<br />
audits. It was asserted that those providers who are investing in their own offshore audits and quality<br />
improvement measures should be acknowledged for this effort in the risk assessment process.<br />
iii.<br />
Less not more.<br />
Every provider interviewed complained of the burdensome level of external reporting that they currently have<br />
to undertake to meet the requirements of funding bodies and the AQTF. Private providers in particular<br />
stressed that they feel overwhelmed and overburdened by reporting requirements, particularly those<br />
associated with AQTF compliance. They strongly requested that any external auditing that might apply to their<br />
offshore activity should strive to minimise the impost on providers. All providers were also concerned with the<br />
negative impact that an external Australian audit would have on their delivery partners in offshore locations.<br />
Dual sector providers who have experienced on-site AQUA audits in offshore locations, stressed that if not<br />
properly managed and supported by the provider, external audits can be both confusing and confronting for<br />
the foreign partners. This partner confusion may well be increased if AQTF audits were to be undertaken by<br />
seven different (state/territory based) authorities who might have differing interpretations and emphasis. A<br />
streamlined, national approach which avoids duplication of provider/partner effort is therefore likely to be<br />
preferred.<br />
iv.<br />
Portability, equivalence and global relevance of AQTF qualifications.<br />
A significant number of providers questioned the ‘portability’ and ‘global relevance’ of AQTF qualifications.<br />
Some suggested that parts of the framework and training package competencies were very ‘Australian centric’<br />
and not relevant to offshore work environments. OHS competencies were frequently quoted as an example of<br />
lack of relevance outside Australia. The requirement that all offshore trainers have Cert IV in TAA was also<br />
seen to be ‘insulting’ to many offshore teaching professionals who were very well qualified in their own<br />
countries.<br />
A related issue was the degree to which the VET qualification could be contextualised to better meet offshore<br />
requirements while still being AQTF compliant. While contextualisation is specified in the AQTF guidelines; on<br />
the ground providers are grappling with the need to balance offshore student needs and still maintain<br />
compliance. The issue of ‘equivalence’ of AQTF qualifications was raised in this context with most providers<br />
indicating that balancing the requirement to be compliant and yet deliver a locally useful qualification was<br />
problematic. One major provider suggested that ‘comparability’ of qualifications would be a much more useful<br />
approach than that of ‘equivalence’.<br />
One major private provider took a broader and stronger position on this issue. The provider agreed on the<br />
issue of the Australian centric nature of VET qualifications and compared them unfavourably to more globally<br />
portable qualifications offered by the UK via City and Guilds. It was argued that the latter were better designed<br />
to be a globally recognised and relevant qualification than was the AQTF. As workers are increasingly<br />
peripatetic there is a growing demand for portable, international vocational qualifications. It was also argued<br />
that perhaps two qualifications should be developed within the AQTF; one for those who intended to work in<br />
Australia and another international qualification for those who were destined to work in their home countries<br />
or who were destined to join the global, peripatetic work force.<br />
26
In contrast those providers who were delivering VET programs to students who were on pathways to<br />
Australian onshore higher education were understandably less concerned with the ‘Australian centric’ nature<br />
of VET qualifications.<br />
Clearly the providers’ viewpoint on this issue is influenced by the motivations and vocational/ educational<br />
destination of their offshore students.<br />
A summary of major themes/issues from the Consultations<br />
In summary, the major themes identified during consultation were: the limited knowledge of the offshore<br />
market for regulators and for the market; there is no offshore auditing; there is no common view of the<br />
regulator’s role in monitoring offshore VET; and experienced providers recognise risks and address them, they<br />
would prefer a process that is not onerous and recognises their efforts.<br />
• No state or national authority has accurate and comprehensive national and state data in regard to<br />
the quantum, location and nature of VET offshore delivery. State and national regulatory authorities<br />
collect data only if it is relevant to a particular audit scheduled in a given year. Public providers submit<br />
data to NCVER on request and in two states (NSW and WA), public providers are required to provide<br />
data to their state bureaucracies. Apart from a voluntary submission to a member organisation<br />
(ACPET), private providers do not submit data unless it is part of a scheduled AQTF audit.<br />
• There is no state or national onsite monitoring/auditing of offshore VET provision except in a very<br />
small number of dual sector institutions that undergo offsite AQTF monitoring as part of their AUQA<br />
audit. <strong>Offshore</strong> quality is currently judged via desktop audit.<br />
• Regulatory authorities do not have a unanimous view regarding their mandated role in monitoring<br />
offshore activity. They are however unanimous in their view that they do not have the resources for<br />
offshore auditing. They are also unanimous in stating that a risk based approach is preferable to a<br />
routine compliance approach and that the AUQA focus on self assessment and continuous<br />
improvement was a useful approach for offshore monitoring.<br />
• The offshore market has no single point of information that might guide their assessment of the<br />
quality of Australian VET providers. While AusLIST was established to provide this service, it is<br />
voluntary and while, widely used by Australian universities, very few VET providers are listed.<br />
• Experienced public and private providers delivering offshore are acutely aware of the risks and<br />
challenges involved. Experienced public providers are investing heavily in their own internal quality<br />
monitoring and improvement systems that are closely aligned to AQTF requirements. Large<br />
networked global and badged private providers also have robust internal quality systems. Both public<br />
and private providers are driven by commercial and reputational imperatives.<br />
• Providers who are investing heavily in quality monitoring/improvement want to be acknowledged for<br />
this effort and do not want an onerous, burdensome additional layer of monitoring which requires<br />
duplication of effort and more resources. Providers also fear the negative business consequences of<br />
culturally insensitive external audits.<br />
27
THE PROPOSE D MODEL<br />
The <strong>National</strong> policy context<br />
The current policy context for VET is one of change to a more national system of tertiary education in which<br />
VET is more closely aligned to the higher education sector and regulation is more centralised at a national<br />
level. The direction to national reform in the VET sector was outlined in the outcomes of the April meeting of<br />
the <strong>Council</strong> of Australian Governments (COAG), which<br />
“endorsed the need for stronger and more cohesive national regulatory arrangements for<br />
Vocational Education and Training (VET), including in-principle support for a national<br />
regulatory body to oversee registration of providers and accreditation of VET<br />
qualifications and courses. A report on operational models, including for a national<br />
regulatory body, will be provided to COAG by September 2009” ( COAG, 2009).<br />
The Commonwealth Government is also working to establish a national higher education quality agency to<br />
provide greater integration of the regulation of tertiary education by 2013. The Tertiary Education <strong>Quality</strong> and<br />
<strong>Standards</strong> Agency (TEQSA) will develop stronger quality assurance arrangements to protect the quality of the<br />
Australian tertiary education system. It is directed to provide for greater consistency and efficiency in quality<br />
assurance. TEQSA will be established in 2010. It’s role will include a focus on risks associated with operating in<br />
particular geographic regions or particular programs of study. It is intended that TEQSA will oversight the<br />
entire tertiary sector, including VET, from 2013 (DEEWR, 2009).<br />
There are also changes in tools of regulation signalled in current reviews commissioned by DEEWR to examine<br />
the AQTF along with the review of the Education Services for Overseas Students (ESOS) Act 2000 (DEEWR,<br />
2009). A focus of the ESOS review on “nationally consistent quality, the quality of providers entering the<br />
market and mechanisms for ongoing, monitoring, quality assurance and quality improvement of registered<br />
providers” (p. 1) is consistent with the focus on the offshore market as undertaken in this project.<br />
These reviews are progressing in parallel with this and other projects. They signal a change in the regulatory<br />
environment and an opportunity for policymakers to ensure that there is greater consistency in the regulatory<br />
system across sectors and to reduce duplication in arrangements for those providers who operate as multisector<br />
providers to international students on- and off-shore. Any recommendations that emerge from this<br />
project should be viewed in the broader context of reform. The researchers are also aware that<br />
implementation of recommendations from this project will need to be viewed in terms of meeting immediate<br />
needs as well as processes of transition to a national system of tertiary regulation by 2013. As stated below,<br />
the proposed model is consistent with the TEQSA approach. The model is independent of which organisation is<br />
to implement it. Whether the accrediting body is a government department, an industry body or a<br />
professional association.<br />
There are two dimensions to the proposed model for managing regulation of offshore VET activity – locus of<br />
control and quality assurance of offshore delivery of training and assessment services for accredited Australian<br />
qualifications.<br />
Locus of control<br />
This dimension is concerned about whether control of offshore VET activity is centralized within bureaucratic<br />
mechanisms or decentralized to the market.<br />
A centralized system assumes that it is possible to control offshore VET activity. A completely decentralized<br />
market oriented system assumes that the market is aware of the quality of VET providers. Neither extremes of<br />
the model are likely, as is discussed below.<br />
Option B is the preferred option. It recognizes that it is not possible to be completely aware of all providers<br />
operating offshore, particularly those who are likely to operate outside AQTF requirements. Option B<br />
strengthens the potential for clients to choose quality providers, which is likely to influence providers’ interest<br />
in being part of a quality system that can be monitored.<br />
28
Option A:<br />
Mandated<br />
registration for all<br />
offshore VET<br />
Option B:<br />
Information to the<br />
market & voluntary<br />
registration<br />
Option C:<br />
Provider-Client<br />
relationship<br />
CENTRAL AUTHORITY<br />
MARKET<br />
Option A – Mandated registration for all offshore VET<br />
This option requires that in order to offer AQF qualifications offshore a provider must have gained approval<br />
from a national or state authority to offer accredited AQF qualifications offshore. It would involve:<br />
• mandated central accreditation of all providers who wish to offer AQF qualifications offshore<br />
• assessment of their preparedness to offer AQF qualifications in a non-Australian context using criteria<br />
such as demonstrated performance in delivery of quality training and assessment services prior to<br />
registration for offshore delivery<br />
• ongoing monitoring of provider accreditation.<br />
Advantages<br />
• this option provides a greater sense of control to those with responsibility for managing the<br />
reputation and credibility of Australian education and training system and AQF qualifications<br />
• the lines of accountability could be readily defined<br />
• providers who did not have a demonstrated history of quality provision would be excluded from<br />
registration for offshore delivery<br />
Disadvantages<br />
The model assumes that<br />
• all providers who operate offshore can be known to an Australian authority<br />
• it is possible to monitor all providers offering qualifications offshore, and<br />
• the administrative burden and costs can be borne by providers and the system.<br />
Option B – Information to the market and voluntary accreditation<br />
This option is based on an assumption that clients’ choice of quality providers and the commercial motivation<br />
of providers will influence their willingness to ensure quality training delivery and assessment services. The<br />
option involves providers of offshore training ‘buying in’ to a regulated quality system that provides access to a<br />
quality ‘badging’ process. It involves:<br />
• recognising member providers against quality criteria and prior demonstrated delivery of quality<br />
training and assessment services<br />
• information to the market on which providers are approved as members<br />
• ongoing membership to be contingent on demonstrated quality performance<br />
• information to the market on provider performance in external and internal quality assurance<br />
processes<br />
• strong relationships between the registration body and host countries to ensure that they know that<br />
the register exists and to ensure that it is seen to promote only quality RTOs.<br />
• strong relationships with the regulatory bodies in host countries to gather intelligence on who is<br />
offering Australian qualifications in these locations and whether there are any problems with their<br />
operations.<br />
29
Advantages<br />
• reputation in the market is a more powerful motivation for providers than accountability to regulators<br />
• those who are most affected by the quality of training and assessment services (clients) have a basis<br />
for selecting quality RTOs<br />
• RTOs who operate outside the system are likely to be identified by competitors and regulatory bodies<br />
in host countries<br />
• RTOs who do not provide quality training and assessment services will be excluded from the positive<br />
marketing opportunity that membership would provide. It is a ‘buyer beware’ approach<br />
• that Australia is interested in protecting the quality of its qualifications will be seen as a positive by<br />
clients, which would enhance the reputation of the Australian education and training system<br />
• information to the market on the outcomes of internal and external quality assurance processes<br />
rewards those providers that have invested in comprehensive quality assurance systems<br />
• the approach depends on thorough quality assurance and sanctions so that it is perceived to be a<br />
thorough and comprehensive approach.<br />
Disadvantages<br />
• The system depends on provider buy-in, which has not been a feature of the current AusLIST model,<br />
as it pertains to VET providers.<br />
• The system depends on registration being seen as a badge of quality by both providers and the<br />
market.<br />
Option C – Provider-client relationship<br />
Option C is based on an assumption that providers will be motivated to ensure that their continued operation<br />
in a competitive market is based on their clients’ positive perceptions of the quality of their training and<br />
assessment services. The option is dependent on the strength of the contracts between the provider and their<br />
clients.<br />
Advantages<br />
• training and assessment services are likely to be directed to client needs<br />
• clients will go elsewhere if they are not satisfied with the training and assessment services provided<br />
by the RTO<br />
• less burden and cost to providers and the system<br />
• commercial-in-confidence information is protected, because information is not in the public domain.<br />
Disadvantages<br />
• there are no mechanisms to ensure that training and assessment services reflect AQTF requirements<br />
• clients and host countries may be suspicious of an education and training system that is not<br />
interested in checking the quality of its ‘badge’ as represented by the AQF qualifications<br />
• assessment of performance assumes that the client knows what to expect from the provider and<br />
receives information on their prior performance.<br />
• dissatisfied clients are not likely to choose to undertake further Australian qualifications, which would<br />
represent a loss of market to international competitors and a cost to the reputation of the AQF and<br />
commercial interests of all Australian offshore providers.<br />
30
The preferred option is Option B as per the following set of decision items:<br />
Is there risk in<br />
offshore delivery?<br />
Yes<br />
Is a provider-based<br />
quality assurance<br />
system sufficient to<br />
manage the risk?<br />
No<br />
Then there is a need for some form of control/regulation<br />
That leaves the choice of model between control by Option A Central authority or Option B Information to the<br />
market and voluntary accreditation. The discussion above suggests that Option B provides a more workable<br />
option that is more likely to gain ‘buy in’ from those outside the system that provide the greatest risk to<br />
system reputation.<br />
Given the anticipated changes to national regulation of a VET system (via TEQSA by 2013) it is assumed that<br />
the operation of the model and subsequent quality monitoring would also operate through a national body. As<br />
stated above, the national body could be a government department, an industry body or a professional body.<br />
<strong>Quality</strong> monitoring<br />
This dimension is concerned with how the quality of offshore delivery of AQF qualifications is monitored and<br />
assured. The approach to quality under the current AQTF 2007 is based on quality assurance rather than<br />
‘quality control’, because in reality it is not possible to absolutely control quality of delivery and control<br />
approaches can constrain innovative good practice. The system can only ensure that appropriate processes<br />
that lead to quality outcomes are in place for those providers registered to offer AQF qualifications on- or<br />
offshore.<br />
Option A:<br />
Mandated regular<br />
audits of all providers<br />
Option B:<br />
Risk based quality<br />
assurance by<br />
accrediting body<br />
Option C:<br />
Providers’ continuous<br />
improvement<br />
processes<br />
COMPLIANCE<br />
CONTINUOUS IMPROVEMENT<br />
The options range from quality assurance of all activities by all providers (Option A) to reliance on the<br />
processes that providers have in place to ensure continuous improvement as a requirement of their<br />
registration (Option C). Option B Risk based quality assurance is the preferred model. It is more efficient and<br />
does not add unreasonable burden to providers’ operations. It is driven by the power of the market to<br />
influence provider behaviour and efficient, risk-based approaches to quality assurance.<br />
Option A – Mandated, regular audits of all providers of offshore training and<br />
assessment services.<br />
Under this option all providers of offshore delivery would be audited regularly. The audits would include<br />
detailed consideration of their offshore training and assessment services. The audits would automatically<br />
occur within existing AQTF 2007 registration requirements, but could also include additional audits as<br />
determined by the registering body. This option involves:<br />
31
• application of existing AQTF 2007 requirements for registration and the associated auditing program<br />
on registration, within 12 months of registration and prior to re-registration. That is, at least once in a<br />
registration period. It would apply to all providers of offshore training and assessment services<br />
irrespective of the nature and scope of their activity<br />
• auditing the deployment of stated policies offshore is a feature of the process<br />
• providers notify the registration authorities that they intend to deliver training and assessment<br />
services offshore<br />
• thorough professional development for auditors to ensure that they are sensitive to the offshore<br />
cultural, educational and regulatory environment.<br />
Advantages<br />
• registration bodies would assume that they have greater control over compliance to standards and<br />
the opportunity to identify RTOs that are not delivering quality services<br />
• registration bodies would develop a stronger understanding of the nature and extent of offshore VET<br />
delivery and assessment to assist in managing potential risks.<br />
Disadvantages<br />
• there may be little reason to be confident that a compliance approach to all providers will ensure that<br />
only quality RTOs will operate offshore. It is possible that there will be providers that operate offshore<br />
that are not known to regulators. The approach may not expand the scope of existing approaches and<br />
may not in reality address the providers that pose the greatest risk to system reputation and the<br />
quality of services to clients<br />
• this would involve ‘heavy handed’ auditing processes directed to compliance rather than continuous<br />
improvement. A compliance focus is less likely to influence actual practice than is a continuous<br />
improvement focus<br />
• it adds a burden of compliance that replicates and magnifies existing quality monitoring processes<br />
associated with the AQTF 2007, providers’ existing quality assurance arrangements such as ISO 9001<br />
registration, registration for delivering English language qualifications and quality assurance<br />
associated with membership of franchising arrangements for some RTOs<br />
• it is not ‘risk sensitive’ and is extremely resource intensive. It would come at considerable expense to<br />
the system and to providers irrespective of the size and nature of their activities.<br />
Option B – Risk based quality assurance by the registering body<br />
This option is based on managing quality through a system of determining which areas of delivery and<br />
assessment services are likely to pose the most risk to the reputation of the education and training system. It<br />
involves:<br />
• annual national data collection from all public and private providers regarding programs, enrolments<br />
and location of offshore delivery to form the basis of an evidence-based risk assessment process<br />
• initial enhanced risk assessment using the data collection as well as data from quality indicators and<br />
information received from the host countries<br />
• offshore site visits to all high risk providers and identified providers as per enhanced risk guidelines<br />
• ongoing registration is dependent on performance.<br />
Advantages<br />
• the approach is consistent with the existing AQTF arrangements, but makes offshore delivery a more<br />
explicit and targeted area for risk assessment<br />
32
• it involves assessment of the deployment of providers’ quality assurance approaches rather than just<br />
their intentions<br />
• the approach is more resource efficient than Option A as only high risk providers of offshore training<br />
and assessment services are subject to audit<br />
• providers’ existing quality assurance processes may become a feature of the audit process in terms of<br />
selection of candidates for audit. This rewards providers that have comprehensive quality assurance<br />
systems.<br />
Disadvantages<br />
• offshore audits are costly to the system and potentially providers depending on funding arrangements<br />
• it depends on appropriate criteria for identifying high, medium and low risk providers<br />
• it depends on providers’ agreeing to submit data and answers to the survey.<br />
Option C – Providers’ continuous improvement processes<br />
This option is based on providers having comprehensive continuous improvement processes that lead to<br />
better training and assessment services rather than external audit processes.<br />
Advantages<br />
• costs to providers are reduced<br />
• improvements are directed to areas of relevance to the providers’ business model rather than<br />
external compliance criteria<br />
• there are incentives to providers to implement quality improvement processes.<br />
Disadvantages<br />
• it depends on providers implementing quality assurance processes<br />
• the areas of improvement may be directed to areas of relevance to the providers’ business model<br />
that are actually contrary to the interests of the AQF qualifications and compliance with the<br />
requirements of the AQTF 2007<br />
• the lack of external points of reference may reduce the quality of information taken into account in<br />
quality assurance processes<br />
• the improvements to providers’ activities may be from a very low base and not represent any form of<br />
quality provision relative to ‘satisfactory’, let alone ‘good’ or ‘best’ practice<br />
• relying on providers’ own practice is not likely to identify those providers who operate outside the<br />
system and are driven solely by commercial rather than educational quality interests<br />
• continuous improvement as the sole form of quality assurance is unlikely to contribute to clients’ or<br />
host countries’ confidence in the overall quality and reputation of Australian qualifications and<br />
provision of education and training services, and<br />
• it is not consistent with quality assurance practices for onshore delivery.<br />
Concluding comment<br />
It should be clear that the preferred model for quality assurance, Option B Risk based quality assurance by the<br />
registering authority, is consistent with the current risk management approach of the AQTF 2007. It does not<br />
require anything in addition to what is already in place and available to regulators. In principle, the AQTF 2007<br />
<strong>National</strong> guidelines for Risk Management provide for a focus on offshore delivery as part of a strategic<br />
approach to risk management. However, the current practice of catering for offshore delivery through desktop<br />
33
audit processes is insufficient to manage the risk that providers’ stated policies and procedures are not<br />
deployed appropriately.<br />
It is recognized that the implementation of the proposed options may impose an additional process that<br />
focuses on off-shore delivery separately from the audit regimes that apply to providers’ onshore activity. That<br />
is, as the offshore component is referred to a national body in addition to their state-based processes.<br />
However, this is likely to be a short-term effect during the transition to a national system.<br />
The notion of a voluntary accreditation process is also consistent with current AusLIST arrangements, except<br />
that the emphasis on quality providers is strengthened through the extent to which demonstrated quality<br />
performance is a requirement for membership. This can only be achieved through publication of performance<br />
results, which have a successful precedent as demonstrated through the AUQA model.<br />
The following section describes six elements of the model based on Option B. Provider responses to the<br />
elements are also included. It is also important to note that feedback from DEEWR officials who are charged<br />
with establishing the new national tertiary regulatory model (TEQSA), indicates that the six elements are in<br />
agreement with the philosophy and intent of the reform of the national higher education regulatory system in<br />
the first instance. This work will no doubt inform the VET component of the national regulatory system when it<br />
is implemented (planned for 2013). As stated above, the model could be implemented through a government<br />
department, an industry body or a professional body depending on the reading of the elements and whether<br />
the weighting is toward compliance or professional capability.<br />
34
ELEMENTS OF PROPOSE D MODEL: OPTION B<br />
The six elements of the proposed model are described below (Figure 5). The responses from providers during<br />
consultation are also outlined for each element in the model. Elements 2 to 4 are core to the model, while the<br />
other three elements are seen to support the overall approach.<br />
Figure 5<br />
Proposed model: Option B<br />
1. Improved information and badging to the offshore market – voluntary membership listing with strong<br />
incentives to achieve listing (supporting element).<br />
2. Compulsory national annual data collection from all public and private providers regarding programs,<br />
enrolments and location of offshore delivery (central element).<br />
3. Initial enhanced risk assessment – desktop audit based on enhanced/more detailed guidelines. High,<br />
medium and low risk offshore providers identified (central element).<br />
4. Detailed offshore site visits of high risk providers as per enhanced risk guidelines (central element).<br />
• strong quality improvement focus, not only AQTF compliance<br />
• supplemented by AEI/AUSTRADE offshore intelligence<br />
• conducted by experienced specialist national audit team.<br />
5. Results of offshore visits in public domain, as per current AUQA model (supporting element).<br />
6. Membership / badging informed by site visit results, e.g. major noncompliance as a provider<br />
(supporting element).<br />
Element 1: Improved information to the offshore market<br />
Element 1 is a strengthened, voluntary accreditation process for offshore delivery. It is intended to provide the<br />
market with clear information on providers that are recognized as having satisfied specified quality assurance<br />
processes. It would involve a national body establishing some clear criteria and assessing each voluntary<br />
applicant against these, prior to accepting the provider for membership on a publicly available, quality<br />
branded list. This will assist the market to make an informed choice of provider and to reward providers who<br />
have implemented quality effective assurance processes. Element 1 recognizes that limited information is<br />
available on who is delivering AQF qualifications offshore. It also recognizes the limited adoption of the current<br />
AusLIST system by the VET sector.<br />
Implications<br />
• Providers continue to notify a national body of their planned offshore delivery. The national body has<br />
the task of ensuring that the provider meets specified conditions of membership. Membership is<br />
voluntary but the status and ‘badge’ of the authority is such that there are strong imperatives to join.<br />
• Accredited providers are widely publicized via a website. The website is marketed widely as a badge<br />
of VET quality in all countries where offshore delivery is occurring.<br />
• A similar process is currently undertaken by AusLIST and is widely used by higher education.<br />
35
Provider response<br />
• There is no uniform provider view regarding the provision of authoritative information to the market<br />
via a single point. A large number of private providers see this as an unnecessary intrusion into their<br />
commercial marketing domain. Other providers have asserted that local accreditation in the offshore<br />
location is more valuable than an Australian ‘badge’. Others believe that an accreditation/ badging<br />
system could be effectively achieved by membership/ peer group organisations acting as an<br />
accreditation body. Some public and private providers also doubt the value of the current AusLIST<br />
model and they fear that publication of their activities will result in loss of business to competitors<br />
and may also result in increased ‘external scrutiny’.<br />
• A minority of public providers believe that the proposed accreditation process does not go far<br />
enough. They propose mandatory registration for all intending offshore providers including very<br />
rigorous registration requirements. This option, if adopted, would require significant changes to the<br />
current regulatory environment. Others thought that this approach might encourage providers to<br />
seek to operate outside the system and that these providers could present offshore VET provision<br />
with its greatest reputation risk.<br />
Element 2: Compulsory national annual data collection of all offshore<br />
VET<br />
Element 2 recognizes that it is difficult to monitor and regulate offshore activity when you do not know who is<br />
providing offshore and whether there are any associated risks to their provision. This element involves a<br />
compulsory annual national collection of all public and private providers to determine the nature and extent of<br />
offshore delivery. It reflects recent state based initiatives undertaken in South Australia and Western Australia<br />
to better understand the extent of offshore delivery and its potential risks.<br />
Implications<br />
• Data could be collected as part of an AVETMISS collection, or as part of the collection of the <strong>Quality</strong><br />
Indicators. The latter approach has an advantage in providing ‘outcomes data’ that is linked to the<br />
nature of the offshore delivery.<br />
• Data would be collected annually from all public and private providers. Data would not include<br />
financial information. Data required would be based on existing data sets that are already required or<br />
have been identified by recent research.<br />
• Public providers currently provide information to NCVER. Private providers do not provide any<br />
information to a central body, except to the state regulator if they are scheduled for an AQTF audit or<br />
to their member organizations if requested.<br />
• If mandated for both public and private providers, accurate and comprehensive data would be<br />
available for the first time to government stakeholders and regulators. It would provide an enhanced<br />
platform on which to identify potential risk, conduct research, analyze trends and to inform future<br />
policy and practice.<br />
Provider response<br />
• Private providers generally supported compulsory annual data collection and suggested ways in which<br />
this might be collected in a cost effective manner. The reservations expressed were not related to the<br />
data collection as such, but to gaining reassurance that the data would be collected by a ‘neutral’<br />
body, would be kept confidential and would not be released in the public domain in ways which<br />
would be commercially harmful to individual providers.<br />
• Public providers generally supported this element because they believe that non disclosure of<br />
overseas delivery has the potential to condone questionable delivery, to compromise quality and<br />
negatively affect the reputation of Australian VET providers overall. Some public providers raised<br />
practical issues regarding the timing of data collection to fit the academic years offshore and the need<br />
36
to clearly specify the use to which the data would be put. However, even for these providers there<br />
was in principle support to collect information to identify the scope and nature of offshore delivery.<br />
• Protocols regarding nondisclosure of sensitive information would need to be developed.<br />
Element 3: Initial Enhanced Risk Assessment<br />
While desktop audits of some offshore providers are conducted by state regulatory authorities Element 3<br />
recognizes that, while many aspects of offshore delivery are mirrored by that in onshore delivery, there are<br />
risks and operational challenges which are particular to offshore delivery. The way in which providers address<br />
these challenges has a direct bearing on the quality of VET delivery and student outcomes. Element 3<br />
therefore seeks to augment existing AQTF risk guidelines with a more detailed description of the<br />
challenges/risks relating to offshore delivery. The aim is to produce a desktop tool that will more accurately<br />
measure risk in offshore delivery.<br />
Implications<br />
• The 17 operational challenges outlined earlier in this report provide a basis on which to more closely<br />
identify and calibrate offshore risk. These challenges have a great deal in common with the 17 facets<br />
which AUQA currently use as a base for monitoring the quality of higher education delivered offshore.<br />
The guidelines recently developed by TAFE NSW to guide the work of their offshore (non regulatory)<br />
visits may also inform a uniform set of guidelines.<br />
• The task of developing and implementing enhanced risk guidelines lends itself to a coordinated<br />
national approach.<br />
Provider response<br />
• Private providers supported a risk based approach to monitoring quality but their views on the need<br />
for enhanced risk guidelines were divided. A significant number believe that the current guidelines are<br />
adequate but the assessment of these by regulators is flawed. They cited cases where private<br />
providers had passed audits and subsequently failed to provide quality programs to students and thus<br />
compromised the reputation of quality VET providers. Those who supported an enhanced risk<br />
assessment were generally keen to ensure that ‘risk’ should encompass financial risk/ provider<br />
viability as a primary assessment tool.<br />
• Public providers, especially those with significant offshore experience, were in general agreement<br />
with a more detailed assessment of offshore risk. They requested that the descriptors of high,<br />
medium and low risk be clearly outlined. They also believed that the risk assessment should take into<br />
account the national quality systems, which apply in the country of delivery and also acknowledge any<br />
international quality accreditation held by the provider. This last point was endorsed by private<br />
providers.<br />
Element 4: <strong>Offshore</strong> site visits<br />
The intent of this element is to ensure that, as an immediate priority, providers that are identified as being<br />
high risk via an enhanced risk assessment undergo an offshore site visit as soon as possible after initial<br />
assessment. Due to the nature of the risk it is likely that the focus of these offshore visits is one of examining<br />
compliance to AQTF requirements. A program of risk based site visits is based on the understanding that,<br />
however detailed a desk top audit might be, it cannot replace the judgments made by observing delivery first<br />
hand and receiving information and feedback from offshore staff and students. Pending the availability of<br />
resources it is suggested that, in addition, a sample of low/ medium risk providers are visited on a cyclical<br />
basis. The focus of these visits should be to ‘value add’ to the internal quality improvement measures that the<br />
provider is undertaking, should reward the provider and should provide useful system information on good<br />
practice.<br />
37
Implications<br />
• This process will be new to most providers. A significant exception is NSW public offshore providers<br />
who will be visited by an <strong>Offshore</strong> Review Panel (not associated with their state regulator) during<br />
2009.<br />
• Given that levels of offshore activity vary between states and given the need to ensure that offshore<br />
auditors have specialist skills, are trained in cultural competencies and briefed on particular in country<br />
environments, the development of a national offshore audit panel is recommended.<br />
• This panel might be formed by inviting NARA and state based auditors to undertake additional<br />
training on the understanding that they would be prepared to undertake offshore work.<br />
• An alternative way of forming the panel might be an adaptation of the process used in the recent pilot<br />
of the Business Excellence Framework where experienced practitioners led by an auditor undertook<br />
the site visits.<br />
• In either model of panel formation, training and management/coordination will be required. A<br />
national approach to this task is likely to be more efficient and cost effective.<br />
• The active engagement of Australian offshore expertise (Austrade, AEI) will be essential if offshore<br />
visit preparations are to be cost effective and if culturally appropriate auditing is to occur.<br />
• Prior to implementing a comprehensive and potentially costly program of off site visits it is proposed<br />
that a limited pilot be conducted during 2010. This pilot would be subject to an independent<br />
evaluation prior to further implementation. This time frame and evaluation would also allow any<br />
further activity to be informed by emerging national regulatory requirements.<br />
Provider response<br />
• Some private providers believe that the current arrangements are adequate to monitor offshore<br />
delivery, if implemented according to the AQTF 2007 guidelines. However others indicated that the<br />
risks of offshore activity were largely unknown and that targeted offshore visits may be necessary to<br />
protect the reputation of all providers. If such visits and assessments were to occur, a number believe<br />
that evidence of student experience should be central to the assessment of providers.<br />
• Public providers raised a number of concerns. They fear that external offshore site visits will add<br />
additional costs to their delivery in a situation where margins are tight. They believe that current<br />
methods of self-assessment and continuous improvement will be compromised by an external<br />
process and merely add another burdensome layer of regulation. Those who have experienced AUQA<br />
offshore site visits also doubt whether an external audit adds value to an institution that already has a<br />
robust quality system.<br />
• All providers expressed a fear that poorly briefed, culturally insensitive, external auditors could harm<br />
business relationships and delivery partnerships.<br />
Element 5: Publication of Audit Results<br />
This Element is premised on the notion that, as is currently the case with AUQA audits, results should be<br />
transparent and publicly available to all stakeholders. A positive report can be a useful promotional tool for<br />
those providers who fare well. A less positive report involving major non-compliances will also provide useful<br />
messages to offshore organisations who may be seeking to establish partnerships with Australian providers. It<br />
can also provide an external point of reference to assist providers’ improvement processes.<br />
Implications<br />
• If this policy is adopted it is a relatively simple task for the national coordinating body to place results<br />
on a website and also provide the offshore reports to state authorities for inclusion on state websites.<br />
• It will be important that the form of the reporting is appropriate to meet market and provider needs.<br />
38
Provider response<br />
• Public providers, while they had some reservations, had no real objections to audit results being in<br />
the public domain. Some actively advocated for the disclosure of both results and sanctions imposed<br />
on providers with major non-compliances.<br />
• While some are strongly opposed to publication of results, many private providers consulted support<br />
the publication of audit results on the understanding that auditors have appropriate backgrounds and<br />
experience, were trained and unbiased in their approach to providers. The remainder are strongly<br />
opposed to the publication of results as they believe they could be misinterpreted by offshore<br />
partners and misused by onshore competitors.<br />
Element 6: Results provided to national accrediting body<br />
This element is fundamental to ensuring that the accreditation process has integrity and has currency and<br />
credibility in signalling quality training and assessment services. Only providers who have a demonstrated<br />
current record of quality performance should be included in the published register at any given time. Those<br />
who have current major non-compliances will be removed from the register. This will ensure that the offshore<br />
market will value the accreditation and that Australian providers will have confidence in the veracity of the list.<br />
Implications<br />
• It will be a relatively simple matter to transfer results to an accrediting body in a timely fashion,<br />
although the form in which the results appear may need careful consideration to ensure that the<br />
needs of the offshore audience and the (potential) concerns of providers are addressed.<br />
Provider response<br />
• In principle there was no objection from public providers to this element. There was a view that the<br />
accreditation process should be more rigorous than that which currently exists for AusLIST<br />
registration and that risk could be reduced by limiting the number of ‘approved’ registered providers<br />
operating in offshore markets.<br />
• Private providers were almost equally divided on this element.. As can be expected, those who<br />
supported Element 1 (central accreditation) also supported Element 6 (audit results to the<br />
accreditation authority). Those who opposed Element 1 also opposed element 6.<br />
Three ways of reading the 6 elements<br />
How the elements of the model are implemented depend on how they are viewed and the work that they are<br />
to do to achieve quality assurance goals. There are three perspectives that can be applied to the elements.<br />
1. The six elements described above can be seen in a linear and sequential way and can be implemented<br />
from element 1 to 6 in logical succession. Each might be seen as an integrated ‘package’ with each<br />
element interdependent on the others. In this reading the model would need to be implemented in its<br />
entirety.<br />
2. The elements could also be read as separate elements that could be weighted differently or ‘tweaked’<br />
according to (risk based) judgments that authorities might make. For example, if one were to take into<br />
account the views of some providers that the way to reduce risk is to make entry into the market more<br />
difficult, then one might want to weight element 1 more heavily. This might involve a strengthening of<br />
the element, turning a voluntary accreditation process into a mandated registration process with rigorous<br />
entry hurdles. Presumably this would reduce the number of players in the market and would assure the<br />
market of the quality of those who are authorised to deliver. This would mean that ‘risk’ was addressed<br />
more strongly at the front end (element 1) of the process and the need for risk based offshore audits<br />
(element 4) might be lessened. This approach is likely to require considerable change to the existing<br />
regulatory frameworks and may therefore be one which is considered in the longer term as a national<br />
(TEQSA) system evolves.<br />
39
3. Another way if reading the elements takes into account the individual functions of each element. If it is<br />
agreed that a centrally coordinated, risk based quality assurance model is preferred it can be seen that<br />
the 6 elements are comprised of elements which are central to risk identification and risk mitigation and<br />
those that are supportive to the central purpose. The diagram below (Figure 3) represents the elements<br />
in a functional way. This may be a useful distinction particularly, as noted above, any model adopted is<br />
likely to be a temporary transitional one which will meet short-term needs. In addition, the costs to<br />
government agencies and providers of implementing a relatively short-term model are also an important<br />
consideration. In this reading it is possible to identify the three central elements that will be essential if<br />
offshore delivery risks are to be identified and mitigated in the short term. Comprehensive data<br />
collection (Element 2), risk assessment (Element 3), and offshore monitoring visits (Element 4) are the<br />
essential activities if risk mitigation is to occur. While no less important, there is a sense in which<br />
Elements 1, 5 and 6 ‘wrap around’ and support the three essential activities.<br />
Concluding Comment<br />
The six elements of the proposed model are based on consideration of two underlying dimensions: locus of<br />
control and approaches to quality assurance. The locus of control dimension moves along a continuum from<br />
centralised authority to free market forces. The dimension of quality moves along a continuum from externally<br />
determined compliance to self-assessment and continuous improvement. Option B seeks to find a ‘middle’<br />
practical way through the extreme positions on each ends of the dimensions while providing a strong basis for<br />
managing the risks associated with offshore delivery of Australian qualifications. In addition a ‘functional’<br />
division of the elements into 3 central elements and 3 supporting ones provides an opportunity to consider a<br />
shorter term solution to identifying an addressing risks in current offshore VET delivery.<br />
It can be seen from the above that there is a wide variety of provider views in regard to the three ‘central’ and<br />
three ‘supporting’ elements in Option B. This is not surprising. The Australian VET system is remarkably<br />
diverse. It unlikely that any model presented would achieve unanimous or even majority support from the very<br />
diverse cohort of providers. The issue is not one of provider support but rather one of protection of the quality<br />
and reputation of the Australian VET qualifications and those responsible for delivering them.<br />
Recommendations<br />
It is recommended that the NQC<br />
1. Supports the proposed 6 elements of the model as a basis of monitoring and managing the risks of<br />
offshore delivery of Australian VET qualifications.<br />
2. In order to identify and mitigate immediate risk, a pilot and evaluation of the three central elements<br />
of the model is conducted and evaluated in 2010. Estimated costs are attached (Appendix C).<br />
3. That an implementation plan is developed which:<br />
a. Facilitates commencement of the pilot as early as possible in 2010.<br />
b. Assesses the costs and practicality associated with progressively implementing the three<br />
support elements (information to the market and/or strengthened accreditation, publication<br />
of results, informing accreditation body) to the model.<br />
c. Identifies any potential changes to current regulations needed to implement the three<br />
supporting elements.<br />
d. Takes into account the effect of impending changes to the VET regulatory arrangements via<br />
TEQSA.<br />
e. Takes into account the effect of any other changes to roles and responsibilities as a result of<br />
reviews that are currently underway or are planned.<br />
f. Ensures that the NQC is provided with the evaluation results of the 2010 pilot by October<br />
2010 so that future action can be recommended.<br />
4. Develops a VET specific offshore delivery manual/guide that includes examples of best practice in<br />
offshore delivery.<br />
40
REFERENCES<br />
Australian Universities <strong>Quality</strong> Agency (2009) <strong>Quality</strong> audits. Melbourne: AUQA<br />
http://www.auqa.edu.au/qualityaudit/qa/ (as at 30/10/09)<br />
Bateman, A. (2007) <strong>Quality</strong> assurance of offshore delivery in VET: Synthesis report. Adelaide: NCVER.<br />
Carmichael, R. (2009) Auditing TNE activities. Unpublished briefing paper. Melbourne: AUQA.<br />
Ciccarelli, A. (2009) A managed approach to TNE disengagement. Paper presented at the Australian<br />
International Education Conference, Sydney Convention and Exhibition Centre, 13-16 October 2009.<br />
City and Guilds (2009) Centre guide – Delivering international qualifications: Edition 2. London: City and Guilds.<br />
<strong>Council</strong> of Australian Governments (2009) Directions for Vocational Education and Training Reform,<br />
Communique, April 2009. http://www.coag.gov.au/coag_meeting_outcomes/2009-04-30/index.cfm#jobs<br />
Department of Education, Employment and Workplace Relations (2007) Delivery of VET offshore by public<br />
providers, 2007. Report on a consultancy undertaken for the Department of Education, Employment and<br />
Workplace Relations. Canberra: DEEWR.<br />
Department of Education, Employment and Workplace Relations (2009) Fact sheet: A national quality and<br />
standards agency. Canberra: DEEWR. www.deewr.gov.au/.../09_FactSheet_<br />
Department of Education, Employment and Workplace Relations (2009) Terms of reference for the review of<br />
the Education Services for Overseas Students (ESOS) Act 2000 and associated regulatory and legislative<br />
frameworks. Canberra: DEEWR.<br />
Department of Education, Science and Training (2007) AQTF 2007: Building Training Excellence. Canberra:<br />
DEST.<br />
Department of Education Services (2007) Transnational <strong>Quality</strong> Strategy Trial <strong>Quality</strong> Assessment: Western<br />
Australian Trial Site Audit. Perth: Department of Education Services.<br />
International Education Association of Australia (2008) Good practice in offshore delivery: A guide for<br />
Australian providers. Draft June 2008, Canberra: DEWR.<br />
Quirk, S. (2009) Positive trade … private international education in Australia. Paper presented at the Australian<br />
International Education Conference, The International Student Experience in ELICOS and VET.<br />
www.aiec.idp.com<br />
Scottish Qualifications Authority (2007) Awarding body criteria. Edinburgh: Scottish Qualifications Authority.<br />
Silver, A. and Yang, H. (2008) Best practice in quality assurance for transnational programs – A case study for<br />
Victoria University, Melbourne Australia. Paper presented at the CCID 32 nd Annual Conference, 23-26 February<br />
2008, Long Beach, California, USA.<br />
Skilbeck, M. (1988) The yearning for tests, Australian Teacher, n20, 18-20.<br />
Stella, A. and Liston, C. (2008) Internationalisation of Australian Universities: Learning from Cycle 1 Audits.<br />
Melbourne: Australian Universities <strong>Quality</strong> Agency<br />
TAFE NSW (2009) Personal communication with senior personnel from TAFE NSW in September 2009.<br />
41
APPENDIX A QUESTIONS POSED IN<br />
CONSULTATION<br />
Providers<br />
Delivery<br />
QA<br />
• What do you deliver offshore currently? [Country? Quantum? Programs? Delivery model/strategy?]<br />
• Who are the main competitors – Australian providers and overseas providers - in this market?<br />
• How has the market changed in the past three years?<br />
• What are the main challenges in offshore delivery? [eg. Staffing qualifications and suitability; language<br />
of instruction; partner selection/management; managing consistency and quality; appropriateness of<br />
training materials; customisation Vs equivalence; facility standards; AQTF pathways; assessment and<br />
moderation.]<br />
• What systems for QA are in place now?<br />
• What is your institution’s approach to monitoring quality system [specifically regarding offshore<br />
delivery]<br />
• What external requirements apply for your registration and compliance for offshore delivery?<br />
• Is there any perceived tension between in-country requirements and the AQTF requirements? If so,<br />
how do you resolve these?<br />
• Given your experience what features should an external QA monitoring system have or not have?<br />
• … Could you walk me through the process from<br />
start to finish. What they read, who they spoke to, evidence looked at … specific to offshore, etc.<br />
• What are your impressions of the process?<br />
• Are there special provisions in the overseas regulatory environments?<br />
• Do you treat off-shore and on-shore as same or different for QA? Does this change for different<br />
courses?<br />
• Has quality assurance changed under the new AQTF? How?<br />
Workforce delivery<br />
• How do you manage workforce development issues around offshore? Which staff groups? <strong>Skills</strong><br />
issues? Costs?<br />
• Additional questions for dual sector institutes<br />
• What is your experience of AUQA audits offshore? What are the key features of the model?<br />
• What are your views on its appropriateness for offshore delivery?<br />
• Are there particular issues in managing both regulatory requirements (AUQA & AQTF)?<br />
• How do they fit with the other requirements around eg. CRICOS/ESOS? Is it a comfortable fit or are<br />
there difficulties in managing the processes?<br />
• What are the relative merits of the AQTF / AUQA systems?<br />
• In a new model what should we make sure was included?<br />
• What are the costs of QA/audit process? (external/internal) Who bears the costs?<br />
42
Regulatory bodies<br />
NARA<br />
AUQA<br />
• What are your requirements for monitoring offshore now?<br />
What processes? Who does it apply to? Are there differences for public and private? What does it<br />
look like in practice? Is there an agreed code of practice -= state / national level for offshore delivery?<br />
• What are the levers available to you now to monitor the quality of offshore delivery?<br />
• What are the risks in the current model?<br />
• What issues have emerged? That you’re dealing with? *re. the process+<br />
• In a new and improved (national) system for monitoring quality of VET programs offshore – what are<br />
the key principles that should drive the system?<br />
• What work should it do?<br />
• What would you want to see in it?<br />
• How would that differ to what you have now?<br />
• Are there features of the AUQA model that have benefit for VET if included in an AQTF model? Or<br />
would not be useful?<br />
• How do they fit with the other requirements around eg. CRICOS/ESOS?<br />
• Is there a comfortable fit?<br />
• How do the current provisions under the Transnational <strong>Quality</strong> Strategy assist monitoring?<br />
• Should registering offshore delivery through AusLIST be mandatory?<br />
• What do you understand as current practice across jurisdictions for monitoring the quality of offshore<br />
delivery?<br />
• What do you see as the main challenges to monitoring offshore delivery? generally? In a national<br />
system?<br />
• What changes would you see as valuable to the current strategies?<br />
• What approaches might be effective in a monitoring process?<br />
• What approaches would you not consider?<br />
• What do you see as the relative merits or complimentarities of the AUQA and AQTF 2007 models?<br />
• Do you know of models from overseas that might be useful to the Australian context?<br />
• What are your views of the main changes and trends in monitoring offshore delivery in general?<br />
• What advice would you have for setting up a system of monitoring offshore delivery?<br />
• Are there challenges that are specific to managing quality improvement in the offshore environment?<br />
• Are there specific considerations that would apply to particular countries?<br />
• From your knowledge of multisector institutions, would you anticipate any particular considerations<br />
for applying the AUQA approach to quality improvement to the VET sector?<br />
• Do you know of models from overseas that might be useful to the Australian context?<br />
• What are the key cost elements of the process? Who bears these costs?<br />
43
APPENDIX B PARTICIPANTS IN<br />
CONSULTATION<br />
Janice Anderson, Trades Recognition Australia, Department of Education, Employment and Workplace<br />
Relations (DEEWR)<br />
Robin Austen, Private consultant<br />
Robyn Adams, RMIT<br />
Andrew Borman, Office of the <strong>Skills</strong> Commission, South Australia.<br />
Dino Bettiol, Northern Melbourne Institute of TAFE (NMIT)<br />
Farman Ullah Babar, Australian Institute of Entrepreneurship<br />
Helen Bately, Blue Mountains International Hotel Management School<br />
Kylie Black, Group Colleges Australia<br />
Peter Bakker, C Management Services<br />
Rebecca Biazos, Gold Coast Institute / TAFE Directors Association<br />
Ruth Browne, Pivot Point International Academy<br />
Wendy Blair, MHM Australasia P/L<br />
Andrew Crevald, Perth Institute of Business and Technology<br />
Inder Cheema, Amtech Institute of Management and Technology<br />
Kim Cleary, International <strong>Quality</strong> Branch, Department of Education, Employment and Workplace Relations<br />
(DEEWR)<br />
Marjorie Christianson, Training, <strong>Quality</strong> and Regulation, Queensland<br />
Martin Cass, JMC Academy<br />
Richard Clifford, Box Hill Institute of TAFE<br />
Rob Carmichael, Australian Universities <strong>Quality</strong> Agency (AUQA)<br />
Tulip Chaudury, Department of Education Employment and Workplace Relations (DEEWR)<br />
Kate Dempsey, TAFE International, Victoria.<br />
Ann Edmunds, North Coast Institute of TAFE, TAFE NSW<br />
David Endean, Holmesglen Institute of TAFE<br />
Julie Eisenbise, RMIT<br />
Claire Field, <strong>National</strong> Audit & Registration Authority (NARA)<br />
Gael Fraser, Office of <strong>Skills</strong> Commission, South Australia<br />
Roger Ferrett, Cambridge College<br />
David Garner, Training, <strong>Quality</strong> and Regulation, Queensland<br />
Ed Green, Australian College of Applied Psychology<br />
Kay Ganley, Charlton Brown<br />
Lyn Glover, Victorian Registration and Qualifications Authority (VRQA)<br />
Peter Gainey, International Vision Education<br />
44
Robyn Gilkes, International <strong>Quality</strong> Branch, Department of Education, Employment and Workplace Relations<br />
(DEEWR)<br />
Roy Gibbs, C Management Services<br />
Tanya Gwin, The Australian College of Hair Design<br />
Bruce Hunter, International College of Management, Sydney<br />
Carol Hunter, Training, <strong>Quality</strong> and Regulation, Queensland<br />
Jenny Harwood, Education and Training International, Western Australia<br />
Lesley Harris, Academies Australasia<br />
Maureen Houssein-Moustafa, MHM Australasia P/L<br />
Michael Hunter, Australian <strong>Council</strong> for Private Education and Training (ACPET)<br />
Roland Hermens, Acacia Group Ltd.<br />
Stephen Henderson, Gurkhas Institute<br />
Sue Hamilton, VETASSESS<br />
Sue Hepperlin, ACT Accreditation and Registration <strong>Council</strong><br />
Sue Honeywell, NSW Vocational Education and Accreditation Board<br />
John Iacono, Academies Australasia<br />
Jeff Brownrigg, Education Training and Employment Australia<br />
Beverley Jeffreys, Chisholm Institute of TAFE<br />
Peter Jasonides, ITHEA<br />
Peter Jackson, Mediagogy<br />
Bill Karkamitsis, Australian Institute of Technology and Education<br />
Domenica Kemp, Education Training and Employment Australia<br />
Ewa Kuriata, <strong>Skills</strong> Victoria<br />
Maria Kouppas, Victoria University<br />
Peter Kyriacou, ITHEA<br />
Spiro, Kardamitsis, Australian Institute of Technology and Education<br />
Sue Kearney, Box Hill Institute of TAFE<br />
Joscelyn Langdon, The Australian College of Hair Design<br />
Melinda Larkin, Australian <strong>Council</strong> for Private Education and Training (ACPET)<br />
Adrian Marron, TAFE SA – North<br />
Bruce Mc Kenzie, Holmesglen Institute of TAFE<br />
George Markakis, JMC Academy<br />
Heidi Merriman, ABC College<br />
Julie Moss, Australian <strong>Council</strong> for Private Education and Training (ACPET)<br />
Neda Morris, The Education Group<br />
Brian O’Mahony, AVTI<br />
Dianne Orr, Training, <strong>Quality</strong> and Regulation, Queensland<br />
Fiona O’Sullivan, Australian College of Applied Psychology<br />
45
Hannah Park, ABC College<br />
Stuart Page, Evolution<br />
Farooq Qamar, Edward Beale Training Salon<br />
Steve Quirk, Australian <strong>Council</strong> for Private Education and Training (ACPET)<br />
Carrie Roach, Trades Recognition Australia, Department of Education, Employment and Workplace Relations<br />
(DEEWR)<br />
Dr Madeleine Reeve, RMIT<br />
Ian Rozdal, Hostec<br />
Lina Ridley, Perth Institute of Business and Technology<br />
Mal Rowe, Northern Melbourne Institute of TAFE (NMIT)<br />
Oksana Razoumova, Australian Institute of Technology and Education<br />
Adam Souss, Southbank Institute of TAFE<br />
Gavin Slattery, Chisholm Institute of TAFE<br />
Joanne Stavely, North Coast Institute of TAFE, TAFE NSW<br />
John Steer, Kangan Batman Institute of TAFE<br />
Kristine Shead, Australian Nationwide College<br />
Lesley Smith, Western Institute Institute of TAFE, NSW<br />
Lesley Smith, Western Institute of TAFE, TAFE NSW<br />
Moninderjit Singh, Australian Academy of Management & Science<br />
Rajan Sharma, The Education Group<br />
Virginia Simmons, TAFE Directors Australia<br />
Wendy Schwedes, VETASSESS<br />
Alan Silver, Australian College of Trade<br />
Gary Thomas, Acuto Consulting<br />
Karen Treloar, Australian Universities <strong>Quality</strong> Agency (AUQA)<br />
Ben Vivekananden, Australian <strong>Council</strong> for Private Education and Training (ACPET)<br />
Catherine Vandermark, TEQSA, Department of Education Employment and Workplace Relations (DEEWR)<br />
Tony Vulic, Kent Institute of Business & Technology<br />
Chris Whitton, ACT Accreditation and Registration <strong>Council</strong><br />
Dr David Woodhouse, Australian Universities <strong>Quality</strong> Agency (AUQA)<br />
John Wood, Navitas<br />
Russell Welch, John Paul International College<br />
Scott Wesley, MHM Australasia P/L<br />
Emily Xu, Kent Institute of Business & Technology<br />
46
APPENDIX C NOTIONAL COSTING OF<br />
OFFSHORE PILOTS<br />
It is assumed that costs associated with elements 1, 4 and 5 will be identified during the development of the<br />
Implementation Plan (see recommendation 3). If accepted Recommendation 2 will require additional<br />
resources as described in Table 5.<br />
Table 5<br />
Estimated costs and assumptions of implementing the model for monitoring offshore VET<br />
delivery<br />
Task Assumptions Subtotal<br />
Development of enhanced<br />
risk guidelines.<br />
Training and coordination of<br />
specialist offshore panel.<br />
Offsite monitoring visits<br />
Evaluation of the offshore<br />
pilot site visits.<br />
Development of delivery<br />
manual/guide for providers<br />
That most of the work will be done within existing<br />
resources. A small allocation to enable some outside<br />
advice may, or may not, be needed.<br />
That some outside assistance may be required and that an<br />
operational manual for offshore assessors may be<br />
advantageous to assist in ensuring consistency of<br />
approach.<br />
That an offshore review team would comprise of two<br />
panel members drawn from the national trained pool. This<br />
may need to be augmented by an industry expert,<br />
depending on the nature of the qualifications being<br />
delivered.<br />
That some salary costs would be absorbed by reprioritizing<br />
existing work loads and/or an honorarium would apply if<br />
external experts were used.<br />
That eight delivery sites in two countries might be visited<br />
in the pilot .It is intended that high risk providers would be<br />
visited in the first instance. If there were not 8 high risk<br />
sites by the desk top risk assessment process, then review<br />
team may wish to visit assess the quality measures<br />
undertaken by low risk providers. Information gained may<br />
inform future action.<br />
That the offshore visits would be scheduled to minimize<br />
trips to and from Australia and to maximize the number of<br />
sites that would be visited in a single country within a<br />
short timeframe.<br />
As per current practice, it is assumed that a visit would be<br />
two to three days per site at an average cost per site of<br />
approximately $15,000<br />
That the evaluation will be undertaken by an independent<br />
evaluator and that some offshore visits may be required.<br />
This will be VET specific; will build on existing documented<br />
best practice and cross sectoral information currently<br />
available.<br />
$15,000<br />
$20,000<br />
$15.000<br />
(per site)<br />
$40,000<br />
$30,000<br />
47