Towards Maturity
Towards Maturity
Towards Maturity
You also want an ePaper? Increase the reach of your titles
YUMPU automatically turns print PDFs into web optimized ePapers that Google loves.
<strong>Towards</strong> maturity<br />
Looking at the impact of e-learning in the workplace March 2007<br />
Facts and Figures
<strong>Towards</strong> <strong>Maturity</strong>: Facts and Figures<br />
This is one of a suite of “<strong>Towards</strong> <strong>Maturity</strong>” publications to report on a comprehensive survey of<br />
over 200 employers and 1000 of their learners conducted online and through interview during<br />
autumn 2006.<br />
Full details of this research are published in the <strong>Towards</strong> <strong>Maturity</strong> suite of reports:<br />
<strong>Towards</strong> <strong>Maturity</strong>: Summary report (published 31 January 2007)<br />
<strong>Towards</strong> <strong>Maturity</strong>: Insights for employers and training providers (published 5 February 2007)<br />
<strong>Towards</strong> <strong>Maturity</strong>: Implications for policy-makers<br />
<strong>Towards</strong> <strong>Maturity</strong>: Facts and Figures (published March 2007). This report provides the detail<br />
on which the other 2 documents build and does not include an executive summary.<br />
The full reports and further information regarding the research findings and implications can be<br />
found at www.e-skills.com/elearning/towardsmaturity<br />
<strong>Towards</strong> <strong>Maturity</strong> research team:<br />
• Laura Overton (author of ‘Linking learning to Business’ investigating e-learning<br />
success, commissioned by e-learning Age magazine, 2004)<br />
• Howard Hills (co- author of ‘Embedding e-learning in large organisations’, a<br />
study commissioned by UfI, 2004)<br />
• Dr Genny Dixon (e-skills UK work based e-learning Project Manager)<br />
This study is part of the Skills for Business Network work based e-learning project<br />
(based at e-skills UK) which is funded by the Learning and Skills Council to understand<br />
how technology assisted learning can support employer skills requirements.<br />
For further information please contact:<br />
e-skills UK<br />
1 Castle Lane<br />
London SW1E 6DR<br />
t: +44 (0)20 7963 8920<br />
f: +44 (0)20 7592 9138<br />
e: info@e-skills.com<br />
w: www.e-skills.com<br />
© Reserved, e-skills UK Ltd, 2007<br />
All rights reserved. No part of this material protected by this copyright may be reproduced or utilised in any form, or by any means,<br />
electronic or mechanical, including photocopying, recording, or by any information storage and retrieval system without prior<br />
authorisation.<br />
e-skills UK is a not-for profit, employer-led organisation, licensed by government as the Sector Skills Council for IT and Telecoms. e-skills<br />
UK has responsibility for improving business competitiveness and UK productivity, uniting employers, educators and government on a<br />
common employer-led agenda for action on skills.<br />
Part of the Skills for Business network of 25 employer-led Sector Skills Councils
Contents<br />
Contents<br />
1 Introduction .............................................................................................. 9<br />
1.1 Research methodology................................................................................................... 9<br />
1.2 <strong>Maturity</strong> ............................................................................................................................ 10<br />
2 Reasons for investing in e-learning...................................................... 13<br />
2.1 e-learning: the drivers and reasons for investment ................................................... 13<br />
2.2 Differences in drivers by maturity segments............................................................... 14<br />
2.3 The Business Case ........................................................................................................... 19<br />
2.4 <strong>Maturity</strong> and Business Impact....................................................................................... 19<br />
2.5 Stakeholder involvement and Business Impact......................................................... 21<br />
2.6 Stakeholder involvement as Users................................................................................ 22<br />
2.7 The relationship between training capability and business impact....................... 24<br />
2.8 Compliance and Business Impact............................................................................... 27<br />
2.9 Staff Impact..................................................................................................................... 28<br />
2.10 Staff Impact versus input dimensions .......................................................................... 29<br />
2.11 <strong>Maturity</strong> and staff impact ............................................................................................. 31<br />
2.12 Learners Perspective...................................................................................................... 33<br />
3 People and organisational capability................................................. 35<br />
3.1 Decision making ............................................................................................................. 35<br />
3.2 Who uses e-learning?..................................................................................................... 37<br />
3.3 Who influences learners? .............................................................................................. 40<br />
3.4 Roles trained by sector .................................................................................................. 45<br />
3.5 Source of funding ........................................................................................................... 47<br />
3.6 Sources of e-learning ..................................................................................................... 49<br />
3.7 Expectation clients have of vendors........................................................................... 51<br />
3.8 Characteristics of the marketplace ............................................................................ 51<br />
4 e-learning – technology, software and topics delivered .................. 53<br />
4.1 Topics covered ............................................................................................................... 53<br />
4.2 Topics learners are interested in................................................................................... 59<br />
4.3 Programmes offered...................................................................................................... 61<br />
4.4 Services provided to learners ....................................................................................... 66<br />
5 Take-up of Software Tools in support of e-learning............................ 69<br />
5.1 Technologies used to support e-learning ................................................................... 69<br />
5.2 Impact of maturity on the use of software tools ....................................................... 71<br />
5.3 Differences due to geography and size..................................................................... 74<br />
6 IT Capability ........................................................................................... 76<br />
6.1 Key differences observed with IT capability .............................................................. 76<br />
6.2 Influence on success...................................................................................................... 78<br />
6.3 Supporting learners ........................................................................................................ 80<br />
<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 3
Contents<br />
7 Supporting learners ............................................................................... 83<br />
7.1 Difference in support provided by maturity segments............................................. 86<br />
7.2 Learning support and business impact ....................................................................... 88<br />
7.3 Learners’ view of support .............................................................................................. 89<br />
7.4 Technical support ........................................................................................................... 92<br />
8 Promoting and sustaining e-learning .................................................. 93<br />
8.1 Learners response to the communication methods................................................. 96<br />
8.2 Convenience of e-learning ........................................................................................ 100<br />
8.3 Who influences learners? ............................................................................................ 102<br />
8.4 Obtaining feedback .................................................................................................... 103<br />
8.5 Key actions that influence the success of e-learning............................................. 106<br />
9 <strong>Towards</strong> <strong>Maturity</strong> – The changing face of e-learning ...................... 109<br />
9.1 Informal learning and the views of learners ............................................................. 109<br />
9.2 Technologies supporting informal learning .............................................................. 111<br />
9.3 Learners’ willingness to contribute............................................................................. 113<br />
9.4 Informal methods and tools – the employers view ................................................. 115<br />
9.5 Spend on e-learning .................................................................................................... 118<br />
10 Comparison of Education Sector with Other Sectors ....................... 121<br />
10.1 Comparison of probability of drivers being selected ............................................. 123<br />
10.2 Sourcing and development of e-learning................................................................ 124<br />
10.3 Funding........................................................................................................................... 124<br />
10.4 Learner support............................................................................................................. 124<br />
10.5 Technologies used and considered .......................................................................... 126<br />
10.6 The future - do educational organisations have a different view?...................... 127<br />
11 The future of e-learning....................................................................... 129<br />
11.1 Challenges for e-learning............................................................................................ 131<br />
11.2 Geographic differences.............................................................................................. 133<br />
11.3 Progress since 2004....................................................................................................... 133<br />
11.4 Sources of advice......................................................................................................... 139<br />
12 Conclusions.......................................................................................... 141<br />
12.1 Introduction ................................................................................................................... 141<br />
12.2 Chapter 2 – Investment ............................................................................................... 141<br />
12.3 Chapter 3 - People and organisational capability................................................. 142<br />
12.4 Chapter 4 – E-learning – technology, software, and topics delivered................ 144<br />
12.5 Chapter 5 – Take-up of software tools in support of e-learning............................ 146<br />
12.6 Chapter 6 - IT capability .............................................................................................. 147<br />
12.7 Chapter 7 – Supporting learners ................................................................................ 148<br />
12.8 Chapter 8 – Promoting e-learning ............................................................................. 149<br />
12.9 Chapter 9 – the changing face of learning............................................................. 150<br />
12.10 Chapter 10 – Comparison of education sector with others .................................. 152<br />
12.11 Chapter 11 – the future of learning ........................................................................... 153<br />
<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 4
Contents<br />
Index of Figures<br />
Figure 2.1 Financial impact of e-learning maturity................................................................. 19<br />
Figure 2.2 <strong>Maturity</strong> and alignment to the business................................................................. 20<br />
Figure 2.3 Who influences success in relation to business impact ....................................... 21<br />
Figure 2.4 <strong>Maturity</strong> versus influences......................................................................................... 22<br />
Figure 2.5 Business impact varies according to usage by different groups of staff.......... 23<br />
Figure 2.6 The learner perspective on business impact......................................................... 24<br />
Figure 2.7 Training function capability affects business impact........................................... 25<br />
Figure 2.8 Consolidation of learning reflected in improved business impact.................... 26<br />
Figure 2.9 Compliance and business impact.......................................................................... 27<br />
Figure 2.10 Factors related to staff impact.............................................................................. 28<br />
Figure 2.11 Staff impact versus input dimensions.................................................................... 30<br />
Figure 2.12 Change management influences staff impact of e-learning ......................... 31<br />
Figure 2.13 Staff impact versus maturity................................................................................... 32<br />
Figure 2.14 Employer view of staff impact............................................................................... 32<br />
Figure 2.15 Learner responses.................................................................................................... 33<br />
Figure 2.16 Staff impact and freedom of choice................................................................... 34<br />
Figure 3.1 Making e-learning investment decisions................................................................ 35<br />
Figure 3.2 Making decisions about e-learning ........................................................................ 36<br />
Figure 3.3 Making decisions about e-learning ........................................................................ 36<br />
Figure 3.4 Business impact of a strategy compared.............................................................. 37<br />
Figure 3.5 Effect on key dimensions when directors use e-learning .................................... 38<br />
Figure 3.6 Staff impact versus use by directors ....................................................................... 39<br />
Figure 3.7 Directors’ use of e-learning affects factors comprising take-up........................ 40<br />
Figure 3.8 Whose opinion encourages use of e-learning...................................................... 41<br />
Figure 3.9 Who encourages you to learn? .............................................................................. 44<br />
Figure 3.10 Percentage organisations by sector selecting role as user of e-learning ...... 47<br />
Figure 3.11 Where does e-learning spend come from?........................................................ 48<br />
Figure 3.12 How is e-learning sourced?.................................................................................... 49<br />
Figure 3.13 Source of supply of e-learning by maturity ......................................................... 50<br />
Figure 3.14 Important qualities organisations are looking for from their supplier .............. 51<br />
Figure 3.15 Percentage of suppliers selected by respondents ............................................ 52<br />
Figure 4.1 Range of topics offered by organisations ............................................................. 53<br />
Figure 4.2 Adoption patterns by topics as organisations become more mature ............. 58<br />
Figure 4.3 The range of topics studied by learners................................................................. 60<br />
Figure 4.4 Programmes offered by organisations................................................................... 61<br />
<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 5
Contents<br />
Figure 4.5 Programmes offered with an e-learning component ......................................... 65<br />
Figure 4.6 Types of formal online services offered.................................................................. 66<br />
Figure 4.7 Formal online services offered changes with maturity ........................................ 67<br />
Figure 4.8 Types of informal online services offered............................................................... 68<br />
Figure 4.9 Use of informal techniques increases with maturity............................................. 68<br />
Figure 5.1 Current and planned use of learning technologies ............................................ 69<br />
Figure 5.2 Information and production tools........................................................................... 72<br />
Figure 5.3 Delivery tools – change of use by maturity ........................................................... 73<br />
Figure 5.4 Use of collaborative tools increases with maturity ............................................... 74<br />
Figure 5.5 Differences from average take-up of technologies by geography ................. 75<br />
Figure 6.1 Effect of IT capability on key dimensions............................................................... 76<br />
Figure 6.2 Key differences associated with IT capability....................................................... 77<br />
Figure 6.3 Variation in influence of roles with IT capability.................................................... 78<br />
Figure 6.4 IT capability affects where learning can be offered........................................... 79<br />
Figure 6.5 Learner support mechanisms change with IT capability .................................... 80<br />
Figure 6.6 Seeking feedback from learners............................................................................. 81<br />
Figure 6.7 Sourcing and managing production of e-learning.............................................. 81<br />
Figure 7.1 Study support provided to learners ........................................................................ 83<br />
Figure 7.2 Learner support – the learner perspective ............................................................ 84<br />
Figure 7.3 Learner support- what is most useful when it is available ................................... 85<br />
Figure 7.4 Number of different types of tutor support............................................................ 86<br />
Figure 7.5 Learner support compared by geographic characteristics .............................. 87<br />
Figure 7.6 Workplace learners support by maturity................................................................ 87<br />
Figure 7.7 Business impact increases when learning is consolidated.................................. 88<br />
Figure 7.8 Support received by employees............................................................................. 89<br />
Figure 7.9 Attributes valued by employees ............................................................................. 90<br />
Figure 7.10 Learners’ views by dimension ................................................................................ 90<br />
Figure 7.11 Relative importance of dimensions to learners by segment ............................ 91<br />
Figure 7.12 Provision of technical support to learners............................................................ 92<br />
Figure 8.1 Promotion of e-learning – what mature organisations do differently ............... 93<br />
Figure 8.2 Sustaining e-learning – what do mature organisations do differently .............. 94<br />
Figure 8.3 Sustaining interest in e-learning according to business impact ......................... 94<br />
Figure 8.4 Promoting and sustaining take-up – action to achieve take-up....................... 95<br />
Figure 8.5 Learner response to communications about e-learning .................................... 96<br />
Figure 8.6 Communication about e-learning – effect of age of learner............................ 97<br />
Figure 8.7 Communication about e-learning – effect of management responsibility..... 98<br />
<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 6
Contents<br />
Figure 8.8 Communication about e-learning – effect of where learners work ................. 98<br />
Figure 8.9 Communication about e-learning – effect of when learning occurs............... 99<br />
Figure 8.10 Availability and access to learning .................................................................... 100<br />
Figure 8.11 Where is e-learning offered and where is it done?.......................................... 101<br />
Figure 8.12 Who encourages learning varies with work and learning location............... 102<br />
Figure 8.13. Who encourages learning varies with age and responsibility....................... 103<br />
Figure 8.14 Methods used to gather learner feedback ...................................................... 103<br />
Figure 8.15 Mature organisations gather more feedback from learners.......................... 104<br />
Figure 8.16 Business impact is enhanced by effective follow up....................................... 105<br />
Figure 8.17 Staff impact is enhanced by effective follow-up............................................. 105<br />
Figure 9.1 How learners are building their skills and knowledge ........................................ 109<br />
Figure 9.2 Technology supporting informal learning – learners’ views .............................. 111<br />
Figure 9.3 Discussion boards – which learners find them most useful?.............................. 112<br />
Figure 9.4 Willingness to use technology to help others learn (by responsibility) ............ 114<br />
Figure 9.5 Willingness to use technology to help others learn (by time/location) .......... 114<br />
Figure 9.6 Informal methods in supporting technologies .................................................... 115<br />
Figure 9.7 Informal services and supporting technologies by maturity............................. 116<br />
Figure 9.8 Use of informal techniques compared to staff impact of e-learning ............. 117<br />
Figure 9.9 Use of informal techniques compared to business impact of e-learning ...... 118<br />
Figure 9.10 e-learning budget plans vary with sector.......................................................... 119<br />
Figure 9.11 e-learning budget plans very with maturity ...................................................... 119<br />
Figure 9.12 Percentage of budget spent on e-learning...................................................... 120<br />
Figure 10.1 Differences in dimensions – education sector versus others........................... 121<br />
Figure 10.2 Drivers for e-learning ............................................................................................. 123<br />
Figure 10.3 Support provided to learners............................................................................... 125<br />
Figure 10.4 Help in consolidating learning............................................................................. 126<br />
Figure 10.5 Learning technologies in use ............................................................................... 126<br />
Figure 11.1 Predictions for the future of e-learning .............................................................. 129<br />
Figure 11.2 Predictions of e-learning futures by maturity..................................................... 130<br />
Figure 11.3 Barriers to e-learning in the next 3 years ............................................................ 131<br />
Figure 11.4 Barriers to e-learning over the next 3 years by business sector ...................... 132<br />
Figure 11.5 Propensity for organisations to report barriers................................................... 133<br />
Figure 11.6 Changes in managerial commitment and availability of e-learning ........... 137<br />
Figure 11.7 Changes in skills and IT capability....................................................................... 138<br />
Figure 11.8 Sources of advice used by respondents............................................................ 139<br />
Figure 11.9 What type of additional support would be helpful? ....................................... 140<br />
<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 7
Contents<br />
Index of Tables<br />
Table 1.1 Defining e-learning maturity ..................................................................................... 10<br />
Table 1.2 Comparison of factual responses by maturity....................................................... 12<br />
Table 2.1 Drivers behind e-learning investment...................................................................... 13<br />
Table 2.2 Biggest benefits of e-learning perceived in 2004 by users (n=291)..................... 14<br />
Table 2.3 Comparison of frequency with which drivers are cited by maturity segments 15<br />
Table 2.4 Frequency of citing drivers compared by geographic circumstances ............ 16<br />
Table 2.5 Comparison of citing drivers by size of organisation............................................. 17<br />
Table 2.6 Comparison of frequency with which drivers are cited by sector ..................... 18<br />
Table 2.7 Who uses e-learning in your organisation?............................................................. 22<br />
Table 2.8 Consolidation of learning reflected in improved business impact..................... 26<br />
Table 3.1 Percentage of respondents agreeing with Staff Impact statements ................ 39<br />
Table 3.2 Percentage agreeing with take up statements .................................................... 40<br />
Table 3.3 Who encourages you to learn? ............................................................................... 41<br />
Table 3.4 Use of e-learning by directors ................................................................................... 44<br />
Table 3.5 Percentage of employers providing e-learning to this role ................................. 45<br />
Table 3.6 Percentage of organisations offering e-learning to specific roles...................... 46<br />
Table 3.7 Sources of funding by expenditure.......................................................................... 49<br />
Table 4.1 Likelihood of skills being delivered by e-learning .................................................. 54<br />
Table 4.2 Percentage of organisations offering skills by sector............................................ 55<br />
Table 4.3 Percentage in each sector who use e-learning for each skills area.................. 56<br />
Table 4.4 Respondents offering topics with an e-learning component ............................. 57<br />
Table 4.5 Provision and usage of e-learning programmes ................................................... 60<br />
Table 4.6 Work-based programmes offered ........................................................................... 62<br />
Table 4.7 Penetration of an e-learning component into work-based programmes ........ 63<br />
Table 4.8 Respondents offering skills with an e-learning component ................................. 64<br />
Table 4.9 Penetration of e-learning .......................................................................................... 65<br />
Table 5.1 Software tools used vary with maturity.................................................................... 71<br />
Table 8.1 Enhancing Business Impact..................................................................................... 106<br />
Table 8.2 Enhancing staff impact ........................................................................................... 107<br />
Table 8.3 Enhancing take-up of e-learning........................................................................... 108<br />
Table 10.1 Significant differences in self-perception ratings............................................... 122<br />
Table 10.2 Capability of the training function....................................................................... 127<br />
Table 11.1 Comparisons in e-learning implementation 2004-2007 .................................... 135<br />
For related case studies please visit www.e-skills.com/elearning.<br />
<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 8
1 Introduction<br />
1 Introduction<br />
The Skills for Business Network commissioned a study during 2006 to research the uptake,<br />
demand and use of e-learning by employers and employees. Its purpose is to report on the<br />
current state of e-learning amongst knowledgeable users rather than across all work-based<br />
learning. The scope of the study is amongst users of e-learning to provide an up-to-date<br />
picture of the demand side to complement annual research programmes that understand<br />
the further education and work-based provider provision on the “supply side”. The aim of this<br />
report is to distil perceived wisdom on the implementation and engagement of e-learning by<br />
both employers and learners. We investigate the barriers and the drivers and the resulting<br />
business impact of e-learning and build on research conducted in 2004 and 2005.<br />
Specifically the “Linking Learning to Business” report and the “Embedded e-learning Report”,<br />
see footnotes.<br />
A further aim is to raise awareness within the potential user community, via the Sector Skills<br />
Councils Network and by other methods, on the potential benefits of e-learning and to<br />
provide guidance to that community on its successful implementation. The study is also<br />
required to guide policy and decision-makers on the future pattern for Government provision<br />
of work-based learning in general and e-learning specifically. The Skills for Business Network<br />
will look to use the findings to help them improve, influence and develop skills<br />
recommendations of behalf of employers.<br />
E-learning has been in place now for more than 6 years, and prior to that time various other<br />
forms of technology have been used to deliver learning. There should be a wealth of<br />
guidance and advice available from experienced and mature users of this technology.<br />
1.1 Research methodology<br />
Appendix A describes the approach to the research in more detail. An on-line survey was<br />
selected as being (1) rapid, (2) economical, (3) in line with the ethos of our research to<br />
investigate the exploitation of technology in the support of learning. However, the on-line<br />
element created a number of risks on the quality of the data, fully discussed in Appendix A.<br />
Likert scale 10-point questions were used extensively in both the employer and the employee<br />
survey. The purpose of using this collection method was to render the data suitable for factor<br />
analysis, specifically Principal Component Analysis, to group factors into dimensions and<br />
investigate the relationship between them. The definition of the dimensions arises from<br />
questions that were identified as related to each other and that were answered in a similar<br />
fashion by a wide range of respondents; no other meaning should be applied to the use of<br />
these terms in this report. The term factors is used to describe the answers to these questions.<br />
The analysis also focused on both social software and informal learning. The term social<br />
software is derived from the current discussions into what has been termed e-learning 2.0 (a<br />
term reported in the DTI Global Watch Mission report “Beyond e-Learning: practical insights<br />
from the USA” May 2006, citing an article by Stephen Downes the Senior Researcher at<br />
National Research Council Canada in October 2005. He described the applications and<br />
environments of Web 2.0 as supporting learning through sharing, communication,<br />
collaboration, syndication and social interaction.<br />
<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 9
1 Introduction<br />
These changes are typified by current developments in the Internet, moving from content<br />
distribution to a much more collaborative phase. This allows the development of more<br />
learner centric applications for learning than has typically been available up till now.<br />
Examples of social software include wikis, blogs, RSS feeds, moderated and un-moderated<br />
chat rooms virtual classrooms and discussion boards. In collecting data about the use<br />
organisations are making of Web technology specific questions are included to investigate<br />
these developments and to find out whether they feature in the plans of organisations up to<br />
2010. The study has also asked specific questions around informal learning, including asking<br />
learners how else they learn. This included questions on such things as search portals and<br />
communities of practice.<br />
1.2 <strong>Maturity</strong><br />
<strong>Maturity</strong> is a key concept that is used throughout the report to analyse the responses from<br />
the employer respondents. The division into maturity segments is done on the basis of the<br />
self-perception of respondents. They were asked to answer the following question ‘Which of<br />
the following statements do you think best describes your company’s knowledge of how to<br />
use ICT to manage and deliver learning?’ Table 1.1 lists the responses, together with the titles<br />
that have been adopted throughout the report and the number of respondents who<br />
selected that particular option.<br />
Table 1.1 Defining e-learning maturity<br />
Which of the following statements do you think best describes your company’s knowledge of<br />
how to use ICT to manage and deliver learning?.<br />
Title used in report Survey statement Number of<br />
respondents<br />
The Novice We know very little about e-learning 10<br />
The Sporadic user<br />
Use of e-learning is localised or sporadic (used in some<br />
departments or for some courses)<br />
The Developing user We are developing and coordinating our use of e-<br />
learning<br />
The Established user e-learning is established across the company and is<br />
transforming the way we manage our learning and<br />
development<br />
The Embedded user e-learning is thoroughly embedded within the company –<br />
we have a learning culture which influences our everyday<br />
work<br />
The Innovator<br />
We are thought leaders and innovators in the way in<br />
which we are using e-learning – prepared to experiment<br />
in new areas and with new technologies<br />
45<br />
75<br />
36<br />
11<br />
36<br />
<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 10
1 Introduction<br />
An essential part of the initial analysis was to assess this segmentation to discover its validity.<br />
The results of this analysis demonstrate very clearly that those who perceive themselves to be<br />
more mature do a number of things differently (Table 1.2).<br />
A certain amount of care is required in this analysis because of the varying number of<br />
respondents. The 2 categories of novices and embedded attracted relatively few<br />
respondents. It is also clear, and is discussed further in Appendix B that the innovation<br />
segment attracted a number of respondents who are perhaps inappropriately placed.<br />
However, a number of trends emerge:<br />
> There is a greater probability that more mature organisations will have staff dedicated<br />
to the development, purchasing and commissioning of e-learning. The percentage<br />
rises from 30% of those who perceive themselves to be novices to 89% of those who<br />
perceive them innovators.<br />
> Generally speaking more mature users are more likely to cite a greater number of<br />
reasons behind their company’s investment in e-learning. For novices this is<br />
approximately 4 rising to 7.7 for embedded users.<br />
> More mature users employ e-learning in some shape or other in support of specific<br />
topics. On average novices will deploy e-learning for about 3 out of 18 topics.<br />
Embedded users will use e-learning for 10 out of these 18 topics.<br />
> More mature users will have a greater number of roles using e-learning, increasing from<br />
3.5 for novices to 6.6 for embedded users. Respondents were asked where they<br />
offered e-learning and again more mature users are likely to offer it in a greater variety<br />
of locations.<br />
> The same pattern appears with the various on-line learning services that are offered,<br />
although those who are less mature do offer a significant number; typically about 5<br />
different types of services for novices and sporadic users, rising to more than 8 for more<br />
mature users.<br />
> The average number of ICT and e-learning technologies that are currently being used<br />
rises from 2.2 for novices to 8.6 for embedded users.<br />
In addition to this analysis there are a significant number of other differences reported on<br />
that are based upon segmentation by this maturity question.<br />
The full employer and learner surveys are included in the Appendices.<br />
<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 11
1 Introduction<br />
Table 1.2 Comparison of factual responses by maturity<br />
Survey<br />
Questions<br />
6) Do you have staff<br />
dedicated to the<br />
development,<br />
purchasing and<br />
commissioning of e-<br />
learning?<br />
10) What are the<br />
reasons behind your<br />
company’s<br />
investment in e-<br />
learning or the use of<br />
ICT to support<br />
learning in your<br />
organisation?<br />
11) Which of the<br />
following types of<br />
a) Key Skills<br />
b) Operational Skills<br />
c) General Skills<br />
training have<br />
employees in your<br />
organisation<br />
undertaken in the last<br />
12 months?<br />
13) Who is<br />
using e-<br />
learning in your<br />
organisation?<br />
(Please tick all<br />
that apply)<br />
14) Where do you<br />
offer e-learning?<br />
(Please tick all that<br />
apply)<br />
Which of the<br />
following<br />
15) formal<br />
16) informal<br />
on-line services<br />
do you offer?<br />
17) Which of the<br />
following types<br />
of ICT e-learning<br />
technologies are<br />
you using?<br />
Average<br />
responses<br />
to factual<br />
Questions<br />
Percentage of<br />
respondents who<br />
have dedicated e-<br />
learning teams<br />
Average total drivers<br />
cited by respondents<br />
Average number of<br />
topics for which e-<br />
learning is being<br />
used now.<br />
Average<br />
number of roles<br />
using e-<br />
learning<br />
Average number of<br />
types of locations in<br />
which e-learning is<br />
provided<br />
Average number<br />
of on-line learning<br />
services offered<br />
Average<br />
number of<br />
technologies<br />
used<br />
Novices 30% 4.10 2.33 3.50 1.83 5.00 2.20<br />
Sporadic<br />
Users<br />
Developin<br />
g Users<br />
Establishe<br />
d Users<br />
Embedde<br />
d users<br />
39% 3.95 3.31 3.49 2.20 4.71 3.79<br />
67% 4.91 5.26 4.61 2.87 5.59 4.28<br />
86% 5.36 9.00 6.63 3.50 6.87 5.16<br />
82% 7.73 10.50 6.67 3.33 8.67 8.67<br />
Innovators 89% 5.61 7.63 5.22 2.89 8.35 8.12<br />
<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 12
2 Investing in e-learning<br />
2 Reasons for investing in e-learning<br />
Overview: This chapter investigates elements in the data that show a link with Business<br />
Impact and the reasons that lie behind employer’s investment in e-learning. We present the<br />
essence of a business case for e-learning; by implication it has many lessons for the<br />
successful deployment of e-learning but a full discussion of this is left to later chapters.<br />
2.1 e-learning: the drivers and reasons for investment<br />
Respondents were asked to select the reasons behind their company’s investment in e-<br />
learning or the use of ICT to support learning. They were asked to select from a list all the<br />
most important reasons to them (Table 2.1). They were given the opportunity to add<br />
additional reasons. Where the question was asked in 2004 the average response is shown.<br />
Table 2.1 Drivers behind e-learning investment<br />
Drivers cited by respondents<br />
2006 responses<br />
(n=212 employers)<br />
2004 responses<br />
(n=290 users)<br />
Increase access to learning 79% 10%<br />
Increase flexibility in providing training 73% 10%<br />
Reduce training costs 49% 16%<br />
Develop a better qualified workforce 48% not asked<br />
Improved management and administration 47% not asked<br />
Improve quality of work-based learning 41% not asked<br />
Availability of improved technology 38% 42%<br />
New processes or new products 31% 26%<br />
Organisational change 27% 37%<br />
New IT systems 25% 29%<br />
New regulations and legal requirements 25% 22%<br />
Maintain image of organisational innovation 20% 23%<br />
Demand from workforce 11% 16%<br />
Respond to ICT literate younger staff 11% not asked<br />
Pressure from senior management 5% 16%<br />
Achieving consistency* 3% not asked<br />
Extending the reach of training* 2% not asked<br />
* listed by respondents in the “other” category<br />
There has been a significant shift in emphasis for the reasons behind the adoption of e-<br />
learning since 2004. Seventy five percent of respondents are driven by a need to increase<br />
the access to learning, compared to 10% of respondents in 2004. Similarly the need for<br />
flexibility was cited by 10% of respondents in 2004 and 69% of respondents in 2006.<br />
<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 13
2 Investing in e-learning<br />
NB. Approximately 75% of respondents in 2004 cited greater flexibility of learning as the most<br />
and 65% cited greater accessibility as the second most significant benefit of e-learning.<br />
What were not seen as drivers in 2004 but were realised to be significant benefits have now<br />
become drivers for investment in 2006. In a very real sense the experience of the past 2 years<br />
has made users of e-learning consider the rationale for its use in a very different way.<br />
Experience of the benefit is translated into drivers for future expansion of e-learning.<br />
Table 2.2 Biggest benefits of e-learning perceived in 2004 by users (n=291)<br />
Survey statement<br />
Number of respondents<br />
Greater flexibility 73%<br />
Greater accessibility 65%<br />
Cost savings 53%<br />
Greater quantity of learning 25%<br />
More effective learning 23%<br />
Record keeping for compliance requirements 24%<br />
Better focus on business requirements 21%<br />
Other responses: 22%<br />
Saves time<br />
Self managed<br />
Consistency of message<br />
Ability to track / assess learners<br />
Provides an alternative<br />
Brings people together<br />
Best practical cutting edge<br />
2.2 Differences in drivers by maturity segments<br />
Respondents are divided into segments according to their self-perception of maturity. Table<br />
2.3 shows the percentage of respondents within each segment who cited a particular driver<br />
as listed in the questionnaire. This table includes the average number of drivers cited per<br />
respondent. More mature organisations cite significantly more drivers. If we make<br />
allowances for the greater number of drivers cited per respondent by more mature<br />
organisations, then there is less difference between the relative importance of the various<br />
drivers between maturity segments than is apparent from the percentages in Table 2.3<br />
More mature organisations are more likely to be driven by a requirement to improve quality,<br />
increase access, increase flexibility and achieve a better qualified workforce. They are also<br />
more likely to be driven by new processes or products, new IT systems and improved<br />
availability of technology for learning. It would appear that this is because more mature<br />
organisations are likely to see more opportunities for e-learning. If we replace the<br />
percentages with a rank order there is little difference in the relative importance of specific<br />
drivers by maturity. The top 5 drivers are predominantly the top 5 drivers for all maturity<br />
segments.<br />
<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 14
2 Investing in e-learning<br />
Table 2.3 Comparison of frequency with which drivers are cited by maturity segments<br />
Title used in report<br />
Novices Sporadic<br />
users<br />
Developing<br />
users<br />
Established<br />
users<br />
Embedded<br />
users<br />
Innovators<br />
Increase access to learning 60% 66% 80% 78% 91% 69%<br />
Increase flexibility in providing<br />
staff training 70% 57% 76% 72% 91% 58%<br />
Reduce training costs 50% 34% 45% 58% 64% 47%<br />
Develop a better qualified<br />
workforce 30% 36% 43% 42% 82% 56%<br />
Better manage or administer<br />
work-based learning 40% 34% 40% 61% 64% 44%<br />
Improve the quality of workbased<br />
learning delivered 20% 32% 35% 39% 73% 50%<br />
Availability of improved<br />
technology (internet, intranet,<br />
bandwidth) 30% 32% 33% 36% 55% 42%<br />
New processes or new products 20% 20% 29% 33% 55% 31%<br />
Organisational change 10% 18% 27% 19% 36% 42%<br />
New IT systems 20% 23% 23% 28% 36% 19%<br />
New regulations and legal<br />
requirements 10% 16% 19% 33% 36% 36%<br />
Maintain public image of a<br />
progressive and innovative<br />
organisation 30% 11% 16% 22% 27% 22%<br />
Demand from workforce 10% 7% 9% 8% 27% 17%<br />
Younger staff recruits increasingly<br />
technology literate 0% 7% 11% 6% 18% 22%<br />
Pressure from senior<br />
management 10% 2% 5% 0% 18% 6%<br />
Average number of drivers cited<br />
per respondent 4.1 4.0 4.9 5.4 7.7 5.6<br />
Table 2.4 shows the percentages within each one of the geographic segments who cited a<br />
particular driver. Those who are occupying a single UK site select slightly fewer drivers than<br />
other organisations. As might be expected those with multiple sites, either globally or UK<br />
wide select slightly more drivers but the difference is small. If we compare the ranking of<br />
individual drivers within these geographic segments the only notable difference is that those<br />
with a few relatively large UK sites are proportionately more likely to select both<br />
organisational change and new IT systems as potential drivers. In the case of all the<br />
geographic segments both increased access and increased flexibility remain as the first and<br />
second most frequently selected drivers.<br />
<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 15
2 Investing in e-learning<br />
Table 2.4 Frequency of citing drivers compared by geographic circumstances<br />
Across<br />
Europe<br />
/Worldwide<br />
N= 81<br />
A few relatively<br />
large sites<br />
N= 50<br />
Single UK<br />
site N= 36<br />
Many small<br />
branches or<br />
offices/location<br />
s N=45<br />
Increase access to learning 77% 76% 61% 80%<br />
Increase flexibility in providing staff<br />
training 70% 72% 56% 73%<br />
Reduce training costs 56% 36% 36% 51%<br />
Develop a better qualified workforce 54% 30% 33% 53%<br />
Better manage or administer workbased<br />
learning 48% 42% 33% 49%<br />
Improve the quality of work-based<br />
learning delivered 36% 44% 28% 47%<br />
Availability of improved technology<br />
(internet, intranet, bandwidth) 35% 34% 39% 38%<br />
New processes or new products 32% 28% 22% 31%<br />
Organisational change 20% 38% 25% 24%<br />
New IT systems 22% 30% 11% 29%<br />
New regulations and legal<br />
requirements 31% 12% 19% 29%<br />
Maintain public image of a progressive<br />
and innovative organisation 19% 20% 25% 11%<br />
Demand from workforce 12% 12% 8% 9%<br />
Younger staff recruits increasingly<br />
technology literate 16% 2% 14% 9%<br />
Pressure from senior management 5% 6% 6% 2%<br />
Average number of drivers cited 5.3 4.8 4.2 5.4<br />
Table 2.5 compares the frequency of selecting drivers by organisations on the basis of<br />
organisation size. The 4 drivers most likely to be selected by all organisations are slightly more<br />
likely to be chosen by the larger organisations. Table 2.5 gives some indication that larger<br />
organisations are more likely to be driven by increased access to learning, increased<br />
flexibility in providing staff training, the need to reduce costs and the requirement to improve<br />
the management or administration of work-based learning. All other drivers show no<br />
particularly distinct pattern in relation to the size of organisations.<br />
<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 16
2 Investing in e-learning<br />
Table 2.5 Comparison of citing drivers by size of organisation<br />
2 Investing in e-learning<br />
Table 2.6 Comparison of frequency with which drivers are cited by sector<br />
Ignoring sectors with >10 respondents<br />
Manufacturing<br />
Transport, storage and<br />
communic-ations<br />
Financial intermediation<br />
Real estate, renting<br />
and business activities<br />
Public admin and<br />
defence<br />
Education<br />
Health and social work<br />
IT and<br />
Telecommuncations<br />
Increased access 80% 71% 78% 82% 76% 68% 85% 75%<br />
Increase flexibility 80% 81% 65% 71% 79% 51% 80% 75%<br />
Reduce training costs 53% 43% 70% 18% 56% 32% 55% 55%<br />
Achieve better qualified<br />
workforce 73% 71% 39% 35% 41% 34% 45% 55%<br />
Improved management for<br />
learning<br />
60% 38% 65% 29% 44% 34% 50% 40%<br />
Improved quality 40% 43% 35% 35% 41% 39% 30% 45%<br />
Improved ICT available 33% 29% 48% 24% 26% 34% 40% 40%<br />
New processes / products 40% 24% 43% 29% 15% 32% 35% 40%<br />
Organisational change 20% 14% 30% 0% 35% 34% 45% 20%<br />
Regulatory requirements 13% 24% 57% 24% 18% 12% 30% 35%<br />
New IT systems 0% 19% 35% 6% 32% 20% 30% 30%<br />
Public image 7% 10% 9% 12% 24% 34% 15% 20%<br />
Younger staff are more<br />
technology literate<br />
7% 10% 26% 6% 3% 12% 5% 15%<br />
Demand from workforce 13% 5% 9% 0% 12% 7% 10% 20%<br />
Senior Management pressure 0% 5% 0% 0% 3% 10% 5% 5%<br />
Regulatory requirements are significantly more important for the financial sector than for<br />
others, the education sector is more likely to be driven by the need for organisational<br />
change and the requirement to maintain public image of a progressive organisation than<br />
those in other sectors. Senior management pressure, demand for work force, younger staff<br />
being more technology literate remain the least important drivers for all sectors.<br />
Access and flexibility are within the top 3 most important drivers for all sectors. Both the<br />
business activities and education sectors are least likely to be driven by the need to reduce<br />
training costs.<br />
<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 18
2 Investing in e-learning<br />
2.3 The Business Case<br />
The initial analysis of the 10-point self-perception Likert scale questions indicates that some of<br />
them could be grouped into dimensions. The analysis has segmented respondents in<br />
accordance with 2 of these dimensions (see Appendix C for detailed definitions). These are:<br />
Business Impact – the tangible business benefits, the ability to respond to business need and<br />
the direct application of skills to the job in hand.<br />
Staff Impact – the intangible benefit of e-learning in an organisation, including staff<br />
motivation and the propensity to learn.<br />
The factor analysis used is discussed in Appendix A (Output Dimensions). The value of e-<br />
learning’s business impact is calculated from the mean of the 6 factors of which it is<br />
composed. Three of these include some financial element in the survey question. They have<br />
been grouped into a sub-dimension termed ‘financial impact’.<br />
2.4 <strong>Maturity</strong> and Business Impact<br />
The average rating for each maturity segment for each factor is shown below (Figure 2.1):<br />
Figure 2.1 Financial impact of e-learning maturity<br />
10<br />
8<br />
6<br />
4<br />
2<br />
0<br />
Novices<br />
Sporadic<br />
users<br />
Developing<br />
Users<br />
Established<br />
Users<br />
Embedded<br />
Users<br />
Innovators<br />
n=139<br />
Job performance metrics* Financial impact** Cost Savings***<br />
* Job performance metrics: e-learning has had a positive impact on existing job performance metrics (eg sales, machinery<br />
downtime, production, project completion etc)<br />
** Financial impact: e-learning has had other positive financial impact on the organisation<br />
*** Cost savings: Cost savings have been realised on staff training and development<br />
NB. On graphs with numeric scales of this type, 1 indicates strong disagreement with the survey statement, 10 indicates strong<br />
agreement.<br />
Ref: This graph appears as Figure 4 in <strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers<br />
<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 19
2 Investing in e-learning<br />
Figure 2.1 shows that the average rating for the 3 factors comprising the dimension financial<br />
impact for innovators and embedded users is double that for novices. The conclusion is that<br />
those who perceive themselves to be more mature in the application of e-learning perceive<br />
that e-learning has a greater financial impact on the business. A similar pattern can be seen<br />
with the other 3 factors that comprise the business impact dimension. These are shown<br />
plotted against maturity segments in Figure 2.2.<br />
Figure 2.2 <strong>Maturity</strong> and alignment to the business<br />
10.00<br />
8.00<br />
6.00<br />
4.00<br />
2.00<br />
0.00<br />
Novices<br />
Sporadic<br />
users<br />
Developing<br />
users<br />
Established<br />
Users<br />
Embedded<br />
Users<br />
Innovators<br />
Better business focus Quicker learning implementation Effective learning<br />
The link between maturity and the perception of business impact is a useful comparator but<br />
segmenting respondents on business impact is more relevant to understanding the link<br />
between e-learning and business performance,<br />
Respondents are segmented based upon the average of these six factors that may be<br />
grouped into the dimension termed Business Impact. Respondents are divided according to<br />
which quartile they are in for these values. Those in the bottom quartile have a business<br />
impact rating of between 1 and 4, those in the 25 th to 50 th percentile have a rating of<br />
between 4 and 5.5, those in the 50 th to 75 th percentile a rating of between 5.5 and 7.3 and<br />
those in the upper quartile have a business impact rating of between 7.3 and 10. These<br />
values are used to segment respondents into 4 groups. The number of respondents who<br />
could be segmented in this way varied from 136 to 141. Although 212 respondents started<br />
the survey only 141 answered the self-perception Likert scale questions, which are used to<br />
make the business impact segmentation and of those only 136 reliably answered every<br />
question.<br />
<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 20
2 Investing in e-learning<br />
2.5 Stakeholder involvement and Business Impact<br />
The respondents were asked to select the top 3 stakeholders that had the most influence on<br />
e-learning success in their organisation. They were offered 9 choices; the training<br />
department, senior executives, head of HR, learners, local champions of e-learning, head of<br />
IT, line managers, project sponsors and head of Finance. These are analysed against the<br />
perceived business impact of e-learning. The head of HR, head of IT and head of Finance<br />
show an inverse relationship with the business impact, the most extreme of which is head of<br />
IT. The influence of this role in terms of e-learning success is shown in Figure 2.3. Those who<br />
perceive themselves to be in the upper quartile for business impact are least likely to select<br />
the head of IT as one of the 3 key influences on e-learning success. Selection of neither<br />
project sponsor nor senior executive showed any particular relationship with business impact<br />
and are not shown in Figure 2.3, neither are the heads of HR and Finance; although selection<br />
of these as influencers show a similar but less pronounced pattern to head of IT. Both the<br />
selection of the training department, learners, and line managers, do show a positive<br />
relationship with perceived business impact. Seventy percent of respondents who are in the<br />
upper quartile for business impact select learners as a key influence on e-learning success,<br />
compared to 40% of those in the bottom quartile.<br />
Figure 2.3 Who influences success in relation to business impact<br />
100%<br />
80%<br />
60%<br />
40%<br />
20%<br />
0%<br />
n=139<br />
Upper quartile 3rd quartile 2nd quartile Lower quartile<br />
Business Impact<br />
Training department Learners Line managers Head of IT<br />
If we plot the probability of these 4 roles shown in Figure 2.3 against maturity, as shown in<br />
Figure 2.4, we see that line managers and learners are considered to be a greater influence<br />
on the success of e-learning by more mature users than less mature users. The influence of<br />
the head of IT shows a similar inverse relationship to maturity as it does to business impact.<br />
However, the influence of the training department drops off significantly amongst innovators.<br />
This may be because 70% of innovators select senior executives as one of the top 3<br />
influencers on the success of e-learning. Perhaps with innovators the training department<br />
sees itself much more as responding to the demands from learners and senior executives.<br />
<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 21
2 Investing in e-learning<br />
Figure 2.4 <strong>Maturity</strong> versus influences<br />
100%<br />
80%<br />
60%<br />
40%<br />
20%<br />
0%<br />
Innovators<br />
Embedded<br />
Users<br />
Established<br />
Users<br />
Developing<br />
Users<br />
Sporadic users<br />
Novices<br />
Training department Learners Line managers Head of IT<br />
2.6 Stakeholder involvement as Users<br />
Respondents were asked to identify the roles of individuals within their organisation who used<br />
e-learning (Table 2.7). Administrators, professionals and line managers are the “soft touch” for<br />
e-learning. In fact 57% of all respondents deliver e-learning to all these 3 roles. They seem to<br />
be the easiest group to market e-learning to, perhaps easiest to develop or buy material for,<br />
by virtue of the nature of their jobs.<br />
Table 2.7 Who uses e-learning in your organisation?<br />
All<br />
Innovators Embedded<br />
Users<br />
Established<br />
Users<br />
Developin<br />
g Users<br />
Sporadic<br />
users<br />
Novices<br />
Admin (with PC) 81% 78% 89% 100% 82% 69% 50%<br />
Professionals 80% 78% 111% 93% 77% 63% 100%<br />
Line Manager 75% 74% 100% 100% 70% 63% 33%<br />
Technicians 64% 67% 78% 80% 57% 54% 67%<br />
Director 52% 74% 100% 80% 38% 29% 17%<br />
Admin (no PC) 39% 41% 56% 57% 38% 23% 17%<br />
Service Roles 38% 41% 56% 57% 34% 23% 17%<br />
Skilled role 37% 37% 44% 53% 38% 20% 33%<br />
Manual role 26% 33% 33% 43% 26% 6% 17%<br />
<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 22
2 Investing in e-learning<br />
However, if we look at the relationship between who uses e-learning and business impact we<br />
can identify the key roles who make the biggest difference to business impact. The 3 key<br />
roles that change with business impact are shown in Figure 2.5. Other roles do not<br />
demonstrate such a clear cut linkage.<br />
Figure 2.5 Business impact varies according to usage by different groups of staff<br />
100%<br />
80%<br />
60%<br />
40%<br />
20%<br />
0%<br />
Upper quartile 3rd quartile 2nd quartile Lower quartile<br />
Business Impact<br />
n=139<br />
Directors Technicians Skilled Roles<br />
Ref: This graph appears as Figure 5 in <strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers<br />
Those organisations which can increase their use of e-learning by directors, technician grade<br />
staff and those in skilled roles are most likely to improve their perception of business impact.<br />
The self rating questions asked of learners mirror those asked of employers; with appropriately<br />
different wording. Learners were asked a number of questions relating to alignment to the<br />
business. Some of these relate to Business Impact. Four of these are picked out in Figure 2.6.<br />
Questions are related to job performance, relevance of training to current role, customer<br />
satisfaction and speed of putting into practice. Three of these belong in a dimension labelled<br />
Job Relevance (see Appendix A, Table A.4). The question relating to customer satisfaction<br />
does not. Not surprisingly learners had a very neutral view on whether or not customer<br />
satisfaction had increased since learners were able to access e-learning; average rating<br />
4.64; (20% agree, 28% disagree). This is close to the employer’s view of customer satisfaction<br />
linking to e-learning with an average rating of 4.71; (agree 16%, disagree 26%). The 28% of<br />
learners and the 26% of employers who disagreed with this statement are not necessarily<br />
saying that customers are more dissatisfied, they may have a much firmer view that there has<br />
been no change in customer satisfaction. Nevertheless the jury is out as far as customer<br />
satisfaction is concerned except that these average ratings change, depending on which<br />
quartile employer respondents are in for staff impact (See Figure 2.10).<br />
<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 23
2 Investing in e-learning<br />
Figure 2.6 The learner perspective on business impact<br />
e-learning has had a positive impact on my<br />
existing job performance<br />
My company provides e-learning events that are<br />
directly relevant to my current job<br />
Customer satisfaction has increased since we<br />
have had more access to e-learning<br />
I am able to quickly put into practice what I<br />
learn from e-learning<br />
n=720<br />
0% 20% 40% 60% 80% 100%<br />
Agree Neutral Disagree<br />
Ref: This graph appears as Figure 6 in <strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers<br />
Employees have a more positive view of the speed with which they can put their learning<br />
into practice, not only do 45% agree they can do it quickly, the average rating for all<br />
employees is 6.02 compared to 5.63 for employer respondents, although employer<br />
respondents are reasonably positive that they can quickly implement learning with an<br />
average rating of 6.03. This factor is included within the business impact dimension for<br />
employers. It appears that employers have some confidence they can roll out e-learning<br />
quickly; but less sure learners apply it quickly. However, learners have some confidence they<br />
can apply it quickly; to the same extent that employers feel they can roll it out quickly.<br />
Generally speaking 4 out of 10 learners perceive that e-learning has a positive impact on<br />
their jobs, is relevant and they can quickly put it into practice. These 3 factors are part of the<br />
learner dimension job relevance which has an overall average of 6.02 and 43% of learners<br />
with an agreement score. Only 13% disagree that e-learning is not relevant to their job.<br />
2.7 The relationship between training capability and business impact<br />
Respondents were asked a number of questions relating to the capability of the training<br />
function. Of these 4 behave in a similar fashion and their relationship to business impact is<br />
shown in Figure 2.7. The fifth question in this section of the questionnaire referred to auditing<br />
skills of those in the training function and this shows a greater relationship with change<br />
management than with the 4 factors reported on in this section. The grouping and<br />
dimensions are defined in Table A.3 All 5 are shown in Figure 2.7 and all show a relationship<br />
with the respondents’ perception of business impact. Respondents who perceive themselves<br />
to be in the top quartile of business impact are far more likely to agree that they have the<br />
skills to manage e-learning providers, have good relationships with IT and are willing to<br />
embrace the new technologies. They are less likely to agree that they have audited the<br />
training skills of the training function; to be more accurate those in the lowest quartile for<br />
business impact are more likely to agree that they have not audited the skills of the training<br />
function against the skills required to deploy e-learning. Appendix A discusses the grouping<br />
of 4 of the above 5 factors into a dimension labelled Training Function Capability; see Table<br />
A.3.<br />
<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 24
2 Investing in e-learning<br />
Figure 2.7 Training function capability affects business impact<br />
10.0<br />
9.0<br />
8.0<br />
7.0<br />
6.0<br />
5.0<br />
4.0<br />
3.0<br />
2.0<br />
1.0<br />
0.0<br />
Top quartile 3rd quartile 2nd quartile Bottom quartile<br />
Business impact<br />
Manage e-learning providers<br />
Audit of IT systems<br />
Audited training skills<br />
Links with IT<br />
Willing to embrace new technology<br />
Ref: This graph appears as Figure 7 in <strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers<br />
2.7.1 The relationship of the consolidation of learning to business impact<br />
Respondents were asked a number of questions relating to the support provided to learners<br />
before, during and after their use of e-learning. These included 4 support mechanisms that<br />
helped them consolidate new skills from e-learning in the workplace. This shows a<br />
relationship with business impact. Respondents were asked which of 6 support mechanisms<br />
they provided. These were: job related assignments, reference books, electronic help and<br />
job aids, periodic reassessment, printed job aids and line management coaching and<br />
feedback support. Four of these demonstrate a relationship with business impact. This is<br />
shown in Figure 2.8. This shows the probability that a respondent in each quartile will offer<br />
that type of support. Of the 2 not shown on this graph printed job aids are provided by 12%<br />
of respondents and job related assignments by 23% of respondents. Neither showed any<br />
particular relationship with business impact. A similar comparison was carried out for other<br />
forms of support.<br />
Table 2.9 shows the percentage of all respondents who offered the particular type of support<br />
listed. A greater number of respondents offer technical support than offer either study<br />
support or support in consolidating learning. Whilst none of these support methods show any<br />
particular relationship with business impact some of them are influenced by the maturity of<br />
respondents in relation to their implementation of e-learning. This is discussed further in<br />
Chapter 5 - Supporting and promoting e-learning.<br />
<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 25
2 Investing in e-learning<br />
Figure 2.8 Consolidation of learning reflected in improved business impact<br />
100%<br />
80%<br />
60%<br />
40%<br />
20%<br />
0%<br />
Upper quartile 3rd quartile 2nd quartile Lower quartile<br />
Business Impact<br />
n=139<br />
Reference books<br />
Re-assessment<br />
Electronic job aids<br />
Line manager coaching<br />
Ref: This graph appears as Figure 8 in <strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers<br />
Table 2.8 Consolidation of learning reflected in improved business impact<br />
How do you provide technical support to your learners? (Please tick all<br />
that apply)<br />
In person 43%<br />
Telephone help desk 80%<br />
By email 74%<br />
Through a web resource 34%<br />
% of respondents<br />
What study support do you provide to your learners as they progress<br />
through the programme? (Please tick all that apply)<br />
In person before e-learning starts 32%<br />
With a tutor in telephone contact 29%<br />
With a tutor in email contact 39%<br />
In person during the course 28%<br />
Through a learning resource centre 28%<br />
With on-line web reference materials 42%<br />
With a virtual learning classroom system 14%<br />
In person after a course is completed to review and evaluate 21%<br />
<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 26
2 Investing in e-learning<br />
How do you help learners consolidate and apply what they have learnt<br />
on completion? (Please tick all that apply)<br />
Job related assignments 36%<br />
Reference books 18%<br />
Electronic help and job aids 26%<br />
Periodic re-assessment 32%<br />
Printed job aids 18%<br />
Line manager coaching and feedback support 53%<br />
2.8 Compliance and Business Impact<br />
In the self rating perception section of the questionnaire respondents were asked 2 questions<br />
in relation to record keeping; e-learning has improved our record keeping for compliance<br />
purposes; and tracking e-learning progress is essential for compliance purposes. Not<br />
surprisingly a covariance calculation shows that these two factors behave similarly;<br />
furthermore their correlation is 0.63. Both have a reasonable correlation with business<br />
impact, 0.52 and 0.57 respectively. This is shown in Figure 2.9. These 2 factors have a much<br />
lower correlation with both staff impact and maturity; 0.36 and 0.32 for any improvement in<br />
record keeping and 0.35 and 0.31 for the relative importance of tracking.<br />
Figure 2.9 Compliance and business impact<br />
10<br />
8<br />
6<br />
4<br />
2<br />
0<br />
Upper quartile 3rd quartile 2nd quartile Lower quartile<br />
Business Impact<br />
n=139<br />
Tracking essential<br />
Improved record keeping<br />
Ref: This graph appears as Figure 9 in <strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers<br />
<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 27
2 Investing in e-learning<br />
Thus, whilst using e-learning to support compliance training has an effect on business impact<br />
its impact on both staff and its relationship to maturity are much less significant. If we isolate<br />
the cost-saving factor from business impact the correlation with improved record keeping is<br />
0.55, thus we can argue that a focus on compliance as an e-learning requirement is likely to<br />
produce cost-savings and improved business impact, but less likely to make a difference to<br />
staff or take-up. Although the correlation figures are all relatively close, if we plot the<br />
compliance self rating factors against the quartiles of either staff impact or take-up we do<br />
not get the same linear relationship.<br />
2.9 Staff Impact<br />
Appendix C defines the meaning of the term staff impact used in this report. The derivation<br />
of this is discussed in Appendix A. Respondents are segmented in accordance with their<br />
average rating for the 5 factors: interest in professional development, learner outcomes,<br />
speed of putting into practice, changes in employee motivation and behaviour. The<br />
dividing points for the quartile are as follows: bottom quartile 1 to 3.7, 25 th percentile to 50 th<br />
percentile 3.7 to 5, 50 th percentile to 75 th percentile 5 to 6.2 and the top percentile 6.2 to 10.<br />
In Table 2.16 the average scores of the respondents grouped by staff impact are shown for 2<br />
dimensions and one factor. These have been selected because they show a particular<br />
linear relationship with segmentation by quartiles at staff impact.<br />
Figure 2.10 Factors related to staff impact<br />
10<br />
8<br />
6<br />
4<br />
2<br />
0<br />
Upper quartile 3rd quartile 2nd quartile Lower quartile<br />
n=139<br />
Staff Impact<br />
Uptake of e-learning Financial impact Customer satisfaction<br />
Ref: This graph appears as Figure 10 in <strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers<br />
The financial impact dimension is composed of 3 factors (see Appendix C): cost savings,<br />
improvement in metrics and other financial benefits. Take-up of e-learning is composed of 3<br />
factors: e-learning has attracted more learners, staff are more likely to complete courses, we<br />
have a high percentage of e-learning course completions. In addition the number of<br />
different roles in the organisation that use e-learning is added into this dimension. Both these<br />
<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 28
2 Investing in e-learning<br />
2 dimensions are related to perception of staff impact in that those organisations who<br />
perceive themselves to be in the top quartile for staff impact are more likely to agree with<br />
the various statements that make up these 2 dimensions than organisations in the bottom<br />
quartile for staff impact. The single factor that is also plotted in Figure 2.10 is respondents’<br />
perception of the extent to which there has been an increase in customer satisfaction since<br />
staff have had more access to e-learning. Whilst this question overall shows a neutral<br />
response; with an average for all respondents of 4.71, there is a relationship to respondents’<br />
perception of the impact e-learning has on staff. This seems to indicate that where<br />
respondents perceive e-learning better motivates staff they are more likely to perceive that<br />
there has been an improvement in customer satisfaction. This is supported by research in the<br />
United States that provided a link between employees’ perception of support provided to<br />
them and a measurement of customer satisfaction. The single most significant factor in the<br />
perception of employees in their employers support was the provision of training 1 . The<br />
hypothesis that improved support to staff via e-learning will improve customer satisfaction<br />
appears to have some substance.<br />
2.10 Staff Impact versus input dimensions<br />
Appendix A defines the use and meaning of the term “input dimension”. These are<br />
composed of factors over which management can exert some control, unlike output<br />
dimensions like staff impact which are the result of actions taken. The dimension Change<br />
Management is composed of 9 factors as listed in Table A.3 of Appendix A. The linkage<br />
between these factors is weaker than with other dimensions. The factors are: we<br />
communicate e-learning success, senior management demonstrates commitment, we brief<br />
line managers, we communicate success to line managers, we apply change management<br />
to the implementation of e-learning, we operate pilot projects, we apply branding and<br />
identity to e-learning, we train local champions and we have audited the skills of the training<br />
function. Figure 2.11 shows that those organisations who agree that they are more likely to<br />
do these 9 things are more likely to be in the upper quartile for staff impact.<br />
Empowerment is defined in Appendix A Table A.3; as comprising the factors: staff know what<br />
e-learning is available and have the freedom to ask for it. The linkage between these 2<br />
factors is not as strong as others; both as a dimension and as 2 factors the extent to which<br />
respondents agree with the statements increases with staff impact.<br />
Availability is an input dimension composed of 6 factors plus one calculation. The factors<br />
are: wide range of opportunities, access anywhere, access anytime, management allow<br />
time (at work and elsewhere), an infrastructure capable of delivering e-learning to places<br />
convenient to staff. The calculation that is included within the dimension of availability is<br />
based upon the range of places in which employers offer e-learning.<br />
Employer respondents were asked to select which locations they used for e-learning from a<br />
list composed of: at the desk, at home, at an in-house learning centre, at an external<br />
learning centre, in a quiet place away from the learner’s desk and when travelling. Those<br />
who make e-learning more available based upon this criteria are more likely to find<br />
themselves in the top quartile for staff impact.<br />
1 Schneider, White and Paul (1998) Service Climate and Customer Perception, Journal of Applied Psychology 1998,<br />
volume 83 and Eisenberger, Cummings, Armeli and Lynch (1997) Perceived Organisational Support, Discretionary<br />
Treatment and Job Satisfaction, Journal of Applied Psychology 1997, volume 82.<br />
<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 29
2 Investing in e-learning<br />
Figure 2.11 Staff impact versus input dimensions<br />
10.00<br />
8.00<br />
6.00<br />
4.00<br />
2.00<br />
0.00<br />
Upper quartile 3rd quartile 2nd quartile Lower quartile<br />
Staff impact<br />
Change Management Empowerment Availability<br />
The variation and linkage between these factors and dimensions is discussed and reported<br />
on in later chapters.<br />
Whilst there is similarity in the way that senior management commitment and the other 4<br />
factors vary with staff impact the covariance calculation does not justify including the<br />
commitment of senior managers in the dimension change management. Senior<br />
management commitment is a key factor closely related to staff impact but considered as<br />
an input factor rather than an output. Senior managers appear to be influenced by some<br />
change management practices (the correlation with communicating success is 0.48, with<br />
line manager briefings is 0.48) and in turn influence availability mainly on their impact on<br />
management behaviour, (correlation with line managers make time for staff to learn 0.46,<br />
time to learn at home 0.52).<br />
Senior management behaviour is clearly key but its linkage to other dimensions and<br />
measures is not as clear cut as the strategic direction and role model example set by<br />
directors, the board and top management.<br />
Figure 2.12 isolates some of the factors that comprise change management and plot them<br />
against staff impact; in addition the extent to which senior managers show commitment.<br />
Whilst there is similarity in the way that senior management commitment and the other 4<br />
factors vary with staff impact the covariance calculation does not justify including the<br />
commitment of senior managers in the dimension change management. Senior<br />
management commitment is a key factor closely related to staff impact but considered as<br />
an input factor rather than an output. Senior managers appear to be influenced by some<br />
<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 30
2 Investing in e-learning<br />
change management practices (the correlation with communicating success is 0.48, with<br />
line manager briefings is 0.48) and in turn influence availability mainly on their impact on<br />
management behaviour, (correlation with line managers make time for staff to learn 0.46,<br />
time to learn at home 0.52).<br />
Senior management behaviour is clearly key but its linkage to other dimensions and<br />
measures is not as clear cut as the strategic direction and role model example set by<br />
directors, the board and top management.<br />
Figure 2.12 Change management influences staff impact of e-learning<br />
10.00<br />
8.00<br />
6.00<br />
4.00<br />
2.00<br />
0.00<br />
Upper quartile 3rd quartile 2nd quartile Lower quartile<br />
e-learning brand<br />
Communication of success<br />
Senior managers<br />
Pilot e-learning<br />
Local champions<br />
Ref: This graph appears as Figure 12 in <strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers<br />
2.11 <strong>Maturity</strong> and staff impact<br />
<strong>Maturity</strong> has an effect on staff impact, as might be expected. We have established that<br />
maturity is a fundamental concept that relates to a number of factual measures, as well as<br />
the more subjective measures of business impact and staff impact. Figure 2.13 plots the 5<br />
factors that make up the staff impact dimension against segmentation by maturity.<br />
Figure 2.14 reports the responses for all employer respondents to the 5 factors that make up<br />
the dimension staff impact. Broadly speaking, as many respondents disagree that e-learning<br />
has an impact as agree. The notable exception is the speed with which learning can be<br />
applied where over one-third of respondents agree with this statement: staff quickly put into<br />
practice what they learn from e-learning.<br />
<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 31
2 Investing in e-learning<br />
Figure 2.13 Staff impact versus maturity<br />
10<br />
8<br />
6<br />
4<br />
2<br />
0<br />
Novices<br />
Sporadic<br />
users<br />
Developing<br />
users<br />
Established<br />
users<br />
Embedded<br />
users<br />
Innovators<br />
Greater interest in development<br />
Improved outcomes<br />
Quickly applied<br />
Improved motivation<br />
Behaviour change<br />
Ref: This graph appears as Figure 11 in <strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers<br />
Figure 2.14 Employer view of staff impact<br />
Quickly applied<br />
Improved<br />
motivation<br />
Greater interest in<br />
development<br />
Improved<br />
outcomes<br />
Behavioural<br />
change<br />
0% 20% 40% 60% 80% 100%<br />
Agree Neutral Disagree<br />
As previously discussed speed of response is surfacing in this report as a statement with which<br />
a significant proportion of both learners and employers agree with in relation to e-learning.<br />
<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 32
2 Investing in e-learning<br />
2.12 Learners Perspective<br />
Learners are asked a number of questions which can be related to their response to e-<br />
learning. The 30 self-perception opinion-based questions, described as factors, have been<br />
grouped into 6 main dimensions. The rationale for these 6 dimensions and their definition is<br />
discussed in Appendix A.<br />
Figure 2.15 Learner responses<br />
Need for recognition<br />
Job relevance<br />
Management support<br />
Learners control their opportunties<br />
Empowered learners<br />
Detachment<br />
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%<br />
Agree Neutral Disagree<br />
It is clear that there are a range of factors that give learners empowerment and that more<br />
learners agree that this has an impact on them than with other dimensions. Empowered<br />
learners in the learner responses is not defined in the same way as Empowerment in the<br />
employer responses. For learners it means confidence in using PCs, engagement without<br />
prompting, knowing what is available, empowered to ask and technology that delivers<br />
learning to places convenient to the learner.<br />
The view of learners is mirrored by the relationship between staff impact and availability of e-<br />
learning and the employer definition of empowered learners. We may relate the views of<br />
learners in relation to empowerment by plotting availability and empowerment as defined<br />
by learners against staff impact (Figure 2.16).<br />
Again, employers have been segmented into quartiles by their perception of staff impact.<br />
The learner dimensions that are closest to both availability and empowerment from an<br />
employer’s perspective are key dimensions that influence staff impact.<br />
<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 33
2 Investing in e-learning<br />
Figure 2.16 Staff impact and freedom of choice<br />
8.00<br />
7.00<br />
6.00<br />
5.00<br />
4.00<br />
3.00<br />
2.00<br />
1.00<br />
0.00<br />
Upper quartile 3rd quartile 2nd quartile Lower quartile<br />
Staff impact<br />
Availability of e-learning<br />
Empowered learners<br />
The dimension detachment shown in Figure 2.16 is a negative effect of e-learning; I only do<br />
e-learning when it is compulsory and I find e-learning choices confusing. It is disturbing to<br />
note that 4 out of 10 in learner respondents demonstrate detachment from this<br />
empowerment because they only do learning when it is compulsory and find the choices<br />
confusing. Are these the same learners who do not feel empowered? In the majority of cases<br />
they are. In fact 62% of respondents were on opposite sides of these 2 dimensions,<br />
empowered and detached. That is; the average score for the factors that make up<br />
empowerment was above 7 and the score for the factors that make up detachment was 3<br />
or below, or the average score on the factors that make up detachment was 7 or above<br />
and the average score on the factors that make up empowerment was 3 or below. Learners<br />
are largely divided into those who embrace e-learning and agree that it brings a certain<br />
freedom to select what they need and want and those who avoid its use unless they have<br />
to. Learners are divided into those who can take the opportunity that e-learning presents<br />
and those that can’t, demonstrated by the 58% of learners who are empowered and the<br />
38% of learners who are detached from doing e-learning voluntarily.<br />
<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 34
3 People and organisational capability<br />
3 People and organisational capability<br />
Overview: This Chapter considers how decisions are made, the impact of an e-learning<br />
strategy and the effect directors have on e-learning and who uses e-learning.<br />
3.1 Decision making<br />
Respondents were asked how they decided which e-learning courses and content will be<br />
bought or developed. They were offered 4 choices but multiple answers were acceptable.<br />
Then average number of responses selected by respondents is 1.5, the proportion of items<br />
selected in Figure 3.1. The percentages shown are the percentages of respondents who<br />
selected that particular item and therefore add up to more than 100.<br />
Figure 3.1 Making e-learning investment decisions<br />
Training<br />
function<br />
decides<br />
44%<br />
Business<br />
projects<br />
demand<br />
30%<br />
Respond to<br />
external<br />
suggestions<br />
2%<br />
Based on<br />
board<br />
strategy<br />
24%<br />
If we segment these responses by maturity, as shown in Figure 3.2, the indications are that<br />
training departments are more likely to make decisions for organisations who are<br />
approaching maturity rather than those who are either embedded or innovators.<br />
Bearing in mind that responses from novices are susceptible to a much wider statistical<br />
variation because there are only 10 respondents in this segment, there is also an indication<br />
that a Board strategy is used to make decisions more often by more e-learning mature<br />
organisations. This is also supported by Figure 2.4 which plots the key stakeholders who<br />
influence e-learning by maturity, although in this case 86% of embedded users selected the<br />
training department as one of the 3 key stakeholders but only 44% agreed that the training<br />
department made purchasing decisions. This may indicate that embedded users have a<br />
greater understanding of the amount of work that training functions need to do in order to<br />
ensure a product is implemented and used successfully. However, this should be viewed<br />
with some caution as there are only 11 respondents in the embedded segment.<br />
<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 35
3 People and organisational capability<br />
Figure 3.2 Making decisions about e-learning<br />
1.00<br />
0.80<br />
0.60<br />
0.40<br />
0.20<br />
0.00<br />
Innovators<br />
Embedded<br />
users<br />
Established<br />
users<br />
Developing<br />
users<br />
Sporadic<br />
users<br />
Novices<br />
A board strategy Training department Business units<br />
The training function is the most frequently selected source of decision-making, 64% of<br />
respondents (Figure 3.3). Those in the upper quartile for business impact are twice as likely to<br />
cite the Board and having a strategy as a key decision-making process (56%) as those in the<br />
bottom quartile for business impact (24%). Those in the upper quartile are also more likely to<br />
involve business units in decision-making for e-learning (50%) as opposed to those in the<br />
lowest quartile (32%).<br />
Figure 3.3 Making decisions about e-learning<br />
0.80<br />
0.70<br />
0.60<br />
0.50<br />
0.40<br />
0.30<br />
0.20<br />
0.10<br />
0.00<br />
Upper quartile<br />
(1.7)<br />
3rd quartile (1.6) 2nd quartile (1.4) Lower quartile<br />
(1.2)<br />
Business impact<br />
A board strategy Training department Business units<br />
<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 36
3 People and organisational capability<br />
The importance of a Board strategy being part of the decision-making process is supported<br />
by previous work. The report on Embedding e-learning in Large Companies 2 reported that<br />
“the analysis shows that the existence or otherwise of a strategy was the most significant<br />
driver of successfully embedding e-learning”.<br />
Over a third of companies agreed that their Board has agreed a learning strategy aligned to<br />
business priorities. Companies were segmented on this basis and their perception of business<br />
impact compared (Figure 3.4). In all cases respondents perceived e-learning has a greater<br />
business impact where a strategy existed than where it didn’t. The average difference is 0.94<br />
on a 10-point scale. Having a Board strategy makes a 10% difference in employers’<br />
perception of the business impact of e-learning.<br />
Figure 3.4 Business impact of a strategy compared<br />
8.00<br />
6.00<br />
4.00<br />
2.00<br />
0.00<br />
Impact on<br />
metrics<br />
Financial<br />
impact<br />
Cost savings<br />
achieved<br />
Business<br />
focus<br />
Speed of Effective in<br />
implementation application<br />
Strategy in place<br />
No strategy<br />
3.2 Who uses e-learning?<br />
Leadership from the top is a key element that influences a number of factors relating to the<br />
success of e-learning. Aiming to involve directors and being successful in doing so pays<br />
significant dividends.<br />
Figure 3.5 compares the key dimension where directors use e-learning personally and where<br />
they do not. In some cases the differences are greater than whether an organisation has a<br />
strategy or not. A difference between 5.6 and 3.9 falls well within an average neutral<br />
assessment about the commitment of senior managers.<br />
2 Hills 2005, published by Ufi<br />
<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 37
3 People and organisational capability<br />
Figure 3.5 Effect on key dimensions when directors use e-learning<br />
8<br />
6<br />
4<br />
2<br />
0<br />
Business impact Staff impact Uptake Senior manager<br />
commitment<br />
Availability<br />
Directors using e-learning<br />
Directors not users<br />
In fact, 39% of respondents in organisations where directors use e-learning, agree that senior<br />
managers show commitment, as opposed to 23% of those in organisations where directors<br />
do not use e-learning. Over half the respondents (55%) in organisations where directors do<br />
not use e-learning expressed strong disagreement implying that senior managers not only do<br />
not show commitment but perhaps are even antagonistic to it. This corresponds to a quarter<br />
of organisations (24%) where directors are users who disagree with the statement. We can<br />
conclude that the example set by directors has a significant impact on the behaviour of<br />
senior managers and on the rest of the organisation. The discussion in Chapter 2 has already<br />
highlighted the influence senior managers have on certain key factors. If we isolate 2 of the<br />
dimensions reported in Figure 3.5, that of staff impact and uptake rates, then we can identify<br />
some even more significant differences.<br />
Figure 3.6 shows the average agreement with the 5 statements that fit within the dimension<br />
termed staff impact. We observe a 10% difference in the perceptions of respondents<br />
between those organisations where directors use e-learning and where they do not.<br />
<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 38
3 People and organisational capability<br />
Figure 3.6 Staff impact versus use by directors<br />
7.00<br />
6.00<br />
5.00<br />
4.00<br />
3.00<br />
2.00<br />
1.00<br />
0.00<br />
Greater interest<br />
in development<br />
Improved<br />
motivation<br />
Improved<br />
outcomes<br />
Behaviour<br />
change<br />
Quickly applied<br />
Directors use e-learning<br />
e-elearning not used by directors<br />
However, the averages are very close to the neutral point on the 10-point scale used in the<br />
self-perception questions. If we look at the percentage of respondents who agree with those<br />
statements then greater differences become apparent (Table 3.1).<br />
Table 3.1 Percentage of respondents agreeing with Staff Impact statements<br />
Directors use e-learning e-learning not used by Directors<br />
Agree Neutral Disagree Agree Neutral Disagree<br />
Greater interest in<br />
development 22% 51% 27% 13% 43% 43%<br />
Improved motivation 27% 56% 17% 10% 60% 30%<br />
Improved outcomes 31% 49% 20% 16% 51% 33%<br />
Behaviour change 29% 51% 20% 19% 46% 34%<br />
Quickly applied 49% 46% 4% 23% 48% 29%<br />
In the case of all respondents twice as many agree with these statements in organisations<br />
where directors use e-learning than in those where they do not. This is mirrored by a<br />
reduction in those that disagree with the statement. About half of respondents in both<br />
segments express a neutral view about these 6 statements; this may be because there is an<br />
uneven pattern of staff responses to e-learning across the organisation or the respondent<br />
doesn’t know how staff are responding. The change in the agreement and disagreement<br />
percentages is more significant than the fact that half of respondents express a neutral view.<br />
We discern a similar pattern when we analyse the dimension take-up of e-learning (Figure 3.7<br />
and Table 3.2). The measurement of take-up is determined by grouping 3 self-perception<br />
questions with a measure of the number of roles in an organisation who use e-learning.<br />
<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 39
3 People and organisational capability<br />
Figure 3.7 Directors’ use of e-learning affects factors comprising take-up<br />
8<br />
7<br />
6<br />
5<br />
4<br />
3<br />
2<br />
1<br />
0<br />
More completions<br />
Higher % of<br />
completions<br />
Increase in<br />
Learners<br />
Roles who use<br />
Directors use e-learning<br />
e-learning not used by directors<br />
Respondents were offered 7 roles to select and the number of roles selected has been rebased<br />
to 10 and averaged with the measure of agreement with the 3 statements. The<br />
average number of roles who use e-learning in organisations where directors do not is<br />
approximately 1½. The number of roles who use e-learning when directors do rises to<br />
approximately 5 out of 7. In Table 3.2 we can see the percentage of respondents who agree<br />
with the 3 statements, the number of respondents who agree with this statement doubles<br />
when directors are users of e-learning.<br />
Table 3.2 Percentage agreeing with take up statements<br />
Directors use e-learning e-learning not used by Directors<br />
Agree Neutral Disagree Agree Neutral Disagree<br />
More completions 32% 37% 31% 18% 39% 43%<br />
Higher % of<br />
completions 55% 26% 19% 26% 40% 34%<br />
Increase in Learners 47% 35% 19% 22% 40% 37%<br />
Directors have a profound impact on the success of e-learning within organisations. Where<br />
they set an example organisations are twice as likely to perceive take-up as successful and<br />
the number of roles who use e-learning will treble.<br />
3.3 Who influences learners?<br />
Learners were asked to select the one person whose opinion is most likely to encourage<br />
them to take an e-learning programme. They were offered a list of 6 individuals, or roles.<br />
Figure 3.9 shows their responses.<br />
<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 40
3 People and organisational capability<br />
Figure 3.8 Whose opinion encourages use of e-learning<br />
My manager<br />
52%<br />
My learning<br />
centre coordinator<br />
2%<br />
A contact outside<br />
of work<br />
4%<br />
A senior executive<br />
5%<br />
A member of the<br />
training<br />
department<br />
10%<br />
A work colleague<br />
27%<br />
Ref: This graph appears as Figure 19 in <strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers<br />
Although senior executives clearly have an impact on the take-up of e-learning this is not<br />
reflected in an individual learner’s view, as only 5% of learner respondents select this role as<br />
the most important influence on them as to whether they will take an e-learning programme.<br />
It may well be a blinding glimpse of the obvious that managers and work colleagues are the<br />
2 most important influences on learners.<br />
There are some differences by learner segments. Learners are segmented by educational<br />
level, age, where they learn, their normal work environment, whether they learn in their own<br />
time or company time, whether they manage their own time or it was managed for them,<br />
whether they have responsibility for others or only for themselves. Table 3.3 shows the<br />
percentage of respondents in each segment who selected a particular individual as their<br />
prime influence.<br />
Table 3.3 Who encourages you to learn?<br />
Education to 16<br />
n=93<br />
Education to 18<br />
n=73<br />
Education to<br />
Post 18<br />
n=147<br />
Education to<br />
Graduate level<br />
n=522<br />
Manager 56% 49% 50% 52%<br />
Colleague 22% 32% 24% 29%<br />
Senior Executive 4% 5% 6% 5%<br />
Others 18% 14% 20% 13%<br />
<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 41
3 People and organisational capability<br />
Age is 25 or<br />
under<br />
n=103<br />
Age is 26 to 39<br />
n=292<br />
Age is 40 to 54<br />
n=314<br />
Age is 55 or<br />
over<br />
n=126<br />
Manager 60% 50% 54% 45%<br />
Colleague 23% 27% 28% 32%<br />
Senior Executive 4% 6% 6% 2%<br />
Others 13% 16% 12% 21%<br />
Learn at an Inhouse<br />
learning<br />
centre<br />
n=27<br />
Learn at home<br />
n=132<br />
Learn at the<br />
desk<br />
n=643<br />
Learn in a quiet<br />
spot away from<br />
the desk<br />
N=32<br />
Manager 41% 45% 54% 59%<br />
Colleague 22% 25% 29% 16%<br />
Senior Executive 0% 9% 5% 9%<br />
Others 37% 20% 13% 16%<br />
Work at a<br />
regular place<br />
n=740<br />
Work from<br />
home<br />
n=35<br />
Work on site at<br />
customer<br />
n=52<br />
Work on the<br />
road<br />
n=8<br />
Manager 52% 57% 44% 50%<br />
Colleague 28% 29% 23% 25%<br />
Senior Executive 9% 9% 15% 13%<br />
Others 5% 3% 8% 13%<br />
Learn in own<br />
time<br />
n=167<br />
Learn in<br />
Company time<br />
n=668<br />
Manager 44% 54%<br />
Colleague 25% 28%<br />
Senior Executive 10% 4%<br />
Others 20% 14%<br />
<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 42
3 People and organisational capability<br />
I do not<br />
manage my<br />
own time<br />
n=57<br />
I manage my<br />
own time<br />
n=778<br />
Manager 44% 53%<br />
Colleague 37% 27%<br />
Senior Executive 2% 6%<br />
Others 18% 15%<br />
No responsibility<br />
for others<br />
n=459<br />
Responsible for<br />
others<br />
n=376<br />
Manager 54% 49%<br />
Colleague 27% 28%<br />
Senior Executive 4% 12%<br />
Others 14% 7%<br />
Those without management responsibility are slightly more likely to respond to their own<br />
manager. Those with management responsibility are slightly more like to respond to senior<br />
executives; but only 6% of this segment select the senior executive as the person whose<br />
opinion they most valued in persuading them to use e-learning. Those who manage their<br />
own time are slightly more likely to respond to senior executives, but again the percentage is<br />
small (6%) although this group are also slightly more likely to respond to their own manager.<br />
They are less likely to respond to recommendations from colleagues. Those who learn in their<br />
own time or work on customer’s sites are less likely to respond to managers and more likely to<br />
respond to senior executives; perhaps a blinding glimpse of the obvious in that those least<br />
likely to be in direct contact with their manager are most likely to respond to the leadership<br />
of a senior executive.<br />
When a manager is in direct control of an individual, that is the learner does not manage<br />
their own time, then managers seem to exert less influence and peers exert more influence.<br />
The pattern that emerges is those that work more independently, either by location or work<br />
style, are less likely to respond to managers and more likely to respond to senior executives,<br />
those in direct contact with managers and whose time is controlled for them are less likely to<br />
respond to the person exerting that control. This analysis should be viewed with some<br />
caution as the segmentation gives population groups of radically different sizes. The<br />
respondents were segmented by age and a linkage is identified.<br />
<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 43
3 People and organisational capability<br />
Figure 3.9 Who encourages you to learn?<br />
50%<br />
40%<br />
30%<br />
20%<br />
10%<br />
0%<br />
Manager Colleague Training<br />
Manager<br />
Senior<br />
Executive<br />
A Friend<br />
LC<br />
Coordinator<br />
N= 948<br />
I do not manage my own time<br />
I manage my own time<br />
The influence of managers declines with the age of the learner; not unreasonably since older<br />
learners are likely to have a better appreciation of their own learning needs. The<br />
recommendation of a colleague rises in importance with age. However, an individual<br />
learner does not seem significantly influenced by a senior executive and yet the behaviour<br />
of senior executives significantly influences uptake (Table 3.4).<br />
Table 3.4 Use of e-learning by directors<br />
Directors use e-<br />
learning<br />
Agree<br />
e-learning not<br />
used by Directors<br />
Agree<br />
The majority of our learners engage with their e-<br />
learning courses without prompting 33% 15%<br />
Senior Management regularly demonstrate<br />
commitment to e-learning 39% 23%<br />
We provide line managers with training and briefings<br />
relating to specific e-learning courses 34% 18%<br />
Managers make time for staff to learn at work 42% 39%<br />
Managers allow staff work time to learn at home or<br />
locally 38% 28%<br />
Managers appraise staff at regular intervals and plan<br />
their development 70% 55%<br />
Managers coach their own teams 55% 36%<br />
<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 44
3 People and organisational capability<br />
The hypothesis is that the behaviour of senior executives influences that of immediate<br />
managers, which in turn increases the availability of both time and space to learners and<br />
improves the propensity for managers to develop and coach their own teams. Managers in<br />
almost three quarters of organisations, where directors use e-learning, appraise staff and<br />
plan their development, as compared to just over half in organisations where directors do<br />
not use e-learning.<br />
The impact of directors’ behaviour is also clearly seen in Table 3.5, which reports the<br />
percentage of each organisation in each segment providing e-learning to the 7 roles<br />
identified in the questionnaire. We have previously (see Chapter Two Table 2.7 and Figure<br />
2.5), seen the significance of encouraging the use of e-learning by technician grades and<br />
skilled roles; where directors use e-learning the percentage of organisations providing e-<br />
learning to these 2 key roles more than doubles.<br />
Table 3.5 Percentage of employers providing e-learning to this role<br />
Directors use e-<br />
learning<br />
n=83<br />
e-learning not<br />
used by directors<br />
n=85<br />
Administrative or customer service positions with a PC 98% 65%<br />
Professional grades or equivalent 95% 65%<br />
Middle/Line Manager/Shift supervisors 96% 54%<br />
Technician grades or equivalent 86% 42%<br />
Director or Senior Management 100% 0%<br />
Administrative or customer service positions without a PC 57% 21%<br />
Employed non-manual position, not at a desk but<br />
travelling or in service job 57% 19%<br />
Supervised or skilled manual worker 52% 22%<br />
Other manual worker 41% 12%<br />
3.4 Roles trained by sector<br />
Table 3.6 lists the percentage of organisations in each sector that provide training to the<br />
various grades of staff. The analysis has only been done for those sectors where the number<br />
of respondents exceeded 10. Four of these sectors do show some key differences from the<br />
overall average (Figure 3.10). The remaining sectors have been combined into one line.<br />
These remaining sectors show little differences from each other. The 4 sectors plotted show<br />
some differences.<br />
Seventy percent of those responding from the manufacturing sector provide e-learning for<br />
supervisory or skilled manual roles, compared to an overall average of 36%. Appendix B<br />
discussed the nature of the various segments in more detail. However, it is clear that<br />
manufacturing directs more e-learning effort at the less skilled employees. By contrast the<br />
financial sector puts significantly more effort into training the knowledge workers and senior<br />
management staff than all other sectors.<br />
<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 45
3 People and organisational capability<br />
Table 3.6 Percentage of organisations offering e-learning to specific roles<br />
Manufac<br />
-turing<br />
Business<br />
Financial activities Public<br />
Health<br />
Education<br />
Computing<br />
Administrative or<br />
customer service<br />
positions with a PC 79% 95% 75% 97% 53% 94% 75% 78%<br />
Professional grades or<br />
equivalent 79% 90% 92% 79% 83% 82% 63% 77%<br />
Middle/Line<br />
Manager/Shift<br />
supervisors 71% 95% 67% 83% 53% 82% 75% 72%<br />
Technician grades or<br />
equivalent 71% 90% 58% 55% 43% 59% 69% 61%<br />
Director or Senior<br />
Management 43% 85% 42% 48% 40% 47% 56% 50%<br />
Administrative or<br />
customer service<br />
positions without a PC 21% 40% 25% 52% 27% 35% 38% 37%<br />
Employed non-manual<br />
position, not at a desk<br />
but travelling or in<br />
service job 57% 50% 25% 34% 7% 29% 50% 36%<br />
Supervised or skilled<br />
manual worker 71% 35% 8% 41% 10% 35% 31% 36%<br />
Other manual worker 50% 25% 8% 28% 10% 18% 19% 25%<br />
By contrast those organisations in the business activities sector put less effort into providing e-<br />
learning for less skilled and more junior staff. Clearly companies in these 3 sectors are making<br />
management decisions at directing e-learning effort at those roles that are most significant<br />
for the business.<br />
The education sector is less likely to train all roles other than professional grade staff. For all<br />
except this role 20% fewer organisations provide e-learning. It is worth investigating what else<br />
the education sector may be doing that is different to others. This is reported on in a later<br />
Chapter.<br />
ALL<br />
<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 46
3 People and organisational capability<br />
Figure 3.10 Percentage organisations by sector selecting role as user of e-learning<br />
100%<br />
90%<br />
80%<br />
70%<br />
60%<br />
50%<br />
40%<br />
30%<br />
20%<br />
10%<br />
0%<br />
Other manual<br />
worker<br />
Employed<br />
non-manual<br />
position, not<br />
at a desk but<br />
Supervised or<br />
skilled manual<br />
worker<br />
Administrative<br />
or customer<br />
service<br />
positions<br />
Director or<br />
Senior<br />
Management<br />
Technician<br />
grades or<br />
equivalent<br />
Middle/Line<br />
Manager/Shift<br />
supervisers<br />
Professional<br />
grades or<br />
equivalent<br />
Administrative<br />
or customer<br />
service<br />
positions with<br />
Manufacturing Financial Business activities Education Others<br />
3.5 Source of funding<br />
Respondents were asked how they funded the development of e-learning and the<br />
acquisition of resources for its development. Respondents were offered 5 choices: internal<br />
company budget, learning and skills council funding, European funding, regional<br />
development agency funding and others. The most commonly quoted source under ‘other’<br />
was those from NHS respondents where they entered bids into strategic Health Authorities.<br />
Indeed the majority of sources quoted under ‘other’ were central Government supported<br />
authorities which either were not within the remit of the LSC or respondents were not aware<br />
of this. In a very few cases bids to these type of organisations represented the majority of a<br />
respondent’s spend on e-learning. For each funding source respondents were asked to<br />
select one of 4 percentages of their total spend on e-learning, in relation to its source.<br />
For all other respondents the majority of their e-learning spend came from internal company<br />
budgets. However 20% of respondents use their internal company budget for less than 10%<br />
of their e-learning spend.<br />
Where does this money come from? The percentage of respondents seeking some level of<br />
funding is as follows:<br />
> Learning and Skills Council funding 14%<br />
> European funding 9%<br />
> Regional Development Agency funding 5%<br />
> Other sources of funding 12%<br />
<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 47
3 People and organisational capability<br />
Figure 3.11 Where does e-learning spend come from?<br />
Other<br />
Regional Development Agency funding<br />
European funding<br />
Learning & Skills Council funding<br />
Internal company budget<br />
0% 20% 40% 60% 80% 100%<br />
less than 10% 10% to
3 People and organisational capability<br />
Table 3.7 Sources of funding by expenditure<br />
Percentage of respondents seeking some<br />
proportion of spend from external sources<br />
Sector<br />
Seeking<br />
> 10% LSC European RDA Other<br />
c) Manufacturing 31% 8% 0% 0% 8%<br />
h) Transport, storage and communications 13% 13% 0% 0% 0%<br />
i) Financial intermediation 15% 0% 0% 0% 0%<br />
j) Real estate, renting and business activities 25% 25% 0% 0% 13%<br />
k) Public admin and defence 19% 14% 10% 5% 5%<br />
l) Education 40% 50% 35% 25% 30%<br />
m)Health and social work 54% 8% 8% 8% 31%<br />
o) Computing 21% 0% 0% 0% 0%<br />
3.6 Sources of e-learning<br />
Respondents were asked how they sourced their e-learning material and facilities.<br />
Respondents were offered 7 options (Figure 3.12). , there was the possibility for respondents<br />
to include an ‘other’ response (selected by 6 percent). This distribution remains uniform by<br />
almost all the segmentation that has been used in this analysis.<br />
Figure 3.12 How is e-learning sourced?<br />
Commercial bought-in products<br />
Partnership with e-learning vendor<br />
47%<br />
55%<br />
In-house with simple rapid development tools<br />
47%<br />
In-house with development tools for experts<br />
33%<br />
Partnership with educational/work-based learning<br />
provider<br />
Through a customer or supplier<br />
18%<br />
14%<br />
n=153<br />
Through an industry or trade body<br />
10%<br />
0% 10% 20% 30% 40% 50% 60%<br />
<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 49
3 People and organisational capability<br />
Buying from commercial sources remains the most likely activity for sourcing e-learning<br />
although in-house development and partnership working are used as sources by over a third<br />
of respondents. Do these patterns change with maturity? We can detect some patterns<br />
relating to maturity if we segment into 3 segments for maturity. Figure 3.13 combines novices<br />
and sporadic users into a less mature segment and innovators, embedded users and<br />
established users into a more mature segment.<br />
Figure 3.13 Source of supply of e-learning by maturity<br />
60%<br />
50%<br />
40%<br />
30%<br />
20%<br />
10%<br />
Commercial bought-in<br />
products<br />
Industry or trade body<br />
In-house (user tools)<br />
In-house (tools for<br />
programmers)<br />
Partnership with e-<br />
learning vendor<br />
Partnership with a<br />
learning provider<br />
Customer/supplier<br />
0%<br />
Less mature Becoming mature More mature<br />
This indicates that more mature organisations are more likely to use in-house development,<br />
both user tools and those more appropriate to programmers and web experts. They are also<br />
more likely to work in partnership with an e-learning vendor. The remaining sources for e-<br />
learning show little change with maturity or with any other segmentation.<br />
The responses to the sources of e-learning were analysed to identify the percentage of<br />
respondents who selected in-house production, either of the 2 options, and no other option.<br />
Fifteen percent of respondents fell into this category, somewhat less than indicated that they<br />
did not use external suppliers.<br />
Amongst the other options mentioned by respondents included: searching the Internet for<br />
the best deal, developing with internal learning designers in partnership with internal IT and in<br />
partnership with specialist instruction design companies who are not e-learning development<br />
companies.<br />
<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 50
3 People and organisational capability<br />
3.7 Expectation clients have of vendors<br />
Respondents were asked to rate a number of features they would expect to see in a<br />
prospective e-learning vendor, irrespective of whether they used one or not. The list of<br />
attributes offered is shown in Figure 3.14.<br />
Respondents have an option of grading each attribute as vital, important, useful or not<br />
relevant. Value for money, expertise and proven reliability are top of the list. It is also<br />
apparent that respondents expected to be able to shop around a number of e-learning<br />
vendors, as a one-stop shop is of least importance. It is worth reflecting that 20% of<br />
respondents regard as vital that suppliers are knowledgeable, innovative, suitable as longterm<br />
partners and provide reliable after-sales support; clients in this market are demanding.<br />
Figure 3.14 Important qualities organisations are looking for from their supplier<br />
Value for money<br />
The expertise to build exactly the e-learning that we need<br />
Prov en reliability<br />
A source of advice with good knowledge of the industry<br />
Innovation<br />
Suitability as a long term partner<br />
Product/system after-sales support and training<br />
A wide range of quality products and content<br />
Experience of needs analysis and can offer wide range of<br />
training solutions<br />
A one stop shop for all our learning needs irrespective of<br />
media<br />
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%<br />
Vital Important Useful Not relevant<br />
Ref: This graph appears as Figure 27 in <strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers<br />
3.8 Characteristics of the marketplace<br />
Respondents were asked to select the suppliers they used. There was a named list of 18<br />
suppliers, all of whom had agreed to distribute the survey to their customers. In addition<br />
respondents were able to add the names of additional suppliers who were not on this list.<br />
A total of 139 suppliers were mentioned by 116 respondents. The majority of these suppliers<br />
were mentioned by only one respondent. Only 5 of the suppliers mentioned could claim 15<br />
or more of the 116 respondents who use external suppliers.<br />
<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 51
3 People and organisational capability<br />
Figure 3.15 Percentage of suppliers selected by respondents<br />
Mentioned by only 1 respondent<br />
by 2<br />
by 3 to 5<br />
by 5 to 10<br />
by 10 to 15<br />
by 15 or more<br />
0% 10% 20% 30% 40% 50% 60% 70%<br />
This is an indication of the nature of the market, there being only a very few large firms but a<br />
large number of very small firms, many of whom may have less than a dozen customers. The<br />
description applied to the e-learning supply market is that it is a cottage industry and this is<br />
borne out by the findings of the report.<br />
<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 52
4 e-learning delivery<br />
4 e-learning – technology, software and topics delivered<br />
Overview: This chapter looks at the range of topics covered, the e-learning services<br />
available, including learner support, and the technologies and software used. We look at<br />
both current delivery and plans for the next 3 years.<br />
4.1 Topics covered<br />
Respondents were asked which type of training employees had undertaken in the last 12<br />
months, divided into key skills, operational skills and general skills. For each topic area<br />
respondents were offered 4 options: the organisation does not offer the topic, the topic is<br />
offered but without using e-learning, the topic is offered with some component of e-learning<br />
or the topic is offered by e-learning alone. The only topics not offered by more than half of<br />
respondents are foreign language, literacy and numeracy. By comparison of the 2 sets of<br />
figures we can indicate the likelihood of a particular topic being delivered by e-learning.<br />
Figure 4.1 Range of topics offered by organisations<br />
Leadership and management<br />
Induction<br />
Health and Safety<br />
Communication<br />
Teamworking<br />
Technical (non IT)<br />
General IT skills<br />
Company specific<br />
Industry specific<br />
Customer handling/service<br />
IT professional<br />
Equality and diversity<br />
Problem solving<br />
Office admin<br />
Sales and marketing<br />
Foreign language<br />
Literacy<br />
Numeracy<br />
0% 20% 40% 60% 80% 100%<br />
Offered by organisations<br />
Offered with e-learning component<br />
Ref: See also Figure 29 in <strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers<br />
<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 53
4 e-learning delivery<br />
As expected general IT skills heads the list, with an 80% probability of an organisation offering<br />
this with some e-learning component. There is a relatively high probability of e-learning<br />
being used for both company specific and industry specific training; topics unlikely to be<br />
offered through generic skills packages. The relatively high probability that numeracy and<br />
literacy are offered with an e-learning component, results from the low probability of<br />
organisations offering any learning in these topics.<br />
Table 4.1 Likelihood of skills being delivered by e-learning<br />
Skills area<br />
Percentage of<br />
respondents<br />
General IT skills 79%<br />
IT professional 70%<br />
Company specific 63%<br />
Industry specific 61%<br />
Numeracy 59%<br />
Induction 53%<br />
Literacy 53%<br />
Office admin 51%<br />
Communication 51%<br />
Health and Safety 51%<br />
Technical (non IT) 51%<br />
Equality and diversity 49%<br />
Sales and marketing 48%<br />
Foreign language 48%<br />
Customer handling/service 45%<br />
Problem solving 45%<br />
Leadership and management 45%<br />
Team working 35%<br />
The probability of topics being offered is analysed by sector in Table 4.2. A study of these<br />
percentages indicates that the education sector is least likely to offer training in any of the<br />
topics listed. Not surprisingly the topics in which they do lead the field are those in literacy<br />
and numeracy, but for both topics approximately half of respondents in the education<br />
sector provide learning in these topics. Similar tables have been calculated for organisations<br />
providing the topics via e-learning and e-learning alone. The number of organisations who<br />
selected this option (e-learning alone) was extremely small. Of the total number of possible<br />
responses in where a topic is offered there are only 5% of responses for e-learning alone. This<br />
shows no particular pattern by topic, maturity, business or staff impact. However, it is no<br />
<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 54
4 e-learning delivery<br />
surprise that the IT and telecommunications sector was the one most likely to use e-learning<br />
alone and the topics most likely to be delivered by e-learning alone were general IT skills,<br />
company specific training, industry specific skills and equality and diversity. The very low<br />
number of responses in this category indicate that almost every user prefers to use e-learning<br />
as a component within a training programme, rather than for the totality of the delivery of a<br />
particular topic. Most of the analysis in this paper, therefore, concentrates on the use of e-<br />
learning irrespective of whether it is on its own or a component within a training topic offered<br />
by an organisation.<br />
Table 4.2 Percentage of organisations offering skills by sector<br />
Manufacturing<br />
Transport<br />
Financial<br />
Business Activities<br />
Public sector<br />
Education<br />
Health<br />
IT / Telecoms<br />
Others<br />
Leadership & Management 93% 100% 100% 100% 97% 87% 94% 94% 88%<br />
Induction 93% 100% 100% 100% 100% 83% 94% 94% 86%<br />
Health & safety 100% 100% 95% 100% 100% 77% 88% 75% 86%<br />
Communication skills 93% 100% 100% 92% 90% 70% 82% 75% 83%<br />
Team working 93% 100% 100% 92% 83% 77% 76% 75% 79%<br />
Technical or practical skills<br />
(non-IT) 93% 88% 85% 100% 83% 77% 82% 88% 83%<br />
General IT user skills 93% 100% 90% 100% 100% 63% 82% 81% 71%<br />
Industry specific 93% 81% 95% 100% 76% 53% 94% 88% 90%<br />
Company specific (not<br />
included above) 79% 88% 100% 83% 86% 67% 82% 88% 86%<br />
Customer handling/service 86% 81% 90% 83% 90% 67% 76% 75% 76%<br />
IT professional skills 79% 94% 85% 75% 90% 67% 59% 94% 79%<br />
Equality and diversity 86% 81% 80% 83% 97% 70% 94% 56% 48%<br />
Problem solving 86% 100% 90% 75% 72% 67% 59% 75% 64%<br />
Office/admin skills 86% 50% 80% 75% 86% 73% 71% 63% 71%<br />
Sales and marketing 93% 81% 95% 67% 28% 57% 29% 100% 62%<br />
Foreign language skills 57% 63% 55% 50% 31% 30% 12% 44% 38%<br />
Literacy 21% 44% 20% 25% 48% 37% 41% 13% 40%<br />
Numeracy 29% 38% 10% 8% 48% 37% 35% 13% 43%<br />
<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 55
4 e-learning delivery<br />
Table 4.3 shows the breakdown of organisations offering specific topics by sector. Sectors<br />
with only a few respondents have been included in the column labelled ‘Others’. One or 2<br />
sectors stand out as doing something different. The IT and Telecommunication sector, for<br />
example, does more induction training and sales and marketing training using e-learning<br />
than other sectors. The financial sector does more company-specific training and health<br />
and safety training using an e-learning component. The sector most likely to use an e-<br />
learning component is the financial sector, whereas other sectors have a more or less even<br />
chance of e-learning being a component in a programme.<br />
Table 4.3 Percentage in each sector who use e-learning for each skills area<br />
Manufacturing<br />
Transport<br />
Financial<br />
Business Activities<br />
Public sector<br />
Education<br />
Health<br />
IT / Telecoms<br />
Others<br />
Leadership & Management 36% 44% 55% 25% 55% 37% 29% 44% 33%<br />
Induction 50% 50% 70% 42% 48% 37% 41% 81% 48%<br />
Health & safety 57% 38% 80% 25% 41% 40% 35% 56% 48%<br />
Communication skills 29% 50% 45% 42% 52% 47% 29% 50% 43%<br />
Team working 29% 44% 45% 8% 31% 23% 18% 44% 17%<br />
Technical or practical skills<br />
(non-IT) 43% 38% 60% 75% 34% 30% 24% 81% 24%<br />
General IT user skills 71% 81% 75% 58% 93% 47% 65% 63% 55%<br />
Industry specific 64% 50% 80% 67% 31% 33% 59% 63% 43%<br />
Company specific<br />
(not included above) 36% 63% 90% 50% 48% 37% 47% 69% 33%<br />
Customer handling/service 36% 38% 65% 17% 41% 20% 24% 56% 29%<br />
IT professional skills 64% 56% 65% 50% 69% 50% 35% 75% 40%<br />
Equality and diversity 21% 38% 65% 25% 48% 33% 35% 31% 29%<br />
Problem solving 36% 63% 40% 33% 31% 30% 18% 44% 14%<br />
Office/admin skills 50% 19% 45% 33% 38% 40% 18% 56% 36%<br />
Sales and marketing 43% 38% 50% 8% 7% 33% 12% 75% 31%<br />
Foreign language skills 14% 19% 25% 17% 17% 23% 6% 31% 14%<br />
Literacy 7% 31% 10% 17% 21% 17% 18% 13% 29%<br />
Numeracy 7% 31% 10% 8% 21% 23% 18% 13% 29%<br />
<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 56
4 e-learning delivery<br />
Selection of topics in which an e-learning component was included was also analysed<br />
according to the e-learning maturity of the respondent as shown in Table 4.4.<br />
Table 4.4 Respondents offering topics with an e-learning component<br />
Novices<br />
Sporadic<br />
users<br />
Developing<br />
Users<br />
Established<br />
Users<br />
Embedded<br />
Users<br />
Innovators<br />
Literacy 0% 20% 18% 31% 10% 11%<br />
Numeracy 29% 23% 15% 28% 20% 11%<br />
General IT user skills 17% 51% 74% 84% 100% 56%<br />
Communication skills 33% 17% 42% 69% 50% 56%<br />
Team working 17% 3% 26% 53% 60% 33%<br />
Problem solving 0% 6% 29% 56% 80% 44%<br />
Induction 14% 31% 40% 66% 90% 74%<br />
Leadership & Management 0% 14% 29% 66% 80% 70%<br />
Customer handling/service 14% 9% 34% 66% 50% 41%<br />
Sales and marketing 29% 6% 24% 53% 60% 48%<br />
Office/admin skills 14% 23% 31% 56% 70% 44%<br />
Technical or practical skills (non-IT) 0% 26% 32% 56% 90% 67%<br />
IT professional skills 14% 37% 58% 66% 100% 63%<br />
Industry specific 29% 40% 35% 72% 90% 67%<br />
Company specific<br />
(not included above) 0% 26% 39% 78% 100% 78%<br />
Foreign language skills 0% 14% 18% 22% 50% 19%<br />
Equality and diversity 0% 26% 29% 56% 60% 52%<br />
Health & safety 29% 14% 45% 75% 70% 52%<br />
<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 57
4 e-learning delivery<br />
The probability of topics being offered with an e-learning component when compared by<br />
maturity shows 4 distinct patterns.<br />
a) IT skills show an adoption pattern that rises rapidly in the early stages of maturity. It<br />
can be seen that for developing users 74% use e-learning for general IT skills and 58%<br />
for professional IT skills.<br />
b) 1. Topics increasing with maturity (communication skills, induction, leadership and<br />
management skills, health and safety, office and administration skills and non-IT,<br />
technical or practical skills) and<br />
2. Topics increasing with maturity which are little used by novices (team-working,<br />
problem solving, customer handling or service skills, sales and marketing skills,,<br />
foreign language skills and equality and diversity training). For the topics in both<br />
this list and the previous one we can expect companies to use e-learning<br />
increasingly as a component within these topics as they increase in maturity.<br />
c) For industry and company specific skills, thee-quarters of the more mature<br />
organisations using e-learning components in these topics, rising from a third for those<br />
organisations which are not amongst the most mature.<br />
d) Two topics, literacy and numeracy, show no consistent change with the maturity of<br />
the organisations delivering them.<br />
Figure 4.2 plots the average of the averages for the groups listed above and therefore is only<br />
indicative of the changes.<br />
Figure 4.2 Adoption patterns by topics as organisations become more mature<br />
80%<br />
70%<br />
60%<br />
50%<br />
40%<br />
30%<br />
20%<br />
10%<br />
0%<br />
Less Mature Becoming Mature More Mature<br />
IT skills<br />
Industry specific<br />
Topics increasing with maturity<br />
Topics increasing with maturity little used by novices<br />
Topics independent of maturity<br />
<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 58
4 e-learning delivery<br />
For those organisations that wish to develop in maturity and e-learning, IT skills are a good<br />
starting point.<br />
The adoption curve for literacy and numeracy may be influenced by the availability of free<br />
courses through learndirect. Nineteen percent of all respondents state that they deliver<br />
these programmes. Of those respondents who selected learndirect as a supplier this rises to<br />
53%. However, of all those respondents who deliver literacy and numeracy programmes with<br />
an e-learning component, only 25% indicated that learndirect is a supplier. This indicates<br />
that respondents are obtaining this material from other suppliers, or alternatively are not<br />
aware that their supplier was using learndirect material.<br />
Overall we can see that early on in an adopting e-learning user organisations rely on e-<br />
learning using IT skills and then switch to other topics as they gain confidence. It is also clear<br />
that industry-specific e-learning becomes as important as the delivery of IT skills once<br />
organisations have gained the confidence that comes with maturity.<br />
There are few differences seen when the survey results are analysed by geographic location.<br />
Sixty percent of global companies provide foreign language training compared to an<br />
average 30% for all other companies; a blinding glimpse of the obvious perhaps. Global<br />
companies also supply less literacy and numeracy programmes, approximately 25%,<br />
compared to 35% of other organisations. Two other possible areas of difference emerge:<br />
that of industry-specific and company-specific training. For both these topics global<br />
companies and those on a UK site, approximately 80% of those respondents who deliver<br />
those training programmes do so with a component of e-learning; for companies in the other<br />
2 geographic segments this drops to approximately 55%. Companies with many branch<br />
locations are also more likely to use e-learning for equality and diversity; 80% of those who<br />
deliver these programmes are likely to use e-learning as opposed to approximately 50% for<br />
companies in the other geographic segments. Global companies and those in many<br />
branch locations are also more likely to deliver induction programmes via e-learning, 60% as<br />
opposed to 50% for companies with either a single UK site or only a few sites (Figure 4.3).<br />
Companies with many branch locations are less likely to use e-learning for sales and<br />
marketing training, 33% of companies in these segments as opposed to approximately 50%<br />
for other companies. Several of these differences may be based on logistics, induction<br />
training is clearly popular for those organisations with many dispersed locations and possibly<br />
availability of generic e-learning material. The fact that companies in all geographic<br />
segments are equally likely to deliver health and safety with an e-learning component but an<br />
increased penetration of equality and diversity training via e-learning is only apparent for<br />
those with dispersed UK operations.<br />
4.2 Topics learners are interested in<br />
Learners were asked which topics they studied using technology. The question asked “have<br />
you used technology (on-line courses, CDs or other technology learning tools) in any of your<br />
formal training in the past 12 months”? For each topic respondents were offered 2 choices:<br />
yes – in work or arranged by your employer, or yes – outside of work. The assumption in this<br />
latter case is that positive responses to this option indicate that respondents will have<br />
completed such learning either at their own expense, as part of a funded educational<br />
programme not sponsored by their employer, or as part of a voluntary activity. We know<br />
that a significant number of charities for example do provide e-learning to volunteers.<br />
<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 59
4 e-learning delivery<br />
Figure 4.3 The range of topics studied by learners<br />
Technical or practical skills<br />
Health & safety<br />
Company specific (not included above)<br />
Communication skills<br />
General IT user skills<br />
Management skills<br />
Equality and diversity<br />
Industry specific compliance<br />
Team working<br />
IT professional skills<br />
Customer handling/service<br />
Induction<br />
Problem solving<br />
Office/admin skills<br />
Sales and marketing<br />
Basic skills training (literacy/numeracy)<br />
Other (please specify)<br />
Foreign language skills<br />
0 100 200 300 400 500 600<br />
n=1183<br />
Arranged by employer<br />
Outside work<br />
Ref: This graph appears as Figure 30 from <strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers<br />
Table 4.5 Provision and usage of e-learning programmes<br />
Programme areas Provided by % of employers Used by % of employees<br />
Technical or practical skills 49% 54%<br />
Health & safety 34% 37%<br />
Company specific 33% 34%<br />
Communication skills 30% 36%<br />
General IT user skills 28% 35%<br />
Management skills 25% 31%<br />
Ref: This table appears as Table 3 from <strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers<br />
Table 4.5 compares the percentage of employees studying particular subjects with a<br />
percentage of employers offering that subject, although this must be viewed with some<br />
caution. The employee respondents came from 14 of the companies who responded in<br />
stage 1 of the survey. Ninety-nine percent of the employee respondents were confident<br />
computer users, whereas for 20% of the employer respondents less than half of their<br />
workforce used computers regularly. What is interesting to note is the extent to which<br />
<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 60
4 e-learning delivery<br />
employees are using e-learning in some form to find out about topics of direct relevance to<br />
work, technical practical skills for example. We might expect learners to be interested in<br />
transferable skills such as those of communication, general IT and team working. This only<br />
seems to be the case for foreign language skills. The fact that a significant amount of foreign<br />
language skills are acquired using e-learning outside work is no surprise. The market for<br />
foreign language training has, for a long time, used various forms of technology.<br />
The number of respondents who state that they do use e-learning outside of work is an<br />
indication of the extent to which e-learning has become available in what might be<br />
described as the retail learning market.<br />
4.3 Programmes offered<br />
Employer respondents were asked to select programmes from the list provided. These<br />
included programmes for individuals outside their direct workforce. Figure 4.4 shows the<br />
percentage of organisations stating that they offered programmes and those that offer<br />
programmes with an e-learning component<br />
Figure 4.4 Programmes offered by organisations<br />
Industry certification<br />
Learning for customers<br />
Professional body qualification<br />
Basic skills<br />
Learning for suppliers<br />
N/SVQ<br />
Community or CSR<br />
Foundation Degree<br />
Employee family and friends<br />
Apprenticeship<br />
0% 20% 40% 60% 80% 100%<br />
n=173<br />
Offered with no e-learning component<br />
Offered with e-learning component<br />
Ref: This graph appears as Figure 31 in <strong>Towards</strong> maturity: Insights for Employers and Training providers<br />
The occurrence of the use of e-learning on its own was extremely infrequent. The highest<br />
percentage occurrence is for basic skills where 4% of respondents indicated that they<br />
provided this via e-learning alone. The majority of respondents in this 4% did not select<br />
learndirect as a supplier and would not have been making use of the basic skills programme<br />
that is funded through learndirect. We can see that the penetration of e-learning remains<br />
low for programmes many of which are designed to lead to qualifications.<br />
<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 61
4 e-learning delivery<br />
Table 4.6 shows the percentage of respondents offering training to support these<br />
programmes by sector.<br />
Table 4.6 Work-based programmes offered<br />
Manufacturing<br />
Transport<br />
Financial<br />
Business Activities<br />
Public sector<br />
Education<br />
Health<br />
IT and Telecoms<br />
Others<br />
Industry recognised<br />
certificate/qualification 67% 76% 78% 76% 88% 73% 75% 55% 62%<br />
Learning for our customers 60% 62% 50% 71% 47% 73% 50% 65% 57%<br />
Professional body training 50% 56% 70% 75% 55% 43% 41% 38% 57%<br />
N/SVQ 53% 67% 26% 47% 62% 49% 65% 25% 48%<br />
Basic skills/Skills for Life 60% 43% 35% 47% 56% 59% 50% 40% 48%<br />
Community or CSR<br />
programmes 60% 57% 52% 47% 32% 39% 30% 40% 33%<br />
Apprenticeship 53% 71% 17% 29% 41% 41% 25% 35% 57%<br />
Learning for our suppliers 53% 57% 30% 47% 21% 41% 20% 50% 33%<br />
Foundation Degree 47% 43% 30% 29% 44% 51% 35% 30% 19%<br />
Employee friends and family<br />
programmes 53% 48% 22% 41% 32% 37% 15% 25% 29%<br />
N= 15 21 23 17 34 41 20 20 21<br />
The demand for industry-recognised qualifications is led by the public sector closely followed<br />
by transport, finance and business activities. We know that compliance training is more<br />
important for the finance sector, which may explain the high percentage of programmes in<br />
this sector seeking industry recognised certificates. E-learning is frequently used for IT<br />
professional skills but about half of organisations in the It and telecommunications sector<br />
include an e-learning component within industry recognised qualifications. It would appear<br />
that the IT and telecommunications industry uses e-learning for individuals to acquire specific<br />
job-related skills rather than a coherent qualification programme. Differences between the<br />
education sector and others are reported elsewhere. Apart from learning for customers and<br />
industry recognised qualifications the use of e-learning in the education sector to support<br />
programmes is on a par with or behind many other sectors. We can expect the<br />
manufacturing sector to lead on apprenticeship training in general and the 2 sectors that<br />
use e-learning most for apprenticeships are manufacturing and transport; the 2 sectors most<br />
likely to offer training to apprentices are manufacturing and transport.<br />
<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 62
4 e-learning delivery<br />
The following table shows the penetration of e-learning by programme and sector. This is<br />
calculated from the percentage of respondents who offer a programme and the<br />
percentage who offer that programme with an e-learning component.<br />
Table 4.7 Penetration of an e-learning component into work-based programmes<br />
Manufacturing<br />
Transport<br />
Financial<br />
Business Activities<br />
Public sector<br />
Education<br />
Health<br />
IT and Telecoms<br />
Others<br />
Professional body training 32% 41% 64% 33% 27% 32% 39% 23% 42%<br />
Industry recognised<br />
certificate/qualification 33% 31% 100% 25% 69% 37% 40% 39% 50%<br />
Basic skills/Skills for Life 67% 34% 6% 0% 27% 45% 49% 13% 17%<br />
N/SVQ 25% 21% 50% 0% 14% 20% 8% 0% 30%<br />
Apprenticeship 22% 33% 0% 0% 0% 17% 10% 13% 30%<br />
Foundation Degree 22% 8% 17% 0% 18% 44% 17% 25% 0%<br />
Learning for our suppliers 50% 20% 25% 0% 7% 18% 0% 71% 17%<br />
Learning for our customers 63% 17% 71% 38% 97% 88% 25% 70% 86%<br />
Employee friends and family<br />
programmes 43% 33% 14% 0% 7% 14.3% 0% 17% 25%<br />
Community or CSR<br />
programmes 38% 10% 80% 0% 27% 20% 67% 20% 17%<br />
All the industry recognised qualification programmes in the finance sector use e-learning. A<br />
pattern that emerges is that learning for customers tends to use a greater proportion of e-<br />
learning than other programmes. Undoubtedly this is because such programmes are cheap<br />
to deliver at the point of use and once the initial investment is completed there are no<br />
additional costs incurred dependent upon the number of users. Although the question was<br />
not asked, it clearly makes sense for organisations to offer such learning free at point of use.<br />
The business activities sector is least likely to use e-learning for programmes and only does so<br />
for professional body training, industry qualification and customer programmes. Even here<br />
the penetration is approximately one-third. Almost all the training the public sector provides<br />
for its customers is delivered through e-learning. The sector that is most likely to use e-<br />
learning in its programmes is the manufacturing sector. Appendix B describes the nature of<br />
the respondents comprising this sector in this study. Many of them were pharmaceuticals<br />
and thus not representative of the manufacturing sector at large. The above differences are<br />
all relatively small given the small number of respondents in each sector.<br />
Table 4.8 explores the percentage of respondents offering topics with an e-learning<br />
component by e-learning maturity. Given the segmentation based upon the question in the<br />
survey it is difficult to see patterns emerging.<br />
<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 63
4 e-learning delivery<br />
Table 4.8 Respondents offering skills with an e-learning component<br />
Novices<br />
Sporadic<br />
users<br />
Developing<br />
Users<br />
Established<br />
Users<br />
Embedded<br />
Users<br />
Innovators<br />
Professional body training 0% 26% 21% 31% 50% 33%<br />
Industry recognised<br />
certificate/qualification 29% 26% 27% 56% 50% 30%<br />
Basic skills/Skills for Life 0% 23% 18% 19% 20% 11%<br />
N/SVQ 33% 17% 42% 69% 50% 56%<br />
Apprenticeship 29% 11% 3% 13% 10% 4%<br />
Foundation Degree 0% 6% 5% 16% 20% 19%<br />
Learning for our suppliers 0% 0% 8% 22% 40% 11%<br />
Learning for our customers 29% 17% 26% 38% 50% 41%<br />
Employee friends and family<br />
programmes 0% 9% 6% 13% 10% 4%<br />
Community or CSR programmes 0% 11% 10% 16% 0% 11%<br />
If we collapse the segments slightly into the less mature, becoming mature and more mature<br />
and categories the programmes into types then a much clearer trend emerges. The original<br />
10 programmes offered have been reduced to a group of 6 in Figure 4.5. Job related<br />
qualifications include professional body training and industry recognised qualifications.<br />
These only increase penetration of delivery with the most mature organisations, similar to the<br />
growth of industry and company specific topics. The wider community learning programme<br />
(includes friends and family of employees), and introductory qualifications (includes<br />
apprenticeships and foundation degrees) change little with maturity.<br />
The probability of organisations offering basic skills programmes with an e-learning<br />
component is independent of the maturity of the organisation. Two programmes do stand<br />
out which are increasingly more likely to be delivered by more mature organisations. As<br />
organisations mature there is a significant increase in the probability of delivering Vocational<br />
Qualifications with an e-learning component. Traditionally, because of the requirements for<br />
assessment and workplace monitoring, these programmes are relatively expensive for<br />
employers to deliver. The benefits of administration may be the driving force behind the<br />
increased probability of these programmes using e-learning as organisations become more<br />
confident and mature about how e-learning should be deployed. The other growth area<br />
with maturity is providing learning for suppliers. As companies become more confident in<br />
their use of e-learning they may realise that, because delivery costs are effectively zero, it<br />
requires no additional investment from them to provide their employee programmes to their<br />
suppliers. By doing this they are able to enhance the quality of the supply chain.<br />
<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 64
4 e-learning delivery<br />
Figure 4.5 Programmes offered with an e-learning component<br />
0.7<br />
0.6<br />
0.5<br />
0.4<br />
0.3<br />
0.2<br />
0.1<br />
0<br />
Less mature N= 41 Becoming mature N = 62 More mature n = 69<br />
Job related qualifications<br />
Introductory qualifications<br />
N/SVQ<br />
Wider community learning<br />
Basic skills/Skills for Life<br />
Learning for our suppliers<br />
Respondents are also segmented by geographic location to see if that has any impact on<br />
the probability of e-learning being used in any particular programme as shown in Table 4.9<br />
below. Companies with a few sites are more likely to use e-learning within apprentice and<br />
foundation degree programmes, but even here the penetration is about a quarter and<br />
about 10% of companies overall. Neither globalisation nor a dispersed branch operation<br />
significantly increases the probability of e-learning being used in any qualification<br />
programme. Indeed for Vocational Qualifications the probability of these programmes using<br />
e-learning, globally or in branch locations, is less than for those companies who operate from<br />
a few UK sites.<br />
Table 4.9 Penetration of e-learning<br />
Worldwide A few sites Single UK site<br />
Many branch<br />
locations<br />
Professional body training 50% 53% 46% 52%<br />
Industry recognised<br />
certificate/qualification 38% 39% 41% 32%<br />
Basic skills/Skills for Life 21% 30% 32% 39%<br />
N/SVQ 15% 23% 13% 19%<br />
Apprenticeship 17% 23% 18% 6%<br />
Foundation Degree 14% 29% 27% 18%<br />
<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 65
4 e-learning delivery<br />
Worldwide A few sites Single UK site<br />
Many branch<br />
locations<br />
Learning for our suppliers 26% 21% 27% 18%<br />
Learning for our customers 43% 39% 44% 36%<br />
Employee friends and family<br />
programmes 21% 12% 33% 10%<br />
Community/CSR programmes 17% 32% 18% 18%<br />
262% 300% 299% 248%<br />
4.4 Services provided to learners<br />
Respondents were asked to select from a list of both formal and informal learning services<br />
that they provided. The list of formal offers is shown in Figure 4.6<br />
Figure 4.6 Types of formal online services offered<br />
Electronic learning materials<br />
Assessment<br />
Adminstration<br />
Collaboration between learners<br />
Competency management<br />
E-tutor support<br />
Evaluation of business impact<br />
0% 20% 40% 60% 80% 100%<br />
Is used now Is planned by 2010<br />
Ninety percent of respondents report using electronic learning materials. For many users e-<br />
learning is defined as the delivery of content and therefore this is no surprise. We deliberately<br />
chose a wide definition of e-learning, particularly to explore the future use of on-line facilities.<br />
This approach is justified by the significant number of respondents who are using e-learning<br />
for learning services other than the delivery of electronic learning material. The pattern of<br />
learning services provided might be expected to change with maturity and more mature<br />
organisations do deliver a wider range of learning services on-line as shown in Figure 4.7.<br />
<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 66
4 e-learning delivery<br />
Figure 4.7 Formal online services offered changes with maturity<br />
100%<br />
80%<br />
60%<br />
40%<br />
20%<br />
0%<br />
Innovators<br />
Embedded<br />
Users<br />
Established<br />
Users<br />
Developing<br />
Users<br />
Sporadic<br />
users<br />
Novices<br />
Competency management<br />
E-tutors<br />
Collaboration between learners<br />
Adminstration<br />
Assessment<br />
Business evaluation<br />
Every learning service included in the survey question is more likely to be delivered by more<br />
mature organisations. The delivery of electronic learning materials is not shown here as this<br />
changes little with maturity. The average response rate between novices and sporadic users,<br />
for example, is 80% and it remains between 80% and 95% for all segments of maturity. The<br />
service reported in the figure above show similar growth rates with maturity but different<br />
probabilities of being used; on-line business evaluation being least likely and administration<br />
services most likely.<br />
Respondents were also offered a selection of 4 informal learning services (Figure 4.8).<br />
> Communities of practice/mentoring/coaching.<br />
> On-line access to company expertise.<br />
> Simplify access to relevant on-line resources (e.g. through improved search engines).<br />
> On-line books/job aids.<br />
A later question asked respondents how they supported learners after learning back in the<br />
workplace. This included a response for on-line job aids. Only 17% of respondents selected<br />
that option in that part of the survey. It is therefore highly probable that the 64% selecting<br />
on-line books/job aids are in fact referring to on-line books rather than job aids. If that is the<br />
case this high percentage indicates a growth in e-books and the delivery of text<br />
electronically perhaps through portable document formats. The 2 informal services most<br />
likely to be offered, on-line books and search portals, are both designed to enable learners<br />
to find things out for themselves from a large source of information made available to them.<br />
<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 67
4 e-learning delivery<br />
Figure 4.8 Types of informal online services offered<br />
Online books<br />
Search Portals<br />
Online company experts<br />
On-line communities<br />
0% 10% 20% 30% 40% 50% 60% 70% 80%<br />
Is used now Is planned by 2010<br />
Personal contact through email to experts or through on-line communities is slightly less likely<br />
to be offered although still by more than 40% of respondents. The probability of these<br />
services being offered is compared by grouping maturity segments as shown in Figure 4.9.<br />
There is a clear increase in the probability of informal services being offered with maturity.<br />
Figure 4.9 Use of informal techniques increases with maturity<br />
100%<br />
80%<br />
60%<br />
40%<br />
20%<br />
0%<br />
Less mature Becoming mature More mature<br />
Search portals<br />
On-line communities<br />
Online company experts<br />
Online books<br />
See also Figure 33 <strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers<br />
As more organisations become more mature we can expect a significant growth in these<br />
types of services. Based on a comparison of maturity versus experience (Chapter 1) we<br />
might expect organisations to move from less mature to more mature within 3 to 5 years. The<br />
future of informal learning and forecasts for the tools that will support it are discussed in more<br />
detail in Chapter 9. However we see technology supported social learning will represent an<br />
increasingly important part of learning provision in organisations over the next 3 years.<br />
<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 68
6 IT capability<br />
5 Take-up of software tools in support of e-learning<br />
Overview: This chapter explores the range of learning technologies used in support of e-<br />
learning and looks at the trends emerging with e-learning maturity.<br />
Respondents were asked a number of questions relating to the technology they use as listed<br />
in Figure 5.1. They were asked how many they were using, or planning to use in the next 3<br />
years. Respondents were offered 4 choices; I’m not familiar with this term, this is not used<br />
here, this is used in some programmes, this is used in most programmes, this will be used in 3<br />
years’ time.<br />
Figure 5.1 Current and planned use of learning technologies<br />
Learning Management System (LMS)<br />
63%<br />
17%<br />
Video conferencing<br />
Content Management Systems<br />
Games/simulations/intray excercises<br />
45%<br />
46%<br />
52%<br />
6%<br />
15%<br />
8%<br />
Virtual classroom<br />
Unmoderated chat rooms/discussion groups<br />
Moderated chat rooms/ discussion groups<br />
36%<br />
32%<br />
38%<br />
17%<br />
13%<br />
14%<br />
Competency Management System<br />
23%<br />
19%<br />
Open source e-learning tools<br />
Rapid application development tools<br />
33%<br />
32%<br />
6%<br />
6%<br />
Mobile learning<br />
Blogs/wikis<br />
Electronic Performance Support Systems<br />
Podcasting<br />
e-portfolios<br />
Video on demand<br />
22%<br />
19%<br />
20%<br />
13%<br />
23%<br />
15%<br />
15%<br />
15%<br />
12%<br />
17%<br />
6%<br />
14%<br />
n=164<br />
0% 20% 40% 60% 80%<br />
Currently in use<br />
Planned within 3 years<br />
Ref: This graph appears as Figure 54 in <strong>Towards</strong> <strong>Maturity</strong>: insights for Employers and training Providers<br />
5.1 Technologies used to support e-learning<br />
Figure 5.1 shows the technologies in the order most likely to be used. In the majority of cases<br />
only 3% or 4% of respondents selected the “I am not familiar” box for the technologies listed.<br />
Exceptions were, competency management systems (14%), open source e-learning tools<br />
(16%), rapid application development tools (18%), electronic performance support systems<br />
(24%) and e-portfolios (26%). The concept of electronic performance support systems or<br />
<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 69
5 Learning technologies<br />
tools is more than 20 years’ old and the high percentage not familiar with the term indicates<br />
that this is a style of application that is likely to be of less interest to most people; certainly<br />
one that is not talked about in literature to any significant extent. By contrast on-line books or<br />
job aids are known about by 98%. It would appear that the simpler electronic job aid is likely<br />
to be more popular than EPSS.<br />
Respondents are asked about study support and helping learners consolidate their learning;<br />
in these questions they were asked if they used electronic help and job aids (17%) and online<br />
web reference materials (27%). These latter figures are more in line with the 20% of<br />
respondents who currently use EPSS. On the other hand both rapid application and open<br />
source tools are relatively new and have reached a stage where approximately 4 out of 5<br />
respondents were familiar with these terms. It is less of a surprise that only 4 out of 5<br />
understand the term Competency Management System. Although this has been available<br />
as a concept for 15 years it is perhaps more the province of HR managers than learning and<br />
development managers. Competency management does show one of the largest growth<br />
rates in comparison to its current usage. Almost as many respondents will plan to implement<br />
competency management by 2010 as are currently using it.<br />
The high percentage of users who are not aware of e-portfolios and the low probability of<br />
them being used is disappointing bearing in mind the importance these are likely to assume<br />
in the education system. Only 3 out of 4 respondents recognise the term and of those only<br />
one-third actually deploy e-portfolios.<br />
The lead position occupied by Learning Management Systems is reflected in all the<br />
segmentation analysis used in this study and is perhaps related to the importance of<br />
administration and compliance reporting as drivers and benefits of e-learning. When<br />
structuring the questions the category labelled content management systems actually said<br />
“Content Management Systems (CMS, VLE)”. A Virtual Learning Environment (VLE) 3 has<br />
some similarities with a virtual classroom. Students are able to communicate synchronously<br />
or asynchronously with each other and with their tutors. Tutors can prepare and store<br />
content for access by students. This may be a category that respondents have interpreted in<br />
a variety of different ways. Differences have been noted between responses in the<br />
education sector and others; reported in more detail elsewhere. Unfortunately we cannot<br />
determine how many respondents considered this choice as a development tool or as a<br />
collaborative learning tool. If the latter this follows a pattern of collaborative learning tools<br />
being an area of expansion from a user base of approximately 25%. Collaborative tools are:<br />
video conferencing, virtual classroom, chat rooms (both moderated and unmoderated),<br />
blogs/wikis and virtual learning environments (content management systems). Collectively<br />
they are in the bottom half of the figure reported previously and least likely to be in use, or<br />
planned.<br />
3 Wikipedia: Components of these systems usually include templates for content pages, discussion forums, chat,<br />
quizzes and exercises such as multiple-choice, true/false and one-word-answer. Teachers fill in these templates and<br />
then release them for learners to use. New features in these systems include blogs and RSS. Services generally<br />
provided include access control, provision of e-learning content, communication tools, and administration of the<br />
user groups.<br />
<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 70
6 IT capability<br />
5.2 Impact of maturity on the use of software tools<br />
The various responses have been analysed in accordance with a number of other factors.<br />
Table 5.1 lists the responses by maturity segments.<br />
Table 5.1 Software tools used vary with maturity<br />
Novices<br />
Sporadic<br />
users<br />
Developing<br />
Users<br />
Established<br />
Users<br />
Embedded<br />
Users<br />
Innovators<br />
LMS 40% 65% 81% 97% 67% 92%<br />
Video conferencing 60% 47% 59% 58% 89% 73%<br />
CMS 0% 59% 52% 58% 78% 88%<br />
Chat - unmoderated 20% 38% 41% 48% 78% 88%<br />
Virtual classrooms 20% 38% 50% 52% 67% 73%<br />
Chat rooms- moderated 20% 35% 40% 55% 67% 81%<br />
Games 0% 38% 52% 55% 78% 69%<br />
Mobile learning 60% 26% 26% 32% 67% 65%<br />
Open source tools 20% 44% 28% 39% 56% 58%<br />
Wikis / blogs 40% 24% 31% 29% 56% 58%<br />
Competency management 0% 38% 36% 45% 67% 50%<br />
Video on demand 60% 18% 28% 16% 56% 50%<br />
Rapid development tools 0% 21% 29% 52% 44% 69%<br />
Pod casting 20% 21% 21% 32% 33% 62%<br />
EPSS 0% 21% 26% 42% 44% 50%<br />
E-portfolios 0% 26% 26% 16% 44% 58%<br />
N=163 5.00 34.00 58.00 31.00 9.00 26.00<br />
An increase in probability of use is shown in the table moving to more mature segments. The<br />
table shows the percentage of respondents in each segment who selected that particular<br />
technology to be one that they were currently using. All these technologies have been<br />
plotted against maturity. They are grouped as information and production tools, as delivery<br />
tools and as collaborative tools and plotted against 3 levels of maturity<br />
<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 71
5 Learning technologies<br />
Figure 5.2 Information and production tools<br />
100%<br />
80%<br />
60%<br />
40%<br />
20%<br />
0%<br />
Less Mature Becoming Mature More Mature<br />
LMS (17%) Competency management (19%)<br />
E-portfolios (6%) Rapid development tools (6%)<br />
Open source tools (6%)<br />
In Figure 5.2 the percentage of respondents who selected the option for planning to use the<br />
tool by 2010 is shown in brackets after the title of the software tool. This figure shows that in<br />
almost every case for information and production tools more mature respondents are more<br />
likely to use these tools; the exception being open source tools. A possible explanation is that<br />
less mature organisations select the use of open source tools as an inexpensive entry point to<br />
e-learning, to enable piloting and experimentation prior to a formal business case being<br />
established. For example, 44% of sporadic users selected this option. It is very clear that the<br />
availability of such open source tools provides an entry point for training functions in the<br />
absence of a strategy or business case.<br />
If we assume that it takes 2 to 3 years for organisations to move from being less mature to<br />
more mature then we can estimate the growth in the use of these tools by 2010 by<br />
comparing current use for organisations of different maturity. For example, 17% of<br />
respondents said that they will be implementing Learning Management Systems in the next 3<br />
years but the difference in market penetration dependent on maturity is 30%. With 91% of<br />
more mature users selecting LMS it is more likely that, for the less mature, there will be a<br />
growth rate nearer 30%. With more or less equal numbers in each category the estimate of<br />
future use balances with a prediction by maturity. The figure for rapid development tools,<br />
however, is likely to be different to the 6% reported in Figure 5.1. It is far more likely to assume<br />
a growth rate of 30 to 35% based on the comparison of the use of rapid development tools<br />
by maturity. Using the same estimating principle the growth rate in competency<br />
management tools of 19% is optimistic, as only 50% of more mature respondents use these<br />
products. With only a third of more mature organisations using e-portfolios then a growth<br />
rate of 6% seems reasonable. The prediction for the Government therefore is that by 2010<br />
only a third of companies will be adopting e-portfolios.<br />
<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 72
6 IT capability<br />
Figure 5.3 Delivery tools – change of use by maturity<br />
100%<br />
80%<br />
60%<br />
40%<br />
20%<br />
0%<br />
Less Mature Becoming Mature More Mature<br />
Mobile learning (15%) Video on demand (14%)<br />
Podcasting (17%) EPSS (12%)<br />
Games (6%)<br />
Figure 5.3 shows the change in use of a number of delivery tools; again in every case more<br />
mature users are more likely to be using these tools. A growth rate of 6% in the use of games<br />
is predicted from the overall question, however, there is a 30% difference between the<br />
probability of use by more mature and less mature organisations. Based on the data in this<br />
figure it seems more likely that the use of games/simulations/in-tray exercises will grow by<br />
15%. Although the shorthand title ‘Games’ has been used when reporting these results it is<br />
essential to understand that respondents were given a much wider definition. In addition the<br />
project has emphasised a very broad definition of e-learning. Therefore a management<br />
game played electronically between participants, based on in-tray exercises could have<br />
been included in a respondent’s answer reported here as ‘Games’. Some of the delivery<br />
tools listed here are still very early in their technological adoption curve. Pod casting and<br />
video on demand, for example, require both bandwidth and software infrastructure in place.<br />
Although changes in the domestic market will make these more widely available these<br />
technologies are likely to face significant corporate barriers.<br />
The same may be said of mobile learning, although the definition offered to respondents<br />
included both laptops and tablet PCs. Such platforms are already widely in use for learning<br />
and work. It is perhaps disappointing that only half of the more mature respondents said that<br />
they delivered mobile learning; although this is significantly greater than the 22% who said<br />
that they made e-learning available when travelling.<br />
Figure 5.4 lists the software and tools that enable collaborative working between learners.<br />
The CMS/VLE has been included in this list here. The older but established technology of<br />
video conferencing achieves the second highest penetration for more mature users. A fuller<br />
discussion of the possible growth in collaborative tools is left until a later chapter when the<br />
views of learners and their preferences have been considered.<br />
<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 73
5 Learning technologies<br />
Figure 5.4 Use of collaborative tools increases with maturity<br />
100%<br />
80%<br />
60%<br />
40%<br />
20%<br />
0%<br />
Less Mature Becoming Mature More Mature<br />
Video conferencing (8%) Chat - unmoderated (14%)<br />
Virtual classrooms (13%) Chat rooms- moderated (17%)<br />
Wikis / blogs (15%) CMS / VLE (15%)<br />
The likelihood of a respondent using one of these tools may be linked to the maturity of the<br />
tool itself. Video conferencing has been available for longest and wikis/blogs is the newest<br />
technology on this list. In general collaborative tools achieve a higher penetration in use with<br />
more mature users than all the other technologies, with the exception of Learning<br />
Management Systems.<br />
5.3 Differences due to geography and size<br />
Figure 5.5 plots major differences between the penetrations of specific technologies by<br />
geographic circumstances. Overall those with many branch or office locations are less likely<br />
to use the technologies listed in the legend (only differences for any one segment over 15%<br />
have been plotted). The results for organisations with a few UK sites are not shown, they are<br />
slightly less likely to use a range of technologies, least likely to use rapid development tools<br />
but otherwise the probability of a particular software application being used in organisations<br />
with this geographic distribution is very close to that of the overall average.<br />
The differences that emerge are that those with many locations are less likely to use software<br />
tools and those on one UK site are more likely to use software. It might be supposed that this<br />
difference arises from a cost barrier; the cost of implementing technology in many locations<br />
is greater than that in one UK site. However, this is not borne out when respondents listed<br />
their perceptions of barriers, as 43% of those with many locations selected cost as a barrier,<br />
as did 44% of those with one UK site. What may be a greater influence is the nature of the<br />
segment who stated that they operated from one UK site; many of them were part of larger<br />
organisations, for example NHS and education. Others were smaller more innovative<br />
companies typically in the e-learning sector itself.<br />
Global companies are more likely to choose the collaborative tools of video conferencing<br />
and virtual classrooms. Clearly with global travel costs to consider the ability for people to<br />
meet and conduct both business and learning will pay for the investment rapidly.<br />
<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 74
6 IT capability<br />
Figure 5.5 Differences from average take-up of technologies by geography<br />
40%<br />
20%<br />
0%<br />
-20%<br />
-40%<br />
Global One UK site Many locations<br />
Video conferencing Virtual classroom Chat- not moderated<br />
Chat- moderated e-portfolios Mobile learning<br />
EPSS Blogs/wikis Podcasting<br />
An interesting difference emerges with EPSS, more likely to be used in global organisations<br />
but less likely to be used in organisations with many UK locations. Whilst the potential<br />
improvement in efficiency for both styles of organisations would be the same, those with<br />
many UK locations do seem more reluctant to adopt e-learning technologies. What is<br />
surprising is that those with one UK site are much more likely to take on the collaborative<br />
working tools of chat and blogs and wikis. They are equally likely to be using virtual<br />
classrooms as global organisations are. Perhaps those on a single site find it easier to<br />
experiment with new technologies than those with many branch and office locations, as the<br />
amount of investment will be less and the project management and deployment of new<br />
technology will be easier. Those with a single UK site are also more likely to provide e-<br />
learning at home (67%) as opposed to 45% of those with many locations. The percentages<br />
for the other geographic distributions are 67% for those with a few relatively large sites and<br />
70% of global companies.<br />
Use of technology was also compared by size of organisation, but few patterns emerged.<br />
The only notable differences were the adoption of LMS, which rises more or less evenly from<br />
52% of the smallest companies (less than 280 staff) to 88% of the largest companies (more<br />
than 10,000 staff). Not surprisingly the use of video conferencing was related to size, with a<br />
third of the smallest companies having it available, as compared to 67% of the largest. This<br />
may also reflect the fact that the larger companies were much more likely to be global<br />
operations. The probability of games simulation as an in-box exercise being used also<br />
changes with size of organisation but the pattern is not consistent. Thirty-eight percent of<br />
smaller organisations use games compared to 58% of the largest. However this drops to 30%<br />
for middle-sized organisations. Apart from video conferencing, the other collaborative tools<br />
do not show consistently more use amongst larger organisations.<br />
<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 75
6 IT capability<br />
6 IT capability<br />
Overview: This chapter considers the effect that improving organisational IT capability has on<br />
the key dimensions. IT capability also influences where learning can be offered and the<br />
types of support provided to learners.<br />
6.1 Key differences observed with IT capability<br />
In most organisations e-learning has to rest on a foundation of IT capability. Two of the self<br />
perception questions behaved in a similar way and may be considered to relate to the IT<br />
capability of an organisation. These are: our learners are familiar with PCs and need little<br />
technical support; and our technology infrastructure is capable of delivering e-learning to<br />
places convenient to staff. Taking the average of these 2 questions and using a cut-off with<br />
a value of 7 means that the employer respondents could be segmented into 79 (termed IT<br />
not capable) and 68 (termed IT capable). The results on these 2 segments are analysed in<br />
relation to a number of factors seeking noticeable differences. The definition of IT capability<br />
therefore rests on the 2 questions that have been used to make this segmentation. In one<br />
case: IT infrastructure; employer responses have much greater similarity with other factors<br />
relating to availability and it is included in that dimension. The confidence and ability of<br />
employees to use PCs is independent of most other dimensions.<br />
Figure 6.1 Effect of IT capability on key dimensions<br />
8<br />
6<br />
4<br />
2<br />
0<br />
Business<br />
Impact<br />
Staff Impact Availability Takeup Financial<br />
Impact<br />
IT capable (n=68)<br />
IT not capable (n=70)<br />
Ref. This graph appears as Figure 22 in <strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and training Providers<br />
Figure 6.1 shows the main differences in the dimensions. In every single case a respondent’s<br />
perception is in closer agreement with the positive statements associated with business<br />
impact, staff impact, availability, take up and financial impact, if they work for an<br />
organisation which is measured as being more IT capable. Because the same factor (IT<br />
<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 76
6 IT capability<br />
infrastructure) is used both to segment by IT capability and to calculate the dimension<br />
“availability”, the difference in scores between averages 5.4 and 7.1 for this dimension must<br />
be viewed with some slight caution. Even taking this into account organisations which are IT<br />
capable make e-learning more available. We may conclude that having the appropriate IT<br />
infrastructure and IT confident staff increases the probability of e-learning being successful.<br />
Figure 6.2 Key differences associated with IT capability<br />
Training function capability<br />
Services offered<br />
Average number of drivers<br />
Directors / Senior managers using e-learning<br />
Technologies used<br />
Average number of roles using e-learning<br />
Barriers cited<br />
0.0 1.0 2.0 3.0 4.0 5.0 6.0 7.0 8.0<br />
IT capable (n=68)<br />
IT not capable (n=70)<br />
Training function capability has been defined in Appendix A, Table A.2. This definition<br />
includes having good links with the IT department and a clear understanding of the<br />
capability of internal IT to support e-learning. Clearly there is a link between the capability of<br />
the training function to use and deploy e-learning with the delivery system and also with the<br />
confidence of users of the technology. The assumption is that training functions and, to a<br />
lesser extent, learners, improve their capability and expertise in response to improved IT<br />
infrastructure.<br />
The services offered are defined by questions 15 and 16 of the questionnaire, which included<br />
a list of formal and informal on-line services. The possible maximum total for any one<br />
organisation is 11. In this graph above the value has not been re-based to 10 and therefore<br />
is not compatible with the measure of training function capability, scored out of ten.<br />
Nevertheless it gives a true comparison between IT capable and IT non-capable<br />
organisations. On average, those organisations that perceive themselves to be more IT<br />
capable, offer about one and a half more on-line services in support of learning.<br />
The total number of drivers that can be selected by a respondent is 15. On average IT<br />
capable organisations select 7 drivers as opposed to 5½ drivers for those who are not IT<br />
capable. Those organisations which have more confident staff and a better IT infrastructure<br />
see more opportunities for using e-learning. The technologies considered are defined in<br />
question 17 of the questionnaire, which included a total of 16 technologies that could be<br />
selected. Again this has not been re-based to 10, indicating that most IT capable<br />
organisations select about one-third of the technologies in the survey but those lacking<br />
confident staff and appropriate infrastructure select a quarter.<br />
<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 77
6 IT capability<br />
For the average number of roles who use e-learning the possible maximum is for users to<br />
select all 9 roles, this average has not been re-based to 10. This is the score which<br />
demonstrates the least difference between IT capable and not capable organisations.<br />
Neither the infrastructure nor user confidence make a great deal of difference to the number<br />
of roles that organisations deliver e-learning to. A far greater difference is observed when we<br />
compare whether directors use e-learning or not, as shown in Figure 3.7. Here there was a<br />
difference of 5 roles in terms of the average number of roles who used e-learning when<br />
directors did so and when they did not. The behaviour of role models within an organisation<br />
matters more than having the right infrastructure, or having PC confident staff.<br />
Respondents could select from a list of 13 barriers. Those who are IT capable select, on<br />
average, one less than those who are not IT capable but in either case the number of<br />
barriers that are selected is few.<br />
We may conclude from this pattern that training functions rise to the challenge of an<br />
adequate IT infrastructure and confident users by offering more services, seeing more<br />
opportunities and using more technologies. They also see fewer barriers.<br />
More than half of IT capable organisations deliver e-learning to their directors or senior<br />
management. Bearing in mind what we know about the significance of directors as a<br />
leadership role, it is perhaps surprising that they have less of an impact on organisations<br />
lacking IT capability, when only 41% of such organisations deliver e-learning to directors.<br />
6.2 Influence on success<br />
Figure 6.3 Variation in influence of roles with IT capability<br />
60%<br />
40%<br />
20%<br />
0%<br />
Head of<br />
Finance<br />
Head of<br />
IT<br />
Head of<br />
HR<br />
Business<br />
sponsor<br />
Local Board<br />
champions executive<br />
Line<br />
managers<br />
Learners<br />
Training<br />
department<br />
IT capable (n=68)<br />
IT not capable (n=70)<br />
The pattern that emerges is that support departments, finance, IT and HR are of less<br />
significance to IT capable organisations than those that are not. We may assume that it is<br />
more difficult to deliver e-learning in the environments which are less IT capable and<br />
therefore training functions need more support from other support functions, either practical<br />
help or financial endorsement. One of the biggest differences noted is the role of the<br />
business sponsor, who becomes more frequently cited as a key influence in those<br />
organisations which have adequate IT infrastructure and confident users of PCs.<br />
<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 78
6 IT capability<br />
We may assume that business sponsors in these organisations are more likely to perceive e-<br />
learning as a suitable route for achieving their business aims.<br />
We can also see differences in where e-learning is delivered and the range of topics offered.<br />
Figure 6.4 IT capability affects where learning can be offered<br />
% of topics offered by e-learning<br />
At the desk<br />
At home<br />
Internal Learning Centre<br />
In a quiet area<br />
Travelling<br />
External Learning Centre<br />
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100<br />
%<br />
IT capable (n=68) IT not capable (n=70)<br />
This figure plots the percentages of organisations who state that they deliver e-learning at a<br />
desk, at home, in learning centres, in quiet areas or when travelling.<br />
The biggest difference between the 2 segments we are considering are in delivery of e-<br />
learning to a quiet area or when travelling. It would appear that when e-learning is available<br />
in these areas and, to a lesser extent at home, respondents are more likely to agree that they<br />
have an appropriate and convenient IT infrastructure.<br />
The figure labelled percentages of topics offered by e-learning is calculated as follows. The<br />
total number of times that e-learning is available for a topic is divided by the total number of<br />
times training is provided irrespective of delivery method. Thus this percentage represents the<br />
extent to which e-learning has penetrated a particular market. For all organisations e-<br />
learning is likely to be available half the number of times that training in a topic is available.<br />
This penetration of the market is shown by topic in Table 4.1. For IT capable organisations this<br />
penetration rises to 60%.<br />
<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 79
6 IT capability<br />
6.3 Supporting learners<br />
Figure 6.5 Learner support mechanisms change with IT capability<br />
Line management coaching<br />
Web study support<br />
Web technical support<br />
Electronic job aids<br />
Printed job aids<br />
Reference books<br />
Virtual classroom<br />
0% 10% 20% 30% 40% 50% 60% 70%<br />
IT capable (n=68)<br />
IT not capable (n=70)<br />
Ref: This graph appears as Figure 23 in <strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers<br />
This figure shows the effect IT capability has on the way that learners are supported. There is<br />
a significant difference in the probability of line management coaching being available. This<br />
is cited as an e-learning support mechanism by 60% of organisations having an infrastructure<br />
and confident PC staff and 40% of organisations that do not. This may be because staff are<br />
more confident about requesting such support from line managers, or line managers<br />
themselves are more confident about delivering it.<br />
Using the web for study support, technical support and job aid support is more prevalent in IT<br />
capable organisations. The reasons for this are self-evident, as is the probability that IT<br />
capable organisations are far less likely to use printed job aids. What is surprising is that IT<br />
capable organisations are more likely to provide reference books. It is unlikely that<br />
respondents interpreted this as on-line reference books, as the option selected states<br />
“reference books” and is in the same sequence as a selection described as; electronic<br />
support mechanisms for learners. IT capable organisations are twice as likely to consider<br />
virtual classrooms with approximately one in 5 respondents making that selection.<br />
We may observe even greater differences in the way that feedback is sought from learners.<br />
Figure 6.6 shows that 60% of IT capable organisations will consider surveys of user satisfaction,<br />
almost twice as many as those organisations which are not IT capable.<br />
<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 80
6 IT capability<br />
Figure 6.6 Seeking feedback from learners<br />
70%<br />
60%<br />
50%<br />
40%<br />
30%<br />
20%<br />
10%<br />
0%<br />
No feedback Team meetings Follow up at work Surveys of user<br />
satisfaction<br />
IT capable (n=68)<br />
IT not capable (n=70)<br />
It is possible that these surveys may be on-line; the question that was asked does not<br />
differentiate between paper surveys and on-line surveys. It is perhaps disturbing to note that<br />
organisations lacking IT capability seek much less feedback than those with IT capability and,<br />
indeed, 13% collect no feedback from learners at all.<br />
Figure 6.7 Sourcing and managing production of e-learning<br />
% with e-learning dedicated training team<br />
% demanding e-learning to exact specs<br />
% demanding Training Analysis skills<br />
% not using suppliers<br />
Commercial products<br />
In-house rapid development<br />
In partnership with vendor<br />
In-house expert tools<br />
0% 20% 40% 60% 80% 100%<br />
IT capable N=68 IT not capable N=70<br />
<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 81
6 IT capability<br />
In Figure 6.7 we can observe that IT capable organisations are more likely to use commercial<br />
products and in-house development, either with a vendor or for themselves. The remaining<br />
methods of sourcing show little difference and are not shown. IT capable organisations are<br />
more likely to have part of their training function dedicated to e-learning, this undoubtedly<br />
reflects on their perceived capability reported in Figure 5.2. We can also see that they are<br />
slightly more likely to be demanding, requiring e-learning to exact specification, although this<br />
difference is less than others. They are less likely to be using suppliers; 30% of IT capable<br />
organisations selected that option compared to 21% of IT not capable organisations.<br />
These differences are also indicative of the confidence and capability of the training<br />
function. Clearly there are a number of related factors linking the trainers, the infrastructure<br />
and the learners. Greater capability in all 3 areas increases the number of ways in which e-<br />
learning can be used, who it is delivered to, what technologies are used and its impact on<br />
the business and on staff.<br />
<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 82
7 Supporting learners<br />
7 Supporting learners<br />
Overview: We examine the range of study support options provided to learners from both the<br />
employer and the learner perspective.<br />
Respondents were asked a number of questions concerning the methods they used to<br />
support learners, including study support, technical support and methods to help them apply<br />
learning in their jobs. This includes both on-line material and resources and help by people,<br />
either in person or remotely via some electronic means. Respondents were given a list of<br />
possible options and were able to select as many as appropriate in response to the question:<br />
“What study support do you provide to your learners?”<br />
Learner respondents were asked an identical set of questions.<br />
Figure 7.1 Study support provided to learners<br />
With on-line web reference materials<br />
With a tutor in email contact<br />
In person before e-learning starts<br />
With a tutor in telephone contact<br />
In person during the course<br />
Through a learning resource centre<br />
In person for review and evaluation<br />
With a virtual learning classroom system<br />
0% 20% 40% 60% 80% 100%<br />
Ref. This graphs appears as Figure 36 in <strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers<br />
Figure 7.2 shows the responses of learners when asked whether the study support they had<br />
was useful or not useful. Learner respondents were also given the option of indicating<br />
whether such resources were available or not available. Hence the 2 options that learners<br />
select and are presented here do not add up to 100%. Although learner responses give an<br />
indication of what learners think of the support provided these are for a limited number of<br />
organisations, rather than the 200 employers who participated in the employer survey.<br />
Therefore we are not directly comparing like with like.<br />
<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 83
7 Supporting learners<br />
Figure 7.2 Learner support – the learner perspective<br />
On-line web reference materials<br />
Electronic help and job aids<br />
Reference books<br />
Printed job aids<br />
Job related assignments<br />
Through a learning resource centre<br />
With a tutor in email contact<br />
In person before e-learning starts<br />
In person to review/evaluate<br />
W ith a virtual learning classroom system<br />
With a tutor in telephone contact<br />
0% 10% 20% 30% 40% 50% 60% 70%<br />
Available and useful<br />
Available but not useful<br />
Ref: This graph appears as Figure 38 in <strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers<br />
The questions asked of learner respondents covered both support whilst studying and also<br />
help provided to consolidate and apply what they had learnt on the job.<br />
The most frequently provided method of study support, on-line reference materials, is highly<br />
regarded by learner respondents with 82% saying that it was available and they found it<br />
useful, although 15% said it was available and they did not find it useful. The proportion of<br />
learner respondents who found a support service useful when it was available is shown in<br />
Figure 7.3. Of the 15 options offered to learner respondents at least 69%, of those where it<br />
was available, found all forms of study support useful. Proportionately the most useful, at<br />
88%, is job related assignments provided by 38% of employers. We can contrast this with<br />
email contact from a tutor, provided by 42% and useful to 74% of those where it was<br />
available. An interesting point to emerge is the high value placed upon support in the<br />
workplace, with both job related assignments and electronic help and job aids, valued by<br />
more than 80% of those to whom it was available.<br />
The data supporting Figure 7.3 is grouped into help provided in person, electronic help, help<br />
delivered electronically from individuals and print based help. The proportion of respondents<br />
who consider this valuable where it was available was calculated for these groups. There is<br />
no significant difference between the method of delivery and the proportion of recipients<br />
who considered it useful. The percentages varied from 85% for print based help and 88% for<br />
electronic help.<br />
<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 84
7 Supporting learners<br />
Figure 7.3 Learner support- what is most useful when it is available<br />
Job related assignments<br />
Electronic help and job aids<br />
Reference books<br />
Print based help<br />
Electronic help<br />
Printed job aids<br />
With web reference materials<br />
In person before e-learning starts<br />
In person to review and evaluate<br />
Help in person<br />
With a tutor in email contact<br />
Help in person delivered electroncally<br />
By a learning resource centre<br />
With a virtual classroom<br />
With a tutor by telephone<br />
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%<br />
The conclusion is that all help delivered directly to learners is considered valuable. Learner<br />
respondents were not asked their view of the most frequently provided form of help, that of<br />
line management coaching, although they were asked to select the one individual who was<br />
most influential in encouraging them to learn. Fifty-two percent of learner respondents chose<br />
their manager and 59% of employer respondents said they provide line management<br />
coaching and feedback to support the application of learning for the job. Even those<br />
support mechanisms only rarely available, for example virtual learning classroom systems<br />
available in 16% of employers and to 17% of learner respondents, are considered useful by<br />
72% of those to whom it is available.<br />
It appears that the method used to deliver support is less important to learners than the fact<br />
that it is available. For example the 3 methods of support least valued by learners (although<br />
70% of them do value these methods of support) are, the learning resource centre, the virtual<br />
classroom and telephone support from a tutor. Telephone contact by tutors is offered by a<br />
third of organisations, learning resource centres by 30% and virtual learning classroom<br />
systems by 16%. When making investment decisions about support to be provided<br />
organisations should bear in mind the perceived value to recipients. It would appear that<br />
telephone contact with tutors, learning resource centres and virtual classrooms are providing<br />
the least benefit to those they support. If we compare all methods of support that are<br />
synchronous with those that are asynchronous, the proportion of respondents for whom they<br />
are available and who perceive the support mechanism to be useful is 74% for synchronous<br />
methods of support and 83% for asynchronous methods. This adds weight to one of the main<br />
conclusions emanating from this report, that convenience as to time and place for learners is<br />
one of the most significant attributes of e-learning in all its forms.<br />
<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 85
7 Supporting learners<br />
7.1 Difference in support provided by maturity segments<br />
The responses to the questions concerning the support provided to learners are analysed<br />
against maturity. No particular pattern emerges. Whilst in general there is growth with<br />
maturity there is no consistent pattern for any one of the methods of support. No particular<br />
pattern emerges if we group the methods of support as requiring personal contact, personal<br />
support provided electronically or electronic support. There is a slight pattern emerging,<br />
shown in Figure 7.4, which seems to imply that more mature organisations will use more<br />
methods of support. However, bearing in mind that there were very few novices in the<br />
respondents, Figure 7.4 must be viewed with caution. All that it really says is that most<br />
respondents use on average, 2 or 3 different types of support.<br />
Figure 7.4 Number of different types of tutor support<br />
5.00<br />
4.00<br />
3.00<br />
2.00<br />
1.00<br />
0.00<br />
Novices<br />
Sporadic<br />
users<br />
Developing<br />
Users<br />
Established<br />
Users<br />
Embedded<br />
Users<br />
Innovators<br />
Similarly no particular pattern could be detected for different sizes of organisations.<br />
However, segmenting via geographic distribution, as shown in Figure 7.5, does produce<br />
some differences.<br />
Organisations with relatively few numbers of UK sites are far more likely to provide learner<br />
support in person, either before, during or after learning has been delivered. Worldwide<br />
companies are least likely to do this; they are more likely to provide electronic support<br />
through reference sites. Organisations with a single UK site are more likely, even than global<br />
companies, to provide this type of electronic support. Again companies with one UK site are<br />
more likely to provide personal support through email, telephone or virtual classrooms. Of<br />
the 36 employer respondents with a single UK site, 19 placed themselves in the education<br />
sector, 5 placed themselves in the health and social work sector, of which at least 3 were<br />
within the NHS. Others included Local Authorities. This particular segment is dominated by<br />
organisations who are in fact part of much larger structures and who would have been more<br />
inclined to seek help and support outside their own organisation but within their<br />
organisational support structure; DfES for education, Strategic Health Authorities for health<br />
and central government for local authorities.<br />
<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 86
7 Supporting learners<br />
Figure 7.5 Learner support compared by geographic characteristics<br />
Many small sites<br />
1 UK site<br />
A few sites<br />
Worldwide<br />
0% 10% 20% 30% 40% 50%<br />
Support provided in person<br />
Electronic support<br />
Personal support provided electronically<br />
Five of the opinion based Likert scale questions relate to the support provided to learners.<br />
Figure 7.6 Workplace learners support by maturity<br />
8.0<br />
7.0<br />
6.0<br />
5.0<br />
4.0<br />
3.0<br />
2.0<br />
1.0<br />
0.0<br />
Novices Sporadic users Developing<br />
Users<br />
Established<br />
Users<br />
Embedded<br />
Users<br />
Innovators<br />
Appraisal used Managers coach Access to mentor<br />
Off-site learning allowed<br />
Empowered staff<br />
See also Figure 40 <strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers.<br />
<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 87
7 Supporting learners<br />
We found a consistent improvement in agreement for all 5 of the learner support offers as<br />
organisations become more e-learning mature. This is supporting evidence that more mature<br />
organisations put more effort into supporting learners using a greater range of support<br />
mechanisms.<br />
7.2 Learning support and business impact<br />
The various support mechanisms are analysed and compared with changes in business<br />
impact. In Chapter Two differences related to business impact were reported, this analysis<br />
was based upon dividing employer respondents into quartiles based upon 6 of the Likert<br />
scale questions which define the dimension business impact. Figure 7.7 plots the percentage<br />
of respondents in each one of those segments that provide the support and consolidation<br />
processes listed in the figure.<br />
Very clearly, those organisations that put more effort into supporting learners in the<br />
workplace are more likely to be found in the upper quartile for business impact. Other<br />
support mechanisms not shown in the graph do not show such a distinct relationship with<br />
business impact. The key message for those inside organisations seeking to support learners<br />
and maximise their business impact is to concentrate on these 4 methods of support.<br />
Figure 7.7 Business impact increases when learning is consolidated<br />
100%<br />
80%<br />
60%<br />
40%<br />
20%<br />
0%<br />
Upper quartile 3rd quartile 2nd quartile Lower quartile<br />
Business Impact<br />
Reference books<br />
Re-assessment<br />
Electronic job aids<br />
Line manager coaching<br />
<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 88
7 Supporting learners<br />
7.3 Learners’ view of support<br />
Learner respondents were also asked a number of questions concerning the support they<br />
received.<br />
Figure 7.8 reports the percentage of learners who agree with the statements; that is their<br />
score was in the top third of the 1-10 agreement scale. From the learners perspective the 2<br />
most valuable features of e-learning are that it is convenient to their work schedule and they<br />
are able to quickly put into practice what they learn from e-learning. The learner<br />
respondents are not an exact match with the employer respondents. The majority of the<br />
learner respondents worked for just 14 of the employers who completed the employer survey.<br />
Appendix B reports on the demographics of the learner respondents. However, over 40% of<br />
respondents agreed that their managers appraised them at regular intervals and provided<br />
coaching feedback support. The analysis earlier in this chapter shows the link between this<br />
and e-learning maturity and the business impact of e-learning.<br />
Figure 7.8 Support received by employees<br />
Convenient to work schedule<br />
Ability to put learning into practice<br />
Elearning relevant to my job<br />
Appraisal from line manager<br />
Provision of coaching from line manager<br />
Time to learn at work<br />
Time to learn elsewhere<br />
Commitment of senior management<br />
Access to a mentor or buddy<br />
0% 20% 40% 60%<br />
A group of additional questions are shown in Figure 7.9 which plots a further 7 responses to<br />
questions asked of employees that are related to the support they receive.<br />
These are related to attributes that are valued by learners and related to e-learning. The<br />
most positive agreement is to the statement: “I am empowered to request my own training<br />
and to take ownership of my own development”, with 65% of respondents agreeing.<br />
Over half agree that e-learning is valuable because it gives them additional opportunities for<br />
development and 43% do e-learning without prompting. A third state that they are more<br />
interested in professional qualifications since using e-learning and half regard it as important<br />
that e-learning contributes to a recognised qualification, 52% wish to receive some<br />
recognition for succeeding at e-learning irrespective of whether qualifications are involved.<br />
<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 89
7 Supporting learners<br />
Figure 7.9 Attributes valued by employees<br />
Empowerment to take charge of my own<br />
development<br />
Recognition for success<br />
Additional opportunites for development<br />
A recognised qualification<br />
Do e-learning without prompting<br />
A more personalised approach<br />
Professional qualifications<br />
0% 10% 20% 30% 40% 50% 60% 70%<br />
The importance of empowerment becomes even more significant following the completion<br />
of an additional analysis. Appendix B discusses, in detail, the factor analysis approach,<br />
which enables us to group the opinion-based questions asked of learners into six key<br />
dimensions. Learner’s responses within these dimensions are reported in Figure 7.10.<br />
This figure shows the percentage of learner respondents who feel positive (that is their<br />
average responses are in the top third of agreement) about the dimensions listed. Fifty-four<br />
percent feel positive about the empowerment that e-learning gives them.<br />
Figure 7.10 Learners’ views by dimension<br />
Learners are empowered<br />
Job relevance<br />
Learners have control over their<br />
opportunties<br />
Need for recognition<br />
Detachment<br />
Management support<br />
0% 20% 40% 60%<br />
Percentage with positive view of dimension<br />
<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 90
7 Supporting learners<br />
Appendix A defines what we mean by empowerment. It is derived from the factor analysis<br />
of the statements, rather than having an inherent definition of itself. In the context of this<br />
report it means that learners are confident about using PCs, they know what training is<br />
available, they do e-learning without prompting, they are able to do it at a place and time<br />
that is convenient to them and feel empowered to ask for what they need.<br />
Twice as many respondents feel empowered as feel they are supported by their<br />
management. Management support being defined as: commitment of senior management,<br />
coaching and feedback support, appraisal, freedom to work at home or locally and time to<br />
learn at work. It would appear that for the target group of learners who responded to this<br />
survey it is easier for them to take charge of their own development than to feel supported<br />
by their management. This general positive view, that empowerment brings to learners, is<br />
more clearly demonstrated in Figure 7.11.<br />
Figure 7.11 Relative importance of dimensions to learners by segment<br />
Empowered learners<br />
Job relevance<br />
Control over learning<br />
Recognition<br />
Detachment<br />
Management Support<br />
0% 10% 20% 30% 40% 50% 60% 70% 80% 90%<br />
Empowerment Control over learning Management support<br />
Job relevance Recognition Detachment<br />
This graph shows the percentage of learners who feel positive about the key dimensions<br />
segmented by those dimensions themselves. For example, the set of percentages shown<br />
against empowered learners is the percentage of those learners who feel empowered who<br />
also feel positive about the control they have, the management support they receive, the<br />
relevance of e-learning to their job, their need for recognition and disagreement with feeling<br />
detached from e-learning.<br />
Detachment is defined by those respondents who agree that they only do e-learning when<br />
told to do so and find the choices offered confusing. In Figure 7.11 the responses to this<br />
question are therefore shown for those respondents who disagree with those 2 statements.<br />
Figure 7.11 shows that learners who feel empowered also feel more positive about all 5 of the<br />
other dimensions, that is more positive than learners who feel positive about those other<br />
dimensions.<br />
<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 91
7 Supporting learners<br />
This segmentation is not exclusive as empowered learners are clearly well represented in<br />
each one of the other 5 segments or groupings. As well as clearly demonstrating the positive<br />
reinforcement supplied to learners who feel empowered it is also interesting to reflect that<br />
those learners who feel supported by management are least likely to feel positive about the<br />
other 5 key dimensions.<br />
7.4 Technical support<br />
Employer respondents were also asked how they provided technical support to their learners<br />
(Figure 7.12).<br />
Figure 7.12 Provision of technical support to learners<br />
Telephone help desk<br />
By email<br />
In person<br />
Through a web resource<br />
n=139<br />
0% 10% 20% 30% 40% 50% 60% 70% 80% 90%<br />
An interesting difference emerges between the way technical support is provided and the<br />
way learning support is provided. Thirty-three percent of respondents provided telephone<br />
tutor support although 79% provide technical help via the telephone. Forty-five percent<br />
provide study support through Web reference materials but only 33% provide technical<br />
support through a Web resource. This demonstrates not only the very different nature of the<br />
support required but possibly that technical support is easier to provide by telephone with a<br />
24/7 coverage, whereas more specialised learning and subject support is more difficult to<br />
provide to learners by telephone at the time they require it. We should also bear in mind that<br />
50% of employer respondents said that more than 90% of their employees were regular PC<br />
users; by assumption requiring less technical support as individuals but more technical<br />
support as a population; because they spend more time using computers.<br />
<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 92
8 Promoting e-learning<br />
8 Promoting and sustaining e-learning<br />
Overview: A range of communications techniques are used by organisations to promote new<br />
e-learning initiatives and to sustain learner interest. We focus on the approach used by<br />
mature organisations realising the greater impact from their e-learning.<br />
Both employer and learner respondents were asked a number of questions related to<br />
sustaining interest in e-learning. Employers were asked the methods by which they promoted<br />
and launched e-learning and those they used to sustain interest in it. Learners were asked<br />
how they first heard about e-learning and the various ways in which their interest was<br />
sustained. Figure 8.1 shows the methods used segmented by the maturity of the<br />
organisation.<br />
Figure 8.1 Promotion of e-learning – what mature organisations do differently<br />
100%<br />
80%<br />
60%<br />
40%<br />
20%<br />
0%<br />
e-mail<br />
Manager Newsletter Posters Open days Peer<br />
briefings<br />
testimonies<br />
Video Giveaways SMS<br />
Less mature (n=33) Becoming mature (n=49) More mature (n=54)<br />
Respondents could select all the methods that applied but were given the option of<br />
selecting none; that is they used no communication or promotion method to launch e-<br />
learning. This was selected by 9% of those less mature organisations and 2% of those<br />
becoming mature. The more mature organisations use more channels to promote and<br />
communicate about e-learning. The use of email is independent of maturity and is the most<br />
frequently used method of communication. Manager briefings are least used by less mature<br />
organisations, indeed almost half as frequent for the least mature as opposed to the most<br />
mature organisations. This pattern is repeated for both newsletters, posters and open days,<br />
all of which are less likely to be used by the less mature. Open days are more likely to be<br />
used by the more mature (a third of such organisations) as opposed to one in 5 of those<br />
becoming mature and one in ten of those less mature. Peer testimonies are equally likely to<br />
be used by organisations irrespective of maturity and approximately one out of 5 do so.<br />
<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 93
8 Promoting e-learning<br />
Figure 8.2 shows the same communication methods, this time in response to the question<br />
“Following the launch what communication methods do you use to maintain interest?”<br />
Figure 8.2 Sustaining e-learning – what do mature organisations do differently<br />
100%<br />
80%<br />
60%<br />
40%<br />
20%<br />
0%<br />
e-mail Newsletter Manager<br />
briefings<br />
Posters<br />
Open<br />
days<br />
Peer<br />
testimonies<br />
Video Giveaways SMS<br />
Less mature (n=33) Becoming mature (n=49) More mature (n=54)<br />
There is less difference in frequency of use of email, newsletters and management briefings<br />
with maturity, particularly between the becoming mature and the more mature. The less<br />
mature are less likely to use email, briefings and posters. Less mature organisations use fewer<br />
communication methods at launch, they are less likely to use communication to sustain<br />
interest; indeed 4% of the less mature organisations use no such communication and 2% of<br />
those becoming mature do not communicate to sustain interest. What is the potential<br />
business return from this promotional activity?<br />
Figure 8.3 Sustaining interest in e-learning according to business impact<br />
100%<br />
80%<br />
60%<br />
40%<br />
20%<br />
0%<br />
e-mail Newsletter Manager<br />
briefings<br />
Posters Open days Peer<br />
testimonies<br />
Video Giveaways SMS None<br />
Take-up of e-learning<br />
Top quartile 3rd quartile 2nd quartile Lower quartile<br />
Ref: This graph appears as figure 48 in <strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers<br />
<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 94
8 Promoting e-learning<br />
Again, email is equally likely to be used irrespective of the business impact achieved from e-<br />
learning. However, both newsletters and management briefings are least likely to be<br />
deployed by those organisations that achieve least business impact. Posters are most likely<br />
to be used by those organisations that achieve the most business impact. The remainder of<br />
the differences reported are relatively minor.<br />
To achieve business impact organisations should sustain their use of email, add in first<br />
management briefings, then newsletter input about e-learning and finally posters.<br />
The influence exerted on success by different categories of individuals is reported in Chapter<br />
2. It’s worth reflecting that the more mature organisations do regard learners as much more<br />
significant to the success of e-learning; 64% of the more mature organisations selected<br />
learners as key influences, as opposed to 23% of the less mature. Likewise with managers,<br />
these were selected as a point of influence by 46% of the more mature and 19% of the less<br />
mature. The best means training departments have of communicating with these 2 target<br />
groups is through email, briefings, posters, open days and newsletters. Since the more<br />
mature organisations believe line managers and learners have a greater influence on the<br />
success of e-learning it is hardly surprising that they put more effort into communicating with<br />
these 2 groups.<br />
The analysis explores the effect the various methods of communication have on take-up.<br />
Respondents are segmented into quartiles dependent upon the take-up of e-learning. The<br />
take-up of e-learning is defined in Appendix A and is a result of the factor analysis of the selfrated<br />
questions.<br />
Figure 8.4 Promoting and sustaining take-up – action to achieve take-up<br />
100%<br />
80%<br />
60%<br />
40%<br />
20%<br />
0%<br />
Upper quartile 3rd quartile 2nd quartile Lower quartile<br />
Take-up of e-learning<br />
e-mail Newsletter Manager briefings Posters Open days Peer testimonies<br />
Email is the most frequently used communication method. Figure 8.4 shows the return in<br />
greater take up from increased effort into newsletters, management briefings and, to a lesser<br />
extent, posters and open days. There is a consistent increase in the probability of newsletters,<br />
management briefings and posters being used with an increase in take-up. Both open days<br />
and peer testimonies show less difference with take-up and, it may be assumed, will show less<br />
of a return in increased take-up than other methods of communication.<br />
<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 95
8 Promoting e-learning<br />
Whilst we also asked employers about the use of give-aways and SMS messages, numbers in<br />
use are very small and the differences are less. However, 16% of organisations in the top 25 th<br />
percentile for take-up use give-aways and SMS; for organisations in the bottom 75 th<br />
percentile approximately 5% will use these 2 methods of communication. Both these<br />
methods go someway to pushing take-up towards the upper limits. Ten percent of<br />
organisations in the bottom half for take-up use no communication methods to promote and<br />
sustain the use of e-learning, compared to about 5% in the top half for take-up.<br />
8.1 Learners response to the communication methods<br />
Learners were asked how they first found out about e-learning and what types of<br />
communication kept them interested. For the first question they were only allowed to select<br />
one response.<br />
Figure 8.5 Learner response to communications about e-learning<br />
Email<br />
Line manager briefing<br />
Company newsletter<br />
Peer testimonies<br />
Open days<br />
Poster<br />
Giveaways<br />
SMS<br />
0% 10% 20% 30% 40% 50% 60% 70%<br />
Finding out<br />
Sustaining interest<br />
The use of a video by a senior executive was only offered as an option for the ‘finding out’<br />
question and no learners selected this option; this is not shown in the figure above. It is very<br />
apparent that the least effective methods of launching e-learning are SMS, give-aways,<br />
posters and open days. Peer testimonies are only marginally effective, being selected by 5%<br />
of the population. Almost twice as many respondents (38%) selected email as the method<br />
by which they found out about e-learning, as opposed to line management briefings (22%),<br />
with 12% selecting a company newsletter. The pattern remains very similar for the types of<br />
communication to which learners respond and that keep them interested in e-learning.<br />
However, open days, posters and give-aways become significantly more important than at<br />
launch, with about one in ten learners selecting these as communication methods that keep<br />
them interested. The learner responses were segmented by age, education levels, gender,<br />
management responsibilities, where people worked and where and when they learnt. There<br />
were no significant differences by either gender or education levels. One or 2 other<br />
differences have been identified and are reported in the following figures.<br />
<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 96
8 Promoting e-learning<br />
Figure 8.6 Communication about e-learning – effect of age of learner<br />
70%<br />
60%<br />
50%<br />
40%<br />
30%<br />
20%<br />
10%<br />
0%<br />
Company<br />
Newsletter<br />
Line<br />
Manager<br />
Briefing<br />
Giveaways Poster Company<br />
Newsletter<br />
Line<br />
Manager<br />
Briefing<br />
Email<br />
Finding out<br />
Sustaining Interest<br />
Age is = 55 N = 126<br />
Younger learners are far more likely to respond to line management briefings than older<br />
learners. One third of those 25 or under found out about e-learning through a line<br />
management briefing, as opposed to one in ten of those 55 or over. On the other hand<br />
company newsletters were more effective with older learners, with about one in 5 selecting<br />
these as a means by which they discovered about e-learning as opposed to one in 20 for<br />
younger learners.<br />
For sustaining interest email proves slightly more effective with older learners (63% of those<br />
over 55 as opposed to 54% of those under 25). Line management briefings continue to be<br />
effective as a means of sustaining interest for younger learners and again company<br />
newsletters more effective for older learners. It would appear that younger learners also<br />
respond to give-aways and posters more than older learners. Where there is little difference<br />
in the responses by age to a method of communication this is not shown. A similar analysis<br />
was completed for management responsibility.<br />
Respondents were asked if they managed their own time, or if it was managed for them;<br />
they were asked if they had responsibilities for others or not. Those who are responsible for<br />
managing others are slightly more likely to respond to company newsletters, both as a<br />
means of finding out about e-learning and sustaining their interest. They are much less likely<br />
to respond to line management briefings or give-aways. Those who do not manage their<br />
own time are more likely to respond to give-aways, although less likely to respond to email.<br />
The pattern that emerges is that those who are able to work independently are more likely to<br />
respond to remote methods of communication and those who are more directly managed<br />
are more likely to respond both to their own line managers and to actions such as giveaways<br />
which make them feel more valued.<br />
<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 97
8 Promoting e-learning<br />
Figure 8.7 Communication about e-learning – effect of management responsibility<br />
70%<br />
60%<br />
50%<br />
40%<br />
30%<br />
20%<br />
10%<br />
0%<br />
Company<br />
Newsletter<br />
Line Manager<br />
Briefing<br />
Company<br />
Newsletter<br />
Giveaways<br />
Email<br />
Finding out<br />
I do not manage my own time (n=57)<br />
No responsibility for others (n=459)<br />
Sustaining Interest<br />
I manage my own time (n=778)<br />
Responsible for others (n=376)<br />
A similar analysis is completed based upon where respondents work. Although the majority<br />
of respondents work at a regular place, 35 worked from home and 52 on site at a customer.<br />
For these small groups there are some noticeable differences.<br />
Figure 8.8 Communication about e-learning – effect of where learners work<br />
70%<br />
60%<br />
50%<br />
40%<br />
30%<br />
20%<br />
10%<br />
0%<br />
Company<br />
Newsletter<br />
Line<br />
Manager<br />
Briefing<br />
Email Open Days Poster Company<br />
Newsletter<br />
Line<br />
Manager<br />
Briefing<br />
Finding out<br />
Sustaining Interest<br />
All Work at a regular place N = 740<br />
Work from home N = 35 Work On site at customer N = 52<br />
<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 98
8 Promoting e-learning<br />
Those who work at a customer’s site are, not surprisingly, much more likely to select email as<br />
the method by which they found out about e-learning. They are much less likely to select a<br />
company newsletter and slightly less likely to select a line management briefing. Those who<br />
work at home, on the other hand, are more likely to select a company newsletter and less<br />
likely to select email as the means by which they find out about e-learning. They are slightly<br />
less likely to select a line management briefing. For sustaining interest open days and<br />
company newsletters are valued by those working at home. Those working at a customer’s<br />
site are less likely to respond to open days, posters, company newsletters and line<br />
management briefings. Their probability of responding to an email is similar to other<br />
respondents. Where there are no significant differences in the responses this is not reported.<br />
Figure 8.9 Communication about e-learning – effect of when learning occurs<br />
70%<br />
60%<br />
50%<br />
40%<br />
30%<br />
20%<br />
10%<br />
0%<br />
Company<br />
Newsletter<br />
Line<br />
Manager<br />
Briefing<br />
Email<br />
Open Days<br />
Giveaways<br />
Poster<br />
Peer<br />
Testimonies<br />
Company<br />
Newsletter<br />
Email<br />
Finding out<br />
Learn in a quiet spot away from the desk (n=32)<br />
Learn at home (n=132)<br />
Learn in company time (n=668)<br />
Sustaining Interest<br />
Learn at the desk (n=643)<br />
Learn in own time (n=167)<br />
Those who learn in a quiet spot away from the desk show a marked difference to the<br />
majority of respondents. Some caution should be exercised as only 32 respondents placed<br />
themselves into this segment. However, they are much less likely to use company newsletters<br />
or open days as a means of finding out about e-learning. They are more likely to select line<br />
management briefings as the communication method which worked for them. This may<br />
have something to do with either learners’ preferences or working environment although we<br />
cannot tell why they do not learn at their desk; possibly a preference for being away from a<br />
busy office, possibly they have a customer service role and need to be out of sight of<br />
customers, possibly they need to be away from ringing ‘phones in a call centre, possibly<br />
exercising a personal preference for a space in which they can reflect quietly as part of the<br />
learning process. These preferences could be explored in a further study.<br />
<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 99
8 Promoting e-learning<br />
There is a similar pattern of responses from learners about communication that keeps them<br />
interested. They are less likely to select any of the communication methods except posters,<br />
being slightly more likely to respond to posters than other segments. They are least likely to<br />
respond to give-aways.<br />
About 4 times as many respondents selected the ‘learn at home’ option (132) against the<br />
‘work at home’ option (35). It is possible that those who learn in their own time are in the<br />
same group as those who learn at home. If so, this will explain the similarity in the<br />
percentage of respondents selecting the various different methods of communication in<br />
both these segments.<br />
Based on this analysis we can see that in general e-mail is both the most frequently used<br />
method of communication and also the one learners are most likely to respond to. There are<br />
learners in special situations and perhaps with personal preferences who are more likely to<br />
respond to other methods of communication. Location is undoubtedly a factor, as is<br />
management responsibility. The successful organisation uses multiple channels of<br />
communication and based upon the evidence of this report, should also direct different<br />
styles and types of communication to learners in different situations. However, increasing the<br />
use of management briefings, newsletters and posters are effective ways of increasing takeup<br />
and improving the probability of e-learning being successful.<br />
8.2 Convenience of e-learning<br />
Providing learners with the freedom and information to manage their own development is a<br />
significant factor in influencing the impact e-learning has on them and their attitude about<br />
all other aspects of e-learning. Delivering e-learning, therefore, at locations which are<br />
convenient for them makes a significant difference.<br />
Figure 8.10 Availability and access to learning<br />
Technology allows me to learn in a place<br />
that is convenient for me<br />
I am empowered to request my own training<br />
and take ownership of my development<br />
I know what is available to me and how to obtain it<br />
I find e-learning convenient for my work schedule<br />
My manager makes time for me to learn at work<br />
e-learning gives me with more control<br />
of my own development<br />
My manager allows me work time to learn<br />
at home or locally<br />
0% 20% 40% 60% 80% 100%<br />
Agree Neutral Disagree<br />
<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 100
8 Promoting e-learning<br />
Learners feel most positive that technology allows them to learn in a place that is convenient<br />
for them. Seven out of 10 learners agree with this statement. In general there are equally<br />
positive feelings concerning the majority of the other statements reported above all of which<br />
relate to the ability of learners to take charge of when and where they learn.<br />
Respondents are less likely to agree that their manager gives them the freedom to learn<br />
where they want and more likely to agree that the technology delivers that capability. So,<br />
where do organisations make learning available? Employer respondents were asked where<br />
they made e-learning available from a choice of six locations.<br />
Figure 8.11 Where is e-learning offered and where is it done?<br />
100%<br />
80%<br />
60%<br />
40%<br />
20%<br />
0%<br />
At the desk At home In-house<br />
learning<br />
centre<br />
A quiet<br />
spot away<br />
from desk<br />
When<br />
travelling<br />
External<br />
learning<br />
centre<br />
Where is e-learning offered (n=174)<br />
Where is it done (n=1072)<br />
Ref: This graph appears as Figure 44 in <strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and training Providers<br />
Employers extending the range of locations in which learners can study. The majority of<br />
employer respondents make e-learning available at the desk; 93%. Half provide an in-house<br />
learning centre. Sixty percent make e-learning available at home. It would appear that<br />
learners do not respond by making use of these locations. However, the comparison must<br />
be viewed with some caution as the majority of employee respondents are drawn from just<br />
14 organisations that completed the employer survey. Whilst the employer survey was<br />
anonymous some of the respondents left either a name or an email address, from which it is<br />
possible to determine that at least 9 of the employer organisations deliver e-learning at the<br />
desk and 8 make it available at home, 3 at an in-house learning centre, 5 in a quiet space<br />
away from the desk and 3 when travelling. Four of the 14 employer respondents are<br />
anonymous which means we do not have a complete picture of the facilities offered to the<br />
learners who completed the employee survey. However, we can reasonably estimate that<br />
three quarters of the learner respondents would have been able to study e-learning at home<br />
but only 16% did so. A much smaller proportion, perhaps a quarter, would have had access<br />
to an in-house internal learning centre but only 3% used this as a location in which to learn.<br />
<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 101
8 Promoting e-learning<br />
8.3 Who influences learners?<br />
Learner respondents were asked who encouraged them to learn. They were given a list of 6<br />
individuals and asked to one. The list included managers (chosen by about half of<br />
respondents), a colleague (chosen by about a quarter), a training manager (chosen by<br />
about 10%), a senior executive (chosen by about 5%), a friend (chosen by about 3%) and a<br />
learning centre co-ordinator (chosen by about 1½%). The responses of learners are analysed<br />
against a number of factors. There is little difference based upon education or age<br />
differences; although there are differences dependent upon where learners work and where<br />
and when they learn.<br />
Figure 8.12 Who encourages learning varies with work and learning location<br />
When I<br />
learn<br />
in my own time<br />
in employer's time<br />
Where I learn Where I work<br />
on customer's site<br />
a regular place<br />
at home<br />
at home<br />
at my desk<br />
a quiet spot away from the desk<br />
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%<br />
Manager Colleague Training Manager Senior Executive Friend<br />
These responses reflect the findings about promotional and communication methods. Those<br />
who learn at home are more likely to select friends and senior executives as the individual<br />
who is most likely to encourage them to learn. Those who work primarily on a customer’s site<br />
are least likely to respond to their line manager and most likely to respond to their training<br />
manager. Those who work in their employer’s time are more likely to be encouraged by their<br />
line manager than those who learn in their own time.<br />
There are some slight differences with age, in that younger members of staff are likely to be<br />
more responsive to line managers. This supports the information reported about<br />
communication; younger employees are more likely than older employees to find out about<br />
e-learning from their line manager.<br />
<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 102
8 Promoting e-learning<br />
Figure 8.13. Who encourages learning varies with age and responsibility<br />
Age is Management time<br />
Responsible for others (n=376)<br />
No responsibility for others (n=459)<br />
I manage my own time (n=778)<br />
I do not manage my own time (n=57)<br />
55 or over (n=126)<br />
40 to 54 (n=314)<br />
26 to 39 (n=292)<br />
25 or under (n=103)<br />
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100<br />
%<br />
Manager Colleague Training Manager Senior Executive Friend<br />
8.4 Obtaining feedback<br />
Responding to learners and being seen to respond to learners is an important part of<br />
influencing the workforce. Respondents were asked to select from a list of methods those<br />
that they used to obtain feedback from learners. Respondents were given a choice of 5<br />
methods of collecting feedback plus the option of saying they did not do so.<br />
Figure 8.14 Methods used to gather learner feedback<br />
Feedback sheets following each course<br />
70%<br />
Regular surveys of user satisfaction<br />
48%<br />
Focus groups<br />
Follow up once they are back at work<br />
Team meetings<br />
29%<br />
23%<br />
31%<br />
We do not gather learner feedback<br />
7%<br />
0% 20% 40% 60% 80%<br />
Ref: This graph appears as Figure 50 in <strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers<br />
<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 103
8 Promoting e-learning<br />
It is no surprise that feedback sheets, the so-called ‘happy sheet’, are the most frequently<br />
used method of collecting feedback. This data is analysed against maturity (Figure 8.15).<br />
Figure 8.15 Mature organisations gather more feedback from learners<br />
80%<br />
70%<br />
60%<br />
50%<br />
40%<br />
30%<br />
20%<br />
10%<br />
0%<br />
Focus groups<br />
Regular surveys<br />
of user<br />
satisfaction<br />
Follow up once<br />
they are back<br />
at work<br />
Team meetings<br />
Feedback<br />
sheets<br />
following each<br />
course<br />
Less mature (n=33) Becoming mature (n=49) More mature (n=54)<br />
It is very apparent that more mature organisations put more effort into collecting feedback<br />
from their learners. A significant difference is the regular surveys of user satisfaction, where<br />
more mature organisations are twice as likely to use this method of collecting feedback. The<br />
only method that shows little difference and no consistent difference with maturity is<br />
feedback sheets following each course. These are equally frequently used by organisations<br />
irrespective of their e-learning maturity.<br />
Although feedback following a course shows no link with business impact, the collection of<br />
feedback via focus groups, team meetings, follow-up at work and regular surveys are all<br />
more likely to occur in organisations who achieve the highest business impact from their e-<br />
learning. It is worth noting that the probability of regular surveys being used increases<br />
consistently with business impact, whereas other methods of feedback collection only show<br />
a significant difference for organisations in the top quartile for business impact.<br />
We can see a similar difference with staff impact (Figure 8.17). A similar pattern emerges in<br />
that those organisations who achieve greater staff impact from e-learning are putting more<br />
effort into collecting feedback from learners. There is one noticeable difference in the<br />
analysis of feedback methods against staff impact and business impact. The probability of<br />
feedback sheets being used is independent of business impact but may influence staff<br />
impact with a slight dependency in that the organisations in the lower quartiles are slightly<br />
less likely to be using feedback sheets. However this method of feedback is least effective in<br />
terms of influencing the success of e-learning. Probably the most effective in achieving<br />
change are regular surveys of user satisfaction.<br />
<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 104
8 Promoting e-learning<br />
Figure 8.16 Business impact is enhanced by effective follow up<br />
100%<br />
80%<br />
60%<br />
40%<br />
20%<br />
0%<br />
Upper quartile 3rd quartile 2nd quartile Lower quartile<br />
Business impact<br />
Focus groups<br />
Team meetings<br />
Follow up once they are back at work Regular surveys of user satisfaction<br />
Feedback sheets following each course<br />
Ref: this graph appears as Figure 51 in <strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers<br />
Figure 8.17 Staff impact is enhanced by effective follow-up<br />
100%<br />
80%<br />
60%<br />
40%<br />
20%<br />
0%<br />
Upper quartile 3rd quartile 2nd quartile Lower quartile<br />
Staff impact<br />
Focus groups<br />
Follow up once they are back at work<br />
Regular surveys of user satisfaction<br />
Team meetings<br />
Feedback sheets following each course<br />
<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 105
8 Promoting e-learning<br />
8.5 Key actions that influence the success of e-learning<br />
The business impact, take-up and staff impact ratings are calculated for each respondent by<br />
the average of the individual ratings for the factors that make up the dimensions. The takeup<br />
rating also includes a calculation based upon the number of roles within the organisation<br />
who use e-learning. The correlation between each of these ratings and all the individual<br />
factors are calculated across data from 150 respondents. The following tables list those<br />
factors where the correlation index exceeds 0.4. The order enables organisations to prioritise<br />
those actions that are likely to make the biggest impact on e-learning success.<br />
Table 8.1 Enhancing Business Impact<br />
Factors correlated with Business Impact > 0.4<br />
Correl<br />
-ation<br />
We can provide access to a wide range of learning opportunities 0.68<br />
The visible demonstration of e-learning success within the business has helped us<br />
maintain resources allocated to learning 0.66<br />
We have a clear understanding of what types of e-learning our internal IT systems can<br />
support 0.53<br />
We are able to personalise the learning experience for each learner 0.53<br />
Change management is an integral part of our e-learning deployment and planning 0.50<br />
We regularly communicate e-learning successes to managers 0.50<br />
We provide line managers with training and briefings relating to specific e-learning<br />
courses 0.49<br />
Senior Management regularly demonstrate commitment to e-learning 0.49<br />
We provide each new e-learning initiative with a specific identity and brand 0.48<br />
Staff can access e-learning at any time 0.46<br />
We have achieved enterprise wide connectivity and collaborative working between<br />
work groups in different locations 0.45<br />
We have the skills to manage external e-learning providers effectively 0.45<br />
e-learning is helping our talent management and succession planning 0.44<br />
When we implement a new e-learning initiative we start with a pilot project before<br />
embarking on a company wide rollout 0.42<br />
Staff can access e-learning from anywhere 0.42<br />
We have audited the skills of those in the training function against the skills required<br />
for e-learning 0.42<br />
We use assessment tools to target skills needed to match work practices 0.42<br />
Our internal training team is willing to embrace new ways of working with technology 0.42<br />
Managers coach their own teams 0.41<br />
<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 106
8 Promoting e-learning<br />
Table 8.2 Enhancing staff impact<br />
Factors correlated with Staff Impact > 0.4<br />
Correlation<br />
We are able to personalise the learning experience for each learner 0.65<br />
We can provide access to a wide range of learning opportunities 0.63<br />
The visible demonstration of e-learning success within the business has helped us<br />
maintain resources allocated to learning 0.62<br />
e-learning is helping our talent management and succession planning 0.54<br />
We regularly communicate e-learning successes to managers 0.53<br />
We identify and train local champions to act as change agents 0.50<br />
Senior Management regularly demonstrate commitment to e-learning 0.50<br />
We provide each new e-learning initiative with a specific identity and brand 0.48<br />
When we implement a new e-learning initiative we start with a pilot project before<br />
embarking on a company wide rollout 0.47<br />
Change management is an integral part of our deployment and planning of e-<br />
learning 0.46<br />
Staff can access e-learning at any time 0.44<br />
We achieve external recognition of our e-learning achievements (such as<br />
conference/seminar presentations, awards, quality marks) 0.44<br />
Learners have regular access to a mentor, coach or buddy with whom they have a<br />
personal relationship for the duration of a course 0.43<br />
Staff can access e-learning from anywhere 0.41<br />
We have achieved enterprise wide connectivity and collaborative working<br />
between work groups in different locations 0.41<br />
<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 107
8 Promoting e-learning<br />
Table 8.3 Enhancing take-up of e-learning<br />
Factors correlated with Take-up of e-learning > 0.4<br />
Correlation<br />
The visible demonstration of e-learning success within the business has helped us<br />
maintain resources allocated to learning 0.74<br />
We can provide access to a wide range of learning opportunities 0.73<br />
We regularly communicate e-learning successes to managers 0.50<br />
We provide each new e-learning initiative with a specific identity and brand 0.47<br />
Change management is an integral part of our deployment and planning of e-<br />
learning 0.47<br />
Senior Management regularly demonstrate commitment to e-learning 0.46<br />
We have a clear understanding of what types of e-learning our internal IT systems can<br />
support 0.45<br />
There has been an increase in customer satisfaction since staff have had more<br />
access to e-learning 0.43<br />
We provide line managers with training and briefings relating to specific e-learning courses 0.43<br />
We use assessment tools to target skills needed to match work practices 0.43<br />
We are able to personalise the learning experience for each learner 0.43<br />
Tracking e-learning progress is essential for compliance purposes 0.43<br />
Staff can access e-learning from anywhere 0.40<br />
In completing the correlation calculations there was one factor that was close to zero in its<br />
correlation with the impact ratings of business, staff and uptake. This was the statement<br />
“Staff only study courses that are relevant to the work they are doing now or will do in the<br />
short-term future”. All other correlations exceeded 0.2, however the correlation for this factor<br />
was below 0.1. This is a strong indication that this particular factor is completely independent<br />
of the success, or otherwise, of e-learning. The implication is that those organisations who<br />
invest in learning credits so that employees can study content not directly relevant to their<br />
work, are unlikely to make a difference to the success of e-learning by this action although<br />
neither is it a detrimental activity. The correlation between this factor and positive changes<br />
in the behaviour and attitude of staff is 0.04. There are a number of other activities that<br />
would appear to be of uncertain value because of these lower correlation scores. Access to<br />
a mentor, coach or buddy also shows a weak relationship with any of the impact measures.<br />
<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 108
9 The changing face of e-learning<br />
9 <strong>Towards</strong> <strong>Maturity</strong> – The changing face of e-learning<br />
Overview: This Chapter considers the increasing provision of informal learning opportunities<br />
and the uptake by learners. It explores the various types of provision and the degree to<br />
which learners find them both helpful and useful.<br />
9.1 Informal learning and the views of learners<br />
Finding things out for themselves is an important part of learning for all learners. Respondents<br />
were asked to agree with the following 2 statements: “I learn most by finding things out for<br />
myself”; “I learn most from Courses provided to me”. Specifically they were asked: “Please<br />
consider the following 2 statements and score your agreement with each statement out of<br />
10. Please note that you cannot agree with both but you might mark both as 5 if you learn<br />
equally in both ways. Ideally the 2 scores should add up to 10, or close to 10.” Inspection of<br />
the scores indicates that only 2 or 3 learners failed to allocate a score of 10 between each<br />
one of these statements. The average agreement with the first statement is 6 and the<br />
average agreement with the second statement is 4. We may interpret from this that 60% of<br />
what is learnt is done so when learners find things out for themselves.<br />
Learner respondents were asked a number of questions relating to their use of informal<br />
learning methods. One is “Outside of the formal training programmes, how else do you go<br />
about learning things in relation to your work?” This question has a choice of 8 categories<br />
and the option to describe other ways in which they learn. Respondents could state whether<br />
the method was very helpful, helpful, used by them and not used by them as shown in Figure<br />
9.1.<br />
Figure 9.1 How learners are building their skills and knowledge<br />
Searching the web<br />
Conversations<br />
Online reference<br />
Books<br />
Industry publications<br />
Printed job aids<br />
Electronic help and job aids<br />
Participating in online communities<br />
(discussion groups)<br />
0% 20% 40% 60% 80% 100%<br />
n=736<br />
Frequently used & very helpful Used and helpful Used Not used<br />
Ref: This graph appears as Figure 35 in <strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers<br />
<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 109
9 The changing face of e-learning<br />
Learners were offered the opportunity to include additional methods of informal learning;<br />
10% did so but almost all of those are specific examples of methods listed above. Three<br />
comments stood out; 2 mentioned CPD and professional institute support and one<br />
mentioned “experimenting”, a healthy approach to learning from mistakes.<br />
The responses are analysed by age, gender, education level, management responsibility<br />
and work circumstances. The difference in the percentage of users for each of these<br />
informal methods varies across these segments. The 2 methods which varied least were<br />
electronic help and printed job aids where variation between all segments do not exceed<br />
10%. The 3 informal methods showing the greatest variation were amongst the ones most<br />
likely to be used: searching the Web, conversation and books, all of which showed a<br />
variation of about 30% between being least likely and most likely, depending on segment.<br />
9.1.1 Searching the Web<br />
Male respondents are slightly more likely to search the Web (56%) than female respondents<br />
(46%). Variation by age is less distinctive, with respondents aged 26 to 39 being most likely to<br />
search the Web (56%) and older learners least likely (47%). Location for where people learn<br />
shows a bigger difference; 62% of those who learn at home will search the Web, compared<br />
to only 30% at an internal learning centre. About half of those who learn in other locations<br />
will search the Web. Those who learn in their own time are slightly more likely to search the<br />
Web (58%) than those who learn in company time (50%). Not surprisingly work location has<br />
an impact with those working from home who are more likely to search the Web at 59%, than<br />
those who work in other locations (about half). Education level shows a consistent<br />
difference; those who achieve a higher standard of education are more likely to search the<br />
Web - 55% of graduates compared to 38% of those educated to 16.<br />
9.1.2 Conversations<br />
Those with a higher educational attainment are more likely to say they use conversations to<br />
learn from. Work location makes a difference, with only 41% of those working at home able<br />
to use conversations to learn from compared to about half in other work locations. Of those<br />
who learn in a quiet space 71% selected conversations as a means of learning, however<br />
there were only 32 respondents in this category so this difference should be viewed with<br />
some caution. Gender makes a small difference, with 45% of males and 52% of females<br />
saying they learn through conversations.<br />
9.1.3 Books, on-line reference and industry publications<br />
These 2 sources of informal learning show a similar pattern in probability of use by<br />
segmentation. Those who learn at home (28%) are more likely to use both sources, those<br />
who use an internal learning centre least likely (10%). This is mirrored by: those who work at<br />
home, where over a third use books and on-line references. This difference should be<br />
viewed with some caution, as there are only 35 respondents in this group. Books, unlike online<br />
reference, do show a significant and consistent change with education levels. Six<br />
percent of those educated to 16 will use books as a source of learning, compared to 26% of<br />
those educated to graduate level. Education levels affect the use of industry publications<br />
but this is not so exaggerated, with 6% of those educated to 16 using such publications and<br />
23% of those educated to graduate level. Those who learn in their own time are also more<br />
likely to use books, on-line reference and industry publications than those who work in<br />
company time.<br />
<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 110
9 The changing face of e-learning<br />
9.2 Technologies supporting informal learning<br />
Learners were asked their views of a range of technologies, some of which specifically<br />
support the type of informal learning shown in Figure 9.2.<br />
The 4 technologies that are most likely to be considered useful by learners are all associated<br />
with searching facilities. That is, learners who use technology to find out information for<br />
themselves in the absence of others. Over half of all respondents find this type of tool useful.<br />
The number of learner respondents who say that discussion boards and blogs and wikis are<br />
useful (27% and 17% respectively) is slightly more than those who say that participating in online<br />
discussion is both helpful and very helpful, a total of 18%.<br />
Figure 9.2 Technology supporting informal learning – learners’ views<br />
Search engines<br />
General web reference source<br />
Specific web reference source<br />
Searchable online books<br />
Discussion Boards<br />
Blogs/wikis<br />
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%<br />
Useful Not Useful Not Available<br />
Participating in on-line communities is the least used method of informal learning, used by<br />
only 34% of learner respondents. Age, education and work and learning circumstances all<br />
impact upon learners’ views. On-line communities are apparently a greater asset to those<br />
who work from home and to the older learner. Female learners and those of lower<br />
educational attainment are less likely to find on-line communities very helpful.<br />
Discussion boards on the other hand do not seem to be placed in the same category as online<br />
communities in the perceptions of users (Figure 9.3). Younger people have a preference<br />
for discussion boards, 33% perceive these to be helpful or very helpful as opposed to on-line<br />
communities where only 14% perceive them to be very helpful or helpful. It may be that an<br />
on-line community is perceived to be more formal than a discussion board or blogs/wikis.<br />
Work and learning circumstances have a big impact on the use of these informal tools.<br />
Those who work from home are the group most likely to be part of on-line communities, use<br />
discussion boards and contribute/learn from blogs/wikis.<br />
<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 111
9 The changing face of e-learning<br />
Figure 9.3 Discussion boards – which learners find them most useful?<br />
Learn at home<br />
Work on site<br />
Age is 25 or under<br />
Responsible for others<br />
Learn in own time<br />
Education to 18<br />
Age is 55 or over<br />
Education to Graduate level<br />
Female<br />
Work from home<br />
I manage my own time<br />
Work at a regular place<br />
Age is 26 to 39<br />
My time is managed for me<br />
Learn in company time<br />
Male<br />
Learn at the desk<br />
Education to 16<br />
Age is 40 to 54<br />
No management responsibility<br />
Education to Post 18<br />
0% 5% 10% 15% 20% 25% 30% 35% 40%<br />
The use of blogs and wikis shows a similar usage pattern to that of discussion boards although<br />
with overall less frequency; as expected for a relatively new technology. Education levels<br />
seem to have a greater impact on the probability of learners using blogs and wikis than it<br />
does for discussion boards. It is somewhat surprising to see that those who work from home<br />
are amongst the group most likely to use discussion boards but least likely to use blogs and<br />
wikis. Users do not perceive these software tools as comparable or serving the same<br />
purpose. Neither do users directly relate participation in on-line communities with the use of<br />
discussion boards or blogs/wikis.<br />
<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 112
9 The changing face of e-learning<br />
Figure 9.5 Use of blogs/wikis – which learners find them most helpful?<br />
Learn at home<br />
Education to Graduate level<br />
Learn in own time<br />
Age is 55 or over<br />
Work at a regular place<br />
Responsible for others<br />
Age is 26 to 39<br />
Age is 40 to 54<br />
I manage my own time<br />
Female<br />
Male<br />
Learn at the desk<br />
No management responsibility<br />
Learn in company time<br />
Work on customer site<br />
My time is managed for me<br />
Age is 25 or under<br />
Education to 16<br />
Education to Post 18<br />
Education to 18<br />
Work from home<br />
0% 5% 10% 15% 20% 25%<br />
9.3 Learners’ willingness to contribute<br />
Learner respondents were asked: “Are you willing to use technology to share your knowledge<br />
to help others learn (e.g. contributing to discussions rooms, etc.)? They were allowed 4<br />
possible responses as shown in Figure 9.4.<br />
The bottom line in this figure reports the responses from all learners who participated in the<br />
survey. Eighty-four percent of respondents were either already using technology to help<br />
others learn or would do so if they had the opportunity. The 26% who already do so is a close<br />
match to the 27% who find discussion boards useful and the 17% who find blogs/wikis useful.<br />
As on-line communities are only considered to be helpful by 18% of respondents it would<br />
seem that learners have a preference for using other forms of collaborative technology<br />
rather than on-line communities. Some differences emerged based upon the management<br />
responsibility of the respondent. Those who manage their own time are more likely to be<br />
willing to contribute to the learning of others through technology as are individuals with<br />
management responsibility for others.<br />
Responses to this question were also segmented on work circumstances, where a number of<br />
differences emerged. Those who work from home are most likely to be already using<br />
technology to help others learn. They are also most likely to say they would feel<br />
uncomfortable doing so, possible because their working relationships with others are not<br />
sufficiently social. Those who learn in their own time are also more likely to help others.<br />
<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 113
9 The changing face of e-learning<br />
Figure 9.4 Willingness to use technology to help others learn (by responsibility)<br />
Responsible for others<br />
No responsibility for others<br />
I manage my own time<br />
My time is managed for me<br />
All<br />
0% 20% 40% 60% 80% 100%<br />
I already do<br />
I would feel uncomfortable<br />
If I had the opportunity<br />
I don't have the time<br />
Figure 9.5 Willingness to use technology to help others learn (by time/location)<br />
Learn in company time (590)<br />
Learn in own time (148)<br />
Work on customer site (49)<br />
Work from home (32)<br />
Work at a regular place (653)<br />
Learn in a quiet spot (28)<br />
Learn at the desk (570)<br />
Learn at home (119)<br />
Learn at an internal centre (20)<br />
0% 20% 40% 60% 80% 100%<br />
I already do<br />
I would feel uncomfortable<br />
If I had the opportunity<br />
I don't have the time<br />
Not surprisingly a picture emerges that those who are in a position to take more control over<br />
their learning, because they work at home, or because they manage their own time, are<br />
more likely to wish to contribute to the development of others using remote methods.<br />
<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 114
9 The changing face of e-learning<br />
9.4 Informal methods and tools – the employers view<br />
If employees are willing to help other people and use a wide variety of informal learning<br />
methods and supporting software tools, how are employers intending to respond?<br />
Figure 9.6 Informal methods in supporting technologies<br />
On-line books / job aids<br />
64%<br />
3%<br />
Video conferencing<br />
Content Management Systems<br />
Search Portals<br />
On-line company experts<br />
52%<br />
45%<br />
49%<br />
49%<br />
8%<br />
15%<br />
4%<br />
3%<br />
Virtual classroom<br />
Unmoderated chat rooms/discussion groups<br />
Moderated chat rooms/ discussion groups<br />
Communities of practice<br />
38%<br />
36%<br />
32%<br />
43%<br />
13%<br />
14%<br />
17%<br />
4%<br />
Blogs/wikis<br />
19%<br />
15%<br />
0% 20% 40% 60% 80%<br />
n=164<br />
Currently in use<br />
Planned within 3 years<br />
The percentage indicating that they are planning to use particular technologies is<br />
consistently greater than that for planning additional informal services or methods. It seems<br />
as if employer respondents think about the technology first and its application to learning<br />
second. It may also be indicative of the fact that publications and conferences tend to<br />
focus on the technologies that are being developed rather than the service that may be<br />
provided as a result.<br />
It is apparent from this that the tools which support social learning (blogs/wikis, moderated<br />
chat rooms, un-moderated chat rooms, virtual classrooms and, possibly content<br />
management systems/virtual learning environments) indicate a 30% growth rate; almost 80%<br />
in the case of blogs/wikis. This possible 30% growth rate must be balanced by an 8% growth<br />
in communities of practice and it may well be that organisations yet have to define how they<br />
will use social software and the types of services they will be delivering through them.<br />
However, almost 70% of the more mature organisations are using communities of practice;<br />
this drops to between one-third and one-fifth of organisations that have not yet reached a<br />
high level of maturity. This would indicate a much faster growth in communities of practice<br />
than is indicated by the previous figure. On the assumption that it takes between 2 to 3 years<br />
for an organisation to become mature we may predict a growth in communities of practice<br />
of 80%.<br />
<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 115
9 The changing face of e-learning<br />
Figure 9.7 Informal services and supporting technologies by maturity<br />
80%<br />
60%<br />
40%<br />
20%<br />
0%<br />
Search<br />
portals<br />
On-line<br />
experts<br />
Communities<br />
of practice<br />
Online<br />
books/job<br />
aids<br />
CMS / VLE<br />
Virtual<br />
classrooms<br />
Unmoderated<br />
chat rooms<br />
Moderated<br />
chat rooms<br />
Video<br />
conferencing<br />
Blogs/wikis<br />
Less mature (n=54) Using<br />
More mature (n=83) Using<br />
Becoming mature (n=75) Planned<br />
Becoming mature (n=75) Using<br />
Less mature (n=54) Planned<br />
More mature (n=83) Planned<br />
Based on this maturity analysis, search portals and the availability of on-line company experts<br />
show a 30% growth rate as opposed to about 10% predicted from the previous graph.<br />
Combining the 2 methods of forecasting indicates a growth rate of closer to 20% by 2010.<br />
The provision of on-line books and job aids may well be close to saturation, with 64% of all<br />
respondents providing this service, 74% of more mature users. Video conferencing may well<br />
have peaked as well, although 8% of organisations predict they will be using this technology<br />
by 2010 in addition to the 56% already using it. There is less difference with maturity (45% to<br />
56%) indicating that this is not a technology whose use is linked to maturity although planning<br />
to use it may be with 13% of the more mature doing so compared to 5% of the less mature.<br />
Growth rate of this technology is more difficult to predict from this survey; perhaps because<br />
its use is driven by corporate goals not associated with learning.<br />
The collaborative tools of virtual learning environments, virtual classrooms and both<br />
moderated and un-moderated chat rooms show a significant difference between usage by<br />
the more mature and the less mature.<br />
Approximately half of the more mature organisations will be using these technologies<br />
compared to about one-third of the less mature. With the exception of VLEs/CMS, a greater<br />
percentage of the more mature organisations are planning to introduce these technologies<br />
within the next 3 years; typically 10% as opposed to about 18%. For VLEs/CMS the results are<br />
reversed with 20% of the less mature planning to introduce CMS/VLE compared to 12% of the<br />
more mature. The CMS/VLE has a number of different functions, at one extreme it may be<br />
considered primarily as a means of managing and delivering content. At the other extreme<br />
it may be considered as a means of facilitating groups and teams of people working<br />
together to create both learning content and conducting and collaborating on learning<br />
activities. Whatever the reason for this difference an analysis of use by maturity indicates a<br />
growth rate of 100%.<br />
<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 116
9 The changing face of e-learning<br />
For the majority of social learning and social software tools more mature organisations are<br />
almost twice as likely to use these tools as the less mature. The exception to this is blogs and<br />
wikis, which are used by 25% of the more mature and approximately 17% of others. However,<br />
these are new technologies and concepts and, even the more mature organisations will<br />
have had little time to assess their capability of delivering learning and consider the best way<br />
of deploying them. Wikipedia was created in 2001 and is the best known example of a wiki,<br />
The use of this type of collaborative Web site took 2 to 3 years to move from a mainly<br />
academic purpose into various types of corporate applications. We see almost as many of<br />
the more mature organisations planning to use blogs and wikis as are currently using them.<br />
This indicates a growth rate of 100% amongst the more e-learning mature organisations.<br />
Employer respondents were segmented into quartiles based upon both staff impact and<br />
business impact. Organisations in the top quartile for both business impact and staff impact<br />
are more likely to be using various informal techniques for enabling learning. It would appear<br />
that the use of on-line books/job aids has the greatest effect on business impact; 47% of<br />
those in the bottom quartile of business impact will be providing this service, compared to<br />
85% of those in the top quartile. The availability of both on-line communities and search<br />
portals appear to have the greatest effect on staff impact. Of those who achieve least staff<br />
impact 21% will deliver on-line communities and 26% make search portals available. For<br />
organisations that achieve the greatest staff impact from e-learning this rises to 65% for online<br />
communities and 75% for search portals.<br />
Investment in on-line books and job aids is likely to show the greatest business return and<br />
investment in search portals and on-line communities is likely to show the biggest change on<br />
staff motivation and behaviour. The inference is that on-line books and job aids are focused<br />
directly at job performance, whereas alternative methods of informal learning bring greater<br />
satisfaction to users but the effect on the business may be slightly diluted because such<br />
services enable learners to explore and learn topics not directly related to their immediate<br />
job performance.<br />
Figure 9.8 Use of informal techniques compared to staff impact of e-learning<br />
80%<br />
60%<br />
40%<br />
20%<br />
0%<br />
Top quartile 3rd quartile 2nd quartile Bottom quartile<br />
Staff Impact<br />
Search portals<br />
Online communities<br />
Online company expertise<br />
Online books/job aids<br />
<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 117
9 The changing face of e-learning<br />
Figure 9.9 Use of informal techniques compared to business impact of e-learning<br />
100%<br />
80%<br />
60%<br />
40%<br />
20%<br />
0%<br />
Top quartile 3rd quartile 2nd quartile Bottom quartile<br />
Business impact<br />
Search portals<br />
Online communities<br />
Online company expertise<br />
Online books/job aids<br />
9.5 Spend on e-learning<br />
One hundred and thirteen respondents provided information about the budgets they spent<br />
on e-learning. Respondents were asked what percentage of their overall training budget<br />
was currently spent, by what percentage of the current budget this was expected to<br />
increase and an estimate of the overall training budget for their organisation. In some cases<br />
respondents withheld overall budgets. The average percentage of total training budgets<br />
spent on e-learning is 17%. The average forecast growth in this expenditure is 70%.<br />
Combining these 2 pieces of information we may assume that by 2010, 26% of training<br />
budgets will be spent on e-learning. This forecast is comparable to one in 2004 predicting<br />
that between 30% and 33% of learning inside organisations would be delivered by e-<br />
learning. 4<br />
There is considerable variation in these figures when compared by sector and maturity.<br />
Figure 9.10 reports the current and projected percentage of total training budgets spent on<br />
e-learning for those sectors where at least 10 respondents completed usable budget<br />
information. Two sectors stand out as being leaders in investment in e-learning; education<br />
and IT/telecommunications spend a greater part of their budget on e-learning than<br />
organisations in other sectors.<br />
More mature organisations spend a greater proportion of their training budget on e-learning<br />
(23%) than do the least mature (6%). Less mature organisations do expect to double their<br />
budget to 12% and the more mature expect to increase their budget to 36% (Figure 9.11).<br />
4 Report on Embedding e-learning in large Organisations, Hills (2004) published byUfi.<br />
<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 118
9 The changing face of e-learning<br />
Figure 9.10 e-learning budget plans vary with sector<br />
50<br />
40<br />
% budget<br />
30<br />
20<br />
10<br />
0<br />
Health (10)<br />
Manufacturing<br />
(11)<br />
Transport (11)<br />
IT & Telecoms<br />
(12)<br />
Finance (15) Education (20) Public admin<br />
(21)<br />
n=100<br />
Current spend on 'e' Planned spend on 'e' in 2010<br />
Ref: See also Figure 57 in <strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers<br />
Figure 9.11 e-learning budget plans very with maturity<br />
70%<br />
60%<br />
50%<br />
40%<br />
30%<br />
20%<br />
10%<br />
0%<br />
n=113<br />
Novice Sporadic Developing Established Embedded Innovators<br />
% Spend Predicted increase<br />
Ref: This graph appears as Figure 58 in <strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers<br />
<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 119
9 The changing face of e-learning<br />
Figure 9.12 Percentage of budget spent on e-learning<br />
8.00<br />
7.00<br />
6.00<br />
5.00<br />
4.00<br />
3.00<br />
2.00<br />
1.00<br />
0.00<br />
Budget > 30%<br />
n=25<br />
Budget 20 - 30%<br />
n=12<br />
Budget 10 - 20%<br />
n=23<br />
Budget < 10%<br />
n=53<br />
Take up Availibility Business Impact Staff Impact<br />
Organisations who responded with budget information were segmented by the proportion of<br />
their budget they spent on e-learning. The segments used were those who spent less than<br />
10%, those who spent between 10 and 20%, those between 20 and 30% and those who spent<br />
more than 30% of their total training budget on e-learning. This does not produce equal<br />
numbers of organisations in each segment and, as can be seen, almost half of all<br />
respondents supplying budget information spend less than 10% on e-learning. This graph<br />
does show that those who spend a greater proportion of their budget on e-learning achieve<br />
improved take-up, availability, business impact and staff impact. Average agreement with<br />
the various statements that are used to describe staff impact rises from 4.3 to 6. This is closely<br />
mirrored by the measurement of take-up from 4.4 to 6.3.<br />
The greatest difference with increasing budget is on business impact, which rises from an<br />
average agreement of 5 to an average agreement of 7. The change in availability shows<br />
least difference. Those organisations who spend more must therefore be channelling this<br />
expenditure into areas that have a greater effect on business impact than on the availability<br />
of e-learning. Given the analysis so far completed, it is likely that this increased budget<br />
spend goes towards change management and promotional activities and it is this that<br />
increases the business impact, staff impact and take-up of e-learning. Global companies<br />
spend a greater proportion of their budget (18%) than other organisations, except for those<br />
operating from one UK site. Global companies also predict that they will increase their e-<br />
learning spend by a greater amount (20%) than other companies. Elsewhere in the report<br />
the anomaly of the single UK site companies is discussed and can be seen reflected in the<br />
budget spend, as their average is 27%. This seems to be influenced by the small number of<br />
education companies in this particular segment who seem to be investing in e-learning as a<br />
delivery platform for the future.<br />
<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 120
10 The education sector<br />
10 Comparison of education sector with other sectors<br />
Overview: This section investigates differences between the education sector and other<br />
sectors. There is a probability that organisations in the education sector do things differently<br />
to others. There may be opportunities for other sectors to learn from the education sector, the<br />
opposite may also apply.<br />
An initial comparison for the principal dimensions is shown in Figure 10.1. Organisations not in<br />
the education sector rate themselves one point higher than organisations in the education<br />
sector for all 4 dimensions. It would appear that non-educational organisations are more<br />
successful at e-learning than those in the education sector. They achieve greater<br />
availability, more business impact, a greater uptake and e-learning has a greater impact on<br />
employees.<br />
Figure 10.1 Differences in dimensions – education sector versus others<br />
7.00<br />
6.00<br />
5.00<br />
4.00<br />
3.00<br />
2.00<br />
1.00<br />
0.00<br />
Uptake Availability Business Impact Staff Impact<br />
Others (n=127)<br />
Education sector (n=22)<br />
Table 10.1 lists those factors with a difference between the education sector and others of<br />
more than 10%: where the education sector has a higher self perception this is never more<br />
than a 3% difference. The first and third items listed are both associated with change<br />
management and promotion of e-learning. The education sector uses fewer communication<br />
methods when launching e-learning than other sectors. Less than a quarter use posters, as<br />
opposed to almost half of others. The education sector makes no use of giveaways at<br />
launch, compared to 10% of organisations in the other sectors. However, 10% of<br />
organisations in the education sector do use SMS messages. The education sector does use<br />
giveaways to maintain interest but makes less use of line management briefings.<br />
<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 121
9 The education sector<br />
Table 10.1 Significant differences in self-perception ratings<br />
Other Sectors<br />
Education<br />
Sector<br />
Recorded<br />
difference<br />
Change management used 6.13 4.26 1.86<br />
Impact on record keeping 5.85 4.00 1.85<br />
Brand and identity for e-learning 5.51 3.95 1.56<br />
Information easy to use 8.33 7.00 1.33<br />
Appraisal used 6.95 5.74 1.21<br />
Manager's coach teams 6.00 4.79 1.21<br />
Skills to manage providers 6.82 5.63 1.19<br />
Skills audit completed 4.79 3.68 1.11<br />
Importance of compliance tracking 6.82 5.74 1.08<br />
Staff know what is available 6.50 5.53 0.98<br />
It would appear that the education sector could learn from other sectors as regards<br />
promotion, marketing and change management for e-learning. The fact that non-education<br />
sector organisations do more marketing will explain the difference of almost 20% in the self<br />
rating perceptions of change management and branding.<br />
There is a 20% difference in the impact e-learning has on record keeping. Companies in the<br />
education sector tend to disagree with the statement ‘e-learning has improved our record<br />
keeping for compliance purposes’. Education sector respondents may feel compliance is<br />
not relevant or they may feel that proper attention is paid to record keeping for compliance<br />
purposes so e-learning has less of an impact.<br />
Managerial support through appraisal and coaching appears to be less successful in the<br />
education sector. Although as reported later in this section it does occur more often.<br />
The education sector perceives itself to be slightly less likely to have the skills to manage e-<br />
learning providers and will tend to disagree with the statement that they have audited their<br />
training function for the skills required to deliver e-learning. If the results of implementing e-<br />
learning in the education sector are different to those of other sectors perhaps the drivers are<br />
different.<br />
<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 122
10 The education sector<br />
10.1 Comparison of probability of drivers being selected<br />
Figure 10.2 Drivers for e-learning<br />
Increase access to learning<br />
Increase flexibility in providing staff training<br />
Better manage or administer work-based learning<br />
Develop a better qualified workforce<br />
Reduce training costs<br />
New regulations and legal requirements<br />
Demand from workforce<br />
Maintain public image of a progressive and<br />
innovative organisation<br />
Organisational change<br />
Pressure from senior management<br />
0% 20% 40% 60% 80%<br />
Others N=171 Education Sector N=41<br />
Figure 10.2 shows the probability of respondents selecting from one of the 14 drivers (only<br />
displayed where there was a difference of more than a few percentage points between the<br />
education and other sectors). About half of those in the education sector are interested in<br />
increasing flexibility through the use of e-learning, compared to almost three-quarters of<br />
those in other sectors. Only a third are influenced by a need to reduce training costs<br />
compared to a half of those in other sectors. They appear to be less driven by a need to<br />
respond to new regulations and legal requirements; only 10% compared to over 25% in other<br />
sectors. Access and flexibility do remain the 2 most frequently cited drivers, as they do for all<br />
other sectors. However, administration and qualifications are slightly more likely to be<br />
selected than a need to reduce costs.<br />
Those in the education sector are more likely to be driven by organisational change and the<br />
requirement to maintain the image of a progressive and innovative organisation. They also<br />
experience more pressure from senior management, although this remains an infrequently<br />
selected driver even for the education sector.<br />
The pattern emerges where image and organisational change matter to a much greater<br />
extent for this sector and cost, qualifications and administration matter less. Whilst the<br />
emphasis for e-learning is different; does this translate into different results?<br />
Companies in the education sector are less likely to provide training in every topic area<br />
except that of literacy and numeracy, although less than 40% offer these topics. Where<br />
training is offered in a particular topic e-learning is used less than by other sectors, except for<br />
foreign language training; 24% use e-learning for foreign language training in the education<br />
sector, as opposed to 19% in other sectors.<br />
<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 123
9 The education sector<br />
For programmes leading to qualifications the picture is different. Educational organisations<br />
are marginally more likely to use e-learning in apprenticeship training, foundation degrees<br />
and learning programmes for customers, suppliers and community programmes. The<br />
education sector is leading the way in deploying e-learning for programmes which lead to<br />
qualifications. However, less than a quarter of organisations in this sector are deploying e-<br />
learning in this way.<br />
Companies in the education sector are less likely to deliver e-learning to as many roles as<br />
those in other sectors. This is most noticeable at a senior level, where only 40% of<br />
organisations deliver e-learning to directors and senior management, compared to 53% in<br />
other sectors. Bearing in mind what we already know about the importance of the<br />
leadership role for directors in setting an example in the use of e-learning, it may be that this<br />
is one of the main influences on the reduced performance of the education sector reported<br />
in Figure 10.1. Possibly the most important item that the education sector can learn from<br />
others is that directors and senior managers should use e-learning personally.<br />
Companies in the organisation sector also deliver e-learning to fewer places than others,<br />
most noticeably only 17% deliver e-learning in a quiet area (43% in other sectors) and only<br />
13% make it available when travelling (23% in other sectors).<br />
Educational organisations are also more likely to have a strategy (42%) than others (31%).<br />
The training function is less likely to be a decision maker in deploying e-learning (35% in<br />
education and 65% in others).<br />
10.2 Sourcing and development of e-learning<br />
Only 15% of those in the education sector use rapid development tools designed for users,<br />
compared to 50% in other sectors. They prefer to use tools designed for Web experts and<br />
programmers (54%) compared to other sectors (27%). They are less likely to work in<br />
partnership with an e-learning vendor (47% for other sectors compared to 27% for the<br />
education sector). They are more likely to work in partnership with other educational suppliers<br />
(23% as opposed to 16% for others). A picture emerges where the education sector develops<br />
more complex and less procedurally based e-learning, more likely working with others in the<br />
same sector.<br />
10.3 Funding<br />
Educational organisations make more use of public funding than others with a much greater<br />
likelihood of pursuing European and RDA funding. Only 60% use their own budget for e-<br />
learning, compared to 76% in other sectors. Those in the education sector clearly take a<br />
much wider view of where they can obtain funding from; whether they are private or public<br />
funded organisations. They demonstrate a better understanding of the various routes used to<br />
fund education and training, both in the UK and the European Union.<br />
10.4 Learner support<br />
The education sector makes significantly more effort to support learners than those in other<br />
sectors. Figure 10.3 shows the probability of organisations supporting learners.<br />
<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 124
10 The education sector<br />
Figure 10.3 Support provided to learners<br />
Techncial<br />
support Study Support<br />
With a tutor by email<br />
With a tutor by phone<br />
In person before<br />
on-line web reference<br />
In person during study<br />
Virtual classroom system<br />
In person after study<br />
Through a resource centre<br />
By email<br />
Telephone help desk<br />
In person<br />
Web resource<br />
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%<br />
Education sector (n=22)<br />
Others (n=127)<br />
Ref: This graph appears as Figure 42 in <strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers<br />
Apart from support through a resource centre, the education sector is more likely to support<br />
learners by any one of the options offered by the survey questions. They are almost twice as<br />
likely to use telephone and in-person support as those in other sectors. This is also true, in the<br />
main, for technical support. It is equally likely that organisations in either of the sectors being<br />
considered will provide support through a telephone help desk or a Web resource. It is more<br />
likely that that companies in the education sector provide support either by email or in<br />
person. The education sector puts more effort into supporting learners and makes a greater<br />
provision for personal contact for technical support.<br />
Does this increased support also apply to help in consolidating learning?<br />
The education sector makes more use of line manager coaching and feedback. However<br />
this conflicts with earlier evidence, where those in the education sector were more likely to<br />
disagree with the statement ‘managers coach their own teams’. They are more likely to say<br />
that line manager coaching and feedback support is provided to help learners consolidate<br />
and apply what they have learnt but marginally less likely to agree that line managers coach<br />
their teams. The difference is small, nevertheless only one-third of organisations agreed with<br />
the Likert self-perception question that managers coach their own teams and 50%<br />
disagreed. This compares to 48% of non-educational organisations who agree that<br />
managers coach their own teams and only 13% disagree. What appears to be a positive<br />
attribute of the education sector; greater occurrence of line managers coaching support<br />
after learning may not fully translate to effective coaching as normal practice. The<br />
education sector makes less use of periodic re-assessment as a line management function.<br />
The education sector makes less use of electronic help and job aids, which are normally used<br />
for procedural tasks in which the education sector may be less interested.<br />
<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 125
9 The education sector<br />
Figure 10.4 Help in consolidating learning<br />
Line manager coaching and feedback support<br />
Job related assignments<br />
Reference books<br />
Periodic re-assessment<br />
Printed job aids<br />
Electronic help and job aids<br />
0% 10% 20% 30% 40% 50% 60%<br />
Education sector (n=22)<br />
Others (n=127)<br />
10.5 Technologies used and considered<br />
Respondents were asked questions about the formal and informal software tools and<br />
resources they knew about, they used or planned to use.<br />
Figure 10.5 Learning technologies in use<br />
Content Management System (CMS, VLE)<br />
Moderated chat rooms / discussion groups<br />
Blogs/wikis<br />
Podcasting<br />
Video on demand<br />
Non-moderated Chat rooms / discussion groups<br />
Mobile learning<br />
Games & simulations<br />
Open source tools<br />
Video conferencing<br />
Rapid development tools<br />
Competency Management System<br />
Learning Management System (LMS)<br />
Virtual classroom<br />
Electronic Performance Support Systems<br />
e-portfolios<br />
0% 5% 10% 15% 20% 25% 30%<br />
Education sector (n=22)<br />
Others (n=127)<br />
<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 126
10 The education sector<br />
Figure 10.5 plots the probability of organisations in either sector stating that they currently use<br />
the technologies listed. The upper part lists technologies that those in the education sector<br />
are more likely to use, the lower those they are less likely to use. The education sector is more<br />
likely to use the collaborative tools of social learning; that is chat rooms, virtual classrooms<br />
and blogs/wikis. They are also likely to make more use of open source tools and podcasting.<br />
Noticeable differences between the two sectors concern electronic performance support<br />
systems (EPSS) and competency management. EPSS is specifically designed to support<br />
procedural or system use applications and lends itself to quite complex cognitive tasks such<br />
as diagnostics and fault finding. It does not necessarily reinforce understanding. Additionally<br />
EPSS may be quite expensive to develop and therefore require a very robust business case in<br />
a subject area showing significant revenue return. Competency management systems are<br />
primarily used to monitor and assess the capability of individuals, or a group of individuals,<br />
against defined competencies for a specific job or jobs. Its most significant application is in<br />
managing the HR capability of an organisation as represented by the people it employs.<br />
The education sector are twice as likely to be using e-portfolios, approximately half of<br />
respondents in the education sector selected this as a technology they were deploying<br />
compared to a quarter of those in the non-education sector.<br />
10.6 The future - do educational organisations have a different view?<br />
In terms of the main barriers to the increasing use of e-learning by 2010 there are only 3 of the<br />
barriers where the view of the education sector is significantly different to that of others.<br />
Unreliable ICT is considered a barrier by relatively few educational organisations (8%)<br />
compared to 26% of those in other sectors. Additionally access to PCs is cited by fewer<br />
educational organisations, 4% as opposed to 9% of others. Half of them perceive a lack of<br />
skills to manage e-learning in the future as a barrier and this compares with only 31% of those<br />
in other sectors. This is somewhat supported by Table 10.2 which shows the difference in<br />
agreement on a variety of statements related to Training Function capability.<br />
Table 10.2 Capability of the training function<br />
Education<br />
sector<br />
Other<br />
sectors<br />
We have the skills to manage external e-learning providers effectively 5.6 6.8<br />
We have good links/relationships with the IT department 6.7 6.9<br />
We have a clear understanding of what types of e-learning our internal IT<br />
systems can support 6.4 7.3<br />
Our internal training team is willing to embrace new ways of working with<br />
technology 6.5 7.3<br />
We have audited the skills of those in the training function against the<br />
skills required for e-learning 3.7 4.8<br />
<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 127
9 The education sector<br />
This table compares the average agreement with the 5 statements that were grouped within<br />
the survey under the heading ‘Capability of the training function’. As reported in Appendix<br />
A 4 of these statements have a close agreement in the way they behave. We can see from<br />
the ratings that the education sector does have a more pessimistic view of the capability of<br />
its training function than those in other sectors. The 2 largest differences relate to the skills of<br />
the training function, both audit and perceived capability to manage external providers. It<br />
would appear that the ICT capability within the education sector is greater than that in other<br />
sectors but that the training functions have not yet risen to the challenge presented by the<br />
opportunity that this infrastructure presents.<br />
This barrier does not prevent the education sector being more enthusiastic about the future<br />
of e-learning than other sectors.<br />
The upper half of Figure 10.5 lists those technologies that the education sector is more likely<br />
to plan for than others. In the majority of cases these are the technologies they are already<br />
making more use of. The education sector intends to do more of what it is currently doing.<br />
The greatest difference in expected growth is the use of content management systems,<br />
currently in use in almost 75% of respondents in the education sector. A response of 25%<br />
indicates that 100% of the education sector will using content management systems by 2010.<br />
It is worth pointing out that the question included VLEs (Virtual Learning Environments). For<br />
many in the education sector these will be interpreted as an environment in which students<br />
and tutors can exchange content in a safe and secure environment. Some current VLEs<br />
implemented in the education sector are in fact devoid of content; such content being<br />
provided by the users which include tutors as well as learners. When we also see that the<br />
education sector expects to make more use of chat rooms and blogs and wikis the pattern<br />
that emerges is one that is of significantly greater use of social learning software tools.<br />
The growth of open source tools within the education sector is set to continue, however it<br />
would appear that the education sector is likely to take a greater interest in rapid<br />
development tools in the future.<br />
It is likely that the education sector will continue to take the lead in collaborative learning,<br />
evidenced by its greater interest in the technology tools that support social learning and the<br />
greater effort they put into supporting learners, before, during and after study.<br />
<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 128
11 The future of e-learning<br />
11 The future of e-learning<br />
Overview: This chapter looks at the plans organisations are making for the future, particularly<br />
in relation to maturity, and explores how barriers to increasing uptake of e-learning are<br />
changing.<br />
Respondents were asked the extent to which they agreed with 5 statements about e-<br />
learning within the next 3 years. A specific question was “How do you see e-learning in your<br />
organisation in 3 year’s time?” Their responses are shown in Figure 11.1.<br />
Figure 11.1 Predictions for the future of e-learning<br />
We will place greater emphasis on<br />
supporting informal learning within the<br />
organisation<br />
The organisation will have electronic access<br />
to the training records of every employee<br />
All employees will have learning records they<br />
can access and an electronic learning plan<br />
e-learning will replace all traditional methods<br />
of corporate training like classroom training<br />
e-learning will be part of all training and<br />
development programmes<br />
0% 20% 40% 60% 80% 100%<br />
Agree Don't know Disagree<br />
Four out of 5 employer respondents agreed that they would place greater emphasis on<br />
informal learning, they would have access to electronic training records and employees<br />
would have access to those records and an on-line learning plan. For informal learning 80%<br />
exceeds the percentage of organisations planning and using informal services. The<br />
increasing importance of electronic records explains the high current and planned usage of<br />
Learning Management Systems. There is less universal agreement (66%) that e-learning will be<br />
part of all training and development programmes. This slightly exceeds the current<br />
penetration based upon respondents’ answers concerning the use of e-learning by topic.<br />
Based upon the results from all respondents 53% of the total possible occurrences of training<br />
taking place do so with some element of e-learning included. Every topic includes the use e-<br />
learning, in whole or in part, from at least one of the employer respondents. e-learning alone<br />
was selected as an option for a topic in just 5% of cases (3% if programmes and topics are<br />
included together).<br />
<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 129
11 The future of e-learning<br />
Only 6% of respondents agree with the statement that e-learning will replace all traditional<br />
methods of corporate training. It is very clear that the significance of a blended approach,<br />
in which e-learning forms part of an offer, is now widespread. The majority of topics and<br />
programmes are delivered, either with no e-learning component, or with e-learning as part<br />
of the mix. Furthermore, about half of all training by topic and respondent contains some<br />
element of e-learning. These predictions are compared by the maturity of the respondents.<br />
Figure 11.2 Predictions of e-learning futures by maturity<br />
Greater emphasis on informal learning<br />
77%<br />
electronic access to the training records<br />
All employees will have learning records<br />
58%<br />
e-learning will replace traditional<br />
methods<br />
12%<br />
e-learning will be part of all training<br />
programmes<br />
0% 20% 40% 60% 80% 100%<br />
Less mature (n=39) Becoming mature (n=58) More mature (n=66)<br />
Note the numbers included in the above figure are results from a 2004 study. 5<br />
More mature organisations are more likely to agree with the statements that there will be a<br />
greater emphasis on informal learning and that training records will be used, which<br />
employees have access to. Interestingly, one in 10 of more mature users believe that e-<br />
learning will replace traditional methods.<br />
The greatest difference reported in the figure above relates to the statement that e-learning<br />
will be part of all training programmes. Less than 2 in 5 of the less mature organisations agree<br />
with this statement compared to 4 out 5 of the more mature. This indicates one of the<br />
changes that maturity brings about is an appreciation that e-learning can be used for a<br />
greater range of topics.<br />
In 2004 77% of respondents agreed that organisations would have electronic access to the<br />
training records of every employee (now 82%.) Then 58% agreed that employees would have<br />
access to learning records (now 76%). In 2004 12% of respondents believed that e-learning<br />
would replace traditional methods of corporate training, like classroom training, now in 2006<br />
5 Embedding e-learning in large Organisations, Hills (2004)<br />
<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 130
11 The future of e-learning<br />
only 6%. In 2004 35% agreed that e-learning would only be used for a few specialist<br />
applications and in 2006 21% disagree with the statement that e-learning will be part of all<br />
training programmes although this changes with maturity; 40% of the less mature, 16% of<br />
those becoming mature and 13% of the more mature. This reinforces the view that maturity<br />
brings with it a more wide spread realisation that e-learning is suitable for more than just<br />
specialist application and that this realisation has become more wide spread since 2004.<br />
The 2004 study did not include any discussion or collection of data in regards to informal<br />
learning.<br />
11.1 Challenges for e-learning<br />
Respondents were asked what they thought were the main barriers to their company<br />
increasing the use of e-learning over the next 3 years. They were asked to select the 3 most<br />
significant from a list although no limit was applied. They were also given an opportunity to<br />
comment on additional barriers not provided in the list. Many respondents selected up to 6<br />
barriers (average number selected by all respondents is 3.3, including the ‘other’ option).<br />
Figure 11.3 Barriers to e-learning in the next 3 years<br />
Cost<br />
Staff resistance<br />
Lack of knowledge about potential<br />
Lack of e-learning management skills<br />
Lack of relevant, quality material<br />
Available content too generic<br />
Inadequate ICT infrastructure<br />
Poor past experience<br />
Staff ICT skills<br />
Hype from suppliers<br />
No staff access to PCs<br />
No need to change<br />
0% 10% 20% 30% 40% 50% 60%<br />
Less mature (n=38) Becoming mature (n=58) More mature (n=66)<br />
More mature organisations are less likely to perceive cost, staff resistance, lack of knowledge<br />
of potential and lack of e-learning management skills as barriers. As these are the 3 barriers<br />
most likely to be selected by less mature organisations (both less mature and becoming<br />
mature in the figure above) this indicates that maturity brings with it the appreciation and<br />
skills to reduce the barriers, as they are first perceived. Cost is perceived as less of a barrier as<br />
organisations become more mature, as does the resistance of staff. Less mature<br />
<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 131
11 The future of e-learning<br />
organisations are slightly less likely to say they have a lack of knowledge about the potential<br />
of e-learning, as those who are becoming mature. This may indicate that early exposure to<br />
e-learning increases the realisation that it requires some skill and knowledge to bring out its<br />
full potential and that the less mature do not yet have this appreciation. Of those who are<br />
less mature and becoming mature about 40% select management skills as a barrier, but this<br />
drops by half to 21% for the more mature organisations.<br />
Lack of relevant quality material remains an issue more or less independent of maturity,<br />
although the importance of this barrier does reduce at an early stage of e-learning<br />
development. Almost half of less mature organisations are concerned that available<br />
content is too generic for their organisation and this drops to 17% for the most mature<br />
organisations. The inference is that this demonstrates a growing confidence with maturity<br />
that bespoke e-learning that is industry and company specific can be readily created.<br />
Poor ICT infrastructure remains a barrier for about one-fifth of all organisations, irrespective of<br />
their maturity. The more mature are less likely to allow poor past experiences, if any, to<br />
impede the development of e-learning. Staff ICT skills also drop off as a barrier very sharply<br />
as organisations become more mature. Only 5% of the most mature organisations perceive<br />
this to be a barrier. The report does find that IT user skills are most likely to be delivered at an<br />
early stage of adopting e-learning and an assumption is that this quickly impacts on staff ICT<br />
skills, the lack of them sharply reducing as a barrier as organisations gain experience. Access<br />
to PCs also reduces as a barrier with maturity; however, this may be because more mature<br />
organisations are more innovative and flexible about the locations at which they make e-<br />
learning available rather than a wider availability of PCs. More mature organisations are<br />
more likely to make e-learning available in a wider range of locations thus making it easier for<br />
staff to gain access to PCs.<br />
Figure 11.4 Barriers to e-learning over the next 3 years by business sector<br />
Cost<br />
Staff resistance<br />
Lack of knowledge about potential<br />
Lack of e-learning management skills<br />
Lack of relevant quality material<br />
Available content too generic<br />
Poor past experience<br />
Inadequate ICT infrastructure<br />
Hype from suppliers<br />
Staff ICT skills<br />
No staff access to PCs<br />
No need to change<br />
0% 50% 100% 150% 200% 250% 300% 350%<br />
c) Manufacturing h) Transport, storage and communications<br />
i) Financial intermediation j) Real estate, renting and business activities<br />
k) Public admin and defence l) Education<br />
m) Health and social work o) Computing<br />
<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 132
11 The future of e-learning<br />
This figure has been assembled by adding together the percentage occurrence of each<br />
barrier by each sector. With an average number selected of 3.3 the possible maximum of this<br />
graph is 330%. The public admin sector has greater staff resistance than other sectors and is<br />
more likely to cite inadequate ICT as a barrier. The manufacturing sector is more likely to cite<br />
lack of staff IT skills and the lack of skills to manage e-learning. Not surprisingly the sector that<br />
reports fewest barriers is IT and telecommunication, followed by education. The sectors most<br />
likely to report barriers are health, public administration and manufacturing as shown in<br />
Figure 11.5. This ranges from an average of 2.6 to 3.7 and includes the selection of “others”.<br />
Figure 11.5 Propensity for organisations to report barriers<br />
m) Health and social work<br />
k) Public admin and defence<br />
l) Education<br />
j) Real estate, renting and business activities<br />
c) Manufacturing<br />
i) Financial intermediation<br />
h) Transport, storage and communications<br />
n=150<br />
o) Computing<br />
11.2 Geographic differences<br />
The barriers selected were analysed by geography. Those with many branch locations are<br />
more likely to cite poor access to PCs (13%), poor ICT skills (22%) and inadequate ICT<br />
infrastructure (27%). Not surprisingly those operating from a single UK site are least likely to<br />
select poor ICT as a barrier (6%) but most likely to select a lack of e-learning management<br />
skills (33%) and a lack of relevant quality material (39%). They are slightly less likely to select<br />
lack of knowledge about potential (22%) or staff resistance (25%). Organisations operating<br />
from a few large sites are least likely to select a lack of relevant quality material as a barrier<br />
(16%). There were no other major differences based upon the geography.<br />
11.3 Progress since 2004<br />
In 2004 respondents were asked what main challenges they faced. The question specifically<br />
said: “What would you consider to have been the main challenges for your organisation,<br />
either in implementing e-learning or in building a case for it?” Responses are grouped as<br />
follows:<br />
<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 133
11 The future of e-learning<br />
Challenges faced 2004<br />
Percentage selecting<br />
this barrier<br />
Responses 2006<br />
Culture change and user objections 42% 42%<br />
Poor ICT infrastructure 28% 23%<br />
Difficult to prove financial potential 15% 38%<br />
Convincing management 9% Not applicable<br />
Insufficient relevant quality content 8% 34%<br />
Cost 7% 44%<br />
Web access 7% 8%<br />
No need to change 7% 7%<br />
Lack of ICT management skills 7% 23%<br />
Learning has a low priority 4% Not applicable<br />
Lack of resources 4% Not applicable<br />
Lack of user ICT skills 4% 17%<br />
The data in 2004 was collected by telephone survey; users were not prompted for the<br />
categories but their responses were placed in the categories as appropriate. The data from<br />
2006 required users to select responses from a list provided. Making allowances for the<br />
difference in the way the data has been collected valid comparisons can still be made.<br />
Cost is seen as a far more significant barrier in 2006 than it was in 2004. This may be because<br />
organisations are seeking to implement e-learning far more widely across organisations or this<br />
may be because increased experience has shown that the process is not as inexpensive as<br />
first considered.<br />
Culture and staff resistance remain the most frequently cited barrier, as significant in 2006/7<br />
as it was in 2004. Clearly organisations have to put considerably more effort into winning the<br />
hearts and minds of learners if e-learning is to become a significant offering of corporates to<br />
their employees.<br />
The lack of relevant quality material is now much more significant as a barrier than it was 3<br />
years ago. Poor ICT skills amongst staff is less of a barrier than it was in 2004 and this is<br />
supported by further evidence collected and reported on elsewhere in this study.<br />
ICT continues to be a problem for about a quarter of organisations, little changed over the<br />
last 2 years although this conflicts with other data in this report. A comparison of the Likert<br />
scale opinion based question reveals that ICT is significantly less of a problem in 2006 than it<br />
was in 2004 (see the next Table).<br />
Respondents in both 2004 and 2006 were asked to make a self-assessment judgement<br />
against a number of key statements. The average ratings and percentage agreeing for this<br />
and previous studies are shown in Table 11.1.<br />
<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 134
11 The future of e-learning<br />
Table 11.1 Comparisons in e-learning implementation 2004-2007<br />
<strong>Towards</strong><br />
<strong>Maturity</strong><br />
Mean<br />
%<br />
agree Mean<br />
Embed<br />
ded 6 LL2B 7<br />
Staff can access e-learning at any time 7.40 70% 6.3 59%<br />
Staff can access e-learning from anywhere 7.09 68% 6.3 59%<br />
We have a clear understanding of what types<br />
of e-learning our internal IT systems can support 7.17 67% 5.7 50%<br />
Our internal training team is willing to embrace<br />
new ways of working with technology 7.16 64% 8.5 88%<br />
Managers appraise staff at regular intervals and<br />
plan their development 6.73 63% 7.7 77%<br />
Tracking e-learning progress is essential for<br />
compliance purposes 6.67 58% 6.4 61%<br />
We have the skills to manage external e-<br />
learning providers effectively 6.66 58% 6.2 55%<br />
Front<br />
line 8<br />
%<br />
agree Mean Mean<br />
When we implement a new e-learning initiative<br />
we start with a pilot project before embarking<br />
on a company wide rollout 6.50 57% 7.2<br />
Staff are empowered to request their own<br />
training and take ownership of their<br />
development 6.48 57% 6.9 64%<br />
We can quickly implement new learning<br />
programmes across the organisation 6.08 52% 7.3<br />
Staff know what training is available to them<br />
and how to obtain it 6.37 51% 7.4 73%<br />
Managers coach their own teams 5.79 46% 6.5 64%<br />
Change management is an integral part of our<br />
deployment and planning of e-learning 5.87 45% 6.5 62%<br />
Managers make time for staff to learn at work 5.41 41% 5.5<br />
6Embedding e-learning in large Organisations, Hills et al (2004) see www.e-skills.com\work-based-elearning/research-and-policy\989#education.<br />
7 Linking learning to Business, Overton (2004) published by Bizmedia.<br />
8 Frontline case study report, Library Workforce Development, published by e-skills UK, see www.e-skills.com\cgibin\go.pl\wbel\case\index.html.<br />
<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 135
11 The future of e-learning<br />
<strong>Towards</strong><br />
<strong>Maturity</strong><br />
Embed<br />
ded 6 LL2B 7<br />
Front<br />
line 8<br />
Staff quickly put into practice what they learn<br />
from e-learning 5.67 36% 8.4<br />
e-learning has made a positive contribution to<br />
changing attitudes to learning and training in<br />
our organisation 5.55 34% 30%<br />
Managers allow staff work time to learn at home<br />
or locally 5.00 33% 5.5 50%<br />
Senior Management regularly demonstrate<br />
commitment to e-learning 4.82 31% 5.8<br />
We regularly communicate e-learning successes<br />
to managers 4.70 31% 6.4<br />
We have audited the skills of those in the<br />
training function against the skills required for e-<br />
learning 4.61 29% 4.1 28%<br />
We provide line managers with training and<br />
briefings relating to specific e-learning courses 4.54 26% 5.8<br />
e-learning has made us focus better on business<br />
requirements 4.72 25% 6<br />
Staff are more interested in professional<br />
development since the introduction of e-<br />
learning 4.47 18% 5.5<br />
This table shows the mean ratings in the <strong>Towards</strong> <strong>Maturity</strong> study together with the<br />
percentage of respondents who agreed with the statements. Where the information is<br />
available this is shown for previous reports (see Footnote). The Frontline case study was<br />
written in 2005 and is a comparison from an isolated sector reviewing a single<br />
implementation of e-learning. A quick review of the figures in the table above indicates a<br />
disappointing lack of progress in almost all aspects of e-learning implementation. The<br />
Frontline case was a particularly effective implementation of e-learning as demonstrated by<br />
the impact on staff with mean scores significantly in excess of those collected from the<br />
<strong>Towards</strong> <strong>Maturity</strong> respondents. The Frontline case study mean scores indicate a level that<br />
organisations should aspire to.<br />
The importance of compliance in relation to the implementation of e-learning has not<br />
changed in the preceding 2 years. Sixty percent of respondents, both now and then,<br />
indicate that tracking progress is a required feature of e-learning implementation. As<br />
reported in this study, compliance is a driver linked to the financial return of e-learning. It is<br />
less strongly linked to both the take-up and impact on staff within organisations.<br />
<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 136
11 The future of e-learning<br />
There has been an improvement in the last 2 years in the availability of e-learning, coupled<br />
with an increased understanding of the capability of internal IT systems.<br />
The willingness and capability of the training function shows little change and perhaps a<br />
rather disappointing drop in their apparent willingness to embrace new ways of working.<br />
One possible explanation may be that a much greater proportion of the internal training<br />
teams are required to change their working practices in 2006 than were required to do so in<br />
2004. Neither management support through appraisal and coaching nor the empowerment<br />
of staff show any significant change, indeed a slight reduction in both the percentage of<br />
respondents agreeing with the statements and the mean ratings.<br />
The observation that e-learning makes a positive contribution to changing attitudes was<br />
identified as a one of the main successes for e-learning by 30% of respondents in 2004 but<br />
was not included as a self rated questions. A very similar percentage of respondents in 2006<br />
now agree with that statement.<br />
In general this table shows a rather gloomy picture with little evidence of any significant<br />
improvement in the last 2 to 3 years. However an analysis by maturity reveals a slightly more<br />
optimistic situations.<br />
Figure 11.6 Changes in managerial commitment and availability of e-learning<br />
8<br />
7<br />
6<br />
5<br />
4<br />
3<br />
2<br />
1<br />
0<br />
Novices Sporadic Developers Established Embedded Innovators<br />
Commitment of Senior Managers<br />
Availability of e-learning<br />
2004 benchmark 2004 benchmark<br />
<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 137
11 The future of e-learning<br />
Figure 11.7 Changes in skills and IT capability<br />
9<br />
8<br />
7<br />
6<br />
5<br />
4<br />
3<br />
2<br />
`<br />
1<br />
0<br />
Novices Sporadic Developers Established Embedded Innovators<br />
Training skills audited Skills to manage providers Good IT infrastruct<br />
2004 benchmark 2004 benchmark 2004 benchmark<br />
The good news in both these figures is that more mature organisations do better against the<br />
2004 benchmarks, so progressing towards maturity does enable organisations to improve<br />
their performance compared to the average of 2 years ago. Figure 11.7 shows the particular<br />
positive improvement in the good IT infrastructure as almost all maturity segments now rate<br />
their IT infrastructure better than the mean of all respondents in 2004. What is perhaps<br />
disappointing is the much poorer rating in relation to organisations auditing their training skills.<br />
It is not until organisations have become embedded users and innovators that they are more<br />
likely to audit the skills of their training team than they were in 2004. Although auditing the<br />
skills of the training team falls within the sphere of the training function capability, this action is<br />
part of the change management process for moving towards maturity in e-learning. The<br />
small percentage of organisations who agree with this statement and the fact that even<br />
those in a middle ranking for maturity report a low mean rating, indicates that many<br />
organisations are making a poor start to the change management process by not auditing<br />
the skills of their internal training teams.<br />
<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 138
11 The future of e-learning<br />
11.4 Sources of advice<br />
Figure 11.8 Sources of advice used by respondents<br />
Websites<br />
Exhibitions and conferences<br />
On-line newsletters<br />
Suppliers of e-learning systems<br />
Books/journals<br />
Other Users<br />
Training providers<br />
E-learning communities<br />
Industry bodies (trade associations)<br />
Independent advisers<br />
Academia<br />
Sector Skills Councils<br />
Business Link<br />
Chambers of Commerce<br />
0% 20% 40% 60% 80% 100%<br />
Frequently use Sometimes use Never used<br />
Respondents were asked which sources they turned to for advice on learning and<br />
development. They were offered the list shown in the figure above and made a selection<br />
based on: they never used that source, they had used it, or they were regular users. They<br />
were also offered the option of entering other sources of advice, 3 did so but named<br />
organisations that may be included in the above figure. It’s very clear from this that users<br />
tend to select sources of advice that they can go to reasonably anonymously, most<br />
noticeably Web sites, exhibitions and conferences. They are more likely to seek advice from<br />
suppliers of e-learning systems than training providers. Newsletters and journals are slightly<br />
more frequently used than other similar organisations to themselves. Government funded<br />
sources such as SSCs and Business Link are used by less than one out of 5 respondents.<br />
Respondents were also asked what type of additional support would be helpful. Given the<br />
low probability of respondents having audited the skills of their training team it is also<br />
disappointing to see that from the figure below only one in 5 request help associated with<br />
implementing and managing e-learning.<br />
<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 139
11 The future of e-learning<br />
Figure 11.9 What type of additional support would be helpful?<br />
Method of evaluating the effectiveness of e-learning<br />
Examples how others have implemented e-learning<br />
solutions successfully<br />
Examples of how to promote e-learning to staff<br />
Information on how to analyse costs/benefits of e-<br />
learning<br />
Database/website of typical e-learning applications<br />
for our sector<br />
Training in implementing e-learning solutions<br />
Identifying training needs<br />
Training in using e-learning solutions<br />
Defining the skills required by the workforce<br />
Defining the skills required by IT users<br />
Training in specifying components of e-learning<br />
solutions<br />
0% 10% 20% 30% 40% 50% 60% 70%<br />
Given the issues surrounding the evaluation of the effectiveness of training in general, it is no<br />
surprise to see that help in evaluating the effectiveness of e-learning is most frequently<br />
selected by respondents as support required. Indeed, the top 4 most popular choices for<br />
additional support are associated with: promotion, implementation and evaluation.<br />
Respondents were offered the opportunity of adding additional support but no respondent<br />
added anything that cannot be included in the above list.<br />
<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 140
12 Conclusions<br />
12 Conclusions<br />
12.1 Introduction<br />
An analysis of the factual responses by segmentation against maturity supports this concept<br />
of e-learning maturity and the validity of its application by self-assessment. There are 5<br />
objective measures which show a consistent difference across maturity segments. The<br />
category of innovator attracts respondents for reasons that do not fit into a pattern of<br />
maturity. This is not the most mature category and its use in the report has disrupted several<br />
patterns discernible in the rest of the data. The survey has too few responses from novice<br />
users. We are not able to make reliable conclusions about this segment.<br />
12.2 Chapter 2 – Investment<br />
The most significant benefits as perceived in 2004 but not listed as drivers then have emerged<br />
as the most significant drivers in 2006. This indicates a more widespread appreciation of the<br />
benefits of e-learning and its specific contribution to business impact: flexibility and<br />
accessibility.<br />
The pattern of which drivers are selected changes with maturity, primarily in that more<br />
mature organisations select more drivers. This indicates that maturity brings with it an<br />
appreciation that e-learning delivers additional benefits other than those commonly<br />
perceived by the less mature. Reduction in costs and administrative benefits are less<br />
important to the more mature. More e-learning mature organisations are more likely to<br />
select response to regulatory and legal requirements and the need to improve quality as<br />
important drivers, than do the less mature.<br />
The financial sector is more likely to be driven by the need to meet regulatory requirements<br />
and the education sector more likely to be driven by the need for organisational change<br />
and the requirement to maintain a public image of a progressive organisation.<br />
More mature organisations are more likely to agree they get financial impact and business<br />
impact from e-learning. Those organisations that put learners and line managers first as<br />
sources of influencing success are more likely to gain business impact from e-learning.<br />
The groups most likely to have e-learning delivered to them are administrators, professionals<br />
and line managers. They seem to be the easiest group to market e-learning to or the easiest<br />
to develop or buy material for, perhaps by virtue of the nature of their jobs. Those<br />
organisations which increase their use of e-learning by directors, technician grade staff and<br />
those in skilled roles are most likely to improve their perception of business benefit.<br />
Organisations can improve their success at e-learning by focusing development and delivery<br />
of e-learning towards these 3 roles.<br />
An analysis of learner responses and a comparison with employer responses supports a view<br />
that the business impact of e-learning is due in part to the quick application of learning to<br />
the job in hand by learners. If the rapid response and roll out by employers is added to the<br />
picture this becomes a compelling argument that the business impact of e-learning is related<br />
to its speed of application to job performance through a chain of circumstances, moving<br />
<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 141
12 Conclusions<br />
from speed of delivery to speed of application by learners. The speed of response as an e-<br />
learning benefit is surfacing in this report as a statement with which a significant proportion of<br />
both learners and employees agree with in relation to e-learning from their different<br />
perspectives.<br />
Those who achieve more business impact from e-learning are more likely to agree that they<br />
have the skills within the training function to manage e-learning. About 15% of respondents<br />
agree they do not have the capability in the training function to manage e-learning (this is<br />
3% for those in the top quartile for business impact and 39% for those in the bottom quartile).<br />
An implication is that training function capability is an essential foundation for achieving<br />
business impact from e-learning.<br />
Improving line management coaching increases the probability of achieving business<br />
impact, as does the provision of reference books, reassessment and electronic job aids as<br />
support to learners. These latter 3 methods of support are less frequently used than line<br />
management coaching. Those organisations who achieve more business impact are more<br />
likely to provide these 4 types of support to learners.<br />
Organisations driven by compliance are more likely to achieve financial impact with e-<br />
learning but not as likely to achieve staff impact or be more e-learning mature. Compliance<br />
is a driver for business and financial impact but makes less of an impact on staff.<br />
Those who achieve greater staff impact from e-learning are more likely to perceive an<br />
improvement in customer satisfaction, greater take-up and better financial impact. Staff<br />
who feel e-learning makes a greater impact on them seem to perceive an improved<br />
satisfaction by customers as a result.<br />
Organisations make a greater impact on staff if the implementation of e-learning includes<br />
change management procedures, if they ensure learners are empowered and increase the<br />
availability of e-learning both for place and time. The evidence shows that flexibility by<br />
place (at home, at the desk, travelling or in a quiet area) has a greater impact on staff than<br />
flexibility by time. Only 41% of line managers are likely to make time available for e-learning<br />
but 57% of organisations can deliver e-learning to places convenient to staff. For learners<br />
42% agree that managers make time for them to learn at work, but 69% agree they can<br />
learn at places convenient for them and 51% say e-learning is convenient for their work<br />
schedule. The benefit of flexibility delivered by e-learning is more important in relation to<br />
place than to time.<br />
The particular target group of learners responding were all regular PC users, 92% felt they<br />
managed their own time and 60% were graduates. Of this group about 6 out of 10 felt they<br />
were empowered by e-learning and 4 out of 10 felt detached from it.<br />
12.3 Chapter 3 - People and organisational capability<br />
Making decisions about e-learning based upon a Board strategy improved the probability of<br />
achieving successful business impact from 25% to 55%. Only a third of respondents agreed<br />
they had such a strategy. Those that did were 10% more satisfied with the business impact<br />
they achieved.<br />
Ensuring directors personally use e-learning improves the probability of business impact, staff<br />
impact, take-up of e-learning, its availability and the commitment of senior managers.<br />
Ensuring directors use e-learning and that a Board strategy is in place are 2 actions that<br />
<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 142
12 Conclusions<br />
increase the probability of e-learning being successful. An example relates to the speed of<br />
application of learning to the job. When directors use e-learning half of all organisations<br />
agree that what is learnt is quickly applied, as opposed to a quarter of those organisations<br />
where directors do not use e-learning. More significant is the number of organisations who<br />
agree that learning is not quickly applied; this changes from 4% of organisations where<br />
directors are users to 29% for those where directors are not users. Leadership from the top is a<br />
key element that influences a number of factors relating to the success of e-learning. Aiming<br />
to involve directors and being successful in doing so pays significant dividends. Where<br />
directors set an example organisations are twice as likely to perceive take-up as successful<br />
and the number of roles who use e-learning will treble.<br />
For individuals their own manager has a greater influence than do directors or senior<br />
executives. For learner respondents half select their line manager as the person most likely to<br />
influence their take-up of e-learning. Just over a quarter select a work colleague. This<br />
pattern changes slightly with age (60% of those under 25 will select their manager as the<br />
prime influence on them for doing e-learning, as opposed to 45% of those over 55).<br />
Colleagues become more important for older learners. Senior executives are more likely to<br />
influence those who work away from a regular place (approximately 15% in those situations<br />
will select senior executives, as opposed to 9% of those in regular workplaces). Managers are<br />
less likely to influence those without the freedom to manage their own time (44%).<br />
Comparing the results for who influences you, we may assume that managers with direct<br />
hands-on contact with staff are less likely to encourage learning than those where learners<br />
have a greater responsibility to manage their own time. It would appear that an individual<br />
learner is not significantly influenced by a senior executive and yet the behaviour of senior<br />
executives significantly influences uptake. It is not unreasonable to suggest that there is a<br />
chain of impact commencing with directors. Directors set a Board strategy and personally<br />
use e-learning; as a result senior managers show commitment; managers then encourage e-<br />
learning at a local level and make it more available to learners, encouraging them to learn.<br />
An analysis by sector in relation to those who use e-learning shows that the manufacturing<br />
sector directs more e-learning effort at the less skilled employees. The financial sector puts<br />
more effort into training knowledge workers and senior management than do other sectors.<br />
The business activity sector puts less effort into providing e-learning for less skilled and more<br />
junior staff. The education sector is least likely to train all roles other than those of professional<br />
grade staff.<br />
The majority of organisations use their own internal budget to fund the majority of their<br />
expenditure on e-learning. The exceptions are the health and education sector, although<br />
organisations in these sectors actually seek funding from within their sectors (strategic health<br />
authorities within the health sector and learning and skills council funding within the<br />
education sector). Regional development authorities are not used to any significant extent<br />
as sources of funding and the only sector to seriously consider European funding is the<br />
education sector.<br />
The principal ways in which organisations source e-learning are through commercial boughtin<br />
products, in partnership with e-learning vendors, or in-house with simple rapid<br />
development tools or slightly less probable in-house with development tools for experts.<br />
Fifteen percent of all respondents use only in-house development tools with the implication<br />
that they are not seeking to source e-learning externally. More e-learning mature<br />
organisations are more likely to use in-house development but more likely to work in<br />
partnership with an e-learning vendor.<br />
<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 143
12 Conclusions<br />
The attributes of suppliers that purchasers regard as most important are those of: value for<br />
money, expertise and proven reliability; which are regarded as important by 4 out of 5<br />
purchasers. However the attributes that are least likely to be selected: knowledgeable,<br />
innovative, long-term partners, good after sales support, a wide range of products and an<br />
experienced needs analysis, are still regarded as vital by one in 5 purchasers. This is a<br />
marketplace in which purchasers have high expectations and a wide variability in the criteria<br />
for choosing suppliers.<br />
A total of 139 suppliers were mentioned by employer respondents, of whom only 5 were<br />
mentioned by more than ten respondents. The market is dominated by many small suppliers,<br />
characterised as a cottage industry; with only 5 large suppliers apparent in the marketplace.<br />
12.4 Chapter 4 – E-learning – technology, software, and topics delivered<br />
Respondents were offered a list of 18 topics and asked whether they delivered these topics<br />
with or without a component of e-learning. All but 3 of the topics are delivered by 3 out of<br />
five respondents; the exceptions being foreign language, literacy and numeracy, delivered<br />
by about a third of respondents. Eleven of the topics are delivered by more than 4 out of 5<br />
respondents. All but 3 of the topics are generic in nature and may be delivered with off the<br />
shelf products or generic face-to-face courses. The exceptions are company-specific skill,<br />
industry-specific skills and induction. These latter 3 topics require companies to invest in<br />
development, either of content or customised delivery through specialised trainers.<br />
The penetration of e-learning within these topic areas varies, with IT skills (both general and<br />
professional) having a penetration of more than 70%. Company and industry-specific skills<br />
are the two topics with the next greatest penetration; approximately 60%. The penetration<br />
for e-learning components within induction is approximately 50%. The implication is that<br />
organisations are able to create e-learning content for these non-generic topics; either by<br />
internal development or purchasing external development. Based on this analysis about half<br />
of organisations have the capability to develop specific e-learning content that meets their<br />
particular business needs.<br />
The IT and telecommunications sector does more induction and sales and marketing training<br />
using e-learning than other sectors, the financial sector does more company-specific and<br />
health and safety training using e-learning and is the sector most likely to use an e-learning<br />
component within the topics offered.<br />
The penetration of e-learning is analysed by maturity. All but 2 topics show an increased<br />
probability of being delivered by more e-learning mature organisations; these 2 topics are<br />
literacy and numeracy. For the remainder, 3 adoption patterns can be seen.<br />
1. IT skills are rapidly adopted by organisations at an early stage of maturity and reach a<br />
penetration in excess of three quarters; that is where these topics are offered, three<br />
quarters of organisations doing so will include an e-learning component.<br />
2. Company and industry-specific skills show little increase in e-learning penetration at<br />
early stages of maturity but this penetration rises steeply at later stages of maturity,<br />
achieving a similar probability of being delivered with e-learning as IT skills.<br />
3. All the other topics, mainly interpersonal and generic skills, show a steady growth in<br />
penetration as organisations become more e-learning mature. One group of topics<br />
starts from a low probability of use (close to zero) whereas another group starts from a<br />
penetration of approximately 20%.<br />
<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 144
12 Conclusions<br />
Companies deliver a wider range of topics as they gain confidence and at later stages of<br />
maturity use this confidence to develop specific content that meets their particular business<br />
needs. For those organisations that wish to develop in maturity, the experience of delivering<br />
e-learning IT skills are a good starting point, concentrating later on other topics, particularly<br />
industry and company-specific skills.<br />
Programmes supporting industry certification are offered by 3 out of 5 companies, learning<br />
for customers and professional body qualifications being offered by about half and all other<br />
programmes offered by less than 2 out of 5 organisations. There is less use of e-learning in<br />
programmes leading to qualifications than in the delivery of stand alone topics. Learning for<br />
customers is the style of programme most likely to include an e-learning component; possibly<br />
because of the low cost of delivery. All programmes for industry qualifications offered by the<br />
finance sector use an e-learning component. The business activities sector is least likely to<br />
use e-learning within any training programmes. The penetration of e-learning by<br />
programmes has been analysed by maturity. As organisations become more mature there is<br />
a greater probability that they will use on-line resources to deliver N/SVQ programmes. The<br />
penetration rises from 20% to 60%; only 2 other styles of programmes show an increase in<br />
penetration with maturity; learning for suppliers, rising from zero for the least mature to 20%<br />
penetration for the more mature and job related qualifications rising from 25% to 40%. As<br />
with e-learning being delivered to customers, the driving force behind delivering e-learning<br />
for suppliers may be the low cost of delivery and an increased perception of the potential for<br />
increasing the quality of the supply chain. The significant growth in N/SVQ programmes using<br />
e-learning is likely to be driven by the benefits of reducing the cost of administration since<br />
these programmes have a requirement for assessment and workplace monitoring, which<br />
without electronic support is relatively expensive for employers to deliver.<br />
Ninety percent of respondents deliver electronic learning material. This is frequently the<br />
narrow definition of e-learning accepted by many. Four out of 5 respondents use, or will use,<br />
e-learning for assessment and administration; almost half for collaboration between learners,<br />
competency management and e-tutor support; with 2 out of 5 using, or planning to use, e-<br />
learning for the evaluation of business impact. As organisations become more mature they<br />
deliver a greater range of formal learning services on-line. Each one of these services is<br />
delivered by more than half of the most mature organisations. This demonstrates that<br />
maturity brings with it a greater appreciation of the capability of e-learning to offer a wider<br />
range of formal learning services.<br />
More than 3 out of 5 respondents offer on-line books and approximately half of respondents<br />
offer search portals, on-line company experts and on-line communities. The two informal<br />
services most likely to be offered, on-line books and search portals, are both designed to<br />
enable learners to find things out for themselves from a large source of information made<br />
available to them. This is appropriate as learners report that 60% of what they learn is by<br />
finding things out for themselves, as opposed to the delivery of content through Courses.<br />
More mature organisations offer more informal services. Although the number of<br />
organisations currently planning to offer e-learning services is relatively small (approximately<br />
10% of those currently offering these services) the probability of organisations using these<br />
services increases from about 25% to 70% as organisations move from less mature to more<br />
mature.<br />
<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 145
12 Conclusions<br />
12.5 Chapter 5 – Take-up of software tools in support of e-learning<br />
We can predict the growth of the use in various software tools that support e-learning by<br />
combining an analysis of users’ plans from the survey with the change in probability of use<br />
with maturity. All software tools are more likely to be used by more mature organisations.<br />
However, open-source tools are more likely to be used by the less mature than those<br />
becoming mature. An assumption is that the availability of open-source tools provides an<br />
entry point for training functions to experiment with e-learning in the absence of a strategy or<br />
business case. A comparison of use by maturity their growth is unlikely to be significantly<br />
different from the 18% predicted on the basis of organisation’s plans up to 2010. The most<br />
frequently occurring e-learning software is the Learning Management System, for which a<br />
growth rate of 30% is predicted. Based upon users’ plans, competency management<br />
appears to be growing at 83%. However, the difference in maturity indicates a lower growth<br />
rate, perhaps nearer 40%, from its current usage level. Rapid development tools on the other<br />
hand show a greater difference between the less and more mature, indicating a growth rate<br />
of 30 to 35% rather than the 19% predicted from users’ plans. E-portfolios show one of the<br />
smallest differences between the less and the more mature, supporting the probable growth<br />
rate of 20% of current usage, with a prediction that by 2010 only a third of companies will be<br />
adopting e-portfolios.<br />
Mobile learning is the only delivery tool that does not consistently increase with greater<br />
maturity, being used by slightly more of the less mature than those becoming mature. The<br />
definition of mobile learning included laptops and tablet PCs and we can make a<br />
reasonable assumption that mobile learning will increase perhaps by a third. Twice as many<br />
of the more mature organisations use pod casting than the less mature. This together with the<br />
forecast of future use by all respondents, indicates that the use of pod casting will more than<br />
double by 2010. The use of games/simulations/in-tray exercises will grow by 15% based on<br />
combining the differences between more mature and less mature users, with the forecast of<br />
13% growth based upon users’ plans. The definition of games includes simulations and in-tray<br />
exercises which is a wider definition than might be understood by the term ‘computer<br />
games’. Video on demand shows a modest change with maturity and we can expect an<br />
overall growth rate of 50%. The electronic performance support systems are twice as likely to<br />
be used by the more mature as compared to the less mature, which supports an overall<br />
growth prediction of 60%.<br />
The majority of software tools supporting collaboration show an adoption curve that rises<br />
more steeply at later stages of maturity. The exceptions are video conferencing and virtual<br />
classrooms, both of which show a steady growth rate, with a difference of 20% in their<br />
probability of use between the less and the more mature organisations. Video conferencing<br />
is a relatively mature software tool with a reasonably high penetration and a predicted<br />
growth rate, based on these figures, of 10%. Virtual classrooms have a much lower<br />
probability of being used and therefore have a higher growth rate of perhaps 25%.<br />
Wikis/blogs are least likely to be used and show the smallest difference between the less and<br />
the more mature. We may expect a growth rate by 2010 of at least 80%. Both moderated<br />
and un-moderated chat shows a similar difference in usage between the less mature and<br />
the more mature, being twice as likely to be used by the more mature. Comparing users’<br />
plans with current levels of use and change with maturity, we can expect a growth in both<br />
types of chat of 60%. However, un-moderated chat may grow at a slower rate. The<br />
CMS/VLE is likely to be used by 70% of the more mature but only 50% of the less mature.<br />
Based upon a comparison of maturity and users’ plans we might expect an actual growth<br />
rate closer to 25% somewhat less than the 30% predicted from user’s plans.<br />
<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 146
12 Conclusions<br />
Global companies are more likely to choose the collaborative tools of video conferencing<br />
and virtual classrooms together with electronic performance support systems, so are likely to<br />
lead the growth in these technologies. Companies with many locations are less likely to be<br />
using almost all of the technologies listed so far. Larger companies are more likely to be<br />
using Learning Management Systems (88% compared to 52% of SMEs). Video conferencing is<br />
more likely to be used by the largest companies (67% compared to 33% of SMEs). Apart from<br />
video conferencing the other collaborative software tools discussed in this report are not<br />
more likely to be used by larger organisations.<br />
12.6 Chapter 6 - IT capability<br />
Organisations were segmented on IT capability, the definition of which is that learners are<br />
familiar with PCs and need little technical support and technology is capable of delivery e-<br />
learning to places convenient to staff. Organisations which have greater IT capability, based<br />
on this definition, achieve greater business impact, staff impact, improved availability and<br />
greater take-up.<br />
IT capable organisations<br />
IT not capable organisations<br />
More likely to have capable IT functions<br />
Offer about seven online services<br />
Offer about 5.5 online services<br />
Select seven drivers for e-learning<br />
Select 5 ½ drivers for e-learning<br />
More likely that directors use e-learning Less likely that directors use e-learning (41%)<br />
(62%)<br />
Offer more topics using a component of e-<br />
learning (60%)<br />
Offer fewer topics using a component of e-<br />
learning ( 50%)<br />
Offer e-learning in more locations (3.1) Offer e-learning in less locations (2.6)<br />
More likely to offer virtual classrooms and<br />
reference books (20%), electronic job aids,<br />
web support (about 40%), line manager<br />
coaching (60%),<br />
Less likely to offer virtual classrooms and<br />
reference books (10%), electronic job aids,<br />
web support (about 25%), line manager<br />
coaching (45%),<br />
Less likely to offer printed job aids (12%) More likely to offer printed job aids (25%)<br />
Twice as likely to use regular surveys of user<br />
satisfaction (61%)<br />
Less likely to use regular surveys of user<br />
satisfaction (35%) (13% collect no feedback<br />
at all)<br />
Given the significance of directors using e-learning IT capability may be a response to<br />
directors using e-learning rather than vice versa. Training functions rise to the challenge of an<br />
adequate IT infrastructure and confident users, by offering more services, seeing more<br />
opportunities, using more technologies and seeing fewer barriers.<br />
The role of support functions is more important for those organisations lacking an IT capability;<br />
we may assume that it is more difficult to deliver e-learning in such organisations and<br />
therefore training functions need more support from the other support functions, either<br />
practical help or financial endorsement. Business sponsors appear less likely to perceive e-<br />
learning as a suitable route for achieving their business aims in organisations which lack IT<br />
capability.<br />
<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 147
12 Conclusions<br />
The difference in probability of line manager coaching being offered may be because staff<br />
are more confident about requesting such support from line managers when they are also<br />
confident about using PCs, or line managers themselves are more confident about delivering<br />
coaching. Bearing in mind that half the employer respondents have more than 90% of their<br />
staff using PCs regularly confidence in using PCs is a critical element for job performance for<br />
the employer respondents in this survey.<br />
IT capable organisations are more likely to have capable training functions, more likely to<br />
have part of their training function dedicated to e-learning, more likely to demand e-<br />
learning to exact specifications, less likely to use suppliers, more likely to use in-house<br />
development tools but also more likely to be using commercial products. There are a<br />
number of related factors which link the capability of the training function, the infrastructure<br />
and the confidence of learners. Greater capability in all 3 areas increases the number of<br />
ways in which e-learning can be used, who it is delivered to, what technologies are used and<br />
its impact on the business and on staff.<br />
12.7 Chapter 7 – Supporting learners<br />
Learners appreciate the availability of study and consolidation support. Of the 15 options to<br />
learner respondents at least 69%, of those where it was available, found all forms of study<br />
support useful. The most useful, at 88%, are job related assignments, provided by 38% of<br />
employers. Email contact from a tutor, provided by 42% of employers, was useful to 74% of<br />
those where it was available. Learner respondents place a high value upon support in the<br />
workplace with both job related assignments, electronic help, job aids and reference books<br />
valued by more than 80% of those to whom it was available. There is no significant<br />
difference between the method of delivery, either electronic, in person or in print in the<br />
proportion of recipients who considered it useful. All help delivered directly to learners is<br />
considered valuable. Even support mechanism only rarely available, (for example: virtual<br />
learning classrooms, available in 16% of employers and to 17% of learner respondents), is still<br />
considered useful by 72% of those to whom it was available. The method used to deliver<br />
support is of less importance to learners than the fact that it is available.<br />
When making investment decisions about support, organisations need to balance the cost of<br />
that support against the perceived value to recipients. For example, a virtual classroom<br />
which may be expensive to implement, is valued by only 72% of those to whom it is available,<br />
compared to Web reference valued by 81% of those to whom it is available.<br />
There is a consistent difference between synchronous and asynchronous support. The<br />
proportion of respondents who value synchronous methods is 74% and 83% for those who<br />
value asynchronous methods. This supports a conclusion developed elsewhere that<br />
convenience as to time and place for learners is one of the most significant attributes of e-<br />
learning, irrespective of its form or method of delivery. On average most respondents use<br />
about two and a half different methods of support.<br />
Worldwide companies are least likely to offer learner support in person, whereas those with a<br />
relatively few number of UK sites are most likely to offer such support. Global companies are<br />
more likely to provide electronic support through reference sites, organisations with a single<br />
UK site do not fit into the pattern since they make a greater use of electronic support,<br />
however this sector is dominated by the education and health and social work sector, who<br />
are most likely to seek learning support from other organisations also within their sector.<br />
<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 148
12 Conclusions<br />
Those organisations that put more effort into supporting learners in the workplace are more<br />
likely to be found in the upper quartile for business impact. The support mechanisms that are<br />
most closely linked with business impact are reference books, electronic job aids,<br />
reassessment and line manager coaching. Investing effort into these support mechanisms is<br />
likely to show the greatest impact on potential business return from e-learning.<br />
Almost half of learner respondents find e-learning convenient, and are able to put it into<br />
practice and 65% feel empowered and able to take charge of their own development.<br />
Forty percent are interested in recognition and qualifications, the same proportion who<br />
regard e-learning as relevant to their job. Ensuring learners feel empowered and take action<br />
to manage their own development is a significant benefit from e-learning. Twice as many<br />
learner respondents feel empowered as feel they have support from management. Learners<br />
who are empowered also feel they have greater control over their learning, that e-learning is<br />
more directly relevant to their job, they are less likely to feel detached and more likely to feel<br />
supported by management.<br />
12.8 Chapter 8 – Promoting e-learning<br />
The most frequently provided method of promoting e-learning is via email, with newsletters,<br />
management briefings and posters frequently used. Differences emerge with maturity in that<br />
the more mature organisations are more likely to use any one particular communication<br />
method except email and newsletters. The more mature organisations are more likely to use<br />
a greater range of communication methods, both at launch and to sustain interest.<br />
Organisations in the upper quartile for business impact are more likely to use a wider range of<br />
communication methods significantly newsletters, where three quarters in the top quartile will<br />
use newsletters compared to half or less in the 3 lower quartiles, half will use posters<br />
compared to less than 40% of those in the lower quartiles.<br />
Similar differences emerge when we analyse the use of communication methods based<br />
upon the take-up of e-learning. Increased effort into promotion by email, newsletter,<br />
management briefings, posters and open days results in improved take-up. The greatest<br />
difference comes from the use of posters, management briefings and newsletters. Learners<br />
themselves report that email is the communication method most likely to sustain their interest,<br />
with line management briefings, company newsletters and peer testimonies all being<br />
important. Posters were only selected as important for sustaining interest by 10% of the<br />
population and do not appear to be effective for launching e-learning, as less than 2% said<br />
they found out about e-learning from a poster. Email, line management briefings and<br />
company newsletters are the most likely ways in which learners find out about e-learning.<br />
Some slight differences emerge by age, with older learners more likely to respond to email<br />
and younger learners more likely to respond to line management briefings. Those who work<br />
at customer sites tend to find out from emails, those who work from home find out from<br />
newsletters. Line management briefings are least effective for these 2 groups.<br />
In general email is both the most frequently used method of communication and also the<br />
one learner’s are most likely to respond to. There are differences by age and working<br />
pattern. There are learners in special situations and perhaps with personal preferences who<br />
are more likely to respond to other methods of communication. A successful organisation will<br />
use multiple channels of communication, using different styles and types of communication<br />
to learners in different situations. The use of management briefings, newsletters and posters<br />
are effective ways of supporting email and increasing take-up and improving the probability<br />
of e-learning being successful.<br />
<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 149
12 Conclusions<br />
Delivering e-learning at locations which are convenient for learners makes a difference to<br />
the impact e-learning has on them as does giving them the freedom and information to<br />
manage their own development. The aspect that learners feel most positive about e-<br />
learning is that it allows them to learn in a place that is convenient for them. Seven out of 10<br />
learners agree with the statement that technology allows them to learn in a place<br />
convenient for them. Although the provision of e-learning at home is convenient, we may<br />
infer that about a quarter of those who could study at home did actually do so. About 15%<br />
of those who could have used an in-house internal learning centre did so. It would appear<br />
that a quiet place at work is a key enabler for convenience to learners as to place. Learners<br />
were asked who motivated them to learn and about a half chose managers, a quarter<br />
colleagues, training managers 10% and senior executives 5%. There are some differences<br />
that emerge based upon age and management responsibility. Those who do not manage<br />
their own time are least likely to respond to their line manager and younger members of staff<br />
are more likely to respond to their line manager, from whom they are also more likely to find<br />
out about e-learning, as previously reported.<br />
More mature organisations put more effort into collecting feedback from learners. Most<br />
organisations use feedback sheets following each course so this method of collecting<br />
feedback shows little difference with maturity, business impact or staff impact. The<br />
probability of regular surveys being used increases consistently with business impact, maturity<br />
and staff impact.<br />
The self-rated perception questions help us identify a number of key actions that correlate<br />
strongly with improved success at e-learning. These are: demonstrating e-learning success<br />
within the business, enabling staff to quickly put into practice what they learn from e-<br />
learning, personalise the learning experience for each learner, quickly implementing learning<br />
across the organisation, communicating success to managers, the demonstration of<br />
commitment to e-learning by senior management, deploying change management<br />
methodologies to implement e-learning, providing e-learning with a specific identify and<br />
brand and having a clear understanding of what type of e-learning internal IT systems<br />
support. Business impact can also be improved by providing line managers with training and<br />
briefings related to specific e-learning courses and ensuring that staff can access e-learning<br />
at any time.<br />
12.9 Chapter 9 – the changing face of learning<br />
Learners were asked how they went about learning outside of formal programmes and 4 out<br />
of 5 search the Web and use conversations with others, 3 out of 3 use on-line reference<br />
materials and books, 2 out of 5 use industry publications, a quarter use job aids, either printed<br />
or electronic, and 18% participate in on-line discussions. All these methods enable learners to<br />
find things out for themselves (60% of what they learn is by finding things out for themselves).<br />
The 4 technologies that are most likely to be considered useful by learners are all associated<br />
with searching facilities: search engines, general Web reference sources, specific Web<br />
reference sources and searchable on-line books.<br />
It appears that users perceive on-line communities, discussion boards and blogs/wikis as<br />
serving very different purposes. For example, it may be that on-line communities are<br />
perceived as formal structures, it may be that those working from home have difficulty<br />
accessing company-specific internal sources and therefore are more likely to resort to<br />
external resources. In general those of lower educational attainment are less likely to use<br />
any of the informal services offered, although this changes when users are specifically asked<br />
<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 150
12 Conclusions<br />
if they use Web reference sources, as those of lower educational attainment are more likely<br />
to use these resources. It may be that those of lower educational attainment are less<br />
comfortable about participating in collaborative tools, but more comfortable about using e-<br />
learning as a reference source.<br />
Learners were asked if they were willing to use technology to share their knowledge with<br />
others and 84% of respondents agreed that they were either already doing so, or would do<br />
so if they had the opportunity. Twenty-six percent of respondents who already provide this<br />
help is a close match to the 27% who find discussion boards useful. As on-line communities<br />
are only considered helpful by 18% of respondents, it would appear that learners have a<br />
preference for using other forms of collaborative technology rather than on-line<br />
communities. It would appear that learners are willing to work collaboratively but that<br />
existing tools are not giving them the type of collaboration they would prefer. In all cases<br />
reference sources are considered more valuable and helpful to learners than collaborative<br />
services.<br />
A comparison of employer’s plans clearly demonstrates that there is a greater interest in the<br />
particular technologies that support informal learning, rather than the services delivered<br />
through those technologies. It appears that employer respondents think about the<br />
technology first and its application to learning second. Given the possible lack of enthusiasm<br />
by learners for the particular collaborative tools offered, it may be that organisations have to<br />
define more clearly how they will use social software and the types of services they will be<br />
delivering through them. In both cases there is a need to consult users so that the services<br />
and technology provided are attractive to learners ensuring that organisations can benefit<br />
from the willingness of learners to help others learn through an application of technology.<br />
The current and planned provision of informal services and supporting technologies is<br />
analysed by maturity, based upon this we may predict the following growth rates: for<br />
communities of practice 80% by 2010, for search portals and on-line company experts a 20%<br />
growth rate by 2010 and for on-line books and job aids a growth rate of perhaps 10% by<br />
2010.<br />
The provision of these informal services is linked to business impact, with those in the top<br />
quartile significantly more likely to be delivering those services than the bottom quartile. The<br />
use of on-line books/job aids has the greatest effect on business impact: 40% of the bottom<br />
quartile providing this service compared to 85% of those in the top quartile. The availability<br />
of on-line communities and search portals, on the other hand, has the greatest effect on staff<br />
impact. Therefore the investment on on-line books and job aids will give greatest business<br />
return and investment in search portals and on-line communities will give the biggest<br />
changes in staff motivation and behaviour.<br />
Of the 113 respondents providing information about budgets, on average 17% of overall<br />
training budgets were spent on e-learning with an estimated forecast growth of 70% to 26%<br />
as a proportion of training budgets to be spent on e-learning by 2010. Although all sectors<br />
forecast some growth the largest expected growth occurs within IT, telecommunications,<br />
education and transport. Education and IT/ telecommunications already spend more of<br />
their budget on e-learning than organisations in other sectors. The more mature<br />
organisations spend more of their budget on e-learning; almost a quarter compared to<br />
approximately 5% of the less mature. The proportion of budget spent on e-learning does<br />
have an impact on take-up, availability, business impact and staff impact. Those who spend<br />
a greater proportion of their budget on e-learning achieve improved take-up, availability,<br />
business impact and staff impact. Increasing spend from 10% of budget to 30% of budget<br />
improves the self-rating of staff impact from 4.3 to six, take-up from 4.4 to 6.3, business impact<br />
from five to seven and availability from 5.9 to 6.8. The change in availability shows least<br />
<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 151
12 Conclusions<br />
difference with an increased proportion spent on e-learning. Those organisations that spend<br />
more must therefore be channelling this expenditure into areas that have a greater effect on<br />
business impact than on the availability of e-learning. The assumption is that this goes<br />
towards change management and promotional activities and it is these activities that<br />
increase the business impact, staff impact and take-up of e-learning.<br />
12.10 Chapter 10 – Comparison of education sector with others<br />
The education sector achieves less business impact, staff impact, availability of e-learning<br />
and take-up than do other sectors. It would appear that non-educational organisations are<br />
more successful at e-learning than those in the education sector. Significantly the education<br />
sector perceives itself to be less successful at using change management, improving record<br />
keeping, applying a brand and identity to e-learning, providing information that is easy to<br />
use, using appraisal, having managers coach their teams, having the skills to manage<br />
providers, completing an audit of their training functions, paying attention to compliance<br />
and tracking and ensuring that learners know what is available for them. It would appear<br />
that the education sector could learn from other sectors as regards the promotion,<br />
marketing and change management for e-learning. The education sector is less likely to<br />
select any of the drivers listed except for the requirement to maintain the public image of a<br />
progressive and innovative organisation (selected by 35% in the education sector, 15% of<br />
others), organisational change (35% in education, 23% of others) and pressure from senior<br />
management (10% in education, 4% of others). Image and organisational change matters<br />
more to those in the education sector and cost qualifications and administration matters less.<br />
Companies in the education sector are less likely to provide training in every topic area<br />
except that of literacy and numeracy. Where training is offered e-learning is less likely to be<br />
used than by any other sector, except for foreign language training. However, educational<br />
organisations are more likely to use e-learning to support programmes leading to<br />
qualifications. The education sector is leading the way in deploying e-learning for<br />
programmes which lead to qualifications. The education sector is less likely to deliver e-<br />
learning to every role except professional grade staff; this is most noticeable at a senior level.<br />
Given the importance of the leadership role for directors it may be that ensuring senior staff<br />
use e-learning personally is the most significant lesson educational organisations can learn<br />
from other sectors.<br />
Educational organisations are more likely to have a strategy (42%) than others (31%). Useful<br />
lessons other sectors can learn from the education sector is to have an e-learning strategy<br />
and to seek ways in which e-learning can be used to support qualification programmes.<br />
The education sector is less likely to use rapid development tools and more likely to use tools<br />
designed for Web experts and programmers. This may be because rapid development tools<br />
are most appropriate to training procedures and IT practices and the education sector has<br />
less need of this type of training and a greater need for training that requires more<br />
interactive and innovative e-learning, which is better developed with the use of more<br />
sophisticated development tools. Educational organisations are less likely to work in<br />
partnership with an e-learning vendor, possibly because they perceive they have the e-<br />
learning expertise themselves, although this is not borne out by the responses to the selfperception<br />
questions. It would appear that the education sector develops more complex<br />
and less procedurally based e-learning and is more likely to work with others in the same<br />
sector rather than seek support from elsewhere.<br />
<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 152
12 Conclusions<br />
The education sector makes more effort to support learners than those in other sectors. They<br />
are twice as likely to use telephone and in-person support than other sectors and this is also<br />
true for technical support. The education sector puts more effort into supporting learners<br />
when studying e-learning, particularly when the personal touch is required, and makes a<br />
greater provision for personal contact for technical support.<br />
Apart from the provision of line management coaching in general the education sector is<br />
less likely to provide support to consolidate learning on the job. An apparent difference in<br />
two sets of questions relating to line management coaching may be that the greater<br />
occurrence of line management coaching support after learning does not translate to<br />
effective coaching as normal practice.<br />
The education sector is more likely to be using the collaborative tools of chat rooms, VLEs,<br />
virtual classrooms and blogs and wikis. They are less likely to be using the more procedural<br />
tools of LMS, Competency Management Systems and EPSS. It is probable that the education<br />
sector recognises the value and importance of collaborative learning and takes steps to<br />
provide the on-line tools for this to occur. They make more use of open-source tools, perhaps<br />
because of probable budget constraints.<br />
The education sector is less likely to perceive unreliable ICT as a barrier and slightly less likely<br />
to perceive access to PCs as a barrier. They are more likely to perceive that a lack of skills to<br />
manage e-learning in the future will be a barrier. They are also in general less positive about<br />
their view of their own training function capability.<br />
They are more enthusiastic about the future of e-learning than other sectors and more likely<br />
to be making plans. They are more likely to be planning to introduce CMS/VLEs, chat rooms,<br />
blogs/wikis, pod casting, video on demand, games and simulations, open-source tools and<br />
rapid development tools than those in other sectors. In other words, what they are already<br />
doing more of they intend to continue doing more of; if anything, opening the lead over<br />
other sectors. However, they are less likely to be planning the use of Competency<br />
Management Systems, LMS, EPSS, e-portfolios and virtual classrooms. This latter software tool<br />
is the only one to show a discrepancy since the educational sector already makes a greater<br />
use of this tool but in fact the non-educational sector is more likely to be planning for its<br />
future use. An analysis of the various responses in relation to CMS/VLE indicates that most of<br />
the education sector will be using Content Management Systems by 2010. However, this<br />
question did include the definition of Virtual Learning Environments and the education sector<br />
may be interpreting these as environments in which students and learners can exchange<br />
content in a safe and secure environment. The education sector will continue to take the<br />
lead in collaborative learning, evidenced by its greater interest in the technology tools that<br />
supports social learning and the greater effort they put into supporting learners, both before,<br />
during and after study.<br />
12.11 Chapter 11 – the future of learning<br />
Four out of 5 employers will place greater emphasis on informal learning in the future. There<br />
will be an increase in the availability and use of electronic learning records and e-learning<br />
will continue to be considered as a component in the learning on offer, rather than a sole<br />
delivery method. However, many organisations are likely to continue to perceive that e-<br />
learning will not be suitable for every topic. Sixty percent of the less mature do not think this<br />
will happen. At an early stage organisations primarily use e-learning for IT skills. As they<br />
become more mature they increasingly use e-learning for a wider range of topics.<br />
<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 153
12 Conclusions<br />
Since 2004 there is a wider appreciation of the importance of training records and a greater<br />
understanding that e-learning is not a sole delivery method. There is slightly less change in<br />
the view that e-learning will be suitable for all applications, although as previously discussed<br />
this does change significantly with maturity.<br />
The most frequently selected barriers were: cost, staff resistance, lack of knowledge about<br />
the potential of e-learning, lack of e-learning management skills, the lack of relevant quality<br />
material and, for the less mature, the content that is available is too generic and that their<br />
staff lack IT skills. <strong>Maturity</strong> is therefore linked to a greater appreciation that content can be<br />
created, or that generic content can be modified to make it more specific and relevant.<br />
<strong>Maturity</strong> also brings with it a reduction in the probability of staff ICT skills being a barrier, most<br />
likely because generic IT skills are part of the e-learning offer and most likely to be provided<br />
by the less mature organisations. The more mature organisations are also significantly less<br />
likely to select a lack of e-learning management skills as a barrier.<br />
The public administration sector is more likely to report staff resistance and inadequate ICT<br />
than other sectors. The manufacturing sector is more likely to cite a lack of staff IT skills and<br />
lack of skills to manage e-learning as barriers. The sector that reports fewest barriers is IT and<br />
telecommunication, followed by education. The sectors most likely to report barriers are<br />
health, public administration and manufacturing.<br />
A comparison with 2004 shows that culture change, user objections and staff resistance<br />
remain as one of the most frequently cited barriers. In 2004 cost was selected by only 7% of<br />
respondents and this has risen to 44% in 2006. This may because organisations are seeking to<br />
implement e-learning far more widely across organisations, or it may be because increased<br />
experience has shown that the process is not as inexpensive as first considered. Part of the<br />
cost may be the increased effort organisations have to put in to winning the hearts and<br />
minds of e-learners to overcome user resistance. The lack of relevant quality content is a<br />
much more significant barrier than it used to be, perhaps because there is a greater<br />
understanding that company and industry-specific skills are an area where organisations<br />
have to create material and that there is a greater interest in doing so. ICT remains a barrier<br />
for about a quarter of organisations, although much of this report indicates that the barrier is<br />
significantly less of a problem in 2006 than it was in 2004. This latter view is principally<br />
supported by respondents having a significantly more positive view about e-learning and its<br />
availability and implementation now than they did in 2004. More respondents perceive that<br />
it is difficult to prove the financial return now than did in 2004; more than twice as many.<br />
There has been an improvement in the availability of e-learning and ICT infrastructure but<br />
otherwise there does not appear to have been much improvement since 2004. More<br />
mature organisations do better against the average of the 2004 results, so progression<br />
towards maturity does enable organisations to improve their performance compared to the<br />
averages reported in 2004.<br />
Employer respondents tend to seek advice from sources where they can be reasonably<br />
anonymous, Web sites, exhibitions and conferences being top of the list. Government<br />
funded sources, such as SSCs and Business Link, are used by less than one out of 5<br />
respondents. Additional help that employer respondents seek are associated with<br />
promotion, implementation and evaluation of e-learning. Given the low probability of<br />
respondents having audited the skills of their training team and the part that this plays in the<br />
change management process it is disappointing to see that only one in 5 of respondents<br />
request help associated with implementing and managing e-learning.<br />
<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 154