13.11.2014 Views

Towards Maturity

Towards Maturity

Towards Maturity

SHOW MORE
SHOW LESS

You also want an ePaper? Increase the reach of your titles

YUMPU automatically turns print PDFs into web optimized ePapers that Google loves.

<strong>Towards</strong> maturity<br />

Looking at the impact of e-learning in the workplace March 2007<br />

Facts and Figures


<strong>Towards</strong> <strong>Maturity</strong>: Facts and Figures<br />

This is one of a suite of “<strong>Towards</strong> <strong>Maturity</strong>” publications to report on a comprehensive survey of<br />

over 200 employers and 1000 of their learners conducted online and through interview during<br />

autumn 2006.<br />

Full details of this research are published in the <strong>Towards</strong> <strong>Maturity</strong> suite of reports:<br />

<strong>Towards</strong> <strong>Maturity</strong>: Summary report (published 31 January 2007)<br />

<strong>Towards</strong> <strong>Maturity</strong>: Insights for employers and training providers (published 5 February 2007)<br />

<strong>Towards</strong> <strong>Maturity</strong>: Implications for policy-makers<br />

<strong>Towards</strong> <strong>Maturity</strong>: Facts and Figures (published March 2007). This report provides the detail<br />

on which the other 2 documents build and does not include an executive summary.<br />

The full reports and further information regarding the research findings and implications can be<br />

found at www.e-skills.com/elearning/towardsmaturity<br />

<strong>Towards</strong> <strong>Maturity</strong> research team:<br />

• Laura Overton (author of ‘Linking learning to Business’ investigating e-learning<br />

success, commissioned by e-learning Age magazine, 2004)<br />

• Howard Hills (co- author of ‘Embedding e-learning in large organisations’, a<br />

study commissioned by UfI, 2004)<br />

• Dr Genny Dixon (e-skills UK work based e-learning Project Manager)<br />

This study is part of the Skills for Business Network work based e-learning project<br />

(based at e-skills UK) which is funded by the Learning and Skills Council to understand<br />

how technology assisted learning can support employer skills requirements.<br />

For further information please contact:<br />

e-skills UK<br />

1 Castle Lane<br />

London SW1E 6DR<br />

t: +44 (0)20 7963 8920<br />

f: +44 (0)20 7592 9138<br />

e: info@e-skills.com<br />

w: www.e-skills.com<br />

© Reserved, e-skills UK Ltd, 2007<br />

All rights reserved. No part of this material protected by this copyright may be reproduced or utilised in any form, or by any means,<br />

electronic or mechanical, including photocopying, recording, or by any information storage and retrieval system without prior<br />

authorisation.<br />

e-skills UK is a not-for profit, employer-led organisation, licensed by government as the Sector Skills Council for IT and Telecoms. e-skills<br />

UK has responsibility for improving business competitiveness and UK productivity, uniting employers, educators and government on a<br />

common employer-led agenda for action on skills.<br />

Part of the Skills for Business network of 25 employer-led Sector Skills Councils


Contents<br />

Contents<br />

1 Introduction .............................................................................................. 9<br />

1.1 Research methodology................................................................................................... 9<br />

1.2 <strong>Maturity</strong> ............................................................................................................................ 10<br />

2 Reasons for investing in e-learning...................................................... 13<br />

2.1 e-learning: the drivers and reasons for investment ................................................... 13<br />

2.2 Differences in drivers by maturity segments............................................................... 14<br />

2.3 The Business Case ........................................................................................................... 19<br />

2.4 <strong>Maturity</strong> and Business Impact....................................................................................... 19<br />

2.5 Stakeholder involvement and Business Impact......................................................... 21<br />

2.6 Stakeholder involvement as Users................................................................................ 22<br />

2.7 The relationship between training capability and business impact....................... 24<br />

2.8 Compliance and Business Impact............................................................................... 27<br />

2.9 Staff Impact..................................................................................................................... 28<br />

2.10 Staff Impact versus input dimensions .......................................................................... 29<br />

2.11 <strong>Maturity</strong> and staff impact ............................................................................................. 31<br />

2.12 Learners Perspective...................................................................................................... 33<br />

3 People and organisational capability................................................. 35<br />

3.1 Decision making ............................................................................................................. 35<br />

3.2 Who uses e-learning?..................................................................................................... 37<br />

3.3 Who influences learners? .............................................................................................. 40<br />

3.4 Roles trained by sector .................................................................................................. 45<br />

3.5 Source of funding ........................................................................................................... 47<br />

3.6 Sources of e-learning ..................................................................................................... 49<br />

3.7 Expectation clients have of vendors........................................................................... 51<br />

3.8 Characteristics of the marketplace ............................................................................ 51<br />

4 e-learning – technology, software and topics delivered .................. 53<br />

4.1 Topics covered ............................................................................................................... 53<br />

4.2 Topics learners are interested in................................................................................... 59<br />

4.3 Programmes offered...................................................................................................... 61<br />

4.4 Services provided to learners ....................................................................................... 66<br />

5 Take-up of Software Tools in support of e-learning............................ 69<br />

5.1 Technologies used to support e-learning ................................................................... 69<br />

5.2 Impact of maturity on the use of software tools ....................................................... 71<br />

5.3 Differences due to geography and size..................................................................... 74<br />

6 IT Capability ........................................................................................... 76<br />

6.1 Key differences observed with IT capability .............................................................. 76<br />

6.2 Influence on success...................................................................................................... 78<br />

6.3 Supporting learners ........................................................................................................ 80<br />

<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 3


Contents<br />

7 Supporting learners ............................................................................... 83<br />

7.1 Difference in support provided by maturity segments............................................. 86<br />

7.2 Learning support and business impact ....................................................................... 88<br />

7.3 Learners’ view of support .............................................................................................. 89<br />

7.4 Technical support ........................................................................................................... 92<br />

8 Promoting and sustaining e-learning .................................................. 93<br />

8.1 Learners response to the communication methods................................................. 96<br />

8.2 Convenience of e-learning ........................................................................................ 100<br />

8.3 Who influences learners? ............................................................................................ 102<br />

8.4 Obtaining feedback .................................................................................................... 103<br />

8.5 Key actions that influence the success of e-learning............................................. 106<br />

9 <strong>Towards</strong> <strong>Maturity</strong> – The changing face of e-learning ...................... 109<br />

9.1 Informal learning and the views of learners ............................................................. 109<br />

9.2 Technologies supporting informal learning .............................................................. 111<br />

9.3 Learners’ willingness to contribute............................................................................. 113<br />

9.4 Informal methods and tools – the employers view ................................................. 115<br />

9.5 Spend on e-learning .................................................................................................... 118<br />

10 Comparison of Education Sector with Other Sectors ....................... 121<br />

10.1 Comparison of probability of drivers being selected ............................................. 123<br />

10.2 Sourcing and development of e-learning................................................................ 124<br />

10.3 Funding........................................................................................................................... 124<br />

10.4 Learner support............................................................................................................. 124<br />

10.5 Technologies used and considered .......................................................................... 126<br />

10.6 The future - do educational organisations have a different view?...................... 127<br />

11 The future of e-learning....................................................................... 129<br />

11.1 Challenges for e-learning............................................................................................ 131<br />

11.2 Geographic differences.............................................................................................. 133<br />

11.3 Progress since 2004....................................................................................................... 133<br />

11.4 Sources of advice......................................................................................................... 139<br />

12 Conclusions.......................................................................................... 141<br />

12.1 Introduction ................................................................................................................... 141<br />

12.2 Chapter 2 – Investment ............................................................................................... 141<br />

12.3 Chapter 3 - People and organisational capability................................................. 142<br />

12.4 Chapter 4 – E-learning – technology, software, and topics delivered................ 144<br />

12.5 Chapter 5 – Take-up of software tools in support of e-learning............................ 146<br />

12.6 Chapter 6 - IT capability .............................................................................................. 147<br />

12.7 Chapter 7 – Supporting learners ................................................................................ 148<br />

12.8 Chapter 8 – Promoting e-learning ............................................................................. 149<br />

12.9 Chapter 9 – the changing face of learning............................................................. 150<br />

12.10 Chapter 10 – Comparison of education sector with others .................................. 152<br />

12.11 Chapter 11 – the future of learning ........................................................................... 153<br />

<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 4


Contents<br />

Index of Figures<br />

Figure 2.1 Financial impact of e-learning maturity................................................................. 19<br />

Figure 2.2 <strong>Maturity</strong> and alignment to the business................................................................. 20<br />

Figure 2.3 Who influences success in relation to business impact ....................................... 21<br />

Figure 2.4 <strong>Maturity</strong> versus influences......................................................................................... 22<br />

Figure 2.5 Business impact varies according to usage by different groups of staff.......... 23<br />

Figure 2.6 The learner perspective on business impact......................................................... 24<br />

Figure 2.7 Training function capability affects business impact........................................... 25<br />

Figure 2.8 Consolidation of learning reflected in improved business impact.................... 26<br />

Figure 2.9 Compliance and business impact.......................................................................... 27<br />

Figure 2.10 Factors related to staff impact.............................................................................. 28<br />

Figure 2.11 Staff impact versus input dimensions.................................................................... 30<br />

Figure 2.12 Change management influences staff impact of e-learning ......................... 31<br />

Figure 2.13 Staff impact versus maturity................................................................................... 32<br />

Figure 2.14 Employer view of staff impact............................................................................... 32<br />

Figure 2.15 Learner responses.................................................................................................... 33<br />

Figure 2.16 Staff impact and freedom of choice................................................................... 34<br />

Figure 3.1 Making e-learning investment decisions................................................................ 35<br />

Figure 3.2 Making decisions about e-learning ........................................................................ 36<br />

Figure 3.3 Making decisions about e-learning ........................................................................ 36<br />

Figure 3.4 Business impact of a strategy compared.............................................................. 37<br />

Figure 3.5 Effect on key dimensions when directors use e-learning .................................... 38<br />

Figure 3.6 Staff impact versus use by directors ....................................................................... 39<br />

Figure 3.7 Directors’ use of e-learning affects factors comprising take-up........................ 40<br />

Figure 3.8 Whose opinion encourages use of e-learning...................................................... 41<br />

Figure 3.9 Who encourages you to learn? .............................................................................. 44<br />

Figure 3.10 Percentage organisations by sector selecting role as user of e-learning ...... 47<br />

Figure 3.11 Where does e-learning spend come from?........................................................ 48<br />

Figure 3.12 How is e-learning sourced?.................................................................................... 49<br />

Figure 3.13 Source of supply of e-learning by maturity ......................................................... 50<br />

Figure 3.14 Important qualities organisations are looking for from their supplier .............. 51<br />

Figure 3.15 Percentage of suppliers selected by respondents ............................................ 52<br />

Figure 4.1 Range of topics offered by organisations ............................................................. 53<br />

Figure 4.2 Adoption patterns by topics as organisations become more mature ............. 58<br />

Figure 4.3 The range of topics studied by learners................................................................. 60<br />

Figure 4.4 Programmes offered by organisations................................................................... 61<br />

<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 5


Contents<br />

Figure 4.5 Programmes offered with an e-learning component ......................................... 65<br />

Figure 4.6 Types of formal online services offered.................................................................. 66<br />

Figure 4.7 Formal online services offered changes with maturity ........................................ 67<br />

Figure 4.8 Types of informal online services offered............................................................... 68<br />

Figure 4.9 Use of informal techniques increases with maturity............................................. 68<br />

Figure 5.1 Current and planned use of learning technologies ............................................ 69<br />

Figure 5.2 Information and production tools........................................................................... 72<br />

Figure 5.3 Delivery tools – change of use by maturity ........................................................... 73<br />

Figure 5.4 Use of collaborative tools increases with maturity ............................................... 74<br />

Figure 5.5 Differences from average take-up of technologies by geography ................. 75<br />

Figure 6.1 Effect of IT capability on key dimensions............................................................... 76<br />

Figure 6.2 Key differences associated with IT capability....................................................... 77<br />

Figure 6.3 Variation in influence of roles with IT capability.................................................... 78<br />

Figure 6.4 IT capability affects where learning can be offered........................................... 79<br />

Figure 6.5 Learner support mechanisms change with IT capability .................................... 80<br />

Figure 6.6 Seeking feedback from learners............................................................................. 81<br />

Figure 6.7 Sourcing and managing production of e-learning.............................................. 81<br />

Figure 7.1 Study support provided to learners ........................................................................ 83<br />

Figure 7.2 Learner support – the learner perspective ............................................................ 84<br />

Figure 7.3 Learner support- what is most useful when it is available ................................... 85<br />

Figure 7.4 Number of different types of tutor support............................................................ 86<br />

Figure 7.5 Learner support compared by geographic characteristics .............................. 87<br />

Figure 7.6 Workplace learners support by maturity................................................................ 87<br />

Figure 7.7 Business impact increases when learning is consolidated.................................. 88<br />

Figure 7.8 Support received by employees............................................................................. 89<br />

Figure 7.9 Attributes valued by employees ............................................................................. 90<br />

Figure 7.10 Learners’ views by dimension ................................................................................ 90<br />

Figure 7.11 Relative importance of dimensions to learners by segment ............................ 91<br />

Figure 7.12 Provision of technical support to learners............................................................ 92<br />

Figure 8.1 Promotion of e-learning – what mature organisations do differently ............... 93<br />

Figure 8.2 Sustaining e-learning – what do mature organisations do differently .............. 94<br />

Figure 8.3 Sustaining interest in e-learning according to business impact ......................... 94<br />

Figure 8.4 Promoting and sustaining take-up – action to achieve take-up....................... 95<br />

Figure 8.5 Learner response to communications about e-learning .................................... 96<br />

Figure 8.6 Communication about e-learning – effect of age of learner............................ 97<br />

Figure 8.7 Communication about e-learning – effect of management responsibility..... 98<br />

<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 6


Contents<br />

Figure 8.8 Communication about e-learning – effect of where learners work ................. 98<br />

Figure 8.9 Communication about e-learning – effect of when learning occurs............... 99<br />

Figure 8.10 Availability and access to learning .................................................................... 100<br />

Figure 8.11 Where is e-learning offered and where is it done?.......................................... 101<br />

Figure 8.12 Who encourages learning varies with work and learning location............... 102<br />

Figure 8.13. Who encourages learning varies with age and responsibility....................... 103<br />

Figure 8.14 Methods used to gather learner feedback ...................................................... 103<br />

Figure 8.15 Mature organisations gather more feedback from learners.......................... 104<br />

Figure 8.16 Business impact is enhanced by effective follow up....................................... 105<br />

Figure 8.17 Staff impact is enhanced by effective follow-up............................................. 105<br />

Figure 9.1 How learners are building their skills and knowledge ........................................ 109<br />

Figure 9.2 Technology supporting informal learning – learners’ views .............................. 111<br />

Figure 9.3 Discussion boards – which learners find them most useful?.............................. 112<br />

Figure 9.4 Willingness to use technology to help others learn (by responsibility) ............ 114<br />

Figure 9.5 Willingness to use technology to help others learn (by time/location) .......... 114<br />

Figure 9.6 Informal methods in supporting technologies .................................................... 115<br />

Figure 9.7 Informal services and supporting technologies by maturity............................. 116<br />

Figure 9.8 Use of informal techniques compared to staff impact of e-learning ............. 117<br />

Figure 9.9 Use of informal techniques compared to business impact of e-learning ...... 118<br />

Figure 9.10 e-learning budget plans vary with sector.......................................................... 119<br />

Figure 9.11 e-learning budget plans very with maturity ...................................................... 119<br />

Figure 9.12 Percentage of budget spent on e-learning...................................................... 120<br />

Figure 10.1 Differences in dimensions – education sector versus others........................... 121<br />

Figure 10.2 Drivers for e-learning ............................................................................................. 123<br />

Figure 10.3 Support provided to learners............................................................................... 125<br />

Figure 10.4 Help in consolidating learning............................................................................. 126<br />

Figure 10.5 Learning technologies in use ............................................................................... 126<br />

Figure 11.1 Predictions for the future of e-learning .............................................................. 129<br />

Figure 11.2 Predictions of e-learning futures by maturity..................................................... 130<br />

Figure 11.3 Barriers to e-learning in the next 3 years ............................................................ 131<br />

Figure 11.4 Barriers to e-learning over the next 3 years by business sector ...................... 132<br />

Figure 11.5 Propensity for organisations to report barriers................................................... 133<br />

Figure 11.6 Changes in managerial commitment and availability of e-learning ........... 137<br />

Figure 11.7 Changes in skills and IT capability....................................................................... 138<br />

Figure 11.8 Sources of advice used by respondents............................................................ 139<br />

Figure 11.9 What type of additional support would be helpful? ....................................... 140<br />

<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 7


Contents<br />

Index of Tables<br />

Table 1.1 Defining e-learning maturity ..................................................................................... 10<br />

Table 1.2 Comparison of factual responses by maturity....................................................... 12<br />

Table 2.1 Drivers behind e-learning investment...................................................................... 13<br />

Table 2.2 Biggest benefits of e-learning perceived in 2004 by users (n=291)..................... 14<br />

Table 2.3 Comparison of frequency with which drivers are cited by maturity segments 15<br />

Table 2.4 Frequency of citing drivers compared by geographic circumstances ............ 16<br />

Table 2.5 Comparison of citing drivers by size of organisation............................................. 17<br />

Table 2.6 Comparison of frequency with which drivers are cited by sector ..................... 18<br />

Table 2.7 Who uses e-learning in your organisation?............................................................. 22<br />

Table 2.8 Consolidation of learning reflected in improved business impact..................... 26<br />

Table 3.1 Percentage of respondents agreeing with Staff Impact statements ................ 39<br />

Table 3.2 Percentage agreeing with take up statements .................................................... 40<br />

Table 3.3 Who encourages you to learn? ............................................................................... 41<br />

Table 3.4 Use of e-learning by directors ................................................................................... 44<br />

Table 3.5 Percentage of employers providing e-learning to this role ................................. 45<br />

Table 3.6 Percentage of organisations offering e-learning to specific roles...................... 46<br />

Table 3.7 Sources of funding by expenditure.......................................................................... 49<br />

Table 4.1 Likelihood of skills being delivered by e-learning .................................................. 54<br />

Table 4.2 Percentage of organisations offering skills by sector............................................ 55<br />

Table 4.3 Percentage in each sector who use e-learning for each skills area.................. 56<br />

Table 4.4 Respondents offering topics with an e-learning component ............................. 57<br />

Table 4.5 Provision and usage of e-learning programmes ................................................... 60<br />

Table 4.6 Work-based programmes offered ........................................................................... 62<br />

Table 4.7 Penetration of an e-learning component into work-based programmes ........ 63<br />

Table 4.8 Respondents offering skills with an e-learning component ................................. 64<br />

Table 4.9 Penetration of e-learning .......................................................................................... 65<br />

Table 5.1 Software tools used vary with maturity.................................................................... 71<br />

Table 8.1 Enhancing Business Impact..................................................................................... 106<br />

Table 8.2 Enhancing staff impact ........................................................................................... 107<br />

Table 8.3 Enhancing take-up of e-learning........................................................................... 108<br />

Table 10.1 Significant differences in self-perception ratings............................................... 122<br />

Table 10.2 Capability of the training function....................................................................... 127<br />

Table 11.1 Comparisons in e-learning implementation 2004-2007 .................................... 135<br />

For related case studies please visit www.e-skills.com/elearning.<br />

<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 8


1 Introduction<br />

1 Introduction<br />

The Skills for Business Network commissioned a study during 2006 to research the uptake,<br />

demand and use of e-learning by employers and employees. Its purpose is to report on the<br />

current state of e-learning amongst knowledgeable users rather than across all work-based<br />

learning. The scope of the study is amongst users of e-learning to provide an up-to-date<br />

picture of the demand side to complement annual research programmes that understand<br />

the further education and work-based provider provision on the “supply side”. The aim of this<br />

report is to distil perceived wisdom on the implementation and engagement of e-learning by<br />

both employers and learners. We investigate the barriers and the drivers and the resulting<br />

business impact of e-learning and build on research conducted in 2004 and 2005.<br />

Specifically the “Linking Learning to Business” report and the “Embedded e-learning Report”,<br />

see footnotes.<br />

A further aim is to raise awareness within the potential user community, via the Sector Skills<br />

Councils Network and by other methods, on the potential benefits of e-learning and to<br />

provide guidance to that community on its successful implementation. The study is also<br />

required to guide policy and decision-makers on the future pattern for Government provision<br />

of work-based learning in general and e-learning specifically. The Skills for Business Network<br />

will look to use the findings to help them improve, influence and develop skills<br />

recommendations of behalf of employers.<br />

E-learning has been in place now for more than 6 years, and prior to that time various other<br />

forms of technology have been used to deliver learning. There should be a wealth of<br />

guidance and advice available from experienced and mature users of this technology.<br />

1.1 Research methodology<br />

Appendix A describes the approach to the research in more detail. An on-line survey was<br />

selected as being (1) rapid, (2) economical, (3) in line with the ethos of our research to<br />

investigate the exploitation of technology in the support of learning. However, the on-line<br />

element created a number of risks on the quality of the data, fully discussed in Appendix A.<br />

Likert scale 10-point questions were used extensively in both the employer and the employee<br />

survey. The purpose of using this collection method was to render the data suitable for factor<br />

analysis, specifically Principal Component Analysis, to group factors into dimensions and<br />

investigate the relationship between them. The definition of the dimensions arises from<br />

questions that were identified as related to each other and that were answered in a similar<br />

fashion by a wide range of respondents; no other meaning should be applied to the use of<br />

these terms in this report. The term factors is used to describe the answers to these questions.<br />

The analysis also focused on both social software and informal learning. The term social<br />

software is derived from the current discussions into what has been termed e-learning 2.0 (a<br />

term reported in the DTI Global Watch Mission report “Beyond e-Learning: practical insights<br />

from the USA” May 2006, citing an article by Stephen Downes the Senior Researcher at<br />

National Research Council Canada in October 2005. He described the applications and<br />

environments of Web 2.0 as supporting learning through sharing, communication,<br />

collaboration, syndication and social interaction.<br />

<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 9


1 Introduction<br />

These changes are typified by current developments in the Internet, moving from content<br />

distribution to a much more collaborative phase. This allows the development of more<br />

learner centric applications for learning than has typically been available up till now.<br />

Examples of social software include wikis, blogs, RSS feeds, moderated and un-moderated<br />

chat rooms virtual classrooms and discussion boards. In collecting data about the use<br />

organisations are making of Web technology specific questions are included to investigate<br />

these developments and to find out whether they feature in the plans of organisations up to<br />

2010. The study has also asked specific questions around informal learning, including asking<br />

learners how else they learn. This included questions on such things as search portals and<br />

communities of practice.<br />

1.2 <strong>Maturity</strong><br />

<strong>Maturity</strong> is a key concept that is used throughout the report to analyse the responses from<br />

the employer respondents. The division into maturity segments is done on the basis of the<br />

self-perception of respondents. They were asked to answer the following question ‘Which of<br />

the following statements do you think best describes your company’s knowledge of how to<br />

use ICT to manage and deliver learning?’ Table 1.1 lists the responses, together with the titles<br />

that have been adopted throughout the report and the number of respondents who<br />

selected that particular option.<br />

Table 1.1 Defining e-learning maturity<br />

Which of the following statements do you think best describes your company’s knowledge of<br />

how to use ICT to manage and deliver learning?.<br />

Title used in report Survey statement Number of<br />

respondents<br />

The Novice We know very little about e-learning 10<br />

The Sporadic user<br />

Use of e-learning is localised or sporadic (used in some<br />

departments or for some courses)<br />

The Developing user We are developing and coordinating our use of e-<br />

learning<br />

The Established user e-learning is established across the company and is<br />

transforming the way we manage our learning and<br />

development<br />

The Embedded user e-learning is thoroughly embedded within the company –<br />

we have a learning culture which influences our everyday<br />

work<br />

The Innovator<br />

We are thought leaders and innovators in the way in<br />

which we are using e-learning – prepared to experiment<br />

in new areas and with new technologies<br />

45<br />

75<br />

36<br />

11<br />

36<br />

<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 10


1 Introduction<br />

An essential part of the initial analysis was to assess this segmentation to discover its validity.<br />

The results of this analysis demonstrate very clearly that those who perceive themselves to be<br />

more mature do a number of things differently (Table 1.2).<br />

A certain amount of care is required in this analysis because of the varying number of<br />

respondents. The 2 categories of novices and embedded attracted relatively few<br />

respondents. It is also clear, and is discussed further in Appendix B that the innovation<br />

segment attracted a number of respondents who are perhaps inappropriately placed.<br />

However, a number of trends emerge:<br />

> There is a greater probability that more mature organisations will have staff dedicated<br />

to the development, purchasing and commissioning of e-learning. The percentage<br />

rises from 30% of those who perceive themselves to be novices to 89% of those who<br />

perceive them innovators.<br />

> Generally speaking more mature users are more likely to cite a greater number of<br />

reasons behind their company’s investment in e-learning. For novices this is<br />

approximately 4 rising to 7.7 for embedded users.<br />

> More mature users employ e-learning in some shape or other in support of specific<br />

topics. On average novices will deploy e-learning for about 3 out of 18 topics.<br />

Embedded users will use e-learning for 10 out of these 18 topics.<br />

> More mature users will have a greater number of roles using e-learning, increasing from<br />

3.5 for novices to 6.6 for embedded users. Respondents were asked where they<br />

offered e-learning and again more mature users are likely to offer it in a greater variety<br />

of locations.<br />

> The same pattern appears with the various on-line learning services that are offered,<br />

although those who are less mature do offer a significant number; typically about 5<br />

different types of services for novices and sporadic users, rising to more than 8 for more<br />

mature users.<br />

> The average number of ICT and e-learning technologies that are currently being used<br />

rises from 2.2 for novices to 8.6 for embedded users.<br />

In addition to this analysis there are a significant number of other differences reported on<br />

that are based upon segmentation by this maturity question.<br />

The full employer and learner surveys are included in the Appendices.<br />

<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 11


1 Introduction<br />

Table 1.2 Comparison of factual responses by maturity<br />

Survey<br />

Questions<br />

6) Do you have staff<br />

dedicated to the<br />

development,<br />

purchasing and<br />

commissioning of e-<br />

learning?<br />

10) What are the<br />

reasons behind your<br />

company’s<br />

investment in e-<br />

learning or the use of<br />

ICT to support<br />

learning in your<br />

organisation?<br />

11) Which of the<br />

following types of<br />

a) Key Skills<br />

b) Operational Skills<br />

c) General Skills<br />

training have<br />

employees in your<br />

organisation<br />

undertaken in the last<br />

12 months?<br />

13) Who is<br />

using e-<br />

learning in your<br />

organisation?<br />

(Please tick all<br />

that apply)<br />

14) Where do you<br />

offer e-learning?<br />

(Please tick all that<br />

apply)<br />

Which of the<br />

following<br />

15) formal<br />

16) informal<br />

on-line services<br />

do you offer?<br />

17) Which of the<br />

following types<br />

of ICT e-learning<br />

technologies are<br />

you using?<br />

Average<br />

responses<br />

to factual<br />

Questions<br />

Percentage of<br />

respondents who<br />

have dedicated e-<br />

learning teams<br />

Average total drivers<br />

cited by respondents<br />

Average number of<br />

topics for which e-<br />

learning is being<br />

used now.<br />

Average<br />

number of roles<br />

using e-<br />

learning<br />

Average number of<br />

types of locations in<br />

which e-learning is<br />

provided<br />

Average number<br />

of on-line learning<br />

services offered<br />

Average<br />

number of<br />

technologies<br />

used<br />

Novices 30% 4.10 2.33 3.50 1.83 5.00 2.20<br />

Sporadic<br />

Users<br />

Developin<br />

g Users<br />

Establishe<br />

d Users<br />

Embedde<br />

d users<br />

39% 3.95 3.31 3.49 2.20 4.71 3.79<br />

67% 4.91 5.26 4.61 2.87 5.59 4.28<br />

86% 5.36 9.00 6.63 3.50 6.87 5.16<br />

82% 7.73 10.50 6.67 3.33 8.67 8.67<br />

Innovators 89% 5.61 7.63 5.22 2.89 8.35 8.12<br />

<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 12


2 Investing in e-learning<br />

2 Reasons for investing in e-learning<br />

Overview: This chapter investigates elements in the data that show a link with Business<br />

Impact and the reasons that lie behind employer’s investment in e-learning. We present the<br />

essence of a business case for e-learning; by implication it has many lessons for the<br />

successful deployment of e-learning but a full discussion of this is left to later chapters.<br />

2.1 e-learning: the drivers and reasons for investment<br />

Respondents were asked to select the reasons behind their company’s investment in e-<br />

learning or the use of ICT to support learning. They were asked to select from a list all the<br />

most important reasons to them (Table 2.1). They were given the opportunity to add<br />

additional reasons. Where the question was asked in 2004 the average response is shown.<br />

Table 2.1 Drivers behind e-learning investment<br />

Drivers cited by respondents<br />

2006 responses<br />

(n=212 employers)<br />

2004 responses<br />

(n=290 users)<br />

Increase access to learning 79% 10%<br />

Increase flexibility in providing training 73% 10%<br />

Reduce training costs 49% 16%<br />

Develop a better qualified workforce 48% not asked<br />

Improved management and administration 47% not asked<br />

Improve quality of work-based learning 41% not asked<br />

Availability of improved technology 38% 42%<br />

New processes or new products 31% 26%<br />

Organisational change 27% 37%<br />

New IT systems 25% 29%<br />

New regulations and legal requirements 25% 22%<br />

Maintain image of organisational innovation 20% 23%<br />

Demand from workforce 11% 16%<br />

Respond to ICT literate younger staff 11% not asked<br />

Pressure from senior management 5% 16%<br />

Achieving consistency* 3% not asked<br />

Extending the reach of training* 2% not asked<br />

* listed by respondents in the “other” category<br />

There has been a significant shift in emphasis for the reasons behind the adoption of e-<br />

learning since 2004. Seventy five percent of respondents are driven by a need to increase<br />

the access to learning, compared to 10% of respondents in 2004. Similarly the need for<br />

flexibility was cited by 10% of respondents in 2004 and 69% of respondents in 2006.<br />

<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 13


2 Investing in e-learning<br />

NB. Approximately 75% of respondents in 2004 cited greater flexibility of learning as the most<br />

and 65% cited greater accessibility as the second most significant benefit of e-learning.<br />

What were not seen as drivers in 2004 but were realised to be significant benefits have now<br />

become drivers for investment in 2006. In a very real sense the experience of the past 2 years<br />

has made users of e-learning consider the rationale for its use in a very different way.<br />

Experience of the benefit is translated into drivers for future expansion of e-learning.<br />

Table 2.2 Biggest benefits of e-learning perceived in 2004 by users (n=291)<br />

Survey statement<br />

Number of respondents<br />

Greater flexibility 73%<br />

Greater accessibility 65%<br />

Cost savings 53%<br />

Greater quantity of learning 25%<br />

More effective learning 23%<br />

Record keeping for compliance requirements 24%<br />

Better focus on business requirements 21%<br />

Other responses: 22%<br />

Saves time<br />

Self managed<br />

Consistency of message<br />

Ability to track / assess learners<br />

Provides an alternative<br />

Brings people together<br />

Best practical cutting edge<br />

2.2 Differences in drivers by maturity segments<br />

Respondents are divided into segments according to their self-perception of maturity. Table<br />

2.3 shows the percentage of respondents within each segment who cited a particular driver<br />

as listed in the questionnaire. This table includes the average number of drivers cited per<br />

respondent. More mature organisations cite significantly more drivers. If we make<br />

allowances for the greater number of drivers cited per respondent by more mature<br />

organisations, then there is less difference between the relative importance of the various<br />

drivers between maturity segments than is apparent from the percentages in Table 2.3<br />

More mature organisations are more likely to be driven by a requirement to improve quality,<br />

increase access, increase flexibility and achieve a better qualified workforce. They are also<br />

more likely to be driven by new processes or products, new IT systems and improved<br />

availability of technology for learning. It would appear that this is because more mature<br />

organisations are likely to see more opportunities for e-learning. If we replace the<br />

percentages with a rank order there is little difference in the relative importance of specific<br />

drivers by maturity. The top 5 drivers are predominantly the top 5 drivers for all maturity<br />

segments.<br />

<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 14


2 Investing in e-learning<br />

Table 2.3 Comparison of frequency with which drivers are cited by maturity segments<br />

Title used in report<br />

Novices Sporadic<br />

users<br />

Developing<br />

users<br />

Established<br />

users<br />

Embedded<br />

users<br />

Innovators<br />

Increase access to learning 60% 66% 80% 78% 91% 69%<br />

Increase flexibility in providing<br />

staff training 70% 57% 76% 72% 91% 58%<br />

Reduce training costs 50% 34% 45% 58% 64% 47%<br />

Develop a better qualified<br />

workforce 30% 36% 43% 42% 82% 56%<br />

Better manage or administer<br />

work-based learning 40% 34% 40% 61% 64% 44%<br />

Improve the quality of workbased<br />

learning delivered 20% 32% 35% 39% 73% 50%<br />

Availability of improved<br />

technology (internet, intranet,<br />

bandwidth) 30% 32% 33% 36% 55% 42%<br />

New processes or new products 20% 20% 29% 33% 55% 31%<br />

Organisational change 10% 18% 27% 19% 36% 42%<br />

New IT systems 20% 23% 23% 28% 36% 19%<br />

New regulations and legal<br />

requirements 10% 16% 19% 33% 36% 36%<br />

Maintain public image of a<br />

progressive and innovative<br />

organisation 30% 11% 16% 22% 27% 22%<br />

Demand from workforce 10% 7% 9% 8% 27% 17%<br />

Younger staff recruits increasingly<br />

technology literate 0% 7% 11% 6% 18% 22%<br />

Pressure from senior<br />

management 10% 2% 5% 0% 18% 6%<br />

Average number of drivers cited<br />

per respondent 4.1 4.0 4.9 5.4 7.7 5.6<br />

Table 2.4 shows the percentages within each one of the geographic segments who cited a<br />

particular driver. Those who are occupying a single UK site select slightly fewer drivers than<br />

other organisations. As might be expected those with multiple sites, either globally or UK<br />

wide select slightly more drivers but the difference is small. If we compare the ranking of<br />

individual drivers within these geographic segments the only notable difference is that those<br />

with a few relatively large UK sites are proportionately more likely to select both<br />

organisational change and new IT systems as potential drivers. In the case of all the<br />

geographic segments both increased access and increased flexibility remain as the first and<br />

second most frequently selected drivers.<br />

<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 15


2 Investing in e-learning<br />

Table 2.4 Frequency of citing drivers compared by geographic circumstances<br />

Across<br />

Europe<br />

/Worldwide<br />

N= 81<br />

A few relatively<br />

large sites<br />

N= 50<br />

Single UK<br />

site N= 36<br />

Many small<br />

branches or<br />

offices/location<br />

s N=45<br />

Increase access to learning 77% 76% 61% 80%<br />

Increase flexibility in providing staff<br />

training 70% 72% 56% 73%<br />

Reduce training costs 56% 36% 36% 51%<br />

Develop a better qualified workforce 54% 30% 33% 53%<br />

Better manage or administer workbased<br />

learning 48% 42% 33% 49%<br />

Improve the quality of work-based<br />

learning delivered 36% 44% 28% 47%<br />

Availability of improved technology<br />

(internet, intranet, bandwidth) 35% 34% 39% 38%<br />

New processes or new products 32% 28% 22% 31%<br />

Organisational change 20% 38% 25% 24%<br />

New IT systems 22% 30% 11% 29%<br />

New regulations and legal<br />

requirements 31% 12% 19% 29%<br />

Maintain public image of a progressive<br />

and innovative organisation 19% 20% 25% 11%<br />

Demand from workforce 12% 12% 8% 9%<br />

Younger staff recruits increasingly<br />

technology literate 16% 2% 14% 9%<br />

Pressure from senior management 5% 6% 6% 2%<br />

Average number of drivers cited 5.3 4.8 4.2 5.4<br />

Table 2.5 compares the frequency of selecting drivers by organisations on the basis of<br />

organisation size. The 4 drivers most likely to be selected by all organisations are slightly more<br />

likely to be chosen by the larger organisations. Table 2.5 gives some indication that larger<br />

organisations are more likely to be driven by increased access to learning, increased<br />

flexibility in providing staff training, the need to reduce costs and the requirement to improve<br />

the management or administration of work-based learning. All other drivers show no<br />

particularly distinct pattern in relation to the size of organisations.<br />

<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 16


2 Investing in e-learning<br />

Table 2.5 Comparison of citing drivers by size of organisation<br />


2 Investing in e-learning<br />

Table 2.6 Comparison of frequency with which drivers are cited by sector<br />

Ignoring sectors with >10 respondents<br />

Manufacturing<br />

Transport, storage and<br />

communic-ations<br />

Financial intermediation<br />

Real estate, renting<br />

and business activities<br />

Public admin and<br />

defence<br />

Education<br />

Health and social work<br />

IT and<br />

Telecommuncations<br />

Increased access 80% 71% 78% 82% 76% 68% 85% 75%<br />

Increase flexibility 80% 81% 65% 71% 79% 51% 80% 75%<br />

Reduce training costs 53% 43% 70% 18% 56% 32% 55% 55%<br />

Achieve better qualified<br />

workforce 73% 71% 39% 35% 41% 34% 45% 55%<br />

Improved management for<br />

learning<br />

60% 38% 65% 29% 44% 34% 50% 40%<br />

Improved quality 40% 43% 35% 35% 41% 39% 30% 45%<br />

Improved ICT available 33% 29% 48% 24% 26% 34% 40% 40%<br />

New processes / products 40% 24% 43% 29% 15% 32% 35% 40%<br />

Organisational change 20% 14% 30% 0% 35% 34% 45% 20%<br />

Regulatory requirements 13% 24% 57% 24% 18% 12% 30% 35%<br />

New IT systems 0% 19% 35% 6% 32% 20% 30% 30%<br />

Public image 7% 10% 9% 12% 24% 34% 15% 20%<br />

Younger staff are more<br />

technology literate<br />

7% 10% 26% 6% 3% 12% 5% 15%<br />

Demand from workforce 13% 5% 9% 0% 12% 7% 10% 20%<br />

Senior Management pressure 0% 5% 0% 0% 3% 10% 5% 5%<br />

Regulatory requirements are significantly more important for the financial sector than for<br />

others, the education sector is more likely to be driven by the need for organisational<br />

change and the requirement to maintain public image of a progressive organisation than<br />

those in other sectors. Senior management pressure, demand for work force, younger staff<br />

being more technology literate remain the least important drivers for all sectors.<br />

Access and flexibility are within the top 3 most important drivers for all sectors. Both the<br />

business activities and education sectors are least likely to be driven by the need to reduce<br />

training costs.<br />

<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 18


2 Investing in e-learning<br />

2.3 The Business Case<br />

The initial analysis of the 10-point self-perception Likert scale questions indicates that some of<br />

them could be grouped into dimensions. The analysis has segmented respondents in<br />

accordance with 2 of these dimensions (see Appendix C for detailed definitions). These are:<br />

Business Impact – the tangible business benefits, the ability to respond to business need and<br />

the direct application of skills to the job in hand.<br />

Staff Impact – the intangible benefit of e-learning in an organisation, including staff<br />

motivation and the propensity to learn.<br />

The factor analysis used is discussed in Appendix A (Output Dimensions). The value of e-<br />

learning’s business impact is calculated from the mean of the 6 factors of which it is<br />

composed. Three of these include some financial element in the survey question. They have<br />

been grouped into a sub-dimension termed ‘financial impact’.<br />

2.4 <strong>Maturity</strong> and Business Impact<br />

The average rating for each maturity segment for each factor is shown below (Figure 2.1):<br />

Figure 2.1 Financial impact of e-learning maturity<br />

10<br />

8<br />

6<br />

4<br />

2<br />

0<br />

Novices<br />

Sporadic<br />

users<br />

Developing<br />

Users<br />

Established<br />

Users<br />

Embedded<br />

Users<br />

Innovators<br />

n=139<br />

Job performance metrics* Financial impact** Cost Savings***<br />

* Job performance metrics: e-learning has had a positive impact on existing job performance metrics (eg sales, machinery<br />

downtime, production, project completion etc)<br />

** Financial impact: e-learning has had other positive financial impact on the organisation<br />

*** Cost savings: Cost savings have been realised on staff training and development<br />

NB. On graphs with numeric scales of this type, 1 indicates strong disagreement with the survey statement, 10 indicates strong<br />

agreement.<br />

Ref: This graph appears as Figure 4 in <strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers<br />

<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 19


2 Investing in e-learning<br />

Figure 2.1 shows that the average rating for the 3 factors comprising the dimension financial<br />

impact for innovators and embedded users is double that for novices. The conclusion is that<br />

those who perceive themselves to be more mature in the application of e-learning perceive<br />

that e-learning has a greater financial impact on the business. A similar pattern can be seen<br />

with the other 3 factors that comprise the business impact dimension. These are shown<br />

plotted against maturity segments in Figure 2.2.<br />

Figure 2.2 <strong>Maturity</strong> and alignment to the business<br />

10.00<br />

8.00<br />

6.00<br />

4.00<br />

2.00<br />

0.00<br />

Novices<br />

Sporadic<br />

users<br />

Developing<br />

users<br />

Established<br />

Users<br />

Embedded<br />

Users<br />

Innovators<br />

Better business focus Quicker learning implementation Effective learning<br />

The link between maturity and the perception of business impact is a useful comparator but<br />

segmenting respondents on business impact is more relevant to understanding the link<br />

between e-learning and business performance,<br />

Respondents are segmented based upon the average of these six factors that may be<br />

grouped into the dimension termed Business Impact. Respondents are divided according to<br />

which quartile they are in for these values. Those in the bottom quartile have a business<br />

impact rating of between 1 and 4, those in the 25 th to 50 th percentile have a rating of<br />

between 4 and 5.5, those in the 50 th to 75 th percentile a rating of between 5.5 and 7.3 and<br />

those in the upper quartile have a business impact rating of between 7.3 and 10. These<br />

values are used to segment respondents into 4 groups. The number of respondents who<br />

could be segmented in this way varied from 136 to 141. Although 212 respondents started<br />

the survey only 141 answered the self-perception Likert scale questions, which are used to<br />

make the business impact segmentation and of those only 136 reliably answered every<br />

question.<br />

<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 20


2 Investing in e-learning<br />

2.5 Stakeholder involvement and Business Impact<br />

The respondents were asked to select the top 3 stakeholders that had the most influence on<br />

e-learning success in their organisation. They were offered 9 choices; the training<br />

department, senior executives, head of HR, learners, local champions of e-learning, head of<br />

IT, line managers, project sponsors and head of Finance. These are analysed against the<br />

perceived business impact of e-learning. The head of HR, head of IT and head of Finance<br />

show an inverse relationship with the business impact, the most extreme of which is head of<br />

IT. The influence of this role in terms of e-learning success is shown in Figure 2.3. Those who<br />

perceive themselves to be in the upper quartile for business impact are least likely to select<br />

the head of IT as one of the 3 key influences on e-learning success. Selection of neither<br />

project sponsor nor senior executive showed any particular relationship with business impact<br />

and are not shown in Figure 2.3, neither are the heads of HR and Finance; although selection<br />

of these as influencers show a similar but less pronounced pattern to head of IT. Both the<br />

selection of the training department, learners, and line managers, do show a positive<br />

relationship with perceived business impact. Seventy percent of respondents who are in the<br />

upper quartile for business impact select learners as a key influence on e-learning success,<br />

compared to 40% of those in the bottom quartile.<br />

Figure 2.3 Who influences success in relation to business impact<br />

100%<br />

80%<br />

60%<br />

40%<br />

20%<br />

0%<br />

n=139<br />

Upper quartile 3rd quartile 2nd quartile Lower quartile<br />

Business Impact<br />

Training department Learners Line managers Head of IT<br />

If we plot the probability of these 4 roles shown in Figure 2.3 against maturity, as shown in<br />

Figure 2.4, we see that line managers and learners are considered to be a greater influence<br />

on the success of e-learning by more mature users than less mature users. The influence of<br />

the head of IT shows a similar inverse relationship to maturity as it does to business impact.<br />

However, the influence of the training department drops off significantly amongst innovators.<br />

This may be because 70% of innovators select senior executives as one of the top 3<br />

influencers on the success of e-learning. Perhaps with innovators the training department<br />

sees itself much more as responding to the demands from learners and senior executives.<br />

<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 21


2 Investing in e-learning<br />

Figure 2.4 <strong>Maturity</strong> versus influences<br />

100%<br />

80%<br />

60%<br />

40%<br />

20%<br />

0%<br />

Innovators<br />

Embedded<br />

Users<br />

Established<br />

Users<br />

Developing<br />

Users<br />

Sporadic users<br />

Novices<br />

Training department Learners Line managers Head of IT<br />

2.6 Stakeholder involvement as Users<br />

Respondents were asked to identify the roles of individuals within their organisation who used<br />

e-learning (Table 2.7). Administrators, professionals and line managers are the “soft touch” for<br />

e-learning. In fact 57% of all respondents deliver e-learning to all these 3 roles. They seem to<br />

be the easiest group to market e-learning to, perhaps easiest to develop or buy material for,<br />

by virtue of the nature of their jobs.<br />

Table 2.7 Who uses e-learning in your organisation?<br />

All<br />

Innovators Embedded<br />

Users<br />

Established<br />

Users<br />

Developin<br />

g Users<br />

Sporadic<br />

users<br />

Novices<br />

Admin (with PC) 81% 78% 89% 100% 82% 69% 50%<br />

Professionals 80% 78% 111% 93% 77% 63% 100%<br />

Line Manager 75% 74% 100% 100% 70% 63% 33%<br />

Technicians 64% 67% 78% 80% 57% 54% 67%<br />

Director 52% 74% 100% 80% 38% 29% 17%<br />

Admin (no PC) 39% 41% 56% 57% 38% 23% 17%<br />

Service Roles 38% 41% 56% 57% 34% 23% 17%<br />

Skilled role 37% 37% 44% 53% 38% 20% 33%<br />

Manual role 26% 33% 33% 43% 26% 6% 17%<br />

<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 22


2 Investing in e-learning<br />

However, if we look at the relationship between who uses e-learning and business impact we<br />

can identify the key roles who make the biggest difference to business impact. The 3 key<br />

roles that change with business impact are shown in Figure 2.5. Other roles do not<br />

demonstrate such a clear cut linkage.<br />

Figure 2.5 Business impact varies according to usage by different groups of staff<br />

100%<br />

80%<br />

60%<br />

40%<br />

20%<br />

0%<br />

Upper quartile 3rd quartile 2nd quartile Lower quartile<br />

Business Impact<br />

n=139<br />

Directors Technicians Skilled Roles<br />

Ref: This graph appears as Figure 5 in <strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers<br />

Those organisations which can increase their use of e-learning by directors, technician grade<br />

staff and those in skilled roles are most likely to improve their perception of business impact.<br />

The self rating questions asked of learners mirror those asked of employers; with appropriately<br />

different wording. Learners were asked a number of questions relating to alignment to the<br />

business. Some of these relate to Business Impact. Four of these are picked out in Figure 2.6.<br />

Questions are related to job performance, relevance of training to current role, customer<br />

satisfaction and speed of putting into practice. Three of these belong in a dimension labelled<br />

Job Relevance (see Appendix A, Table A.4). The question relating to customer satisfaction<br />

does not. Not surprisingly learners had a very neutral view on whether or not customer<br />

satisfaction had increased since learners were able to access e-learning; average rating<br />

4.64; (20% agree, 28% disagree). This is close to the employer’s view of customer satisfaction<br />

linking to e-learning with an average rating of 4.71; (agree 16%, disagree 26%). The 28% of<br />

learners and the 26% of employers who disagreed with this statement are not necessarily<br />

saying that customers are more dissatisfied, they may have a much firmer view that there has<br />

been no change in customer satisfaction. Nevertheless the jury is out as far as customer<br />

satisfaction is concerned except that these average ratings change, depending on which<br />

quartile employer respondents are in for staff impact (See Figure 2.10).<br />

<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 23


2 Investing in e-learning<br />

Figure 2.6 The learner perspective on business impact<br />

e-learning has had a positive impact on my<br />

existing job performance<br />

My company provides e-learning events that are<br />

directly relevant to my current job<br />

Customer satisfaction has increased since we<br />

have had more access to e-learning<br />

I am able to quickly put into practice what I<br />

learn from e-learning<br />

n=720<br />

0% 20% 40% 60% 80% 100%<br />

Agree Neutral Disagree<br />

Ref: This graph appears as Figure 6 in <strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers<br />

Employees have a more positive view of the speed with which they can put their learning<br />

into practice, not only do 45% agree they can do it quickly, the average rating for all<br />

employees is 6.02 compared to 5.63 for employer respondents, although employer<br />

respondents are reasonably positive that they can quickly implement learning with an<br />

average rating of 6.03. This factor is included within the business impact dimension for<br />

employers. It appears that employers have some confidence they can roll out e-learning<br />

quickly; but less sure learners apply it quickly. However, learners have some confidence they<br />

can apply it quickly; to the same extent that employers feel they can roll it out quickly.<br />

Generally speaking 4 out of 10 learners perceive that e-learning has a positive impact on<br />

their jobs, is relevant and they can quickly put it into practice. These 3 factors are part of the<br />

learner dimension job relevance which has an overall average of 6.02 and 43% of learners<br />

with an agreement score. Only 13% disagree that e-learning is not relevant to their job.<br />

2.7 The relationship between training capability and business impact<br />

Respondents were asked a number of questions relating to the capability of the training<br />

function. Of these 4 behave in a similar fashion and their relationship to business impact is<br />

shown in Figure 2.7. The fifth question in this section of the questionnaire referred to auditing<br />

skills of those in the training function and this shows a greater relationship with change<br />

management than with the 4 factors reported on in this section. The grouping and<br />

dimensions are defined in Table A.3 All 5 are shown in Figure 2.7 and all show a relationship<br />

with the respondents’ perception of business impact. Respondents who perceive themselves<br />

to be in the top quartile of business impact are far more likely to agree that they have the<br />

skills to manage e-learning providers, have good relationships with IT and are willing to<br />

embrace the new technologies. They are less likely to agree that they have audited the<br />

training skills of the training function; to be more accurate those in the lowest quartile for<br />

business impact are more likely to agree that they have not audited the skills of the training<br />

function against the skills required to deploy e-learning. Appendix A discusses the grouping<br />

of 4 of the above 5 factors into a dimension labelled Training Function Capability; see Table<br />

A.3.<br />

<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 24


2 Investing in e-learning<br />

Figure 2.7 Training function capability affects business impact<br />

10.0<br />

9.0<br />

8.0<br />

7.0<br />

6.0<br />

5.0<br />

4.0<br />

3.0<br />

2.0<br />

1.0<br />

0.0<br />

Top quartile 3rd quartile 2nd quartile Bottom quartile<br />

Business impact<br />

Manage e-learning providers<br />

Audit of IT systems<br />

Audited training skills<br />

Links with IT<br />

Willing to embrace new technology<br />

Ref: This graph appears as Figure 7 in <strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers<br />

2.7.1 The relationship of the consolidation of learning to business impact<br />

Respondents were asked a number of questions relating to the support provided to learners<br />

before, during and after their use of e-learning. These included 4 support mechanisms that<br />

helped them consolidate new skills from e-learning in the workplace. This shows a<br />

relationship with business impact. Respondents were asked which of 6 support mechanisms<br />

they provided. These were: job related assignments, reference books, electronic help and<br />

job aids, periodic reassessment, printed job aids and line management coaching and<br />

feedback support. Four of these demonstrate a relationship with business impact. This is<br />

shown in Figure 2.8. This shows the probability that a respondent in each quartile will offer<br />

that type of support. Of the 2 not shown on this graph printed job aids are provided by 12%<br />

of respondents and job related assignments by 23% of respondents. Neither showed any<br />

particular relationship with business impact. A similar comparison was carried out for other<br />

forms of support.<br />

Table 2.9 shows the percentage of all respondents who offered the particular type of support<br />

listed. A greater number of respondents offer technical support than offer either study<br />

support or support in consolidating learning. Whilst none of these support methods show any<br />

particular relationship with business impact some of them are influenced by the maturity of<br />

respondents in relation to their implementation of e-learning. This is discussed further in<br />

Chapter 5 - Supporting and promoting e-learning.<br />

<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 25


2 Investing in e-learning<br />

Figure 2.8 Consolidation of learning reflected in improved business impact<br />

100%<br />

80%<br />

60%<br />

40%<br />

20%<br />

0%<br />

Upper quartile 3rd quartile 2nd quartile Lower quartile<br />

Business Impact<br />

n=139<br />

Reference books<br />

Re-assessment<br />

Electronic job aids<br />

Line manager coaching<br />

Ref: This graph appears as Figure 8 in <strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers<br />

Table 2.8 Consolidation of learning reflected in improved business impact<br />

How do you provide technical support to your learners? (Please tick all<br />

that apply)<br />

In person 43%<br />

Telephone help desk 80%<br />

By email 74%<br />

Through a web resource 34%<br />

% of respondents<br />

What study support do you provide to your learners as they progress<br />

through the programme? (Please tick all that apply)<br />

In person before e-learning starts 32%<br />

With a tutor in telephone contact 29%<br />

With a tutor in email contact 39%<br />

In person during the course 28%<br />

Through a learning resource centre 28%<br />

With on-line web reference materials 42%<br />

With a virtual learning classroom system 14%<br />

In person after a course is completed to review and evaluate 21%<br />

<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 26


2 Investing in e-learning<br />

How do you help learners consolidate and apply what they have learnt<br />

on completion? (Please tick all that apply)<br />

Job related assignments 36%<br />

Reference books 18%<br />

Electronic help and job aids 26%<br />

Periodic re-assessment 32%<br />

Printed job aids 18%<br />

Line manager coaching and feedback support 53%<br />

2.8 Compliance and Business Impact<br />

In the self rating perception section of the questionnaire respondents were asked 2 questions<br />

in relation to record keeping; e-learning has improved our record keeping for compliance<br />

purposes; and tracking e-learning progress is essential for compliance purposes. Not<br />

surprisingly a covariance calculation shows that these two factors behave similarly;<br />

furthermore their correlation is 0.63. Both have a reasonable correlation with business<br />

impact, 0.52 and 0.57 respectively. This is shown in Figure 2.9. These 2 factors have a much<br />

lower correlation with both staff impact and maturity; 0.36 and 0.32 for any improvement in<br />

record keeping and 0.35 and 0.31 for the relative importance of tracking.<br />

Figure 2.9 Compliance and business impact<br />

10<br />

8<br />

6<br />

4<br />

2<br />

0<br />

Upper quartile 3rd quartile 2nd quartile Lower quartile<br />

Business Impact<br />

n=139<br />

Tracking essential<br />

Improved record keeping<br />

Ref: This graph appears as Figure 9 in <strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers<br />

<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 27


2 Investing in e-learning<br />

Thus, whilst using e-learning to support compliance training has an effect on business impact<br />

its impact on both staff and its relationship to maturity are much less significant. If we isolate<br />

the cost-saving factor from business impact the correlation with improved record keeping is<br />

0.55, thus we can argue that a focus on compliance as an e-learning requirement is likely to<br />

produce cost-savings and improved business impact, but less likely to make a difference to<br />

staff or take-up. Although the correlation figures are all relatively close, if we plot the<br />

compliance self rating factors against the quartiles of either staff impact or take-up we do<br />

not get the same linear relationship.<br />

2.9 Staff Impact<br />

Appendix C defines the meaning of the term staff impact used in this report. The derivation<br />

of this is discussed in Appendix A. Respondents are segmented in accordance with their<br />

average rating for the 5 factors: interest in professional development, learner outcomes,<br />

speed of putting into practice, changes in employee motivation and behaviour. The<br />

dividing points for the quartile are as follows: bottom quartile 1 to 3.7, 25 th percentile to 50 th<br />

percentile 3.7 to 5, 50 th percentile to 75 th percentile 5 to 6.2 and the top percentile 6.2 to 10.<br />

In Table 2.16 the average scores of the respondents grouped by staff impact are shown for 2<br />

dimensions and one factor. These have been selected because they show a particular<br />

linear relationship with segmentation by quartiles at staff impact.<br />

Figure 2.10 Factors related to staff impact<br />

10<br />

8<br />

6<br />

4<br />

2<br />

0<br />

Upper quartile 3rd quartile 2nd quartile Lower quartile<br />

n=139<br />

Staff Impact<br />

Uptake of e-learning Financial impact Customer satisfaction<br />

Ref: This graph appears as Figure 10 in <strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers<br />

The financial impact dimension is composed of 3 factors (see Appendix C): cost savings,<br />

improvement in metrics and other financial benefits. Take-up of e-learning is composed of 3<br />

factors: e-learning has attracted more learners, staff are more likely to complete courses, we<br />

have a high percentage of e-learning course completions. In addition the number of<br />

different roles in the organisation that use e-learning is added into this dimension. Both these<br />

<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 28


2 Investing in e-learning<br />

2 dimensions are related to perception of staff impact in that those organisations who<br />

perceive themselves to be in the top quartile for staff impact are more likely to agree with<br />

the various statements that make up these 2 dimensions than organisations in the bottom<br />

quartile for staff impact. The single factor that is also plotted in Figure 2.10 is respondents’<br />

perception of the extent to which there has been an increase in customer satisfaction since<br />

staff have had more access to e-learning. Whilst this question overall shows a neutral<br />

response; with an average for all respondents of 4.71, there is a relationship to respondents’<br />

perception of the impact e-learning has on staff. This seems to indicate that where<br />

respondents perceive e-learning better motivates staff they are more likely to perceive that<br />

there has been an improvement in customer satisfaction. This is supported by research in the<br />

United States that provided a link between employees’ perception of support provided to<br />

them and a measurement of customer satisfaction. The single most significant factor in the<br />

perception of employees in their employers support was the provision of training 1 . The<br />

hypothesis that improved support to staff via e-learning will improve customer satisfaction<br />

appears to have some substance.<br />

2.10 Staff Impact versus input dimensions<br />

Appendix A defines the use and meaning of the term “input dimension”. These are<br />

composed of factors over which management can exert some control, unlike output<br />

dimensions like staff impact which are the result of actions taken. The dimension Change<br />

Management is composed of 9 factors as listed in Table A.3 of Appendix A. The linkage<br />

between these factors is weaker than with other dimensions. The factors are: we<br />

communicate e-learning success, senior management demonstrates commitment, we brief<br />

line managers, we communicate success to line managers, we apply change management<br />

to the implementation of e-learning, we operate pilot projects, we apply branding and<br />

identity to e-learning, we train local champions and we have audited the skills of the training<br />

function. Figure 2.11 shows that those organisations who agree that they are more likely to<br />

do these 9 things are more likely to be in the upper quartile for staff impact.<br />

Empowerment is defined in Appendix A Table A.3; as comprising the factors: staff know what<br />

e-learning is available and have the freedom to ask for it. The linkage between these 2<br />

factors is not as strong as others; both as a dimension and as 2 factors the extent to which<br />

respondents agree with the statements increases with staff impact.<br />

Availability is an input dimension composed of 6 factors plus one calculation. The factors<br />

are: wide range of opportunities, access anywhere, access anytime, management allow<br />

time (at work and elsewhere), an infrastructure capable of delivering e-learning to places<br />

convenient to staff. The calculation that is included within the dimension of availability is<br />

based upon the range of places in which employers offer e-learning.<br />

Employer respondents were asked to select which locations they used for e-learning from a<br />

list composed of: at the desk, at home, at an in-house learning centre, at an external<br />

learning centre, in a quiet place away from the learner’s desk and when travelling. Those<br />

who make e-learning more available based upon this criteria are more likely to find<br />

themselves in the top quartile for staff impact.<br />

1 Schneider, White and Paul (1998) Service Climate and Customer Perception, Journal of Applied Psychology 1998,<br />

volume 83 and Eisenberger, Cummings, Armeli and Lynch (1997) Perceived Organisational Support, Discretionary<br />

Treatment and Job Satisfaction, Journal of Applied Psychology 1997, volume 82.<br />

<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 29


2 Investing in e-learning<br />

Figure 2.11 Staff impact versus input dimensions<br />

10.00<br />

8.00<br />

6.00<br />

4.00<br />

2.00<br />

0.00<br />

Upper quartile 3rd quartile 2nd quartile Lower quartile<br />

Staff impact<br />

Change Management Empowerment Availability<br />

The variation and linkage between these factors and dimensions is discussed and reported<br />

on in later chapters.<br />

Whilst there is similarity in the way that senior management commitment and the other 4<br />

factors vary with staff impact the covariance calculation does not justify including the<br />

commitment of senior managers in the dimension change management. Senior<br />

management commitment is a key factor closely related to staff impact but considered as<br />

an input factor rather than an output. Senior managers appear to be influenced by some<br />

change management practices (the correlation with communicating success is 0.48, with<br />

line manager briefings is 0.48) and in turn influence availability mainly on their impact on<br />

management behaviour, (correlation with line managers make time for staff to learn 0.46,<br />

time to learn at home 0.52).<br />

Senior management behaviour is clearly key but its linkage to other dimensions and<br />

measures is not as clear cut as the strategic direction and role model example set by<br />

directors, the board and top management.<br />

Figure 2.12 isolates some of the factors that comprise change management and plot them<br />

against staff impact; in addition the extent to which senior managers show commitment.<br />

Whilst there is similarity in the way that senior management commitment and the other 4<br />

factors vary with staff impact the covariance calculation does not justify including the<br />

commitment of senior managers in the dimension change management. Senior<br />

management commitment is a key factor closely related to staff impact but considered as<br />

an input factor rather than an output. Senior managers appear to be influenced by some<br />

<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 30


2 Investing in e-learning<br />

change management practices (the correlation with communicating success is 0.48, with<br />

line manager briefings is 0.48) and in turn influence availability mainly on their impact on<br />

management behaviour, (correlation with line managers make time for staff to learn 0.46,<br />

time to learn at home 0.52).<br />

Senior management behaviour is clearly key but its linkage to other dimensions and<br />

measures is not as clear cut as the strategic direction and role model example set by<br />

directors, the board and top management.<br />

Figure 2.12 Change management influences staff impact of e-learning<br />

10.00<br />

8.00<br />

6.00<br />

4.00<br />

2.00<br />

0.00<br />

Upper quartile 3rd quartile 2nd quartile Lower quartile<br />

e-learning brand<br />

Communication of success<br />

Senior managers<br />

Pilot e-learning<br />

Local champions<br />

Ref: This graph appears as Figure 12 in <strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers<br />

2.11 <strong>Maturity</strong> and staff impact<br />

<strong>Maturity</strong> has an effect on staff impact, as might be expected. We have established that<br />

maturity is a fundamental concept that relates to a number of factual measures, as well as<br />

the more subjective measures of business impact and staff impact. Figure 2.13 plots the 5<br />

factors that make up the staff impact dimension against segmentation by maturity.<br />

Figure 2.14 reports the responses for all employer respondents to the 5 factors that make up<br />

the dimension staff impact. Broadly speaking, as many respondents disagree that e-learning<br />

has an impact as agree. The notable exception is the speed with which learning can be<br />

applied where over one-third of respondents agree with this statement: staff quickly put into<br />

practice what they learn from e-learning.<br />

<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 31


2 Investing in e-learning<br />

Figure 2.13 Staff impact versus maturity<br />

10<br />

8<br />

6<br />

4<br />

2<br />

0<br />

Novices<br />

Sporadic<br />

users<br />

Developing<br />

users<br />

Established<br />

users<br />

Embedded<br />

users<br />

Innovators<br />

Greater interest in development<br />

Improved outcomes<br />

Quickly applied<br />

Improved motivation<br />

Behaviour change<br />

Ref: This graph appears as Figure 11 in <strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers<br />

Figure 2.14 Employer view of staff impact<br />

Quickly applied<br />

Improved<br />

motivation<br />

Greater interest in<br />

development<br />

Improved<br />

outcomes<br />

Behavioural<br />

change<br />

0% 20% 40% 60% 80% 100%<br />

Agree Neutral Disagree<br />

As previously discussed speed of response is surfacing in this report as a statement with which<br />

a significant proportion of both learners and employers agree with in relation to e-learning.<br />

<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 32


2 Investing in e-learning<br />

2.12 Learners Perspective<br />

Learners are asked a number of questions which can be related to their response to e-<br />

learning. The 30 self-perception opinion-based questions, described as factors, have been<br />

grouped into 6 main dimensions. The rationale for these 6 dimensions and their definition is<br />

discussed in Appendix A.<br />

Figure 2.15 Learner responses<br />

Need for recognition<br />

Job relevance<br />

Management support<br />

Learners control their opportunties<br />

Empowered learners<br />

Detachment<br />

0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%<br />

Agree Neutral Disagree<br />

It is clear that there are a range of factors that give learners empowerment and that more<br />

learners agree that this has an impact on them than with other dimensions. Empowered<br />

learners in the learner responses is not defined in the same way as Empowerment in the<br />

employer responses. For learners it means confidence in using PCs, engagement without<br />

prompting, knowing what is available, empowered to ask and technology that delivers<br />

learning to places convenient to the learner.<br />

The view of learners is mirrored by the relationship between staff impact and availability of e-<br />

learning and the employer definition of empowered learners. We may relate the views of<br />

learners in relation to empowerment by plotting availability and empowerment as defined<br />

by learners against staff impact (Figure 2.16).<br />

Again, employers have been segmented into quartiles by their perception of staff impact.<br />

The learner dimensions that are closest to both availability and empowerment from an<br />

employer’s perspective are key dimensions that influence staff impact.<br />

<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 33


2 Investing in e-learning<br />

Figure 2.16 Staff impact and freedom of choice<br />

8.00<br />

7.00<br />

6.00<br />

5.00<br />

4.00<br />

3.00<br />

2.00<br />

1.00<br />

0.00<br />

Upper quartile 3rd quartile 2nd quartile Lower quartile<br />

Staff impact<br />

Availability of e-learning<br />

Empowered learners<br />

The dimension detachment shown in Figure 2.16 is a negative effect of e-learning; I only do<br />

e-learning when it is compulsory and I find e-learning choices confusing. It is disturbing to<br />

note that 4 out of 10 in learner respondents demonstrate detachment from this<br />

empowerment because they only do learning when it is compulsory and find the choices<br />

confusing. Are these the same learners who do not feel empowered? In the majority of cases<br />

they are. In fact 62% of respondents were on opposite sides of these 2 dimensions,<br />

empowered and detached. That is; the average score for the factors that make up<br />

empowerment was above 7 and the score for the factors that make up detachment was 3<br />

or below, or the average score on the factors that make up detachment was 7 or above<br />

and the average score on the factors that make up empowerment was 3 or below. Learners<br />

are largely divided into those who embrace e-learning and agree that it brings a certain<br />

freedom to select what they need and want and those who avoid its use unless they have<br />

to. Learners are divided into those who can take the opportunity that e-learning presents<br />

and those that can’t, demonstrated by the 58% of learners who are empowered and the<br />

38% of learners who are detached from doing e-learning voluntarily.<br />

<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 34


3 People and organisational capability<br />

3 People and organisational capability<br />

Overview: This Chapter considers how decisions are made, the impact of an e-learning<br />

strategy and the effect directors have on e-learning and who uses e-learning.<br />

3.1 Decision making<br />

Respondents were asked how they decided which e-learning courses and content will be<br />

bought or developed. They were offered 4 choices but multiple answers were acceptable.<br />

Then average number of responses selected by respondents is 1.5, the proportion of items<br />

selected in Figure 3.1. The percentages shown are the percentages of respondents who<br />

selected that particular item and therefore add up to more than 100.<br />

Figure 3.1 Making e-learning investment decisions<br />

Training<br />

function<br />

decides<br />

44%<br />

Business<br />

projects<br />

demand<br />

30%<br />

Respond to<br />

external<br />

suggestions<br />

2%<br />

Based on<br />

board<br />

strategy<br />

24%<br />

If we segment these responses by maturity, as shown in Figure 3.2, the indications are that<br />

training departments are more likely to make decisions for organisations who are<br />

approaching maturity rather than those who are either embedded or innovators.<br />

Bearing in mind that responses from novices are susceptible to a much wider statistical<br />

variation because there are only 10 respondents in this segment, there is also an indication<br />

that a Board strategy is used to make decisions more often by more e-learning mature<br />

organisations. This is also supported by Figure 2.4 which plots the key stakeholders who<br />

influence e-learning by maturity, although in this case 86% of embedded users selected the<br />

training department as one of the 3 key stakeholders but only 44% agreed that the training<br />

department made purchasing decisions. This may indicate that embedded users have a<br />

greater understanding of the amount of work that training functions need to do in order to<br />

ensure a product is implemented and used successfully. However, this should be viewed<br />

with some caution as there are only 11 respondents in the embedded segment.<br />

<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 35


3 People and organisational capability<br />

Figure 3.2 Making decisions about e-learning<br />

1.00<br />

0.80<br />

0.60<br />

0.40<br />

0.20<br />

0.00<br />

Innovators<br />

Embedded<br />

users<br />

Established<br />

users<br />

Developing<br />

users<br />

Sporadic<br />

users<br />

Novices<br />

A board strategy Training department Business units<br />

The training function is the most frequently selected source of decision-making, 64% of<br />

respondents (Figure 3.3). Those in the upper quartile for business impact are twice as likely to<br />

cite the Board and having a strategy as a key decision-making process (56%) as those in the<br />

bottom quartile for business impact (24%). Those in the upper quartile are also more likely to<br />

involve business units in decision-making for e-learning (50%) as opposed to those in the<br />

lowest quartile (32%).<br />

Figure 3.3 Making decisions about e-learning<br />

0.80<br />

0.70<br />

0.60<br />

0.50<br />

0.40<br />

0.30<br />

0.20<br />

0.10<br />

0.00<br />

Upper quartile<br />

(1.7)<br />

3rd quartile (1.6) 2nd quartile (1.4) Lower quartile<br />

(1.2)<br />

Business impact<br />

A board strategy Training department Business units<br />

<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 36


3 People and organisational capability<br />

The importance of a Board strategy being part of the decision-making process is supported<br />

by previous work. The report on Embedding e-learning in Large Companies 2 reported that<br />

“the analysis shows that the existence or otherwise of a strategy was the most significant<br />

driver of successfully embedding e-learning”.<br />

Over a third of companies agreed that their Board has agreed a learning strategy aligned to<br />

business priorities. Companies were segmented on this basis and their perception of business<br />

impact compared (Figure 3.4). In all cases respondents perceived e-learning has a greater<br />

business impact where a strategy existed than where it didn’t. The average difference is 0.94<br />

on a 10-point scale. Having a Board strategy makes a 10% difference in employers’<br />

perception of the business impact of e-learning.<br />

Figure 3.4 Business impact of a strategy compared<br />

8.00<br />

6.00<br />

4.00<br />

2.00<br />

0.00<br />

Impact on<br />

metrics<br />

Financial<br />

impact<br />

Cost savings<br />

achieved<br />

Business<br />

focus<br />

Speed of Effective in<br />

implementation application<br />

Strategy in place<br />

No strategy<br />

3.2 Who uses e-learning?<br />

Leadership from the top is a key element that influences a number of factors relating to the<br />

success of e-learning. Aiming to involve directors and being successful in doing so pays<br />

significant dividends.<br />

Figure 3.5 compares the key dimension where directors use e-learning personally and where<br />

they do not. In some cases the differences are greater than whether an organisation has a<br />

strategy or not. A difference between 5.6 and 3.9 falls well within an average neutral<br />

assessment about the commitment of senior managers.<br />

2 Hills 2005, published by Ufi<br />

<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 37


3 People and organisational capability<br />

Figure 3.5 Effect on key dimensions when directors use e-learning<br />

8<br />

6<br />

4<br />

2<br />

0<br />

Business impact Staff impact Uptake Senior manager<br />

commitment<br />

Availability<br />

Directors using e-learning<br />

Directors not users<br />

In fact, 39% of respondents in organisations where directors use e-learning, agree that senior<br />

managers show commitment, as opposed to 23% of those in organisations where directors<br />

do not use e-learning. Over half the respondents (55%) in organisations where directors do<br />

not use e-learning expressed strong disagreement implying that senior managers not only do<br />

not show commitment but perhaps are even antagonistic to it. This corresponds to a quarter<br />

of organisations (24%) where directors are users who disagree with the statement. We can<br />

conclude that the example set by directors has a significant impact on the behaviour of<br />

senior managers and on the rest of the organisation. The discussion in Chapter 2 has already<br />

highlighted the influence senior managers have on certain key factors. If we isolate 2 of the<br />

dimensions reported in Figure 3.5, that of staff impact and uptake rates, then we can identify<br />

some even more significant differences.<br />

Figure 3.6 shows the average agreement with the 5 statements that fit within the dimension<br />

termed staff impact. We observe a 10% difference in the perceptions of respondents<br />

between those organisations where directors use e-learning and where they do not.<br />

<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 38


3 People and organisational capability<br />

Figure 3.6 Staff impact versus use by directors<br />

7.00<br />

6.00<br />

5.00<br />

4.00<br />

3.00<br />

2.00<br />

1.00<br />

0.00<br />

Greater interest<br />

in development<br />

Improved<br />

motivation<br />

Improved<br />

outcomes<br />

Behaviour<br />

change<br />

Quickly applied<br />

Directors use e-learning<br />

e-elearning not used by directors<br />

However, the averages are very close to the neutral point on the 10-point scale used in the<br />

self-perception questions. If we look at the percentage of respondents who agree with those<br />

statements then greater differences become apparent (Table 3.1).<br />

Table 3.1 Percentage of respondents agreeing with Staff Impact statements<br />

Directors use e-learning e-learning not used by Directors<br />

Agree Neutral Disagree Agree Neutral Disagree<br />

Greater interest in<br />

development 22% 51% 27% 13% 43% 43%<br />

Improved motivation 27% 56% 17% 10% 60% 30%<br />

Improved outcomes 31% 49% 20% 16% 51% 33%<br />

Behaviour change 29% 51% 20% 19% 46% 34%<br />

Quickly applied 49% 46% 4% 23% 48% 29%<br />

In the case of all respondents twice as many agree with these statements in organisations<br />

where directors use e-learning than in those where they do not. This is mirrored by a<br />

reduction in those that disagree with the statement. About half of respondents in both<br />

segments express a neutral view about these 6 statements; this may be because there is an<br />

uneven pattern of staff responses to e-learning across the organisation or the respondent<br />

doesn’t know how staff are responding. The change in the agreement and disagreement<br />

percentages is more significant than the fact that half of respondents express a neutral view.<br />

We discern a similar pattern when we analyse the dimension take-up of e-learning (Figure 3.7<br />

and Table 3.2). The measurement of take-up is determined by grouping 3 self-perception<br />

questions with a measure of the number of roles in an organisation who use e-learning.<br />

<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 39


3 People and organisational capability<br />

Figure 3.7 Directors’ use of e-learning affects factors comprising take-up<br />

8<br />

7<br />

6<br />

5<br />

4<br />

3<br />

2<br />

1<br />

0<br />

More completions<br />

Higher % of<br />

completions<br />

Increase in<br />

Learners<br />

Roles who use<br />

Directors use e-learning<br />

e-learning not used by directors<br />

Respondents were offered 7 roles to select and the number of roles selected has been rebased<br />

to 10 and averaged with the measure of agreement with the 3 statements. The<br />

average number of roles who use e-learning in organisations where directors do not is<br />

approximately 1½. The number of roles who use e-learning when directors do rises to<br />

approximately 5 out of 7. In Table 3.2 we can see the percentage of respondents who agree<br />

with the 3 statements, the number of respondents who agree with this statement doubles<br />

when directors are users of e-learning.<br />

Table 3.2 Percentage agreeing with take up statements<br />

Directors use e-learning e-learning not used by Directors<br />

Agree Neutral Disagree Agree Neutral Disagree<br />

More completions 32% 37% 31% 18% 39% 43%<br />

Higher % of<br />

completions 55% 26% 19% 26% 40% 34%<br />

Increase in Learners 47% 35% 19% 22% 40% 37%<br />

Directors have a profound impact on the success of e-learning within organisations. Where<br />

they set an example organisations are twice as likely to perceive take-up as successful and<br />

the number of roles who use e-learning will treble.<br />

3.3 Who influences learners?<br />

Learners were asked to select the one person whose opinion is most likely to encourage<br />

them to take an e-learning programme. They were offered a list of 6 individuals, or roles.<br />

Figure 3.9 shows their responses.<br />

<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 40


3 People and organisational capability<br />

Figure 3.8 Whose opinion encourages use of e-learning<br />

My manager<br />

52%<br />

My learning<br />

centre coordinator<br />

2%<br />

A contact outside<br />

of work<br />

4%<br />

A senior executive<br />

5%<br />

A member of the<br />

training<br />

department<br />

10%<br />

A work colleague<br />

27%<br />

Ref: This graph appears as Figure 19 in <strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers<br />

Although senior executives clearly have an impact on the take-up of e-learning this is not<br />

reflected in an individual learner’s view, as only 5% of learner respondents select this role as<br />

the most important influence on them as to whether they will take an e-learning programme.<br />

It may well be a blinding glimpse of the obvious that managers and work colleagues are the<br />

2 most important influences on learners.<br />

There are some differences by learner segments. Learners are segmented by educational<br />

level, age, where they learn, their normal work environment, whether they learn in their own<br />

time or company time, whether they manage their own time or it was managed for them,<br />

whether they have responsibility for others or only for themselves. Table 3.3 shows the<br />

percentage of respondents in each segment who selected a particular individual as their<br />

prime influence.<br />

Table 3.3 Who encourages you to learn?<br />

Education to 16<br />

n=93<br />

Education to 18<br />

n=73<br />

Education to<br />

Post 18<br />

n=147<br />

Education to<br />

Graduate level<br />

n=522<br />

Manager 56% 49% 50% 52%<br />

Colleague 22% 32% 24% 29%<br />

Senior Executive 4% 5% 6% 5%<br />

Others 18% 14% 20% 13%<br />

<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 41


3 People and organisational capability<br />

Age is 25 or<br />

under<br />

n=103<br />

Age is 26 to 39<br />

n=292<br />

Age is 40 to 54<br />

n=314<br />

Age is 55 or<br />

over<br />

n=126<br />

Manager 60% 50% 54% 45%<br />

Colleague 23% 27% 28% 32%<br />

Senior Executive 4% 6% 6% 2%<br />

Others 13% 16% 12% 21%<br />

Learn at an Inhouse<br />

learning<br />

centre<br />

n=27<br />

Learn at home<br />

n=132<br />

Learn at the<br />

desk<br />

n=643<br />

Learn in a quiet<br />

spot away from<br />

the desk<br />

N=32<br />

Manager 41% 45% 54% 59%<br />

Colleague 22% 25% 29% 16%<br />

Senior Executive 0% 9% 5% 9%<br />

Others 37% 20% 13% 16%<br />

Work at a<br />

regular place<br />

n=740<br />

Work from<br />

home<br />

n=35<br />

Work on site at<br />

customer<br />

n=52<br />

Work on the<br />

road<br />

n=8<br />

Manager 52% 57% 44% 50%<br />

Colleague 28% 29% 23% 25%<br />

Senior Executive 9% 9% 15% 13%<br />

Others 5% 3% 8% 13%<br />

Learn in own<br />

time<br />

n=167<br />

Learn in<br />

Company time<br />

n=668<br />

Manager 44% 54%<br />

Colleague 25% 28%<br />

Senior Executive 10% 4%<br />

Others 20% 14%<br />

<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 42


3 People and organisational capability<br />

I do not<br />

manage my<br />

own time<br />

n=57<br />

I manage my<br />

own time<br />

n=778<br />

Manager 44% 53%<br />

Colleague 37% 27%<br />

Senior Executive 2% 6%<br />

Others 18% 15%<br />

No responsibility<br />

for others<br />

n=459<br />

Responsible for<br />

others<br />

n=376<br />

Manager 54% 49%<br />

Colleague 27% 28%<br />

Senior Executive 4% 12%<br />

Others 14% 7%<br />

Those without management responsibility are slightly more likely to respond to their own<br />

manager. Those with management responsibility are slightly more like to respond to senior<br />

executives; but only 6% of this segment select the senior executive as the person whose<br />

opinion they most valued in persuading them to use e-learning. Those who manage their<br />

own time are slightly more likely to respond to senior executives, but again the percentage is<br />

small (6%) although this group are also slightly more likely to respond to their own manager.<br />

They are less likely to respond to recommendations from colleagues. Those who learn in their<br />

own time or work on customer’s sites are less likely to respond to managers and more likely to<br />

respond to senior executives; perhaps a blinding glimpse of the obvious in that those least<br />

likely to be in direct contact with their manager are most likely to respond to the leadership<br />

of a senior executive.<br />

When a manager is in direct control of an individual, that is the learner does not manage<br />

their own time, then managers seem to exert less influence and peers exert more influence.<br />

The pattern that emerges is those that work more independently, either by location or work<br />

style, are less likely to respond to managers and more likely to respond to senior executives,<br />

those in direct contact with managers and whose time is controlled for them are less likely to<br />

respond to the person exerting that control. This analysis should be viewed with some<br />

caution as the segmentation gives population groups of radically different sizes. The<br />

respondents were segmented by age and a linkage is identified.<br />

<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 43


3 People and organisational capability<br />

Figure 3.9 Who encourages you to learn?<br />

50%<br />

40%<br />

30%<br />

20%<br />

10%<br />

0%<br />

Manager Colleague Training<br />

Manager<br />

Senior<br />

Executive<br />

A Friend<br />

LC<br />

Coordinator<br />

N= 948<br />

I do not manage my own time<br />

I manage my own time<br />

The influence of managers declines with the age of the learner; not unreasonably since older<br />

learners are likely to have a better appreciation of their own learning needs. The<br />

recommendation of a colleague rises in importance with age. However, an individual<br />

learner does not seem significantly influenced by a senior executive and yet the behaviour<br />

of senior executives significantly influences uptake (Table 3.4).<br />

Table 3.4 Use of e-learning by directors<br />

Directors use e-<br />

learning<br />

Agree<br />

e-learning not<br />

used by Directors<br />

Agree<br />

The majority of our learners engage with their e-<br />

learning courses without prompting 33% 15%<br />

Senior Management regularly demonstrate<br />

commitment to e-learning 39% 23%<br />

We provide line managers with training and briefings<br />

relating to specific e-learning courses 34% 18%<br />

Managers make time for staff to learn at work 42% 39%<br />

Managers allow staff work time to learn at home or<br />

locally 38% 28%<br />

Managers appraise staff at regular intervals and plan<br />

their development 70% 55%<br />

Managers coach their own teams 55% 36%<br />

<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 44


3 People and organisational capability<br />

The hypothesis is that the behaviour of senior executives influences that of immediate<br />

managers, which in turn increases the availability of both time and space to learners and<br />

improves the propensity for managers to develop and coach their own teams. Managers in<br />

almost three quarters of organisations, where directors use e-learning, appraise staff and<br />

plan their development, as compared to just over half in organisations where directors do<br />

not use e-learning.<br />

The impact of directors’ behaviour is also clearly seen in Table 3.5, which reports the<br />

percentage of each organisation in each segment providing e-learning to the 7 roles<br />

identified in the questionnaire. We have previously (see Chapter Two Table 2.7 and Figure<br />

2.5), seen the significance of encouraging the use of e-learning by technician grades and<br />

skilled roles; where directors use e-learning the percentage of organisations providing e-<br />

learning to these 2 key roles more than doubles.<br />

Table 3.5 Percentage of employers providing e-learning to this role<br />

Directors use e-<br />

learning<br />

n=83<br />

e-learning not<br />

used by directors<br />

n=85<br />

Administrative or customer service positions with a PC 98% 65%<br />

Professional grades or equivalent 95% 65%<br />

Middle/Line Manager/Shift supervisors 96% 54%<br />

Technician grades or equivalent 86% 42%<br />

Director or Senior Management 100% 0%<br />

Administrative or customer service positions without a PC 57% 21%<br />

Employed non-manual position, not at a desk but<br />

travelling or in service job 57% 19%<br />

Supervised or skilled manual worker 52% 22%<br />

Other manual worker 41% 12%<br />

3.4 Roles trained by sector<br />

Table 3.6 lists the percentage of organisations in each sector that provide training to the<br />

various grades of staff. The analysis has only been done for those sectors where the number<br />

of respondents exceeded 10. Four of these sectors do show some key differences from the<br />

overall average (Figure 3.10). The remaining sectors have been combined into one line.<br />

These remaining sectors show little differences from each other. The 4 sectors plotted show<br />

some differences.<br />

Seventy percent of those responding from the manufacturing sector provide e-learning for<br />

supervisory or skilled manual roles, compared to an overall average of 36%. Appendix B<br />

discussed the nature of the various segments in more detail. However, it is clear that<br />

manufacturing directs more e-learning effort at the less skilled employees. By contrast the<br />

financial sector puts significantly more effort into training the knowledge workers and senior<br />

management staff than all other sectors.<br />

<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 45


3 People and organisational capability<br />

Table 3.6 Percentage of organisations offering e-learning to specific roles<br />

Manufac<br />

-turing<br />

Business<br />

Financial activities Public<br />

Health<br />

Education<br />

Computing<br />

Administrative or<br />

customer service<br />

positions with a PC 79% 95% 75% 97% 53% 94% 75% 78%<br />

Professional grades or<br />

equivalent 79% 90% 92% 79% 83% 82% 63% 77%<br />

Middle/Line<br />

Manager/Shift<br />

supervisors 71% 95% 67% 83% 53% 82% 75% 72%<br />

Technician grades or<br />

equivalent 71% 90% 58% 55% 43% 59% 69% 61%<br />

Director or Senior<br />

Management 43% 85% 42% 48% 40% 47% 56% 50%<br />

Administrative or<br />

customer service<br />

positions without a PC 21% 40% 25% 52% 27% 35% 38% 37%<br />

Employed non-manual<br />

position, not at a desk<br />

but travelling or in<br />

service job 57% 50% 25% 34% 7% 29% 50% 36%<br />

Supervised or skilled<br />

manual worker 71% 35% 8% 41% 10% 35% 31% 36%<br />

Other manual worker 50% 25% 8% 28% 10% 18% 19% 25%<br />

By contrast those organisations in the business activities sector put less effort into providing e-<br />

learning for less skilled and more junior staff. Clearly companies in these 3 sectors are making<br />

management decisions at directing e-learning effort at those roles that are most significant<br />

for the business.<br />

The education sector is less likely to train all roles other than professional grade staff. For all<br />

except this role 20% fewer organisations provide e-learning. It is worth investigating what else<br />

the education sector may be doing that is different to others. This is reported on in a later<br />

Chapter.<br />

ALL<br />

<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 46


3 People and organisational capability<br />

Figure 3.10 Percentage organisations by sector selecting role as user of e-learning<br />

100%<br />

90%<br />

80%<br />

70%<br />

60%<br />

50%<br />

40%<br />

30%<br />

20%<br />

10%<br />

0%<br />

Other manual<br />

worker<br />

Employed<br />

non-manual<br />

position, not<br />

at a desk but<br />

Supervised or<br />

skilled manual<br />

worker<br />

Administrative<br />

or customer<br />

service<br />

positions<br />

Director or<br />

Senior<br />

Management<br />

Technician<br />

grades or<br />

equivalent<br />

Middle/Line<br />

Manager/Shift<br />

supervisers<br />

Professional<br />

grades or<br />

equivalent<br />

Administrative<br />

or customer<br />

service<br />

positions with<br />

Manufacturing Financial Business activities Education Others<br />

3.5 Source of funding<br />

Respondents were asked how they funded the development of e-learning and the<br />

acquisition of resources for its development. Respondents were offered 5 choices: internal<br />

company budget, learning and skills council funding, European funding, regional<br />

development agency funding and others. The most commonly quoted source under ‘other’<br />

was those from NHS respondents where they entered bids into strategic Health Authorities.<br />

Indeed the majority of sources quoted under ‘other’ were central Government supported<br />

authorities which either were not within the remit of the LSC or respondents were not aware<br />

of this. In a very few cases bids to these type of organisations represented the majority of a<br />

respondent’s spend on e-learning. For each funding source respondents were asked to<br />

select one of 4 percentages of their total spend on e-learning, in relation to its source.<br />

For all other respondents the majority of their e-learning spend came from internal company<br />

budgets. However 20% of respondents use their internal company budget for less than 10%<br />

of their e-learning spend.<br />

Where does this money come from? The percentage of respondents seeking some level of<br />

funding is as follows:<br />

> Learning and Skills Council funding 14%<br />

> European funding 9%<br />

> Regional Development Agency funding 5%<br />

> Other sources of funding 12%<br />

<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 47


3 People and organisational capability<br />

Figure 3.11 Where does e-learning spend come from?<br />

Other<br />

Regional Development Agency funding<br />

European funding<br />

Learning & Skills Council funding<br />

Internal company budget<br />

0% 20% 40% 60% 80% 100%<br />

less than 10% 10% to


3 People and organisational capability<br />

Table 3.7 Sources of funding by expenditure<br />

Percentage of respondents seeking some<br />

proportion of spend from external sources<br />

Sector<br />

Seeking<br />

> 10% LSC European RDA Other<br />

c) Manufacturing 31% 8% 0% 0% 8%<br />

h) Transport, storage and communications 13% 13% 0% 0% 0%<br />

i) Financial intermediation 15% 0% 0% 0% 0%<br />

j) Real estate, renting and business activities 25% 25% 0% 0% 13%<br />

k) Public admin and defence 19% 14% 10% 5% 5%<br />

l) Education 40% 50% 35% 25% 30%<br />

m)Health and social work 54% 8% 8% 8% 31%<br />

o) Computing 21% 0% 0% 0% 0%<br />

3.6 Sources of e-learning<br />

Respondents were asked how they sourced their e-learning material and facilities.<br />

Respondents were offered 7 options (Figure 3.12). , there was the possibility for respondents<br />

to include an ‘other’ response (selected by 6 percent). This distribution remains uniform by<br />

almost all the segmentation that has been used in this analysis.<br />

Figure 3.12 How is e-learning sourced?<br />

Commercial bought-in products<br />

Partnership with e-learning vendor<br />

47%<br />

55%<br />

In-house with simple rapid development tools<br />

47%<br />

In-house with development tools for experts<br />

33%<br />

Partnership with educational/work-based learning<br />

provider<br />

Through a customer or supplier<br />

18%<br />

14%<br />

n=153<br />

Through an industry or trade body<br />

10%<br />

0% 10% 20% 30% 40% 50% 60%<br />

<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 49


3 People and organisational capability<br />

Buying from commercial sources remains the most likely activity for sourcing e-learning<br />

although in-house development and partnership working are used as sources by over a third<br />

of respondents. Do these patterns change with maturity? We can detect some patterns<br />

relating to maturity if we segment into 3 segments for maturity. Figure 3.13 combines novices<br />

and sporadic users into a less mature segment and innovators, embedded users and<br />

established users into a more mature segment.<br />

Figure 3.13 Source of supply of e-learning by maturity<br />

60%<br />

50%<br />

40%<br />

30%<br />

20%<br />

10%<br />

Commercial bought-in<br />

products<br />

Industry or trade body<br />

In-house (user tools)<br />

In-house (tools for<br />

programmers)<br />

Partnership with e-<br />

learning vendor<br />

Partnership with a<br />

learning provider<br />

Customer/supplier<br />

0%<br />

Less mature Becoming mature More mature<br />

This indicates that more mature organisations are more likely to use in-house development,<br />

both user tools and those more appropriate to programmers and web experts. They are also<br />

more likely to work in partnership with an e-learning vendor. The remaining sources for e-<br />

learning show little change with maturity or with any other segmentation.<br />

The responses to the sources of e-learning were analysed to identify the percentage of<br />

respondents who selected in-house production, either of the 2 options, and no other option.<br />

Fifteen percent of respondents fell into this category, somewhat less than indicated that they<br />

did not use external suppliers.<br />

Amongst the other options mentioned by respondents included: searching the Internet for<br />

the best deal, developing with internal learning designers in partnership with internal IT and in<br />

partnership with specialist instruction design companies who are not e-learning development<br />

companies.<br />

<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 50


3 People and organisational capability<br />

3.7 Expectation clients have of vendors<br />

Respondents were asked to rate a number of features they would expect to see in a<br />

prospective e-learning vendor, irrespective of whether they used one or not. The list of<br />

attributes offered is shown in Figure 3.14.<br />

Respondents have an option of grading each attribute as vital, important, useful or not<br />

relevant. Value for money, expertise and proven reliability are top of the list. It is also<br />

apparent that respondents expected to be able to shop around a number of e-learning<br />

vendors, as a one-stop shop is of least importance. It is worth reflecting that 20% of<br />

respondents regard as vital that suppliers are knowledgeable, innovative, suitable as longterm<br />

partners and provide reliable after-sales support; clients in this market are demanding.<br />

Figure 3.14 Important qualities organisations are looking for from their supplier<br />

Value for money<br />

The expertise to build exactly the e-learning that we need<br />

Prov en reliability<br />

A source of advice with good knowledge of the industry<br />

Innovation<br />

Suitability as a long term partner<br />

Product/system after-sales support and training<br />

A wide range of quality products and content<br />

Experience of needs analysis and can offer wide range of<br />

training solutions<br />

A one stop shop for all our learning needs irrespective of<br />

media<br />

0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%<br />

Vital Important Useful Not relevant<br />

Ref: This graph appears as Figure 27 in <strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers<br />

3.8 Characteristics of the marketplace<br />

Respondents were asked to select the suppliers they used. There was a named list of 18<br />

suppliers, all of whom had agreed to distribute the survey to their customers. In addition<br />

respondents were able to add the names of additional suppliers who were not on this list.<br />

A total of 139 suppliers were mentioned by 116 respondents. The majority of these suppliers<br />

were mentioned by only one respondent. Only 5 of the suppliers mentioned could claim 15<br />

or more of the 116 respondents who use external suppliers.<br />

<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 51


3 People and organisational capability<br />

Figure 3.15 Percentage of suppliers selected by respondents<br />

Mentioned by only 1 respondent<br />

by 2<br />

by 3 to 5<br />

by 5 to 10<br />

by 10 to 15<br />

by 15 or more<br />

0% 10% 20% 30% 40% 50% 60% 70%<br />

This is an indication of the nature of the market, there being only a very few large firms but a<br />

large number of very small firms, many of whom may have less than a dozen customers. The<br />

description applied to the e-learning supply market is that it is a cottage industry and this is<br />

borne out by the findings of the report.<br />

<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 52


4 e-learning delivery<br />

4 e-learning – technology, software and topics delivered<br />

Overview: This chapter looks at the range of topics covered, the e-learning services<br />

available, including learner support, and the technologies and software used. We look at<br />

both current delivery and plans for the next 3 years.<br />

4.1 Topics covered<br />

Respondents were asked which type of training employees had undertaken in the last 12<br />

months, divided into key skills, operational skills and general skills. For each topic area<br />

respondents were offered 4 options: the organisation does not offer the topic, the topic is<br />

offered but without using e-learning, the topic is offered with some component of e-learning<br />

or the topic is offered by e-learning alone. The only topics not offered by more than half of<br />

respondents are foreign language, literacy and numeracy. By comparison of the 2 sets of<br />

figures we can indicate the likelihood of a particular topic being delivered by e-learning.<br />

Figure 4.1 Range of topics offered by organisations<br />

Leadership and management<br />

Induction<br />

Health and Safety<br />

Communication<br />

Teamworking<br />

Technical (non IT)<br />

General IT skills<br />

Company specific<br />

Industry specific<br />

Customer handling/service<br />

IT professional<br />

Equality and diversity<br />

Problem solving<br />

Office admin<br />

Sales and marketing<br />

Foreign language<br />

Literacy<br />

Numeracy<br />

0% 20% 40% 60% 80% 100%<br />

Offered by organisations<br />

Offered with e-learning component<br />

Ref: See also Figure 29 in <strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers<br />

<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 53


4 e-learning delivery<br />

As expected general IT skills heads the list, with an 80% probability of an organisation offering<br />

this with some e-learning component. There is a relatively high probability of e-learning<br />

being used for both company specific and industry specific training; topics unlikely to be<br />

offered through generic skills packages. The relatively high probability that numeracy and<br />

literacy are offered with an e-learning component, results from the low probability of<br />

organisations offering any learning in these topics.<br />

Table 4.1 Likelihood of skills being delivered by e-learning<br />

Skills area<br />

Percentage of<br />

respondents<br />

General IT skills 79%<br />

IT professional 70%<br />

Company specific 63%<br />

Industry specific 61%<br />

Numeracy 59%<br />

Induction 53%<br />

Literacy 53%<br />

Office admin 51%<br />

Communication 51%<br />

Health and Safety 51%<br />

Technical (non IT) 51%<br />

Equality and diversity 49%<br />

Sales and marketing 48%<br />

Foreign language 48%<br />

Customer handling/service 45%<br />

Problem solving 45%<br />

Leadership and management 45%<br />

Team working 35%<br />

The probability of topics being offered is analysed by sector in Table 4.2. A study of these<br />

percentages indicates that the education sector is least likely to offer training in any of the<br />

topics listed. Not surprisingly the topics in which they do lead the field are those in literacy<br />

and numeracy, but for both topics approximately half of respondents in the education<br />

sector provide learning in these topics. Similar tables have been calculated for organisations<br />

providing the topics via e-learning and e-learning alone. The number of organisations who<br />

selected this option (e-learning alone) was extremely small. Of the total number of possible<br />

responses in where a topic is offered there are only 5% of responses for e-learning alone. This<br />

shows no particular pattern by topic, maturity, business or staff impact. However, it is no<br />

<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 54


4 e-learning delivery<br />

surprise that the IT and telecommunications sector was the one most likely to use e-learning<br />

alone and the topics most likely to be delivered by e-learning alone were general IT skills,<br />

company specific training, industry specific skills and equality and diversity. The very low<br />

number of responses in this category indicate that almost every user prefers to use e-learning<br />

as a component within a training programme, rather than for the totality of the delivery of a<br />

particular topic. Most of the analysis in this paper, therefore, concentrates on the use of e-<br />

learning irrespective of whether it is on its own or a component within a training topic offered<br />

by an organisation.<br />

Table 4.2 Percentage of organisations offering skills by sector<br />

Manufacturing<br />

Transport<br />

Financial<br />

Business Activities<br />

Public sector<br />

Education<br />

Health<br />

IT / Telecoms<br />

Others<br />

Leadership & Management 93% 100% 100% 100% 97% 87% 94% 94% 88%<br />

Induction 93% 100% 100% 100% 100% 83% 94% 94% 86%<br />

Health & safety 100% 100% 95% 100% 100% 77% 88% 75% 86%<br />

Communication skills 93% 100% 100% 92% 90% 70% 82% 75% 83%<br />

Team working 93% 100% 100% 92% 83% 77% 76% 75% 79%<br />

Technical or practical skills<br />

(non-IT) 93% 88% 85% 100% 83% 77% 82% 88% 83%<br />

General IT user skills 93% 100% 90% 100% 100% 63% 82% 81% 71%<br />

Industry specific 93% 81% 95% 100% 76% 53% 94% 88% 90%<br />

Company specific (not<br />

included above) 79% 88% 100% 83% 86% 67% 82% 88% 86%<br />

Customer handling/service 86% 81% 90% 83% 90% 67% 76% 75% 76%<br />

IT professional skills 79% 94% 85% 75% 90% 67% 59% 94% 79%<br />

Equality and diversity 86% 81% 80% 83% 97% 70% 94% 56% 48%<br />

Problem solving 86% 100% 90% 75% 72% 67% 59% 75% 64%<br />

Office/admin skills 86% 50% 80% 75% 86% 73% 71% 63% 71%<br />

Sales and marketing 93% 81% 95% 67% 28% 57% 29% 100% 62%<br />

Foreign language skills 57% 63% 55% 50% 31% 30% 12% 44% 38%<br />

Literacy 21% 44% 20% 25% 48% 37% 41% 13% 40%<br />

Numeracy 29% 38% 10% 8% 48% 37% 35% 13% 43%<br />

<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 55


4 e-learning delivery<br />

Table 4.3 shows the breakdown of organisations offering specific topics by sector. Sectors<br />

with only a few respondents have been included in the column labelled ‘Others’. One or 2<br />

sectors stand out as doing something different. The IT and Telecommunication sector, for<br />

example, does more induction training and sales and marketing training using e-learning<br />

than other sectors. The financial sector does more company-specific training and health<br />

and safety training using an e-learning component. The sector most likely to use an e-<br />

learning component is the financial sector, whereas other sectors have a more or less even<br />

chance of e-learning being a component in a programme.<br />

Table 4.3 Percentage in each sector who use e-learning for each skills area<br />

Manufacturing<br />

Transport<br />

Financial<br />

Business Activities<br />

Public sector<br />

Education<br />

Health<br />

IT / Telecoms<br />

Others<br />

Leadership & Management 36% 44% 55% 25% 55% 37% 29% 44% 33%<br />

Induction 50% 50% 70% 42% 48% 37% 41% 81% 48%<br />

Health & safety 57% 38% 80% 25% 41% 40% 35% 56% 48%<br />

Communication skills 29% 50% 45% 42% 52% 47% 29% 50% 43%<br />

Team working 29% 44% 45% 8% 31% 23% 18% 44% 17%<br />

Technical or practical skills<br />

(non-IT) 43% 38% 60% 75% 34% 30% 24% 81% 24%<br />

General IT user skills 71% 81% 75% 58% 93% 47% 65% 63% 55%<br />

Industry specific 64% 50% 80% 67% 31% 33% 59% 63% 43%<br />

Company specific<br />

(not included above) 36% 63% 90% 50% 48% 37% 47% 69% 33%<br />

Customer handling/service 36% 38% 65% 17% 41% 20% 24% 56% 29%<br />

IT professional skills 64% 56% 65% 50% 69% 50% 35% 75% 40%<br />

Equality and diversity 21% 38% 65% 25% 48% 33% 35% 31% 29%<br />

Problem solving 36% 63% 40% 33% 31% 30% 18% 44% 14%<br />

Office/admin skills 50% 19% 45% 33% 38% 40% 18% 56% 36%<br />

Sales and marketing 43% 38% 50% 8% 7% 33% 12% 75% 31%<br />

Foreign language skills 14% 19% 25% 17% 17% 23% 6% 31% 14%<br />

Literacy 7% 31% 10% 17% 21% 17% 18% 13% 29%<br />

Numeracy 7% 31% 10% 8% 21% 23% 18% 13% 29%<br />

<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 56


4 e-learning delivery<br />

Selection of topics in which an e-learning component was included was also analysed<br />

according to the e-learning maturity of the respondent as shown in Table 4.4.<br />

Table 4.4 Respondents offering topics with an e-learning component<br />

Novices<br />

Sporadic<br />

users<br />

Developing<br />

Users<br />

Established<br />

Users<br />

Embedded<br />

Users<br />

Innovators<br />

Literacy 0% 20% 18% 31% 10% 11%<br />

Numeracy 29% 23% 15% 28% 20% 11%<br />

General IT user skills 17% 51% 74% 84% 100% 56%<br />

Communication skills 33% 17% 42% 69% 50% 56%<br />

Team working 17% 3% 26% 53% 60% 33%<br />

Problem solving 0% 6% 29% 56% 80% 44%<br />

Induction 14% 31% 40% 66% 90% 74%<br />

Leadership & Management 0% 14% 29% 66% 80% 70%<br />

Customer handling/service 14% 9% 34% 66% 50% 41%<br />

Sales and marketing 29% 6% 24% 53% 60% 48%<br />

Office/admin skills 14% 23% 31% 56% 70% 44%<br />

Technical or practical skills (non-IT) 0% 26% 32% 56% 90% 67%<br />

IT professional skills 14% 37% 58% 66% 100% 63%<br />

Industry specific 29% 40% 35% 72% 90% 67%<br />

Company specific<br />

(not included above) 0% 26% 39% 78% 100% 78%<br />

Foreign language skills 0% 14% 18% 22% 50% 19%<br />

Equality and diversity 0% 26% 29% 56% 60% 52%<br />

Health & safety 29% 14% 45% 75% 70% 52%<br />

<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 57


4 e-learning delivery<br />

The probability of topics being offered with an e-learning component when compared by<br />

maturity shows 4 distinct patterns.<br />

a) IT skills show an adoption pattern that rises rapidly in the early stages of maturity. It<br />

can be seen that for developing users 74% use e-learning for general IT skills and 58%<br />

for professional IT skills.<br />

b) 1. Topics increasing with maturity (communication skills, induction, leadership and<br />

management skills, health and safety, office and administration skills and non-IT,<br />

technical or practical skills) and<br />

2. Topics increasing with maturity which are little used by novices (team-working,<br />

problem solving, customer handling or service skills, sales and marketing skills,,<br />

foreign language skills and equality and diversity training). For the topics in both<br />

this list and the previous one we can expect companies to use e-learning<br />

increasingly as a component within these topics as they increase in maturity.<br />

c) For industry and company specific skills, thee-quarters of the more mature<br />

organisations using e-learning components in these topics, rising from a third for those<br />

organisations which are not amongst the most mature.<br />

d) Two topics, literacy and numeracy, show no consistent change with the maturity of<br />

the organisations delivering them.<br />

Figure 4.2 plots the average of the averages for the groups listed above and therefore is only<br />

indicative of the changes.<br />

Figure 4.2 Adoption patterns by topics as organisations become more mature<br />

80%<br />

70%<br />

60%<br />

50%<br />

40%<br />

30%<br />

20%<br />

10%<br />

0%<br />

Less Mature Becoming Mature More Mature<br />

IT skills<br />

Industry specific<br />

Topics increasing with maturity<br />

Topics increasing with maturity little used by novices<br />

Topics independent of maturity<br />

<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 58


4 e-learning delivery<br />

For those organisations that wish to develop in maturity and e-learning, IT skills are a good<br />

starting point.<br />

The adoption curve for literacy and numeracy may be influenced by the availability of free<br />

courses through learndirect. Nineteen percent of all respondents state that they deliver<br />

these programmes. Of those respondents who selected learndirect as a supplier this rises to<br />

53%. However, of all those respondents who deliver literacy and numeracy programmes with<br />

an e-learning component, only 25% indicated that learndirect is a supplier. This indicates<br />

that respondents are obtaining this material from other suppliers, or alternatively are not<br />

aware that their supplier was using learndirect material.<br />

Overall we can see that early on in an adopting e-learning user organisations rely on e-<br />

learning using IT skills and then switch to other topics as they gain confidence. It is also clear<br />

that industry-specific e-learning becomes as important as the delivery of IT skills once<br />

organisations have gained the confidence that comes with maturity.<br />

There are few differences seen when the survey results are analysed by geographic location.<br />

Sixty percent of global companies provide foreign language training compared to an<br />

average 30% for all other companies; a blinding glimpse of the obvious perhaps. Global<br />

companies also supply less literacy and numeracy programmes, approximately 25%,<br />

compared to 35% of other organisations. Two other possible areas of difference emerge:<br />

that of industry-specific and company-specific training. For both these topics global<br />

companies and those on a UK site, approximately 80% of those respondents who deliver<br />

those training programmes do so with a component of e-learning; for companies in the other<br />

2 geographic segments this drops to approximately 55%. Companies with many branch<br />

locations are also more likely to use e-learning for equality and diversity; 80% of those who<br />

deliver these programmes are likely to use e-learning as opposed to approximately 50% for<br />

companies in the other geographic segments. Global companies and those in many<br />

branch locations are also more likely to deliver induction programmes via e-learning, 60% as<br />

opposed to 50% for companies with either a single UK site or only a few sites (Figure 4.3).<br />

Companies with many branch locations are less likely to use e-learning for sales and<br />

marketing training, 33% of companies in these segments as opposed to approximately 50%<br />

for other companies. Several of these differences may be based on logistics, induction<br />

training is clearly popular for those organisations with many dispersed locations and possibly<br />

availability of generic e-learning material. The fact that companies in all geographic<br />

segments are equally likely to deliver health and safety with an e-learning component but an<br />

increased penetration of equality and diversity training via e-learning is only apparent for<br />

those with dispersed UK operations.<br />

4.2 Topics learners are interested in<br />

Learners were asked which topics they studied using technology. The question asked “have<br />

you used technology (on-line courses, CDs or other technology learning tools) in any of your<br />

formal training in the past 12 months”? For each topic respondents were offered 2 choices:<br />

yes – in work or arranged by your employer, or yes – outside of work. The assumption in this<br />

latter case is that positive responses to this option indicate that respondents will have<br />

completed such learning either at their own expense, as part of a funded educational<br />

programme not sponsored by their employer, or as part of a voluntary activity. We know<br />

that a significant number of charities for example do provide e-learning to volunteers.<br />

<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 59


4 e-learning delivery<br />

Figure 4.3 The range of topics studied by learners<br />

Technical or practical skills<br />

Health & safety<br />

Company specific (not included above)<br />

Communication skills<br />

General IT user skills<br />

Management skills<br />

Equality and diversity<br />

Industry specific compliance<br />

Team working<br />

IT professional skills<br />

Customer handling/service<br />

Induction<br />

Problem solving<br />

Office/admin skills<br />

Sales and marketing<br />

Basic skills training (literacy/numeracy)<br />

Other (please specify)<br />

Foreign language skills<br />

0 100 200 300 400 500 600<br />

n=1183<br />

Arranged by employer<br />

Outside work<br />

Ref: This graph appears as Figure 30 from <strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers<br />

Table 4.5 Provision and usage of e-learning programmes<br />

Programme areas Provided by % of employers Used by % of employees<br />

Technical or practical skills 49% 54%<br />

Health & safety 34% 37%<br />

Company specific 33% 34%<br />

Communication skills 30% 36%<br />

General IT user skills 28% 35%<br />

Management skills 25% 31%<br />

Ref: This table appears as Table 3 from <strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers<br />

Table 4.5 compares the percentage of employees studying particular subjects with a<br />

percentage of employers offering that subject, although this must be viewed with some<br />

caution. The employee respondents came from 14 of the companies who responded in<br />

stage 1 of the survey. Ninety-nine percent of the employee respondents were confident<br />

computer users, whereas for 20% of the employer respondents less than half of their<br />

workforce used computers regularly. What is interesting to note is the extent to which<br />

<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 60


4 e-learning delivery<br />

employees are using e-learning in some form to find out about topics of direct relevance to<br />

work, technical practical skills for example. We might expect learners to be interested in<br />

transferable skills such as those of communication, general IT and team working. This only<br />

seems to be the case for foreign language skills. The fact that a significant amount of foreign<br />

language skills are acquired using e-learning outside work is no surprise. The market for<br />

foreign language training has, for a long time, used various forms of technology.<br />

The number of respondents who state that they do use e-learning outside of work is an<br />

indication of the extent to which e-learning has become available in what might be<br />

described as the retail learning market.<br />

4.3 Programmes offered<br />

Employer respondents were asked to select programmes from the list provided. These<br />

included programmes for individuals outside their direct workforce. Figure 4.4 shows the<br />

percentage of organisations stating that they offered programmes and those that offer<br />

programmes with an e-learning component<br />

Figure 4.4 Programmes offered by organisations<br />

Industry certification<br />

Learning for customers<br />

Professional body qualification<br />

Basic skills<br />

Learning for suppliers<br />

N/SVQ<br />

Community or CSR<br />

Foundation Degree<br />

Employee family and friends<br />

Apprenticeship<br />

0% 20% 40% 60% 80% 100%<br />

n=173<br />

Offered with no e-learning component<br />

Offered with e-learning component<br />

Ref: This graph appears as Figure 31 in <strong>Towards</strong> maturity: Insights for Employers and Training providers<br />

The occurrence of the use of e-learning on its own was extremely infrequent. The highest<br />

percentage occurrence is for basic skills where 4% of respondents indicated that they<br />

provided this via e-learning alone. The majority of respondents in this 4% did not select<br />

learndirect as a supplier and would not have been making use of the basic skills programme<br />

that is funded through learndirect. We can see that the penetration of e-learning remains<br />

low for programmes many of which are designed to lead to qualifications.<br />

<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 61


4 e-learning delivery<br />

Table 4.6 shows the percentage of respondents offering training to support these<br />

programmes by sector.<br />

Table 4.6 Work-based programmes offered<br />

Manufacturing<br />

Transport<br />

Financial<br />

Business Activities<br />

Public sector<br />

Education<br />

Health<br />

IT and Telecoms<br />

Others<br />

Industry recognised<br />

certificate/qualification 67% 76% 78% 76% 88% 73% 75% 55% 62%<br />

Learning for our customers 60% 62% 50% 71% 47% 73% 50% 65% 57%<br />

Professional body training 50% 56% 70% 75% 55% 43% 41% 38% 57%<br />

N/SVQ 53% 67% 26% 47% 62% 49% 65% 25% 48%<br />

Basic skills/Skills for Life 60% 43% 35% 47% 56% 59% 50% 40% 48%<br />

Community or CSR<br />

programmes 60% 57% 52% 47% 32% 39% 30% 40% 33%<br />

Apprenticeship 53% 71% 17% 29% 41% 41% 25% 35% 57%<br />

Learning for our suppliers 53% 57% 30% 47% 21% 41% 20% 50% 33%<br />

Foundation Degree 47% 43% 30% 29% 44% 51% 35% 30% 19%<br />

Employee friends and family<br />

programmes 53% 48% 22% 41% 32% 37% 15% 25% 29%<br />

N= 15 21 23 17 34 41 20 20 21<br />

The demand for industry-recognised qualifications is led by the public sector closely followed<br />

by transport, finance and business activities. We know that compliance training is more<br />

important for the finance sector, which may explain the high percentage of programmes in<br />

this sector seeking industry recognised certificates. E-learning is frequently used for IT<br />

professional skills but about half of organisations in the It and telecommunications sector<br />

include an e-learning component within industry recognised qualifications. It would appear<br />

that the IT and telecommunications industry uses e-learning for individuals to acquire specific<br />

job-related skills rather than a coherent qualification programme. Differences between the<br />

education sector and others are reported elsewhere. Apart from learning for customers and<br />

industry recognised qualifications the use of e-learning in the education sector to support<br />

programmes is on a par with or behind many other sectors. We can expect the<br />

manufacturing sector to lead on apprenticeship training in general and the 2 sectors that<br />

use e-learning most for apprenticeships are manufacturing and transport; the 2 sectors most<br />

likely to offer training to apprentices are manufacturing and transport.<br />

<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 62


4 e-learning delivery<br />

The following table shows the penetration of e-learning by programme and sector. This is<br />

calculated from the percentage of respondents who offer a programme and the<br />

percentage who offer that programme with an e-learning component.<br />

Table 4.7 Penetration of an e-learning component into work-based programmes<br />

Manufacturing<br />

Transport<br />

Financial<br />

Business Activities<br />

Public sector<br />

Education<br />

Health<br />

IT and Telecoms<br />

Others<br />

Professional body training 32% 41% 64% 33% 27% 32% 39% 23% 42%<br />

Industry recognised<br />

certificate/qualification 33% 31% 100% 25% 69% 37% 40% 39% 50%<br />

Basic skills/Skills for Life 67% 34% 6% 0% 27% 45% 49% 13% 17%<br />

N/SVQ 25% 21% 50% 0% 14% 20% 8% 0% 30%<br />

Apprenticeship 22% 33% 0% 0% 0% 17% 10% 13% 30%<br />

Foundation Degree 22% 8% 17% 0% 18% 44% 17% 25% 0%<br />

Learning for our suppliers 50% 20% 25% 0% 7% 18% 0% 71% 17%<br />

Learning for our customers 63% 17% 71% 38% 97% 88% 25% 70% 86%<br />

Employee friends and family<br />

programmes 43% 33% 14% 0% 7% 14.3% 0% 17% 25%<br />

Community or CSR<br />

programmes 38% 10% 80% 0% 27% 20% 67% 20% 17%<br />

All the industry recognised qualification programmes in the finance sector use e-learning. A<br />

pattern that emerges is that learning for customers tends to use a greater proportion of e-<br />

learning than other programmes. Undoubtedly this is because such programmes are cheap<br />

to deliver at the point of use and once the initial investment is completed there are no<br />

additional costs incurred dependent upon the number of users. Although the question was<br />

not asked, it clearly makes sense for organisations to offer such learning free at point of use.<br />

The business activities sector is least likely to use e-learning for programmes and only does so<br />

for professional body training, industry qualification and customer programmes. Even here<br />

the penetration is approximately one-third. Almost all the training the public sector provides<br />

for its customers is delivered through e-learning. The sector that is most likely to use e-<br />

learning in its programmes is the manufacturing sector. Appendix B describes the nature of<br />

the respondents comprising this sector in this study. Many of them were pharmaceuticals<br />

and thus not representative of the manufacturing sector at large. The above differences are<br />

all relatively small given the small number of respondents in each sector.<br />

Table 4.8 explores the percentage of respondents offering topics with an e-learning<br />

component by e-learning maturity. Given the segmentation based upon the question in the<br />

survey it is difficult to see patterns emerging.<br />

<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 63


4 e-learning delivery<br />

Table 4.8 Respondents offering skills with an e-learning component<br />

Novices<br />

Sporadic<br />

users<br />

Developing<br />

Users<br />

Established<br />

Users<br />

Embedded<br />

Users<br />

Innovators<br />

Professional body training 0% 26% 21% 31% 50% 33%<br />

Industry recognised<br />

certificate/qualification 29% 26% 27% 56% 50% 30%<br />

Basic skills/Skills for Life 0% 23% 18% 19% 20% 11%<br />

N/SVQ 33% 17% 42% 69% 50% 56%<br />

Apprenticeship 29% 11% 3% 13% 10% 4%<br />

Foundation Degree 0% 6% 5% 16% 20% 19%<br />

Learning for our suppliers 0% 0% 8% 22% 40% 11%<br />

Learning for our customers 29% 17% 26% 38% 50% 41%<br />

Employee friends and family<br />

programmes 0% 9% 6% 13% 10% 4%<br />

Community or CSR programmes 0% 11% 10% 16% 0% 11%<br />

If we collapse the segments slightly into the less mature, becoming mature and more mature<br />

and categories the programmes into types then a much clearer trend emerges. The original<br />

10 programmes offered have been reduced to a group of 6 in Figure 4.5. Job related<br />

qualifications include professional body training and industry recognised qualifications.<br />

These only increase penetration of delivery with the most mature organisations, similar to the<br />

growth of industry and company specific topics. The wider community learning programme<br />

(includes friends and family of employees), and introductory qualifications (includes<br />

apprenticeships and foundation degrees) change little with maturity.<br />

The probability of organisations offering basic skills programmes with an e-learning<br />

component is independent of the maturity of the organisation. Two programmes do stand<br />

out which are increasingly more likely to be delivered by more mature organisations. As<br />

organisations mature there is a significant increase in the probability of delivering Vocational<br />

Qualifications with an e-learning component. Traditionally, because of the requirements for<br />

assessment and workplace monitoring, these programmes are relatively expensive for<br />

employers to deliver. The benefits of administration may be the driving force behind the<br />

increased probability of these programmes using e-learning as organisations become more<br />

confident and mature about how e-learning should be deployed. The other growth area<br />

with maturity is providing learning for suppliers. As companies become more confident in<br />

their use of e-learning they may realise that, because delivery costs are effectively zero, it<br />

requires no additional investment from them to provide their employee programmes to their<br />

suppliers. By doing this they are able to enhance the quality of the supply chain.<br />

<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 64


4 e-learning delivery<br />

Figure 4.5 Programmes offered with an e-learning component<br />

0.7<br />

0.6<br />

0.5<br />

0.4<br />

0.3<br />

0.2<br />

0.1<br />

0<br />

Less mature N= 41 Becoming mature N = 62 More mature n = 69<br />

Job related qualifications<br />

Introductory qualifications<br />

N/SVQ<br />

Wider community learning<br />

Basic skills/Skills for Life<br />

Learning for our suppliers<br />

Respondents are also segmented by geographic location to see if that has any impact on<br />

the probability of e-learning being used in any particular programme as shown in Table 4.9<br />

below. Companies with a few sites are more likely to use e-learning within apprentice and<br />

foundation degree programmes, but even here the penetration is about a quarter and<br />

about 10% of companies overall. Neither globalisation nor a dispersed branch operation<br />

significantly increases the probability of e-learning being used in any qualification<br />

programme. Indeed for Vocational Qualifications the probability of these programmes using<br />

e-learning, globally or in branch locations, is less than for those companies who operate from<br />

a few UK sites.<br />

Table 4.9 Penetration of e-learning<br />

Worldwide A few sites Single UK site<br />

Many branch<br />

locations<br />

Professional body training 50% 53% 46% 52%<br />

Industry recognised<br />

certificate/qualification 38% 39% 41% 32%<br />

Basic skills/Skills for Life 21% 30% 32% 39%<br />

N/SVQ 15% 23% 13% 19%<br />

Apprenticeship 17% 23% 18% 6%<br />

Foundation Degree 14% 29% 27% 18%<br />

<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 65


4 e-learning delivery<br />

Worldwide A few sites Single UK site<br />

Many branch<br />

locations<br />

Learning for our suppliers 26% 21% 27% 18%<br />

Learning for our customers 43% 39% 44% 36%<br />

Employee friends and family<br />

programmes 21% 12% 33% 10%<br />

Community/CSR programmes 17% 32% 18% 18%<br />

262% 300% 299% 248%<br />

4.4 Services provided to learners<br />

Respondents were asked to select from a list of both formal and informal learning services<br />

that they provided. The list of formal offers is shown in Figure 4.6<br />

Figure 4.6 Types of formal online services offered<br />

Electronic learning materials<br />

Assessment<br />

Adminstration<br />

Collaboration between learners<br />

Competency management<br />

E-tutor support<br />

Evaluation of business impact<br />

0% 20% 40% 60% 80% 100%<br />

Is used now Is planned by 2010<br />

Ninety percent of respondents report using electronic learning materials. For many users e-<br />

learning is defined as the delivery of content and therefore this is no surprise. We deliberately<br />

chose a wide definition of e-learning, particularly to explore the future use of on-line facilities.<br />

This approach is justified by the significant number of respondents who are using e-learning<br />

for learning services other than the delivery of electronic learning material. The pattern of<br />

learning services provided might be expected to change with maturity and more mature<br />

organisations do deliver a wider range of learning services on-line as shown in Figure 4.7.<br />

<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 66


4 e-learning delivery<br />

Figure 4.7 Formal online services offered changes with maturity<br />

100%<br />

80%<br />

60%<br />

40%<br />

20%<br />

0%<br />

Innovators<br />

Embedded<br />

Users<br />

Established<br />

Users<br />

Developing<br />

Users<br />

Sporadic<br />

users<br />

Novices<br />

Competency management<br />

E-tutors<br />

Collaboration between learners<br />

Adminstration<br />

Assessment<br />

Business evaluation<br />

Every learning service included in the survey question is more likely to be delivered by more<br />

mature organisations. The delivery of electronic learning materials is not shown here as this<br />

changes little with maturity. The average response rate between novices and sporadic users,<br />

for example, is 80% and it remains between 80% and 95% for all segments of maturity. The<br />

service reported in the figure above show similar growth rates with maturity but different<br />

probabilities of being used; on-line business evaluation being least likely and administration<br />

services most likely.<br />

Respondents were also offered a selection of 4 informal learning services (Figure 4.8).<br />

> Communities of practice/mentoring/coaching.<br />

> On-line access to company expertise.<br />

> Simplify access to relevant on-line resources (e.g. through improved search engines).<br />

> On-line books/job aids.<br />

A later question asked respondents how they supported learners after learning back in the<br />

workplace. This included a response for on-line job aids. Only 17% of respondents selected<br />

that option in that part of the survey. It is therefore highly probable that the 64% selecting<br />

on-line books/job aids are in fact referring to on-line books rather than job aids. If that is the<br />

case this high percentage indicates a growth in e-books and the delivery of text<br />

electronically perhaps through portable document formats. The 2 informal services most<br />

likely to be offered, on-line books and search portals, are both designed to enable learners<br />

to find things out for themselves from a large source of information made available to them.<br />

<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 67


4 e-learning delivery<br />

Figure 4.8 Types of informal online services offered<br />

Online books<br />

Search Portals<br />

Online company experts<br />

On-line communities<br />

0% 10% 20% 30% 40% 50% 60% 70% 80%<br />

Is used now Is planned by 2010<br />

Personal contact through email to experts or through on-line communities is slightly less likely<br />

to be offered although still by more than 40% of respondents. The probability of these<br />

services being offered is compared by grouping maturity segments as shown in Figure 4.9.<br />

There is a clear increase in the probability of informal services being offered with maturity.<br />

Figure 4.9 Use of informal techniques increases with maturity<br />

100%<br />

80%<br />

60%<br />

40%<br />

20%<br />

0%<br />

Less mature Becoming mature More mature<br />

Search portals<br />

On-line communities<br />

Online company experts<br />

Online books<br />

See also Figure 33 <strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers<br />

As more organisations become more mature we can expect a significant growth in these<br />

types of services. Based on a comparison of maturity versus experience (Chapter 1) we<br />

might expect organisations to move from less mature to more mature within 3 to 5 years. The<br />

future of informal learning and forecasts for the tools that will support it are discussed in more<br />

detail in Chapter 9. However we see technology supported social learning will represent an<br />

increasingly important part of learning provision in organisations over the next 3 years.<br />

<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 68


6 IT capability<br />

5 Take-up of software tools in support of e-learning<br />

Overview: This chapter explores the range of learning technologies used in support of e-<br />

learning and looks at the trends emerging with e-learning maturity.<br />

Respondents were asked a number of questions relating to the technology they use as listed<br />

in Figure 5.1. They were asked how many they were using, or planning to use in the next 3<br />

years. Respondents were offered 4 choices; I’m not familiar with this term, this is not used<br />

here, this is used in some programmes, this is used in most programmes, this will be used in 3<br />

years’ time.<br />

Figure 5.1 Current and planned use of learning technologies<br />

Learning Management System (LMS)<br />

63%<br />

17%<br />

Video conferencing<br />

Content Management Systems<br />

Games/simulations/intray excercises<br />

45%<br />

46%<br />

52%<br />

6%<br />

15%<br />

8%<br />

Virtual classroom<br />

Unmoderated chat rooms/discussion groups<br />

Moderated chat rooms/ discussion groups<br />

36%<br />

32%<br />

38%<br />

17%<br />

13%<br />

14%<br />

Competency Management System<br />

23%<br />

19%<br />

Open source e-learning tools<br />

Rapid application development tools<br />

33%<br />

32%<br />

6%<br />

6%<br />

Mobile learning<br />

Blogs/wikis<br />

Electronic Performance Support Systems<br />

Podcasting<br />

e-portfolios<br />

Video on demand<br />

22%<br />

19%<br />

20%<br />

13%<br />

23%<br />

15%<br />

15%<br />

15%<br />

12%<br />

17%<br />

6%<br />

14%<br />

n=164<br />

0% 20% 40% 60% 80%<br />

Currently in use<br />

Planned within 3 years<br />

Ref: This graph appears as Figure 54 in <strong>Towards</strong> <strong>Maturity</strong>: insights for Employers and training Providers<br />

5.1 Technologies used to support e-learning<br />

Figure 5.1 shows the technologies in the order most likely to be used. In the majority of cases<br />

only 3% or 4% of respondents selected the “I am not familiar” box for the technologies listed.<br />

Exceptions were, competency management systems (14%), open source e-learning tools<br />

(16%), rapid application development tools (18%), electronic performance support systems<br />

(24%) and e-portfolios (26%). The concept of electronic performance support systems or<br />

<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 69


5 Learning technologies<br />

tools is more than 20 years’ old and the high percentage not familiar with the term indicates<br />

that this is a style of application that is likely to be of less interest to most people; certainly<br />

one that is not talked about in literature to any significant extent. By contrast on-line books or<br />

job aids are known about by 98%. It would appear that the simpler electronic job aid is likely<br />

to be more popular than EPSS.<br />

Respondents are asked about study support and helping learners consolidate their learning;<br />

in these questions they were asked if they used electronic help and job aids (17%) and online<br />

web reference materials (27%). These latter figures are more in line with the 20% of<br />

respondents who currently use EPSS. On the other hand both rapid application and open<br />

source tools are relatively new and have reached a stage where approximately 4 out of 5<br />

respondents were familiar with these terms. It is less of a surprise that only 4 out of 5<br />

understand the term Competency Management System. Although this has been available<br />

as a concept for 15 years it is perhaps more the province of HR managers than learning and<br />

development managers. Competency management does show one of the largest growth<br />

rates in comparison to its current usage. Almost as many respondents will plan to implement<br />

competency management by 2010 as are currently using it.<br />

The high percentage of users who are not aware of e-portfolios and the low probability of<br />

them being used is disappointing bearing in mind the importance these are likely to assume<br />

in the education system. Only 3 out of 4 respondents recognise the term and of those only<br />

one-third actually deploy e-portfolios.<br />

The lead position occupied by Learning Management Systems is reflected in all the<br />

segmentation analysis used in this study and is perhaps related to the importance of<br />

administration and compliance reporting as drivers and benefits of e-learning. When<br />

structuring the questions the category labelled content management systems actually said<br />

“Content Management Systems (CMS, VLE)”. A Virtual Learning Environment (VLE) 3 has<br />

some similarities with a virtual classroom. Students are able to communicate synchronously<br />

or asynchronously with each other and with their tutors. Tutors can prepare and store<br />

content for access by students. This may be a category that respondents have interpreted in<br />

a variety of different ways. Differences have been noted between responses in the<br />

education sector and others; reported in more detail elsewhere. Unfortunately we cannot<br />

determine how many respondents considered this choice as a development tool or as a<br />

collaborative learning tool. If the latter this follows a pattern of collaborative learning tools<br />

being an area of expansion from a user base of approximately 25%. Collaborative tools are:<br />

video conferencing, virtual classroom, chat rooms (both moderated and unmoderated),<br />

blogs/wikis and virtual learning environments (content management systems). Collectively<br />

they are in the bottom half of the figure reported previously and least likely to be in use, or<br />

planned.<br />

3 Wikipedia: Components of these systems usually include templates for content pages, discussion forums, chat,<br />

quizzes and exercises such as multiple-choice, true/false and one-word-answer. Teachers fill in these templates and<br />

then release them for learners to use. New features in these systems include blogs and RSS. Services generally<br />

provided include access control, provision of e-learning content, communication tools, and administration of the<br />

user groups.<br />

<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 70


6 IT capability<br />

5.2 Impact of maturity on the use of software tools<br />

The various responses have been analysed in accordance with a number of other factors.<br />

Table 5.1 lists the responses by maturity segments.<br />

Table 5.1 Software tools used vary with maturity<br />

Novices<br />

Sporadic<br />

users<br />

Developing<br />

Users<br />

Established<br />

Users<br />

Embedded<br />

Users<br />

Innovators<br />

LMS 40% 65% 81% 97% 67% 92%<br />

Video conferencing 60% 47% 59% 58% 89% 73%<br />

CMS 0% 59% 52% 58% 78% 88%<br />

Chat - unmoderated 20% 38% 41% 48% 78% 88%<br />

Virtual classrooms 20% 38% 50% 52% 67% 73%<br />

Chat rooms- moderated 20% 35% 40% 55% 67% 81%<br />

Games 0% 38% 52% 55% 78% 69%<br />

Mobile learning 60% 26% 26% 32% 67% 65%<br />

Open source tools 20% 44% 28% 39% 56% 58%<br />

Wikis / blogs 40% 24% 31% 29% 56% 58%<br />

Competency management 0% 38% 36% 45% 67% 50%<br />

Video on demand 60% 18% 28% 16% 56% 50%<br />

Rapid development tools 0% 21% 29% 52% 44% 69%<br />

Pod casting 20% 21% 21% 32% 33% 62%<br />

EPSS 0% 21% 26% 42% 44% 50%<br />

E-portfolios 0% 26% 26% 16% 44% 58%<br />

N=163 5.00 34.00 58.00 31.00 9.00 26.00<br />

An increase in probability of use is shown in the table moving to more mature segments. The<br />

table shows the percentage of respondents in each segment who selected that particular<br />

technology to be one that they were currently using. All these technologies have been<br />

plotted against maturity. They are grouped as information and production tools, as delivery<br />

tools and as collaborative tools and plotted against 3 levels of maturity<br />

<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 71


5 Learning technologies<br />

Figure 5.2 Information and production tools<br />

100%<br />

80%<br />

60%<br />

40%<br />

20%<br />

0%<br />

Less Mature Becoming Mature More Mature<br />

LMS (17%) Competency management (19%)<br />

E-portfolios (6%) Rapid development tools (6%)<br />

Open source tools (6%)<br />

In Figure 5.2 the percentage of respondents who selected the option for planning to use the<br />

tool by 2010 is shown in brackets after the title of the software tool. This figure shows that in<br />

almost every case for information and production tools more mature respondents are more<br />

likely to use these tools; the exception being open source tools. A possible explanation is that<br />

less mature organisations select the use of open source tools as an inexpensive entry point to<br />

e-learning, to enable piloting and experimentation prior to a formal business case being<br />

established. For example, 44% of sporadic users selected this option. It is very clear that the<br />

availability of such open source tools provides an entry point for training functions in the<br />

absence of a strategy or business case.<br />

If we assume that it takes 2 to 3 years for organisations to move from being less mature to<br />

more mature then we can estimate the growth in the use of these tools by 2010 by<br />

comparing current use for organisations of different maturity. For example, 17% of<br />

respondents said that they will be implementing Learning Management Systems in the next 3<br />

years but the difference in market penetration dependent on maturity is 30%. With 91% of<br />

more mature users selecting LMS it is more likely that, for the less mature, there will be a<br />

growth rate nearer 30%. With more or less equal numbers in each category the estimate of<br />

future use balances with a prediction by maturity. The figure for rapid development tools,<br />

however, is likely to be different to the 6% reported in Figure 5.1. It is far more likely to assume<br />

a growth rate of 30 to 35% based on the comparison of the use of rapid development tools<br />

by maturity. Using the same estimating principle the growth rate in competency<br />

management tools of 19% is optimistic, as only 50% of more mature respondents use these<br />

products. With only a third of more mature organisations using e-portfolios then a growth<br />

rate of 6% seems reasonable. The prediction for the Government therefore is that by 2010<br />

only a third of companies will be adopting e-portfolios.<br />

<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 72


6 IT capability<br />

Figure 5.3 Delivery tools – change of use by maturity<br />

100%<br />

80%<br />

60%<br />

40%<br />

20%<br />

0%<br />

Less Mature Becoming Mature More Mature<br />

Mobile learning (15%) Video on demand (14%)<br />

Podcasting (17%) EPSS (12%)<br />

Games (6%)<br />

Figure 5.3 shows the change in use of a number of delivery tools; again in every case more<br />

mature users are more likely to be using these tools. A growth rate of 6% in the use of games<br />

is predicted from the overall question, however, there is a 30% difference between the<br />

probability of use by more mature and less mature organisations. Based on the data in this<br />

figure it seems more likely that the use of games/simulations/in-tray exercises will grow by<br />

15%. Although the shorthand title ‘Games’ has been used when reporting these results it is<br />

essential to understand that respondents were given a much wider definition. In addition the<br />

project has emphasised a very broad definition of e-learning. Therefore a management<br />

game played electronically between participants, based on in-tray exercises could have<br />

been included in a respondent’s answer reported here as ‘Games’. Some of the delivery<br />

tools listed here are still very early in their technological adoption curve. Pod casting and<br />

video on demand, for example, require both bandwidth and software infrastructure in place.<br />

Although changes in the domestic market will make these more widely available these<br />

technologies are likely to face significant corporate barriers.<br />

The same may be said of mobile learning, although the definition offered to respondents<br />

included both laptops and tablet PCs. Such platforms are already widely in use for learning<br />

and work. It is perhaps disappointing that only half of the more mature respondents said that<br />

they delivered mobile learning; although this is significantly greater than the 22% who said<br />

that they made e-learning available when travelling.<br />

Figure 5.4 lists the software and tools that enable collaborative working between learners.<br />

The CMS/VLE has been included in this list here. The older but established technology of<br />

video conferencing achieves the second highest penetration for more mature users. A fuller<br />

discussion of the possible growth in collaborative tools is left until a later chapter when the<br />

views of learners and their preferences have been considered.<br />

<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 73


5 Learning technologies<br />

Figure 5.4 Use of collaborative tools increases with maturity<br />

100%<br />

80%<br />

60%<br />

40%<br />

20%<br />

0%<br />

Less Mature Becoming Mature More Mature<br />

Video conferencing (8%) Chat - unmoderated (14%)<br />

Virtual classrooms (13%) Chat rooms- moderated (17%)<br />

Wikis / blogs (15%) CMS / VLE (15%)<br />

The likelihood of a respondent using one of these tools may be linked to the maturity of the<br />

tool itself. Video conferencing has been available for longest and wikis/blogs is the newest<br />

technology on this list. In general collaborative tools achieve a higher penetration in use with<br />

more mature users than all the other technologies, with the exception of Learning<br />

Management Systems.<br />

5.3 Differences due to geography and size<br />

Figure 5.5 plots major differences between the penetrations of specific technologies by<br />

geographic circumstances. Overall those with many branch or office locations are less likely<br />

to use the technologies listed in the legend (only differences for any one segment over 15%<br />

have been plotted). The results for organisations with a few UK sites are not shown, they are<br />

slightly less likely to use a range of technologies, least likely to use rapid development tools<br />

but otherwise the probability of a particular software application being used in organisations<br />

with this geographic distribution is very close to that of the overall average.<br />

The differences that emerge are that those with many locations are less likely to use software<br />

tools and those on one UK site are more likely to use software. It might be supposed that this<br />

difference arises from a cost barrier; the cost of implementing technology in many locations<br />

is greater than that in one UK site. However, this is not borne out when respondents listed<br />

their perceptions of barriers, as 43% of those with many locations selected cost as a barrier,<br />

as did 44% of those with one UK site. What may be a greater influence is the nature of the<br />

segment who stated that they operated from one UK site; many of them were part of larger<br />

organisations, for example NHS and education. Others were smaller more innovative<br />

companies typically in the e-learning sector itself.<br />

Global companies are more likely to choose the collaborative tools of video conferencing<br />

and virtual classrooms. Clearly with global travel costs to consider the ability for people to<br />

meet and conduct both business and learning will pay for the investment rapidly.<br />

<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 74


6 IT capability<br />

Figure 5.5 Differences from average take-up of technologies by geography<br />

40%<br />

20%<br />

0%<br />

-20%<br />

-40%<br />

Global One UK site Many locations<br />

Video conferencing Virtual classroom Chat- not moderated<br />

Chat- moderated e-portfolios Mobile learning<br />

EPSS Blogs/wikis Podcasting<br />

An interesting difference emerges with EPSS, more likely to be used in global organisations<br />

but less likely to be used in organisations with many UK locations. Whilst the potential<br />

improvement in efficiency for both styles of organisations would be the same, those with<br />

many UK locations do seem more reluctant to adopt e-learning technologies. What is<br />

surprising is that those with one UK site are much more likely to take on the collaborative<br />

working tools of chat and blogs and wikis. They are equally likely to be using virtual<br />

classrooms as global organisations are. Perhaps those on a single site find it easier to<br />

experiment with new technologies than those with many branch and office locations, as the<br />

amount of investment will be less and the project management and deployment of new<br />

technology will be easier. Those with a single UK site are also more likely to provide e-<br />

learning at home (67%) as opposed to 45% of those with many locations. The percentages<br />

for the other geographic distributions are 67% for those with a few relatively large sites and<br />

70% of global companies.<br />

Use of technology was also compared by size of organisation, but few patterns emerged.<br />

The only notable differences were the adoption of LMS, which rises more or less evenly from<br />

52% of the smallest companies (less than 280 staff) to 88% of the largest companies (more<br />

than 10,000 staff). Not surprisingly the use of video conferencing was related to size, with a<br />

third of the smallest companies having it available, as compared to 67% of the largest. This<br />

may also reflect the fact that the larger companies were much more likely to be global<br />

operations. The probability of games simulation as an in-box exercise being used also<br />

changes with size of organisation but the pattern is not consistent. Thirty-eight percent of<br />

smaller organisations use games compared to 58% of the largest. However this drops to 30%<br />

for middle-sized organisations. Apart from video conferencing, the other collaborative tools<br />

do not show consistently more use amongst larger organisations.<br />

<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 75


6 IT capability<br />

6 IT capability<br />

Overview: This chapter considers the effect that improving organisational IT capability has on<br />

the key dimensions. IT capability also influences where learning can be offered and the<br />

types of support provided to learners.<br />

6.1 Key differences observed with IT capability<br />

In most organisations e-learning has to rest on a foundation of IT capability. Two of the self<br />

perception questions behaved in a similar way and may be considered to relate to the IT<br />

capability of an organisation. These are: our learners are familiar with PCs and need little<br />

technical support; and our technology infrastructure is capable of delivering e-learning to<br />

places convenient to staff. Taking the average of these 2 questions and using a cut-off with<br />

a value of 7 means that the employer respondents could be segmented into 79 (termed IT<br />

not capable) and 68 (termed IT capable). The results on these 2 segments are analysed in<br />

relation to a number of factors seeking noticeable differences. The definition of IT capability<br />

therefore rests on the 2 questions that have been used to make this segmentation. In one<br />

case: IT infrastructure; employer responses have much greater similarity with other factors<br />

relating to availability and it is included in that dimension. The confidence and ability of<br />

employees to use PCs is independent of most other dimensions.<br />

Figure 6.1 Effect of IT capability on key dimensions<br />

8<br />

6<br />

4<br />

2<br />

0<br />

Business<br />

Impact<br />

Staff Impact Availability Takeup Financial<br />

Impact<br />

IT capable (n=68)<br />

IT not capable (n=70)<br />

Ref. This graph appears as Figure 22 in <strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and training Providers<br />

Figure 6.1 shows the main differences in the dimensions. In every single case a respondent’s<br />

perception is in closer agreement with the positive statements associated with business<br />

impact, staff impact, availability, take up and financial impact, if they work for an<br />

organisation which is measured as being more IT capable. Because the same factor (IT<br />

<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 76


6 IT capability<br />

infrastructure) is used both to segment by IT capability and to calculate the dimension<br />

“availability”, the difference in scores between averages 5.4 and 7.1 for this dimension must<br />

be viewed with some slight caution. Even taking this into account organisations which are IT<br />

capable make e-learning more available. We may conclude that having the appropriate IT<br />

infrastructure and IT confident staff increases the probability of e-learning being successful.<br />

Figure 6.2 Key differences associated with IT capability<br />

Training function capability<br />

Services offered<br />

Average number of drivers<br />

Directors / Senior managers using e-learning<br />

Technologies used<br />

Average number of roles using e-learning<br />

Barriers cited<br />

0.0 1.0 2.0 3.0 4.0 5.0 6.0 7.0 8.0<br />

IT capable (n=68)<br />

IT not capable (n=70)<br />

Training function capability has been defined in Appendix A, Table A.2. This definition<br />

includes having good links with the IT department and a clear understanding of the<br />

capability of internal IT to support e-learning. Clearly there is a link between the capability of<br />

the training function to use and deploy e-learning with the delivery system and also with the<br />

confidence of users of the technology. The assumption is that training functions and, to a<br />

lesser extent, learners, improve their capability and expertise in response to improved IT<br />

infrastructure.<br />

The services offered are defined by questions 15 and 16 of the questionnaire, which included<br />

a list of formal and informal on-line services. The possible maximum total for any one<br />

organisation is 11. In this graph above the value has not been re-based to 10 and therefore<br />

is not compatible with the measure of training function capability, scored out of ten.<br />

Nevertheless it gives a true comparison between IT capable and IT non-capable<br />

organisations. On average, those organisations that perceive themselves to be more IT<br />

capable, offer about one and a half more on-line services in support of learning.<br />

The total number of drivers that can be selected by a respondent is 15. On average IT<br />

capable organisations select 7 drivers as opposed to 5½ drivers for those who are not IT<br />

capable. Those organisations which have more confident staff and a better IT infrastructure<br />

see more opportunities for using e-learning. The technologies considered are defined in<br />

question 17 of the questionnaire, which included a total of 16 technologies that could be<br />

selected. Again this has not been re-based to 10, indicating that most IT capable<br />

organisations select about one-third of the technologies in the survey but those lacking<br />

confident staff and appropriate infrastructure select a quarter.<br />

<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 77


6 IT capability<br />

For the average number of roles who use e-learning the possible maximum is for users to<br />

select all 9 roles, this average has not been re-based to 10. This is the score which<br />

demonstrates the least difference between IT capable and not capable organisations.<br />

Neither the infrastructure nor user confidence make a great deal of difference to the number<br />

of roles that organisations deliver e-learning to. A far greater difference is observed when we<br />

compare whether directors use e-learning or not, as shown in Figure 3.7. Here there was a<br />

difference of 5 roles in terms of the average number of roles who used e-learning when<br />

directors did so and when they did not. The behaviour of role models within an organisation<br />

matters more than having the right infrastructure, or having PC confident staff.<br />

Respondents could select from a list of 13 barriers. Those who are IT capable select, on<br />

average, one less than those who are not IT capable but in either case the number of<br />

barriers that are selected is few.<br />

We may conclude from this pattern that training functions rise to the challenge of an<br />

adequate IT infrastructure and confident users by offering more services, seeing more<br />

opportunities and using more technologies. They also see fewer barriers.<br />

More than half of IT capable organisations deliver e-learning to their directors or senior<br />

management. Bearing in mind what we know about the significance of directors as a<br />

leadership role, it is perhaps surprising that they have less of an impact on organisations<br />

lacking IT capability, when only 41% of such organisations deliver e-learning to directors.<br />

6.2 Influence on success<br />

Figure 6.3 Variation in influence of roles with IT capability<br />

60%<br />

40%<br />

20%<br />

0%<br />

Head of<br />

Finance<br />

Head of<br />

IT<br />

Head of<br />

HR<br />

Business<br />

sponsor<br />

Local Board<br />

champions executive<br />

Line<br />

managers<br />

Learners<br />

Training<br />

department<br />

IT capable (n=68)<br />

IT not capable (n=70)<br />

The pattern that emerges is that support departments, finance, IT and HR are of less<br />

significance to IT capable organisations than those that are not. We may assume that it is<br />

more difficult to deliver e-learning in the environments which are less IT capable and<br />

therefore training functions need more support from other support functions, either practical<br />

help or financial endorsement. One of the biggest differences noted is the role of the<br />

business sponsor, who becomes more frequently cited as a key influence in those<br />

organisations which have adequate IT infrastructure and confident users of PCs.<br />

<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 78


6 IT capability<br />

We may assume that business sponsors in these organisations are more likely to perceive e-<br />

learning as a suitable route for achieving their business aims.<br />

We can also see differences in where e-learning is delivered and the range of topics offered.<br />

Figure 6.4 IT capability affects where learning can be offered<br />

% of topics offered by e-learning<br />

At the desk<br />

At home<br />

Internal Learning Centre<br />

In a quiet area<br />

Travelling<br />

External Learning Centre<br />

0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100<br />

%<br />

IT capable (n=68) IT not capable (n=70)<br />

This figure plots the percentages of organisations who state that they deliver e-learning at a<br />

desk, at home, in learning centres, in quiet areas or when travelling.<br />

The biggest difference between the 2 segments we are considering are in delivery of e-<br />

learning to a quiet area or when travelling. It would appear that when e-learning is available<br />

in these areas and, to a lesser extent at home, respondents are more likely to agree that they<br />

have an appropriate and convenient IT infrastructure.<br />

The figure labelled percentages of topics offered by e-learning is calculated as follows. The<br />

total number of times that e-learning is available for a topic is divided by the total number of<br />

times training is provided irrespective of delivery method. Thus this percentage represents the<br />

extent to which e-learning has penetrated a particular market. For all organisations e-<br />

learning is likely to be available half the number of times that training in a topic is available.<br />

This penetration of the market is shown by topic in Table 4.1. For IT capable organisations this<br />

penetration rises to 60%.<br />

<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 79


6 IT capability<br />

6.3 Supporting learners<br />

Figure 6.5 Learner support mechanisms change with IT capability<br />

Line management coaching<br />

Web study support<br />

Web technical support<br />

Electronic job aids<br />

Printed job aids<br />

Reference books<br />

Virtual classroom<br />

0% 10% 20% 30% 40% 50% 60% 70%<br />

IT capable (n=68)<br />

IT not capable (n=70)<br />

Ref: This graph appears as Figure 23 in <strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers<br />

This figure shows the effect IT capability has on the way that learners are supported. There is<br />

a significant difference in the probability of line management coaching being available. This<br />

is cited as an e-learning support mechanism by 60% of organisations having an infrastructure<br />

and confident PC staff and 40% of organisations that do not. This may be because staff are<br />

more confident about requesting such support from line managers, or line managers<br />

themselves are more confident about delivering it.<br />

Using the web for study support, technical support and job aid support is more prevalent in IT<br />

capable organisations. The reasons for this are self-evident, as is the probability that IT<br />

capable organisations are far less likely to use printed job aids. What is surprising is that IT<br />

capable organisations are more likely to provide reference books. It is unlikely that<br />

respondents interpreted this as on-line reference books, as the option selected states<br />

“reference books” and is in the same sequence as a selection described as; electronic<br />

support mechanisms for learners. IT capable organisations are twice as likely to consider<br />

virtual classrooms with approximately one in 5 respondents making that selection.<br />

We may observe even greater differences in the way that feedback is sought from learners.<br />

Figure 6.6 shows that 60% of IT capable organisations will consider surveys of user satisfaction,<br />

almost twice as many as those organisations which are not IT capable.<br />

<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 80


6 IT capability<br />

Figure 6.6 Seeking feedback from learners<br />

70%<br />

60%<br />

50%<br />

40%<br />

30%<br />

20%<br />

10%<br />

0%<br />

No feedback Team meetings Follow up at work Surveys of user<br />

satisfaction<br />

IT capable (n=68)<br />

IT not capable (n=70)<br />

It is possible that these surveys may be on-line; the question that was asked does not<br />

differentiate between paper surveys and on-line surveys. It is perhaps disturbing to note that<br />

organisations lacking IT capability seek much less feedback than those with IT capability and,<br />

indeed, 13% collect no feedback from learners at all.<br />

Figure 6.7 Sourcing and managing production of e-learning<br />

% with e-learning dedicated training team<br />

% demanding e-learning to exact specs<br />

% demanding Training Analysis skills<br />

% not using suppliers<br />

Commercial products<br />

In-house rapid development<br />

In partnership with vendor<br />

In-house expert tools<br />

0% 20% 40% 60% 80% 100%<br />

IT capable N=68 IT not capable N=70<br />

<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 81


6 IT capability<br />

In Figure 6.7 we can observe that IT capable organisations are more likely to use commercial<br />

products and in-house development, either with a vendor or for themselves. The remaining<br />

methods of sourcing show little difference and are not shown. IT capable organisations are<br />

more likely to have part of their training function dedicated to e-learning, this undoubtedly<br />

reflects on their perceived capability reported in Figure 5.2. We can also see that they are<br />

slightly more likely to be demanding, requiring e-learning to exact specification, although this<br />

difference is less than others. They are less likely to be using suppliers; 30% of IT capable<br />

organisations selected that option compared to 21% of IT not capable organisations.<br />

These differences are also indicative of the confidence and capability of the training<br />

function. Clearly there are a number of related factors linking the trainers, the infrastructure<br />

and the learners. Greater capability in all 3 areas increases the number of ways in which e-<br />

learning can be used, who it is delivered to, what technologies are used and its impact on<br />

the business and on staff.<br />

<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 82


7 Supporting learners<br />

7 Supporting learners<br />

Overview: We examine the range of study support options provided to learners from both the<br />

employer and the learner perspective.<br />

Respondents were asked a number of questions concerning the methods they used to<br />

support learners, including study support, technical support and methods to help them apply<br />

learning in their jobs. This includes both on-line material and resources and help by people,<br />

either in person or remotely via some electronic means. Respondents were given a list of<br />

possible options and were able to select as many as appropriate in response to the question:<br />

“What study support do you provide to your learners?”<br />

Learner respondents were asked an identical set of questions.<br />

Figure 7.1 Study support provided to learners<br />

With on-line web reference materials<br />

With a tutor in email contact<br />

In person before e-learning starts<br />

With a tutor in telephone contact<br />

In person during the course<br />

Through a learning resource centre<br />

In person for review and evaluation<br />

With a virtual learning classroom system<br />

0% 20% 40% 60% 80% 100%<br />

Ref. This graphs appears as Figure 36 in <strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers<br />

Figure 7.2 shows the responses of learners when asked whether the study support they had<br />

was useful or not useful. Learner respondents were also given the option of indicating<br />

whether such resources were available or not available. Hence the 2 options that learners<br />

select and are presented here do not add up to 100%. Although learner responses give an<br />

indication of what learners think of the support provided these are for a limited number of<br />

organisations, rather than the 200 employers who participated in the employer survey.<br />

Therefore we are not directly comparing like with like.<br />

<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 83


7 Supporting learners<br />

Figure 7.2 Learner support – the learner perspective<br />

On-line web reference materials<br />

Electronic help and job aids<br />

Reference books<br />

Printed job aids<br />

Job related assignments<br />

Through a learning resource centre<br />

With a tutor in email contact<br />

In person before e-learning starts<br />

In person to review/evaluate<br />

W ith a virtual learning classroom system<br />

With a tutor in telephone contact<br />

0% 10% 20% 30% 40% 50% 60% 70%<br />

Available and useful<br />

Available but not useful<br />

Ref: This graph appears as Figure 38 in <strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers<br />

The questions asked of learner respondents covered both support whilst studying and also<br />

help provided to consolidate and apply what they had learnt on the job.<br />

The most frequently provided method of study support, on-line reference materials, is highly<br />

regarded by learner respondents with 82% saying that it was available and they found it<br />

useful, although 15% said it was available and they did not find it useful. The proportion of<br />

learner respondents who found a support service useful when it was available is shown in<br />

Figure 7.3. Of the 15 options offered to learner respondents at least 69%, of those where it<br />

was available, found all forms of study support useful. Proportionately the most useful, at<br />

88%, is job related assignments provided by 38% of employers. We can contrast this with<br />

email contact from a tutor, provided by 42% and useful to 74% of those where it was<br />

available. An interesting point to emerge is the high value placed upon support in the<br />

workplace, with both job related assignments and electronic help and job aids, valued by<br />

more than 80% of those to whom it was available.<br />

The data supporting Figure 7.3 is grouped into help provided in person, electronic help, help<br />

delivered electronically from individuals and print based help. The proportion of respondents<br />

who consider this valuable where it was available was calculated for these groups. There is<br />

no significant difference between the method of delivery and the proportion of recipients<br />

who considered it useful. The percentages varied from 85% for print based help and 88% for<br />

electronic help.<br />

<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 84


7 Supporting learners<br />

Figure 7.3 Learner support- what is most useful when it is available<br />

Job related assignments<br />

Electronic help and job aids<br />

Reference books<br />

Print based help<br />

Electronic help<br />

Printed job aids<br />

With web reference materials<br />

In person before e-learning starts<br />

In person to review and evaluate<br />

Help in person<br />

With a tutor in email contact<br />

Help in person delivered electroncally<br />

By a learning resource centre<br />

With a virtual classroom<br />

With a tutor by telephone<br />

0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%<br />

The conclusion is that all help delivered directly to learners is considered valuable. Learner<br />

respondents were not asked their view of the most frequently provided form of help, that of<br />

line management coaching, although they were asked to select the one individual who was<br />

most influential in encouraging them to learn. Fifty-two percent of learner respondents chose<br />

their manager and 59% of employer respondents said they provide line management<br />

coaching and feedback to support the application of learning for the job. Even those<br />

support mechanisms only rarely available, for example virtual learning classroom systems<br />

available in 16% of employers and to 17% of learner respondents, are considered useful by<br />

72% of those to whom it is available.<br />

It appears that the method used to deliver support is less important to learners than the fact<br />

that it is available. For example the 3 methods of support least valued by learners (although<br />

70% of them do value these methods of support) are, the learning resource centre, the virtual<br />

classroom and telephone support from a tutor. Telephone contact by tutors is offered by a<br />

third of organisations, learning resource centres by 30% and virtual learning classroom<br />

systems by 16%. When making investment decisions about support to be provided<br />

organisations should bear in mind the perceived value to recipients. It would appear that<br />

telephone contact with tutors, learning resource centres and virtual classrooms are providing<br />

the least benefit to those they support. If we compare all methods of support that are<br />

synchronous with those that are asynchronous, the proportion of respondents for whom they<br />

are available and who perceive the support mechanism to be useful is 74% for synchronous<br />

methods of support and 83% for asynchronous methods. This adds weight to one of the main<br />

conclusions emanating from this report, that convenience as to time and place for learners is<br />

one of the most significant attributes of e-learning in all its forms.<br />

<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 85


7 Supporting learners<br />

7.1 Difference in support provided by maturity segments<br />

The responses to the questions concerning the support provided to learners are analysed<br />

against maturity. No particular pattern emerges. Whilst in general there is growth with<br />

maturity there is no consistent pattern for any one of the methods of support. No particular<br />

pattern emerges if we group the methods of support as requiring personal contact, personal<br />

support provided electronically or electronic support. There is a slight pattern emerging,<br />

shown in Figure 7.4, which seems to imply that more mature organisations will use more<br />

methods of support. However, bearing in mind that there were very few novices in the<br />

respondents, Figure 7.4 must be viewed with caution. All that it really says is that most<br />

respondents use on average, 2 or 3 different types of support.<br />

Figure 7.4 Number of different types of tutor support<br />

5.00<br />

4.00<br />

3.00<br />

2.00<br />

1.00<br />

0.00<br />

Novices<br />

Sporadic<br />

users<br />

Developing<br />

Users<br />

Established<br />

Users<br />

Embedded<br />

Users<br />

Innovators<br />

Similarly no particular pattern could be detected for different sizes of organisations.<br />

However, segmenting via geographic distribution, as shown in Figure 7.5, does produce<br />

some differences.<br />

Organisations with relatively few numbers of UK sites are far more likely to provide learner<br />

support in person, either before, during or after learning has been delivered. Worldwide<br />

companies are least likely to do this; they are more likely to provide electronic support<br />

through reference sites. Organisations with a single UK site are more likely, even than global<br />

companies, to provide this type of electronic support. Again companies with one UK site are<br />

more likely to provide personal support through email, telephone or virtual classrooms. Of<br />

the 36 employer respondents with a single UK site, 19 placed themselves in the education<br />

sector, 5 placed themselves in the health and social work sector, of which at least 3 were<br />

within the NHS. Others included Local Authorities. This particular segment is dominated by<br />

organisations who are in fact part of much larger structures and who would have been more<br />

inclined to seek help and support outside their own organisation but within their<br />

organisational support structure; DfES for education, Strategic Health Authorities for health<br />

and central government for local authorities.<br />

<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 86


7 Supporting learners<br />

Figure 7.5 Learner support compared by geographic characteristics<br />

Many small sites<br />

1 UK site<br />

A few sites<br />

Worldwide<br />

0% 10% 20% 30% 40% 50%<br />

Support provided in person<br />

Electronic support<br />

Personal support provided electronically<br />

Five of the opinion based Likert scale questions relate to the support provided to learners.<br />

Figure 7.6 Workplace learners support by maturity<br />

8.0<br />

7.0<br />

6.0<br />

5.0<br />

4.0<br />

3.0<br />

2.0<br />

1.0<br />

0.0<br />

Novices Sporadic users Developing<br />

Users<br />

Established<br />

Users<br />

Embedded<br />

Users<br />

Innovators<br />

Appraisal used Managers coach Access to mentor<br />

Off-site learning allowed<br />

Empowered staff<br />

See also Figure 40 <strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers.<br />

<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 87


7 Supporting learners<br />

We found a consistent improvement in agreement for all 5 of the learner support offers as<br />

organisations become more e-learning mature. This is supporting evidence that more mature<br />

organisations put more effort into supporting learners using a greater range of support<br />

mechanisms.<br />

7.2 Learning support and business impact<br />

The various support mechanisms are analysed and compared with changes in business<br />

impact. In Chapter Two differences related to business impact were reported, this analysis<br />

was based upon dividing employer respondents into quartiles based upon 6 of the Likert<br />

scale questions which define the dimension business impact. Figure 7.7 plots the percentage<br />

of respondents in each one of those segments that provide the support and consolidation<br />

processes listed in the figure.<br />

Very clearly, those organisations that put more effort into supporting learners in the<br />

workplace are more likely to be found in the upper quartile for business impact. Other<br />

support mechanisms not shown in the graph do not show such a distinct relationship with<br />

business impact. The key message for those inside organisations seeking to support learners<br />

and maximise their business impact is to concentrate on these 4 methods of support.<br />

Figure 7.7 Business impact increases when learning is consolidated<br />

100%<br />

80%<br />

60%<br />

40%<br />

20%<br />

0%<br />

Upper quartile 3rd quartile 2nd quartile Lower quartile<br />

Business Impact<br />

Reference books<br />

Re-assessment<br />

Electronic job aids<br />

Line manager coaching<br />

<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 88


7 Supporting learners<br />

7.3 Learners’ view of support<br />

Learner respondents were also asked a number of questions concerning the support they<br />

received.<br />

Figure 7.8 reports the percentage of learners who agree with the statements; that is their<br />

score was in the top third of the 1-10 agreement scale. From the learners perspective the 2<br />

most valuable features of e-learning are that it is convenient to their work schedule and they<br />

are able to quickly put into practice what they learn from e-learning. The learner<br />

respondents are not an exact match with the employer respondents. The majority of the<br />

learner respondents worked for just 14 of the employers who completed the employer survey.<br />

Appendix B reports on the demographics of the learner respondents. However, over 40% of<br />

respondents agreed that their managers appraised them at regular intervals and provided<br />

coaching feedback support. The analysis earlier in this chapter shows the link between this<br />

and e-learning maturity and the business impact of e-learning.<br />

Figure 7.8 Support received by employees<br />

Convenient to work schedule<br />

Ability to put learning into practice<br />

Elearning relevant to my job<br />

Appraisal from line manager<br />

Provision of coaching from line manager<br />

Time to learn at work<br />

Time to learn elsewhere<br />

Commitment of senior management<br />

Access to a mentor or buddy<br />

0% 20% 40% 60%<br />

A group of additional questions are shown in Figure 7.9 which plots a further 7 responses to<br />

questions asked of employees that are related to the support they receive.<br />

These are related to attributes that are valued by learners and related to e-learning. The<br />

most positive agreement is to the statement: “I am empowered to request my own training<br />

and to take ownership of my own development”, with 65% of respondents agreeing.<br />

Over half agree that e-learning is valuable because it gives them additional opportunities for<br />

development and 43% do e-learning without prompting. A third state that they are more<br />

interested in professional qualifications since using e-learning and half regard it as important<br />

that e-learning contributes to a recognised qualification, 52% wish to receive some<br />

recognition for succeeding at e-learning irrespective of whether qualifications are involved.<br />

<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 89


7 Supporting learners<br />

Figure 7.9 Attributes valued by employees<br />

Empowerment to take charge of my own<br />

development<br />

Recognition for success<br />

Additional opportunites for development<br />

A recognised qualification<br />

Do e-learning without prompting<br />

A more personalised approach<br />

Professional qualifications<br />

0% 10% 20% 30% 40% 50% 60% 70%<br />

The importance of empowerment becomes even more significant following the completion<br />

of an additional analysis. Appendix B discusses, in detail, the factor analysis approach,<br />

which enables us to group the opinion-based questions asked of learners into six key<br />

dimensions. Learner’s responses within these dimensions are reported in Figure 7.10.<br />

This figure shows the percentage of learner respondents who feel positive (that is their<br />

average responses are in the top third of agreement) about the dimensions listed. Fifty-four<br />

percent feel positive about the empowerment that e-learning gives them.<br />

Figure 7.10 Learners’ views by dimension<br />

Learners are empowered<br />

Job relevance<br />

Learners have control over their<br />

opportunties<br />

Need for recognition<br />

Detachment<br />

Management support<br />

0% 20% 40% 60%<br />

Percentage with positive view of dimension<br />

<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 90


7 Supporting learners<br />

Appendix A defines what we mean by empowerment. It is derived from the factor analysis<br />

of the statements, rather than having an inherent definition of itself. In the context of this<br />

report it means that learners are confident about using PCs, they know what training is<br />

available, they do e-learning without prompting, they are able to do it at a place and time<br />

that is convenient to them and feel empowered to ask for what they need.<br />

Twice as many respondents feel empowered as feel they are supported by their<br />

management. Management support being defined as: commitment of senior management,<br />

coaching and feedback support, appraisal, freedom to work at home or locally and time to<br />

learn at work. It would appear that for the target group of learners who responded to this<br />

survey it is easier for them to take charge of their own development than to feel supported<br />

by their management. This general positive view, that empowerment brings to learners, is<br />

more clearly demonstrated in Figure 7.11.<br />

Figure 7.11 Relative importance of dimensions to learners by segment<br />

Empowered learners<br />

Job relevance<br />

Control over learning<br />

Recognition<br />

Detachment<br />

Management Support<br />

0% 10% 20% 30% 40% 50% 60% 70% 80% 90%<br />

Empowerment Control over learning Management support<br />

Job relevance Recognition Detachment<br />

This graph shows the percentage of learners who feel positive about the key dimensions<br />

segmented by those dimensions themselves. For example, the set of percentages shown<br />

against empowered learners is the percentage of those learners who feel empowered who<br />

also feel positive about the control they have, the management support they receive, the<br />

relevance of e-learning to their job, their need for recognition and disagreement with feeling<br />

detached from e-learning.<br />

Detachment is defined by those respondents who agree that they only do e-learning when<br />

told to do so and find the choices offered confusing. In Figure 7.11 the responses to this<br />

question are therefore shown for those respondents who disagree with those 2 statements.<br />

Figure 7.11 shows that learners who feel empowered also feel more positive about all 5 of the<br />

other dimensions, that is more positive than learners who feel positive about those other<br />

dimensions.<br />

<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 91


7 Supporting learners<br />

This segmentation is not exclusive as empowered learners are clearly well represented in<br />

each one of the other 5 segments or groupings. As well as clearly demonstrating the positive<br />

reinforcement supplied to learners who feel empowered it is also interesting to reflect that<br />

those learners who feel supported by management are least likely to feel positive about the<br />

other 5 key dimensions.<br />

7.4 Technical support<br />

Employer respondents were also asked how they provided technical support to their learners<br />

(Figure 7.12).<br />

Figure 7.12 Provision of technical support to learners<br />

Telephone help desk<br />

By email<br />

In person<br />

Through a web resource<br />

n=139<br />

0% 10% 20% 30% 40% 50% 60% 70% 80% 90%<br />

An interesting difference emerges between the way technical support is provided and the<br />

way learning support is provided. Thirty-three percent of respondents provided telephone<br />

tutor support although 79% provide technical help via the telephone. Forty-five percent<br />

provide study support through Web reference materials but only 33% provide technical<br />

support through a Web resource. This demonstrates not only the very different nature of the<br />

support required but possibly that technical support is easier to provide by telephone with a<br />

24/7 coverage, whereas more specialised learning and subject support is more difficult to<br />

provide to learners by telephone at the time they require it. We should also bear in mind that<br />

50% of employer respondents said that more than 90% of their employees were regular PC<br />

users; by assumption requiring less technical support as individuals but more technical<br />

support as a population; because they spend more time using computers.<br />

<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 92


8 Promoting e-learning<br />

8 Promoting and sustaining e-learning<br />

Overview: A range of communications techniques are used by organisations to promote new<br />

e-learning initiatives and to sustain learner interest. We focus on the approach used by<br />

mature organisations realising the greater impact from their e-learning.<br />

Both employer and learner respondents were asked a number of questions related to<br />

sustaining interest in e-learning. Employers were asked the methods by which they promoted<br />

and launched e-learning and those they used to sustain interest in it. Learners were asked<br />

how they first heard about e-learning and the various ways in which their interest was<br />

sustained. Figure 8.1 shows the methods used segmented by the maturity of the<br />

organisation.<br />

Figure 8.1 Promotion of e-learning – what mature organisations do differently<br />

100%<br />

80%<br />

60%<br />

40%<br />

20%<br />

0%<br />

e-mail<br />

Manager Newsletter Posters Open days Peer<br />

briefings<br />

testimonies<br />

Video Giveaways SMS<br />

Less mature (n=33) Becoming mature (n=49) More mature (n=54)<br />

Respondents could select all the methods that applied but were given the option of<br />

selecting none; that is they used no communication or promotion method to launch e-<br />

learning. This was selected by 9% of those less mature organisations and 2% of those<br />

becoming mature. The more mature organisations use more channels to promote and<br />

communicate about e-learning. The use of email is independent of maturity and is the most<br />

frequently used method of communication. Manager briefings are least used by less mature<br />

organisations, indeed almost half as frequent for the least mature as opposed to the most<br />

mature organisations. This pattern is repeated for both newsletters, posters and open days,<br />

all of which are less likely to be used by the less mature. Open days are more likely to be<br />

used by the more mature (a third of such organisations) as opposed to one in 5 of those<br />

becoming mature and one in ten of those less mature. Peer testimonies are equally likely to<br />

be used by organisations irrespective of maturity and approximately one out of 5 do so.<br />

<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 93


8 Promoting e-learning<br />

Figure 8.2 shows the same communication methods, this time in response to the question<br />

“Following the launch what communication methods do you use to maintain interest?”<br />

Figure 8.2 Sustaining e-learning – what do mature organisations do differently<br />

100%<br />

80%<br />

60%<br />

40%<br />

20%<br />

0%<br />

e-mail Newsletter Manager<br />

briefings<br />

Posters<br />

Open<br />

days<br />

Peer<br />

testimonies<br />

Video Giveaways SMS<br />

Less mature (n=33) Becoming mature (n=49) More mature (n=54)<br />

There is less difference in frequency of use of email, newsletters and management briefings<br />

with maturity, particularly between the becoming mature and the more mature. The less<br />

mature are less likely to use email, briefings and posters. Less mature organisations use fewer<br />

communication methods at launch, they are less likely to use communication to sustain<br />

interest; indeed 4% of the less mature organisations use no such communication and 2% of<br />

those becoming mature do not communicate to sustain interest. What is the potential<br />

business return from this promotional activity?<br />

Figure 8.3 Sustaining interest in e-learning according to business impact<br />

100%<br />

80%<br />

60%<br />

40%<br />

20%<br />

0%<br />

e-mail Newsletter Manager<br />

briefings<br />

Posters Open days Peer<br />

testimonies<br />

Video Giveaways SMS None<br />

Take-up of e-learning<br />

Top quartile 3rd quartile 2nd quartile Lower quartile<br />

Ref: This graph appears as figure 48 in <strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers<br />

<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 94


8 Promoting e-learning<br />

Again, email is equally likely to be used irrespective of the business impact achieved from e-<br />

learning. However, both newsletters and management briefings are least likely to be<br />

deployed by those organisations that achieve least business impact. Posters are most likely<br />

to be used by those organisations that achieve the most business impact. The remainder of<br />

the differences reported are relatively minor.<br />

To achieve business impact organisations should sustain their use of email, add in first<br />

management briefings, then newsletter input about e-learning and finally posters.<br />

The influence exerted on success by different categories of individuals is reported in Chapter<br />

2. It’s worth reflecting that the more mature organisations do regard learners as much more<br />

significant to the success of e-learning; 64% of the more mature organisations selected<br />

learners as key influences, as opposed to 23% of the less mature. Likewise with managers,<br />

these were selected as a point of influence by 46% of the more mature and 19% of the less<br />

mature. The best means training departments have of communicating with these 2 target<br />

groups is through email, briefings, posters, open days and newsletters. Since the more<br />

mature organisations believe line managers and learners have a greater influence on the<br />

success of e-learning it is hardly surprising that they put more effort into communicating with<br />

these 2 groups.<br />

The analysis explores the effect the various methods of communication have on take-up.<br />

Respondents are segmented into quartiles dependent upon the take-up of e-learning. The<br />

take-up of e-learning is defined in Appendix A and is a result of the factor analysis of the selfrated<br />

questions.<br />

Figure 8.4 Promoting and sustaining take-up – action to achieve take-up<br />

100%<br />

80%<br />

60%<br />

40%<br />

20%<br />

0%<br />

Upper quartile 3rd quartile 2nd quartile Lower quartile<br />

Take-up of e-learning<br />

e-mail Newsletter Manager briefings Posters Open days Peer testimonies<br />

Email is the most frequently used communication method. Figure 8.4 shows the return in<br />

greater take up from increased effort into newsletters, management briefings and, to a lesser<br />

extent, posters and open days. There is a consistent increase in the probability of newsletters,<br />

management briefings and posters being used with an increase in take-up. Both open days<br />

and peer testimonies show less difference with take-up and, it may be assumed, will show less<br />

of a return in increased take-up than other methods of communication.<br />

<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 95


8 Promoting e-learning<br />

Whilst we also asked employers about the use of give-aways and SMS messages, numbers in<br />

use are very small and the differences are less. However, 16% of organisations in the top 25 th<br />

percentile for take-up use give-aways and SMS; for organisations in the bottom 75 th<br />

percentile approximately 5% will use these 2 methods of communication. Both these<br />

methods go someway to pushing take-up towards the upper limits. Ten percent of<br />

organisations in the bottom half for take-up use no communication methods to promote and<br />

sustain the use of e-learning, compared to about 5% in the top half for take-up.<br />

8.1 Learners response to the communication methods<br />

Learners were asked how they first found out about e-learning and what types of<br />

communication kept them interested. For the first question they were only allowed to select<br />

one response.<br />

Figure 8.5 Learner response to communications about e-learning<br />

Email<br />

Line manager briefing<br />

Company newsletter<br />

Peer testimonies<br />

Open days<br />

Poster<br />

Giveaways<br />

SMS<br />

0% 10% 20% 30% 40% 50% 60% 70%<br />

Finding out<br />

Sustaining interest<br />

The use of a video by a senior executive was only offered as an option for the ‘finding out’<br />

question and no learners selected this option; this is not shown in the figure above. It is very<br />

apparent that the least effective methods of launching e-learning are SMS, give-aways,<br />

posters and open days. Peer testimonies are only marginally effective, being selected by 5%<br />

of the population. Almost twice as many respondents (38%) selected email as the method<br />

by which they found out about e-learning, as opposed to line management briefings (22%),<br />

with 12% selecting a company newsletter. The pattern remains very similar for the types of<br />

communication to which learners respond and that keep them interested in e-learning.<br />

However, open days, posters and give-aways become significantly more important than at<br />

launch, with about one in ten learners selecting these as communication methods that keep<br />

them interested. The learner responses were segmented by age, education levels, gender,<br />

management responsibilities, where people worked and where and when they learnt. There<br />

were no significant differences by either gender or education levels. One or 2 other<br />

differences have been identified and are reported in the following figures.<br />

<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 96


8 Promoting e-learning<br />

Figure 8.6 Communication about e-learning – effect of age of learner<br />

70%<br />

60%<br />

50%<br />

40%<br />

30%<br />

20%<br />

10%<br />

0%<br />

Company<br />

Newsletter<br />

Line<br />

Manager<br />

Briefing<br />

Giveaways Poster Company<br />

Newsletter<br />

Line<br />

Manager<br />

Briefing<br />

Email<br />

Finding out<br />

Sustaining Interest<br />

Age is = 55 N = 126<br />

Younger learners are far more likely to respond to line management briefings than older<br />

learners. One third of those 25 or under found out about e-learning through a line<br />

management briefing, as opposed to one in ten of those 55 or over. On the other hand<br />

company newsletters were more effective with older learners, with about one in 5 selecting<br />

these as a means by which they discovered about e-learning as opposed to one in 20 for<br />

younger learners.<br />

For sustaining interest email proves slightly more effective with older learners (63% of those<br />

over 55 as opposed to 54% of those under 25). Line management briefings continue to be<br />

effective as a means of sustaining interest for younger learners and again company<br />

newsletters more effective for older learners. It would appear that younger learners also<br />

respond to give-aways and posters more than older learners. Where there is little difference<br />

in the responses by age to a method of communication this is not shown. A similar analysis<br />

was completed for management responsibility.<br />

Respondents were asked if they managed their own time, or if it was managed for them;<br />

they were asked if they had responsibilities for others or not. Those who are responsible for<br />

managing others are slightly more likely to respond to company newsletters, both as a<br />

means of finding out about e-learning and sustaining their interest. They are much less likely<br />

to respond to line management briefings or give-aways. Those who do not manage their<br />

own time are more likely to respond to give-aways, although less likely to respond to email.<br />

The pattern that emerges is that those who are able to work independently are more likely to<br />

respond to remote methods of communication and those who are more directly managed<br />

are more likely to respond both to their own line managers and to actions such as giveaways<br />

which make them feel more valued.<br />

<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 97


8 Promoting e-learning<br />

Figure 8.7 Communication about e-learning – effect of management responsibility<br />

70%<br />

60%<br />

50%<br />

40%<br />

30%<br />

20%<br />

10%<br />

0%<br />

Company<br />

Newsletter<br />

Line Manager<br />

Briefing<br />

Company<br />

Newsletter<br />

Giveaways<br />

Email<br />

Finding out<br />

I do not manage my own time (n=57)<br />

No responsibility for others (n=459)<br />

Sustaining Interest<br />

I manage my own time (n=778)<br />

Responsible for others (n=376)<br />

A similar analysis is completed based upon where respondents work. Although the majority<br />

of respondents work at a regular place, 35 worked from home and 52 on site at a customer.<br />

For these small groups there are some noticeable differences.<br />

Figure 8.8 Communication about e-learning – effect of where learners work<br />

70%<br />

60%<br />

50%<br />

40%<br />

30%<br />

20%<br />

10%<br />

0%<br />

Company<br />

Newsletter<br />

Line<br />

Manager<br />

Briefing<br />

Email Open Days Poster Company<br />

Newsletter<br />

Line<br />

Manager<br />

Briefing<br />

Finding out<br />

Sustaining Interest<br />

All Work at a regular place N = 740<br />

Work from home N = 35 Work On site at customer N = 52<br />

<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 98


8 Promoting e-learning<br />

Those who work at a customer’s site are, not surprisingly, much more likely to select email as<br />

the method by which they found out about e-learning. They are much less likely to select a<br />

company newsletter and slightly less likely to select a line management briefing. Those who<br />

work at home, on the other hand, are more likely to select a company newsletter and less<br />

likely to select email as the means by which they find out about e-learning. They are slightly<br />

less likely to select a line management briefing. For sustaining interest open days and<br />

company newsletters are valued by those working at home. Those working at a customer’s<br />

site are less likely to respond to open days, posters, company newsletters and line<br />

management briefings. Their probability of responding to an email is similar to other<br />

respondents. Where there are no significant differences in the responses this is not reported.<br />

Figure 8.9 Communication about e-learning – effect of when learning occurs<br />

70%<br />

60%<br />

50%<br />

40%<br />

30%<br />

20%<br />

10%<br />

0%<br />

Company<br />

Newsletter<br />

Line<br />

Manager<br />

Briefing<br />

Email<br />

Open Days<br />

Giveaways<br />

Poster<br />

Peer<br />

Testimonies<br />

Company<br />

Newsletter<br />

Email<br />

Finding out<br />

Learn in a quiet spot away from the desk (n=32)<br />

Learn at home (n=132)<br />

Learn in company time (n=668)<br />

Sustaining Interest<br />

Learn at the desk (n=643)<br />

Learn in own time (n=167)<br />

Those who learn in a quiet spot away from the desk show a marked difference to the<br />

majority of respondents. Some caution should be exercised as only 32 respondents placed<br />

themselves into this segment. However, they are much less likely to use company newsletters<br />

or open days as a means of finding out about e-learning. They are more likely to select line<br />

management briefings as the communication method which worked for them. This may<br />

have something to do with either learners’ preferences or working environment although we<br />

cannot tell why they do not learn at their desk; possibly a preference for being away from a<br />

busy office, possibly they have a customer service role and need to be out of sight of<br />

customers, possibly they need to be away from ringing ‘phones in a call centre, possibly<br />

exercising a personal preference for a space in which they can reflect quietly as part of the<br />

learning process. These preferences could be explored in a further study.<br />

<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 99


8 Promoting e-learning<br />

There is a similar pattern of responses from learners about communication that keeps them<br />

interested. They are less likely to select any of the communication methods except posters,<br />

being slightly more likely to respond to posters than other segments. They are least likely to<br />

respond to give-aways.<br />

About 4 times as many respondents selected the ‘learn at home’ option (132) against the<br />

‘work at home’ option (35). It is possible that those who learn in their own time are in the<br />

same group as those who learn at home. If so, this will explain the similarity in the<br />

percentage of respondents selecting the various different methods of communication in<br />

both these segments.<br />

Based on this analysis we can see that in general e-mail is both the most frequently used<br />

method of communication and also the one learners are most likely to respond to. There are<br />

learners in special situations and perhaps with personal preferences who are more likely to<br />

respond to other methods of communication. Location is undoubtedly a factor, as is<br />

management responsibility. The successful organisation uses multiple channels of<br />

communication and based upon the evidence of this report, should also direct different<br />

styles and types of communication to learners in different situations. However, increasing the<br />

use of management briefings, newsletters and posters are effective ways of increasing takeup<br />

and improving the probability of e-learning being successful.<br />

8.2 Convenience of e-learning<br />

Providing learners with the freedom and information to manage their own development is a<br />

significant factor in influencing the impact e-learning has on them and their attitude about<br />

all other aspects of e-learning. Delivering e-learning, therefore, at locations which are<br />

convenient for them makes a significant difference.<br />

Figure 8.10 Availability and access to learning<br />

Technology allows me to learn in a place<br />

that is convenient for me<br />

I am empowered to request my own training<br />

and take ownership of my development<br />

I know what is available to me and how to obtain it<br />

I find e-learning convenient for my work schedule<br />

My manager makes time for me to learn at work<br />

e-learning gives me with more control<br />

of my own development<br />

My manager allows me work time to learn<br />

at home or locally<br />

0% 20% 40% 60% 80% 100%<br />

Agree Neutral Disagree<br />

<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 100


8 Promoting e-learning<br />

Learners feel most positive that technology allows them to learn in a place that is convenient<br />

for them. Seven out of 10 learners agree with this statement. In general there are equally<br />

positive feelings concerning the majority of the other statements reported above all of which<br />

relate to the ability of learners to take charge of when and where they learn.<br />

Respondents are less likely to agree that their manager gives them the freedom to learn<br />

where they want and more likely to agree that the technology delivers that capability. So,<br />

where do organisations make learning available? Employer respondents were asked where<br />

they made e-learning available from a choice of six locations.<br />

Figure 8.11 Where is e-learning offered and where is it done?<br />

100%<br />

80%<br />

60%<br />

40%<br />

20%<br />

0%<br />

At the desk At home In-house<br />

learning<br />

centre<br />

A quiet<br />

spot away<br />

from desk<br />

When<br />

travelling<br />

External<br />

learning<br />

centre<br />

Where is e-learning offered (n=174)<br />

Where is it done (n=1072)<br />

Ref: This graph appears as Figure 44 in <strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and training Providers<br />

Employers extending the range of locations in which learners can study. The majority of<br />

employer respondents make e-learning available at the desk; 93%. Half provide an in-house<br />

learning centre. Sixty percent make e-learning available at home. It would appear that<br />

learners do not respond by making use of these locations. However, the comparison must<br />

be viewed with some caution as the majority of employee respondents are drawn from just<br />

14 organisations that completed the employer survey. Whilst the employer survey was<br />

anonymous some of the respondents left either a name or an email address, from which it is<br />

possible to determine that at least 9 of the employer organisations deliver e-learning at the<br />

desk and 8 make it available at home, 3 at an in-house learning centre, 5 in a quiet space<br />

away from the desk and 3 when travelling. Four of the 14 employer respondents are<br />

anonymous which means we do not have a complete picture of the facilities offered to the<br />

learners who completed the employee survey. However, we can reasonably estimate that<br />

three quarters of the learner respondents would have been able to study e-learning at home<br />

but only 16% did so. A much smaller proportion, perhaps a quarter, would have had access<br />

to an in-house internal learning centre but only 3% used this as a location in which to learn.<br />

<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 101


8 Promoting e-learning<br />

8.3 Who influences learners?<br />

Learner respondents were asked who encouraged them to learn. They were given a list of 6<br />

individuals and asked to one. The list included managers (chosen by about half of<br />

respondents), a colleague (chosen by about a quarter), a training manager (chosen by<br />

about 10%), a senior executive (chosen by about 5%), a friend (chosen by about 3%) and a<br />

learning centre co-ordinator (chosen by about 1½%). The responses of learners are analysed<br />

against a number of factors. There is little difference based upon education or age<br />

differences; although there are differences dependent upon where learners work and where<br />

and when they learn.<br />

Figure 8.12 Who encourages learning varies with work and learning location<br />

When I<br />

learn<br />

in my own time<br />

in employer's time<br />

Where I learn Where I work<br />

on customer's site<br />

a regular place<br />

at home<br />

at home<br />

at my desk<br />

a quiet spot away from the desk<br />

0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%<br />

Manager Colleague Training Manager Senior Executive Friend<br />

These responses reflect the findings about promotional and communication methods. Those<br />

who learn at home are more likely to select friends and senior executives as the individual<br />

who is most likely to encourage them to learn. Those who work primarily on a customer’s site<br />

are least likely to respond to their line manager and most likely to respond to their training<br />

manager. Those who work in their employer’s time are more likely to be encouraged by their<br />

line manager than those who learn in their own time.<br />

There are some slight differences with age, in that younger members of staff are likely to be<br />

more responsive to line managers. This supports the information reported about<br />

communication; younger employees are more likely than older employees to find out about<br />

e-learning from their line manager.<br />

<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 102


8 Promoting e-learning<br />

Figure 8.13. Who encourages learning varies with age and responsibility<br />

Age is Management time<br />

Responsible for others (n=376)<br />

No responsibility for others (n=459)<br />

I manage my own time (n=778)<br />

I do not manage my own time (n=57)<br />

55 or over (n=126)<br />

40 to 54 (n=314)<br />

26 to 39 (n=292)<br />

25 or under (n=103)<br />

0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100<br />

%<br />

Manager Colleague Training Manager Senior Executive Friend<br />

8.4 Obtaining feedback<br />

Responding to learners and being seen to respond to learners is an important part of<br />

influencing the workforce. Respondents were asked to select from a list of methods those<br />

that they used to obtain feedback from learners. Respondents were given a choice of 5<br />

methods of collecting feedback plus the option of saying they did not do so.<br />

Figure 8.14 Methods used to gather learner feedback<br />

Feedback sheets following each course<br />

70%<br />

Regular surveys of user satisfaction<br />

48%<br />

Focus groups<br />

Follow up once they are back at work<br />

Team meetings<br />

29%<br />

23%<br />

31%<br />

We do not gather learner feedback<br />

7%<br />

0% 20% 40% 60% 80%<br />

Ref: This graph appears as Figure 50 in <strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers<br />

<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 103


8 Promoting e-learning<br />

It is no surprise that feedback sheets, the so-called ‘happy sheet’, are the most frequently<br />

used method of collecting feedback. This data is analysed against maturity (Figure 8.15).<br />

Figure 8.15 Mature organisations gather more feedback from learners<br />

80%<br />

70%<br />

60%<br />

50%<br />

40%<br />

30%<br />

20%<br />

10%<br />

0%<br />

Focus groups<br />

Regular surveys<br />

of user<br />

satisfaction<br />

Follow up once<br />

they are back<br />

at work<br />

Team meetings<br />

Feedback<br />

sheets<br />

following each<br />

course<br />

Less mature (n=33) Becoming mature (n=49) More mature (n=54)<br />

It is very apparent that more mature organisations put more effort into collecting feedback<br />

from their learners. A significant difference is the regular surveys of user satisfaction, where<br />

more mature organisations are twice as likely to use this method of collecting feedback. The<br />

only method that shows little difference and no consistent difference with maturity is<br />

feedback sheets following each course. These are equally frequently used by organisations<br />

irrespective of their e-learning maturity.<br />

Although feedback following a course shows no link with business impact, the collection of<br />

feedback via focus groups, team meetings, follow-up at work and regular surveys are all<br />

more likely to occur in organisations who achieve the highest business impact from their e-<br />

learning. It is worth noting that the probability of regular surveys being used increases<br />

consistently with business impact, whereas other methods of feedback collection only show<br />

a significant difference for organisations in the top quartile for business impact.<br />

We can see a similar difference with staff impact (Figure 8.17). A similar pattern emerges in<br />

that those organisations who achieve greater staff impact from e-learning are putting more<br />

effort into collecting feedback from learners. There is one noticeable difference in the<br />

analysis of feedback methods against staff impact and business impact. The probability of<br />

feedback sheets being used is independent of business impact but may influence staff<br />

impact with a slight dependency in that the organisations in the lower quartiles are slightly<br />

less likely to be using feedback sheets. However this method of feedback is least effective in<br />

terms of influencing the success of e-learning. Probably the most effective in achieving<br />

change are regular surveys of user satisfaction.<br />

<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 104


8 Promoting e-learning<br />

Figure 8.16 Business impact is enhanced by effective follow up<br />

100%<br />

80%<br />

60%<br />

40%<br />

20%<br />

0%<br />

Upper quartile 3rd quartile 2nd quartile Lower quartile<br />

Business impact<br />

Focus groups<br />

Team meetings<br />

Follow up once they are back at work Regular surveys of user satisfaction<br />

Feedback sheets following each course<br />

Ref: this graph appears as Figure 51 in <strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers<br />

Figure 8.17 Staff impact is enhanced by effective follow-up<br />

100%<br />

80%<br />

60%<br />

40%<br />

20%<br />

0%<br />

Upper quartile 3rd quartile 2nd quartile Lower quartile<br />

Staff impact<br />

Focus groups<br />

Follow up once they are back at work<br />

Regular surveys of user satisfaction<br />

Team meetings<br />

Feedback sheets following each course<br />

<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 105


8 Promoting e-learning<br />

8.5 Key actions that influence the success of e-learning<br />

The business impact, take-up and staff impact ratings are calculated for each respondent by<br />

the average of the individual ratings for the factors that make up the dimensions. The takeup<br />

rating also includes a calculation based upon the number of roles within the organisation<br />

who use e-learning. The correlation between each of these ratings and all the individual<br />

factors are calculated across data from 150 respondents. The following tables list those<br />

factors where the correlation index exceeds 0.4. The order enables organisations to prioritise<br />

those actions that are likely to make the biggest impact on e-learning success.<br />

Table 8.1 Enhancing Business Impact<br />

Factors correlated with Business Impact > 0.4<br />

Correl<br />

-ation<br />

We can provide access to a wide range of learning opportunities 0.68<br />

The visible demonstration of e-learning success within the business has helped us<br />

maintain resources allocated to learning 0.66<br />

We have a clear understanding of what types of e-learning our internal IT systems can<br />

support 0.53<br />

We are able to personalise the learning experience for each learner 0.53<br />

Change management is an integral part of our e-learning deployment and planning 0.50<br />

We regularly communicate e-learning successes to managers 0.50<br />

We provide line managers with training and briefings relating to specific e-learning<br />

courses 0.49<br />

Senior Management regularly demonstrate commitment to e-learning 0.49<br />

We provide each new e-learning initiative with a specific identity and brand 0.48<br />

Staff can access e-learning at any time 0.46<br />

We have achieved enterprise wide connectivity and collaborative working between<br />

work groups in different locations 0.45<br />

We have the skills to manage external e-learning providers effectively 0.45<br />

e-learning is helping our talent management and succession planning 0.44<br />

When we implement a new e-learning initiative we start with a pilot project before<br />

embarking on a company wide rollout 0.42<br />

Staff can access e-learning from anywhere 0.42<br />

We have audited the skills of those in the training function against the skills required<br />

for e-learning 0.42<br />

We use assessment tools to target skills needed to match work practices 0.42<br />

Our internal training team is willing to embrace new ways of working with technology 0.42<br />

Managers coach their own teams 0.41<br />

<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 106


8 Promoting e-learning<br />

Table 8.2 Enhancing staff impact<br />

Factors correlated with Staff Impact > 0.4<br />

Correlation<br />

We are able to personalise the learning experience for each learner 0.65<br />

We can provide access to a wide range of learning opportunities 0.63<br />

The visible demonstration of e-learning success within the business has helped us<br />

maintain resources allocated to learning 0.62<br />

e-learning is helping our talent management and succession planning 0.54<br />

We regularly communicate e-learning successes to managers 0.53<br />

We identify and train local champions to act as change agents 0.50<br />

Senior Management regularly demonstrate commitment to e-learning 0.50<br />

We provide each new e-learning initiative with a specific identity and brand 0.48<br />

When we implement a new e-learning initiative we start with a pilot project before<br />

embarking on a company wide rollout 0.47<br />

Change management is an integral part of our deployment and planning of e-<br />

learning 0.46<br />

Staff can access e-learning at any time 0.44<br />

We achieve external recognition of our e-learning achievements (such as<br />

conference/seminar presentations, awards, quality marks) 0.44<br />

Learners have regular access to a mentor, coach or buddy with whom they have a<br />

personal relationship for the duration of a course 0.43<br />

Staff can access e-learning from anywhere 0.41<br />

We have achieved enterprise wide connectivity and collaborative working<br />

between work groups in different locations 0.41<br />

<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 107


8 Promoting e-learning<br />

Table 8.3 Enhancing take-up of e-learning<br />

Factors correlated with Take-up of e-learning > 0.4<br />

Correlation<br />

The visible demonstration of e-learning success within the business has helped us<br />

maintain resources allocated to learning 0.74<br />

We can provide access to a wide range of learning opportunities 0.73<br />

We regularly communicate e-learning successes to managers 0.50<br />

We provide each new e-learning initiative with a specific identity and brand 0.47<br />

Change management is an integral part of our deployment and planning of e-<br />

learning 0.47<br />

Senior Management regularly demonstrate commitment to e-learning 0.46<br />

We have a clear understanding of what types of e-learning our internal IT systems can<br />

support 0.45<br />

There has been an increase in customer satisfaction since staff have had more<br />

access to e-learning 0.43<br />

We provide line managers with training and briefings relating to specific e-learning courses 0.43<br />

We use assessment tools to target skills needed to match work practices 0.43<br />

We are able to personalise the learning experience for each learner 0.43<br />

Tracking e-learning progress is essential for compliance purposes 0.43<br />

Staff can access e-learning from anywhere 0.40<br />

In completing the correlation calculations there was one factor that was close to zero in its<br />

correlation with the impact ratings of business, staff and uptake. This was the statement<br />

“Staff only study courses that are relevant to the work they are doing now or will do in the<br />

short-term future”. All other correlations exceeded 0.2, however the correlation for this factor<br />

was below 0.1. This is a strong indication that this particular factor is completely independent<br />

of the success, or otherwise, of e-learning. The implication is that those organisations who<br />

invest in learning credits so that employees can study content not directly relevant to their<br />

work, are unlikely to make a difference to the success of e-learning by this action although<br />

neither is it a detrimental activity. The correlation between this factor and positive changes<br />

in the behaviour and attitude of staff is 0.04. There are a number of other activities that<br />

would appear to be of uncertain value because of these lower correlation scores. Access to<br />

a mentor, coach or buddy also shows a weak relationship with any of the impact measures.<br />

<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 108


9 The changing face of e-learning<br />

9 <strong>Towards</strong> <strong>Maturity</strong> – The changing face of e-learning<br />

Overview: This Chapter considers the increasing provision of informal learning opportunities<br />

and the uptake by learners. It explores the various types of provision and the degree to<br />

which learners find them both helpful and useful.<br />

9.1 Informal learning and the views of learners<br />

Finding things out for themselves is an important part of learning for all learners. Respondents<br />

were asked to agree with the following 2 statements: “I learn most by finding things out for<br />

myself”; “I learn most from Courses provided to me”. Specifically they were asked: “Please<br />

consider the following 2 statements and score your agreement with each statement out of<br />

10. Please note that you cannot agree with both but you might mark both as 5 if you learn<br />

equally in both ways. Ideally the 2 scores should add up to 10, or close to 10.” Inspection of<br />

the scores indicates that only 2 or 3 learners failed to allocate a score of 10 between each<br />

one of these statements. The average agreement with the first statement is 6 and the<br />

average agreement with the second statement is 4. We may interpret from this that 60% of<br />

what is learnt is done so when learners find things out for themselves.<br />

Learner respondents were asked a number of questions relating to their use of informal<br />

learning methods. One is “Outside of the formal training programmes, how else do you go<br />

about learning things in relation to your work?” This question has a choice of 8 categories<br />

and the option to describe other ways in which they learn. Respondents could state whether<br />

the method was very helpful, helpful, used by them and not used by them as shown in Figure<br />

9.1.<br />

Figure 9.1 How learners are building their skills and knowledge<br />

Searching the web<br />

Conversations<br />

Online reference<br />

Books<br />

Industry publications<br />

Printed job aids<br />

Electronic help and job aids<br />

Participating in online communities<br />

(discussion groups)<br />

0% 20% 40% 60% 80% 100%<br />

n=736<br />

Frequently used & very helpful Used and helpful Used Not used<br />

Ref: This graph appears as Figure 35 in <strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers<br />

<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 109


9 The changing face of e-learning<br />

Learners were offered the opportunity to include additional methods of informal learning;<br />

10% did so but almost all of those are specific examples of methods listed above. Three<br />

comments stood out; 2 mentioned CPD and professional institute support and one<br />

mentioned “experimenting”, a healthy approach to learning from mistakes.<br />

The responses are analysed by age, gender, education level, management responsibility<br />

and work circumstances. The difference in the percentage of users for each of these<br />

informal methods varies across these segments. The 2 methods which varied least were<br />

electronic help and printed job aids where variation between all segments do not exceed<br />

10%. The 3 informal methods showing the greatest variation were amongst the ones most<br />

likely to be used: searching the Web, conversation and books, all of which showed a<br />

variation of about 30% between being least likely and most likely, depending on segment.<br />

9.1.1 Searching the Web<br />

Male respondents are slightly more likely to search the Web (56%) than female respondents<br />

(46%). Variation by age is less distinctive, with respondents aged 26 to 39 being most likely to<br />

search the Web (56%) and older learners least likely (47%). Location for where people learn<br />

shows a bigger difference; 62% of those who learn at home will search the Web, compared<br />

to only 30% at an internal learning centre. About half of those who learn in other locations<br />

will search the Web. Those who learn in their own time are slightly more likely to search the<br />

Web (58%) than those who learn in company time (50%). Not surprisingly work location has<br />

an impact with those working from home who are more likely to search the Web at 59%, than<br />

those who work in other locations (about half). Education level shows a consistent<br />

difference; those who achieve a higher standard of education are more likely to search the<br />

Web - 55% of graduates compared to 38% of those educated to 16.<br />

9.1.2 Conversations<br />

Those with a higher educational attainment are more likely to say they use conversations to<br />

learn from. Work location makes a difference, with only 41% of those working at home able<br />

to use conversations to learn from compared to about half in other work locations. Of those<br />

who learn in a quiet space 71% selected conversations as a means of learning, however<br />

there were only 32 respondents in this category so this difference should be viewed with<br />

some caution. Gender makes a small difference, with 45% of males and 52% of females<br />

saying they learn through conversations.<br />

9.1.3 Books, on-line reference and industry publications<br />

These 2 sources of informal learning show a similar pattern in probability of use by<br />

segmentation. Those who learn at home (28%) are more likely to use both sources, those<br />

who use an internal learning centre least likely (10%). This is mirrored by: those who work at<br />

home, where over a third use books and on-line references. This difference should be<br />

viewed with some caution, as there are only 35 respondents in this group. Books, unlike online<br />

reference, do show a significant and consistent change with education levels. Six<br />

percent of those educated to 16 will use books as a source of learning, compared to 26% of<br />

those educated to graduate level. Education levels affect the use of industry publications<br />

but this is not so exaggerated, with 6% of those educated to 16 using such publications and<br />

23% of those educated to graduate level. Those who learn in their own time are also more<br />

likely to use books, on-line reference and industry publications than those who work in<br />

company time.<br />

<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 110


9 The changing face of e-learning<br />

9.2 Technologies supporting informal learning<br />

Learners were asked their views of a range of technologies, some of which specifically<br />

support the type of informal learning shown in Figure 9.2.<br />

The 4 technologies that are most likely to be considered useful by learners are all associated<br />

with searching facilities. That is, learners who use technology to find out information for<br />

themselves in the absence of others. Over half of all respondents find this type of tool useful.<br />

The number of learner respondents who say that discussion boards and blogs and wikis are<br />

useful (27% and 17% respectively) is slightly more than those who say that participating in online<br />

discussion is both helpful and very helpful, a total of 18%.<br />

Figure 9.2 Technology supporting informal learning – learners’ views<br />

Search engines<br />

General web reference source<br />

Specific web reference source<br />

Searchable online books<br />

Discussion Boards<br />

Blogs/wikis<br />

0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%<br />

Useful Not Useful Not Available<br />

Participating in on-line communities is the least used method of informal learning, used by<br />

only 34% of learner respondents. Age, education and work and learning circumstances all<br />

impact upon learners’ views. On-line communities are apparently a greater asset to those<br />

who work from home and to the older learner. Female learners and those of lower<br />

educational attainment are less likely to find on-line communities very helpful.<br />

Discussion boards on the other hand do not seem to be placed in the same category as online<br />

communities in the perceptions of users (Figure 9.3). Younger people have a preference<br />

for discussion boards, 33% perceive these to be helpful or very helpful as opposed to on-line<br />

communities where only 14% perceive them to be very helpful or helpful. It may be that an<br />

on-line community is perceived to be more formal than a discussion board or blogs/wikis.<br />

Work and learning circumstances have a big impact on the use of these informal tools.<br />

Those who work from home are the group most likely to be part of on-line communities, use<br />

discussion boards and contribute/learn from blogs/wikis.<br />

<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 111


9 The changing face of e-learning<br />

Figure 9.3 Discussion boards – which learners find them most useful?<br />

Learn at home<br />

Work on site<br />

Age is 25 or under<br />

Responsible for others<br />

Learn in own time<br />

Education to 18<br />

Age is 55 or over<br />

Education to Graduate level<br />

Female<br />

Work from home<br />

I manage my own time<br />

Work at a regular place<br />

Age is 26 to 39<br />

My time is managed for me<br />

Learn in company time<br />

Male<br />

Learn at the desk<br />

Education to 16<br />

Age is 40 to 54<br />

No management responsibility<br />

Education to Post 18<br />

0% 5% 10% 15% 20% 25% 30% 35% 40%<br />

The use of blogs and wikis shows a similar usage pattern to that of discussion boards although<br />

with overall less frequency; as expected for a relatively new technology. Education levels<br />

seem to have a greater impact on the probability of learners using blogs and wikis than it<br />

does for discussion boards. It is somewhat surprising to see that those who work from home<br />

are amongst the group most likely to use discussion boards but least likely to use blogs and<br />

wikis. Users do not perceive these software tools as comparable or serving the same<br />

purpose. Neither do users directly relate participation in on-line communities with the use of<br />

discussion boards or blogs/wikis.<br />

<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 112


9 The changing face of e-learning<br />

Figure 9.5 Use of blogs/wikis – which learners find them most helpful?<br />

Learn at home<br />

Education to Graduate level<br />

Learn in own time<br />

Age is 55 or over<br />

Work at a regular place<br />

Responsible for others<br />

Age is 26 to 39<br />

Age is 40 to 54<br />

I manage my own time<br />

Female<br />

Male<br />

Learn at the desk<br />

No management responsibility<br />

Learn in company time<br />

Work on customer site<br />

My time is managed for me<br />

Age is 25 or under<br />

Education to 16<br />

Education to Post 18<br />

Education to 18<br />

Work from home<br />

0% 5% 10% 15% 20% 25%<br />

9.3 Learners’ willingness to contribute<br />

Learner respondents were asked: “Are you willing to use technology to share your knowledge<br />

to help others learn (e.g. contributing to discussions rooms, etc.)? They were allowed 4<br />

possible responses as shown in Figure 9.4.<br />

The bottom line in this figure reports the responses from all learners who participated in the<br />

survey. Eighty-four percent of respondents were either already using technology to help<br />

others learn or would do so if they had the opportunity. The 26% who already do so is a close<br />

match to the 27% who find discussion boards useful and the 17% who find blogs/wikis useful.<br />

As on-line communities are only considered to be helpful by 18% of respondents it would<br />

seem that learners have a preference for using other forms of collaborative technology<br />

rather than on-line communities. Some differences emerged based upon the management<br />

responsibility of the respondent. Those who manage their own time are more likely to be<br />

willing to contribute to the learning of others through technology as are individuals with<br />

management responsibility for others.<br />

Responses to this question were also segmented on work circumstances, where a number of<br />

differences emerged. Those who work from home are most likely to be already using<br />

technology to help others learn. They are also most likely to say they would feel<br />

uncomfortable doing so, possible because their working relationships with others are not<br />

sufficiently social. Those who learn in their own time are also more likely to help others.<br />

<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 113


9 The changing face of e-learning<br />

Figure 9.4 Willingness to use technology to help others learn (by responsibility)<br />

Responsible for others<br />

No responsibility for others<br />

I manage my own time<br />

My time is managed for me<br />

All<br />

0% 20% 40% 60% 80% 100%<br />

I already do<br />

I would feel uncomfortable<br />

If I had the opportunity<br />

I don't have the time<br />

Figure 9.5 Willingness to use technology to help others learn (by time/location)<br />

Learn in company time (590)<br />

Learn in own time (148)<br />

Work on customer site (49)<br />

Work from home (32)<br />

Work at a regular place (653)<br />

Learn in a quiet spot (28)<br />

Learn at the desk (570)<br />

Learn at home (119)<br />

Learn at an internal centre (20)<br />

0% 20% 40% 60% 80% 100%<br />

I already do<br />

I would feel uncomfortable<br />

If I had the opportunity<br />

I don't have the time<br />

Not surprisingly a picture emerges that those who are in a position to take more control over<br />

their learning, because they work at home, or because they manage their own time, are<br />

more likely to wish to contribute to the development of others using remote methods.<br />

<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 114


9 The changing face of e-learning<br />

9.4 Informal methods and tools – the employers view<br />

If employees are willing to help other people and use a wide variety of informal learning<br />

methods and supporting software tools, how are employers intending to respond?<br />

Figure 9.6 Informal methods in supporting technologies<br />

On-line books / job aids<br />

64%<br />

3%<br />

Video conferencing<br />

Content Management Systems<br />

Search Portals<br />

On-line company experts<br />

52%<br />

45%<br />

49%<br />

49%<br />

8%<br />

15%<br />

4%<br />

3%<br />

Virtual classroom<br />

Unmoderated chat rooms/discussion groups<br />

Moderated chat rooms/ discussion groups<br />

Communities of practice<br />

38%<br />

36%<br />

32%<br />

43%<br />

13%<br />

14%<br />

17%<br />

4%<br />

Blogs/wikis<br />

19%<br />

15%<br />

0% 20% 40% 60% 80%<br />

n=164<br />

Currently in use<br />

Planned within 3 years<br />

The percentage indicating that they are planning to use particular technologies is<br />

consistently greater than that for planning additional informal services or methods. It seems<br />

as if employer respondents think about the technology first and its application to learning<br />

second. It may also be indicative of the fact that publications and conferences tend to<br />

focus on the technologies that are being developed rather than the service that may be<br />

provided as a result.<br />

It is apparent from this that the tools which support social learning (blogs/wikis, moderated<br />

chat rooms, un-moderated chat rooms, virtual classrooms and, possibly content<br />

management systems/virtual learning environments) indicate a 30% growth rate; almost 80%<br />

in the case of blogs/wikis. This possible 30% growth rate must be balanced by an 8% growth<br />

in communities of practice and it may well be that organisations yet have to define how they<br />

will use social software and the types of services they will be delivering through them.<br />

However, almost 70% of the more mature organisations are using communities of practice;<br />

this drops to between one-third and one-fifth of organisations that have not yet reached a<br />

high level of maturity. This would indicate a much faster growth in communities of practice<br />

than is indicated by the previous figure. On the assumption that it takes between 2 to 3 years<br />

for an organisation to become mature we may predict a growth in communities of practice<br />

of 80%.<br />

<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 115


9 The changing face of e-learning<br />

Figure 9.7 Informal services and supporting technologies by maturity<br />

80%<br />

60%<br />

40%<br />

20%<br />

0%<br />

Search<br />

portals<br />

On-line<br />

experts<br />

Communities<br />

of practice<br />

Online<br />

books/job<br />

aids<br />

CMS / VLE<br />

Virtual<br />

classrooms<br />

Unmoderated<br />

chat rooms<br />

Moderated<br />

chat rooms<br />

Video<br />

conferencing<br />

Blogs/wikis<br />

Less mature (n=54) Using<br />

More mature (n=83) Using<br />

Becoming mature (n=75) Planned<br />

Becoming mature (n=75) Using<br />

Less mature (n=54) Planned<br />

More mature (n=83) Planned<br />

Based on this maturity analysis, search portals and the availability of on-line company experts<br />

show a 30% growth rate as opposed to about 10% predicted from the previous graph.<br />

Combining the 2 methods of forecasting indicates a growth rate of closer to 20% by 2010.<br />

The provision of on-line books and job aids may well be close to saturation, with 64% of all<br />

respondents providing this service, 74% of more mature users. Video conferencing may well<br />

have peaked as well, although 8% of organisations predict they will be using this technology<br />

by 2010 in addition to the 56% already using it. There is less difference with maturity (45% to<br />

56%) indicating that this is not a technology whose use is linked to maturity although planning<br />

to use it may be with 13% of the more mature doing so compared to 5% of the less mature.<br />

Growth rate of this technology is more difficult to predict from this survey; perhaps because<br />

its use is driven by corporate goals not associated with learning.<br />

The collaborative tools of virtual learning environments, virtual classrooms and both<br />

moderated and un-moderated chat rooms show a significant difference between usage by<br />

the more mature and the less mature.<br />

Approximately half of the more mature organisations will be using these technologies<br />

compared to about one-third of the less mature. With the exception of VLEs/CMS, a greater<br />

percentage of the more mature organisations are planning to introduce these technologies<br />

within the next 3 years; typically 10% as opposed to about 18%. For VLEs/CMS the results are<br />

reversed with 20% of the less mature planning to introduce CMS/VLE compared to 12% of the<br />

more mature. The CMS/VLE has a number of different functions, at one extreme it may be<br />

considered primarily as a means of managing and delivering content. At the other extreme<br />

it may be considered as a means of facilitating groups and teams of people working<br />

together to create both learning content and conducting and collaborating on learning<br />

activities. Whatever the reason for this difference an analysis of use by maturity indicates a<br />

growth rate of 100%.<br />

<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 116


9 The changing face of e-learning<br />

For the majority of social learning and social software tools more mature organisations are<br />

almost twice as likely to use these tools as the less mature. The exception to this is blogs and<br />

wikis, which are used by 25% of the more mature and approximately 17% of others. However,<br />

these are new technologies and concepts and, even the more mature organisations will<br />

have had little time to assess their capability of delivering learning and consider the best way<br />

of deploying them. Wikipedia was created in 2001 and is the best known example of a wiki,<br />

The use of this type of collaborative Web site took 2 to 3 years to move from a mainly<br />

academic purpose into various types of corporate applications. We see almost as many of<br />

the more mature organisations planning to use blogs and wikis as are currently using them.<br />

This indicates a growth rate of 100% amongst the more e-learning mature organisations.<br />

Employer respondents were segmented into quartiles based upon both staff impact and<br />

business impact. Organisations in the top quartile for both business impact and staff impact<br />

are more likely to be using various informal techniques for enabling learning. It would appear<br />

that the use of on-line books/job aids has the greatest effect on business impact; 47% of<br />

those in the bottom quartile of business impact will be providing this service, compared to<br />

85% of those in the top quartile. The availability of both on-line communities and search<br />

portals appear to have the greatest effect on staff impact. Of those who achieve least staff<br />

impact 21% will deliver on-line communities and 26% make search portals available. For<br />

organisations that achieve the greatest staff impact from e-learning this rises to 65% for online<br />

communities and 75% for search portals.<br />

Investment in on-line books and job aids is likely to show the greatest business return and<br />

investment in search portals and on-line communities is likely to show the biggest change on<br />

staff motivation and behaviour. The inference is that on-line books and job aids are focused<br />

directly at job performance, whereas alternative methods of informal learning bring greater<br />

satisfaction to users but the effect on the business may be slightly diluted because such<br />

services enable learners to explore and learn topics not directly related to their immediate<br />

job performance.<br />

Figure 9.8 Use of informal techniques compared to staff impact of e-learning<br />

80%<br />

60%<br />

40%<br />

20%<br />

0%<br />

Top quartile 3rd quartile 2nd quartile Bottom quartile<br />

Staff Impact<br />

Search portals<br />

Online communities<br />

Online company expertise<br />

Online books/job aids<br />

<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 117


9 The changing face of e-learning<br />

Figure 9.9 Use of informal techniques compared to business impact of e-learning<br />

100%<br />

80%<br />

60%<br />

40%<br />

20%<br />

0%<br />

Top quartile 3rd quartile 2nd quartile Bottom quartile<br />

Business impact<br />

Search portals<br />

Online communities<br />

Online company expertise<br />

Online books/job aids<br />

9.5 Spend on e-learning<br />

One hundred and thirteen respondents provided information about the budgets they spent<br />

on e-learning. Respondents were asked what percentage of their overall training budget<br />

was currently spent, by what percentage of the current budget this was expected to<br />

increase and an estimate of the overall training budget for their organisation. In some cases<br />

respondents withheld overall budgets. The average percentage of total training budgets<br />

spent on e-learning is 17%. The average forecast growth in this expenditure is 70%.<br />

Combining these 2 pieces of information we may assume that by 2010, 26% of training<br />

budgets will be spent on e-learning. This forecast is comparable to one in 2004 predicting<br />

that between 30% and 33% of learning inside organisations would be delivered by e-<br />

learning. 4<br />

There is considerable variation in these figures when compared by sector and maturity.<br />

Figure 9.10 reports the current and projected percentage of total training budgets spent on<br />

e-learning for those sectors where at least 10 respondents completed usable budget<br />

information. Two sectors stand out as being leaders in investment in e-learning; education<br />

and IT/telecommunications spend a greater part of their budget on e-learning than<br />

organisations in other sectors.<br />

More mature organisations spend a greater proportion of their training budget on e-learning<br />

(23%) than do the least mature (6%). Less mature organisations do expect to double their<br />

budget to 12% and the more mature expect to increase their budget to 36% (Figure 9.11).<br />

4 Report on Embedding e-learning in large Organisations, Hills (2004) published byUfi.<br />

<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 118


9 The changing face of e-learning<br />

Figure 9.10 e-learning budget plans vary with sector<br />

50<br />

40<br />

% budget<br />

30<br />

20<br />

10<br />

0<br />

Health (10)<br />

Manufacturing<br />

(11)<br />

Transport (11)<br />

IT & Telecoms<br />

(12)<br />

Finance (15) Education (20) Public admin<br />

(21)<br />

n=100<br />

Current spend on 'e' Planned spend on 'e' in 2010<br />

Ref: See also Figure 57 in <strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers<br />

Figure 9.11 e-learning budget plans very with maturity<br />

70%<br />

60%<br />

50%<br />

40%<br />

30%<br />

20%<br />

10%<br />

0%<br />

n=113<br />

Novice Sporadic Developing Established Embedded Innovators<br />

% Spend Predicted increase<br />

Ref: This graph appears as Figure 58 in <strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers<br />

<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 119


9 The changing face of e-learning<br />

Figure 9.12 Percentage of budget spent on e-learning<br />

8.00<br />

7.00<br />

6.00<br />

5.00<br />

4.00<br />

3.00<br />

2.00<br />

1.00<br />

0.00<br />

Budget > 30%<br />

n=25<br />

Budget 20 - 30%<br />

n=12<br />

Budget 10 - 20%<br />

n=23<br />

Budget < 10%<br />

n=53<br />

Take up Availibility Business Impact Staff Impact<br />

Organisations who responded with budget information were segmented by the proportion of<br />

their budget they spent on e-learning. The segments used were those who spent less than<br />

10%, those who spent between 10 and 20%, those between 20 and 30% and those who spent<br />

more than 30% of their total training budget on e-learning. This does not produce equal<br />

numbers of organisations in each segment and, as can be seen, almost half of all<br />

respondents supplying budget information spend less than 10% on e-learning. This graph<br />

does show that those who spend a greater proportion of their budget on e-learning achieve<br />

improved take-up, availability, business impact and staff impact. Average agreement with<br />

the various statements that are used to describe staff impact rises from 4.3 to 6. This is closely<br />

mirrored by the measurement of take-up from 4.4 to 6.3.<br />

The greatest difference with increasing budget is on business impact, which rises from an<br />

average agreement of 5 to an average agreement of 7. The change in availability shows<br />

least difference. Those organisations who spend more must therefore be channelling this<br />

expenditure into areas that have a greater effect on business impact than on the availability<br />

of e-learning. Given the analysis so far completed, it is likely that this increased budget<br />

spend goes towards change management and promotional activities and it is this that<br />

increases the business impact, staff impact and take-up of e-learning. Global companies<br />

spend a greater proportion of their budget (18%) than other organisations, except for those<br />

operating from one UK site. Global companies also predict that they will increase their e-<br />

learning spend by a greater amount (20%) than other companies. Elsewhere in the report<br />

the anomaly of the single UK site companies is discussed and can be seen reflected in the<br />

budget spend, as their average is 27%. This seems to be influenced by the small number of<br />

education companies in this particular segment who seem to be investing in e-learning as a<br />

delivery platform for the future.<br />

<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 120


10 The education sector<br />

10 Comparison of education sector with other sectors<br />

Overview: This section investigates differences between the education sector and other<br />

sectors. There is a probability that organisations in the education sector do things differently<br />

to others. There may be opportunities for other sectors to learn from the education sector, the<br />

opposite may also apply.<br />

An initial comparison for the principal dimensions is shown in Figure 10.1. Organisations not in<br />

the education sector rate themselves one point higher than organisations in the education<br />

sector for all 4 dimensions. It would appear that non-educational organisations are more<br />

successful at e-learning than those in the education sector. They achieve greater<br />

availability, more business impact, a greater uptake and e-learning has a greater impact on<br />

employees.<br />

Figure 10.1 Differences in dimensions – education sector versus others<br />

7.00<br />

6.00<br />

5.00<br />

4.00<br />

3.00<br />

2.00<br />

1.00<br />

0.00<br />

Uptake Availability Business Impact Staff Impact<br />

Others (n=127)<br />

Education sector (n=22)<br />

Table 10.1 lists those factors with a difference between the education sector and others of<br />

more than 10%: where the education sector has a higher self perception this is never more<br />

than a 3% difference. The first and third items listed are both associated with change<br />

management and promotion of e-learning. The education sector uses fewer communication<br />

methods when launching e-learning than other sectors. Less than a quarter use posters, as<br />

opposed to almost half of others. The education sector makes no use of giveaways at<br />

launch, compared to 10% of organisations in the other sectors. However, 10% of<br />

organisations in the education sector do use SMS messages. The education sector does use<br />

giveaways to maintain interest but makes less use of line management briefings.<br />

<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 121


9 The education sector<br />

Table 10.1 Significant differences in self-perception ratings<br />

Other Sectors<br />

Education<br />

Sector<br />

Recorded<br />

difference<br />

Change management used 6.13 4.26 1.86<br />

Impact on record keeping 5.85 4.00 1.85<br />

Brand and identity for e-learning 5.51 3.95 1.56<br />

Information easy to use 8.33 7.00 1.33<br />

Appraisal used 6.95 5.74 1.21<br />

Manager's coach teams 6.00 4.79 1.21<br />

Skills to manage providers 6.82 5.63 1.19<br />

Skills audit completed 4.79 3.68 1.11<br />

Importance of compliance tracking 6.82 5.74 1.08<br />

Staff know what is available 6.50 5.53 0.98<br />

It would appear that the education sector could learn from other sectors as regards<br />

promotion, marketing and change management for e-learning. The fact that non-education<br />

sector organisations do more marketing will explain the difference of almost 20% in the self<br />

rating perceptions of change management and branding.<br />

There is a 20% difference in the impact e-learning has on record keeping. Companies in the<br />

education sector tend to disagree with the statement ‘e-learning has improved our record<br />

keeping for compliance purposes’. Education sector respondents may feel compliance is<br />

not relevant or they may feel that proper attention is paid to record keeping for compliance<br />

purposes so e-learning has less of an impact.<br />

Managerial support through appraisal and coaching appears to be less successful in the<br />

education sector. Although as reported later in this section it does occur more often.<br />

The education sector perceives itself to be slightly less likely to have the skills to manage e-<br />

learning providers and will tend to disagree with the statement that they have audited their<br />

training function for the skills required to deliver e-learning. If the results of implementing e-<br />

learning in the education sector are different to those of other sectors perhaps the drivers are<br />

different.<br />

<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 122


10 The education sector<br />

10.1 Comparison of probability of drivers being selected<br />

Figure 10.2 Drivers for e-learning<br />

Increase access to learning<br />

Increase flexibility in providing staff training<br />

Better manage or administer work-based learning<br />

Develop a better qualified workforce<br />

Reduce training costs<br />

New regulations and legal requirements<br />

Demand from workforce<br />

Maintain public image of a progressive and<br />

innovative organisation<br />

Organisational change<br />

Pressure from senior management<br />

0% 20% 40% 60% 80%<br />

Others N=171 Education Sector N=41<br />

Figure 10.2 shows the probability of respondents selecting from one of the 14 drivers (only<br />

displayed where there was a difference of more than a few percentage points between the<br />

education and other sectors). About half of those in the education sector are interested in<br />

increasing flexibility through the use of e-learning, compared to almost three-quarters of<br />

those in other sectors. Only a third are influenced by a need to reduce training costs<br />

compared to a half of those in other sectors. They appear to be less driven by a need to<br />

respond to new regulations and legal requirements; only 10% compared to over 25% in other<br />

sectors. Access and flexibility do remain the 2 most frequently cited drivers, as they do for all<br />

other sectors. However, administration and qualifications are slightly more likely to be<br />

selected than a need to reduce costs.<br />

Those in the education sector are more likely to be driven by organisational change and the<br />

requirement to maintain the image of a progressive and innovative organisation. They also<br />

experience more pressure from senior management, although this remains an infrequently<br />

selected driver even for the education sector.<br />

The pattern emerges where image and organisational change matter to a much greater<br />

extent for this sector and cost, qualifications and administration matter less. Whilst the<br />

emphasis for e-learning is different; does this translate into different results?<br />

Companies in the education sector are less likely to provide training in every topic area<br />

except that of literacy and numeracy, although less than 40% offer these topics. Where<br />

training is offered in a particular topic e-learning is used less than by other sectors, except for<br />

foreign language training; 24% use e-learning for foreign language training in the education<br />

sector, as opposed to 19% in other sectors.<br />

<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 123


9 The education sector<br />

For programmes leading to qualifications the picture is different. Educational organisations<br />

are marginally more likely to use e-learning in apprenticeship training, foundation degrees<br />

and learning programmes for customers, suppliers and community programmes. The<br />

education sector is leading the way in deploying e-learning for programmes which lead to<br />

qualifications. However, less than a quarter of organisations in this sector are deploying e-<br />

learning in this way.<br />

Companies in the education sector are less likely to deliver e-learning to as many roles as<br />

those in other sectors. This is most noticeable at a senior level, where only 40% of<br />

organisations deliver e-learning to directors and senior management, compared to 53% in<br />

other sectors. Bearing in mind what we already know about the importance of the<br />

leadership role for directors in setting an example in the use of e-learning, it may be that this<br />

is one of the main influences on the reduced performance of the education sector reported<br />

in Figure 10.1. Possibly the most important item that the education sector can learn from<br />

others is that directors and senior managers should use e-learning personally.<br />

Companies in the organisation sector also deliver e-learning to fewer places than others,<br />

most noticeably only 17% deliver e-learning in a quiet area (43% in other sectors) and only<br />

13% make it available when travelling (23% in other sectors).<br />

Educational organisations are also more likely to have a strategy (42%) than others (31%).<br />

The training function is less likely to be a decision maker in deploying e-learning (35% in<br />

education and 65% in others).<br />

10.2 Sourcing and development of e-learning<br />

Only 15% of those in the education sector use rapid development tools designed for users,<br />

compared to 50% in other sectors. They prefer to use tools designed for Web experts and<br />

programmers (54%) compared to other sectors (27%). They are less likely to work in<br />

partnership with an e-learning vendor (47% for other sectors compared to 27% for the<br />

education sector). They are more likely to work in partnership with other educational suppliers<br />

(23% as opposed to 16% for others). A picture emerges where the education sector develops<br />

more complex and less procedurally based e-learning, more likely working with others in the<br />

same sector.<br />

10.3 Funding<br />

Educational organisations make more use of public funding than others with a much greater<br />

likelihood of pursuing European and RDA funding. Only 60% use their own budget for e-<br />

learning, compared to 76% in other sectors. Those in the education sector clearly take a<br />

much wider view of where they can obtain funding from; whether they are private or public<br />

funded organisations. They demonstrate a better understanding of the various routes used to<br />

fund education and training, both in the UK and the European Union.<br />

10.4 Learner support<br />

The education sector makes significantly more effort to support learners than those in other<br />

sectors. Figure 10.3 shows the probability of organisations supporting learners.<br />

<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 124


10 The education sector<br />

Figure 10.3 Support provided to learners<br />

Techncial<br />

support Study Support<br />

With a tutor by email<br />

With a tutor by phone<br />

In person before<br />

on-line web reference<br />

In person during study<br />

Virtual classroom system<br />

In person after study<br />

Through a resource centre<br />

By email<br />

Telephone help desk<br />

In person<br />

Web resource<br />

0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%<br />

Education sector (n=22)<br />

Others (n=127)<br />

Ref: This graph appears as Figure 42 in <strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers<br />

Apart from support through a resource centre, the education sector is more likely to support<br />

learners by any one of the options offered by the survey questions. They are almost twice as<br />

likely to use telephone and in-person support as those in other sectors. This is also true, in the<br />

main, for technical support. It is equally likely that organisations in either of the sectors being<br />

considered will provide support through a telephone help desk or a Web resource. It is more<br />

likely that that companies in the education sector provide support either by email or in<br />

person. The education sector puts more effort into supporting learners and makes a greater<br />

provision for personal contact for technical support.<br />

Does this increased support also apply to help in consolidating learning?<br />

The education sector makes more use of line manager coaching and feedback. However<br />

this conflicts with earlier evidence, where those in the education sector were more likely to<br />

disagree with the statement ‘managers coach their own teams’. They are more likely to say<br />

that line manager coaching and feedback support is provided to help learners consolidate<br />

and apply what they have learnt but marginally less likely to agree that line managers coach<br />

their teams. The difference is small, nevertheless only one-third of organisations agreed with<br />

the Likert self-perception question that managers coach their own teams and 50%<br />

disagreed. This compares to 48% of non-educational organisations who agree that<br />

managers coach their own teams and only 13% disagree. What appears to be a positive<br />

attribute of the education sector; greater occurrence of line managers coaching support<br />

after learning may not fully translate to effective coaching as normal practice. The<br />

education sector makes less use of periodic re-assessment as a line management function.<br />

The education sector makes less use of electronic help and job aids, which are normally used<br />

for procedural tasks in which the education sector may be less interested.<br />

<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 125


9 The education sector<br />

Figure 10.4 Help in consolidating learning<br />

Line manager coaching and feedback support<br />

Job related assignments<br />

Reference books<br />

Periodic re-assessment<br />

Printed job aids<br />

Electronic help and job aids<br />

0% 10% 20% 30% 40% 50% 60%<br />

Education sector (n=22)<br />

Others (n=127)<br />

10.5 Technologies used and considered<br />

Respondents were asked questions about the formal and informal software tools and<br />

resources they knew about, they used or planned to use.<br />

Figure 10.5 Learning technologies in use<br />

Content Management System (CMS, VLE)<br />

Moderated chat rooms / discussion groups<br />

Blogs/wikis<br />

Podcasting<br />

Video on demand<br />

Non-moderated Chat rooms / discussion groups<br />

Mobile learning<br />

Games & simulations<br />

Open source tools<br />

Video conferencing<br />

Rapid development tools<br />

Competency Management System<br />

Learning Management System (LMS)<br />

Virtual classroom<br />

Electronic Performance Support Systems<br />

e-portfolios<br />

0% 5% 10% 15% 20% 25% 30%<br />

Education sector (n=22)<br />

Others (n=127)<br />

<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 126


10 The education sector<br />

Figure 10.5 plots the probability of organisations in either sector stating that they currently use<br />

the technologies listed. The upper part lists technologies that those in the education sector<br />

are more likely to use, the lower those they are less likely to use. The education sector is more<br />

likely to use the collaborative tools of social learning; that is chat rooms, virtual classrooms<br />

and blogs/wikis. They are also likely to make more use of open source tools and podcasting.<br />

Noticeable differences between the two sectors concern electronic performance support<br />

systems (EPSS) and competency management. EPSS is specifically designed to support<br />

procedural or system use applications and lends itself to quite complex cognitive tasks such<br />

as diagnostics and fault finding. It does not necessarily reinforce understanding. Additionally<br />

EPSS may be quite expensive to develop and therefore require a very robust business case in<br />

a subject area showing significant revenue return. Competency management systems are<br />

primarily used to monitor and assess the capability of individuals, or a group of individuals,<br />

against defined competencies for a specific job or jobs. Its most significant application is in<br />

managing the HR capability of an organisation as represented by the people it employs.<br />

The education sector are twice as likely to be using e-portfolios, approximately half of<br />

respondents in the education sector selected this as a technology they were deploying<br />

compared to a quarter of those in the non-education sector.<br />

10.6 The future - do educational organisations have a different view?<br />

In terms of the main barriers to the increasing use of e-learning by 2010 there are only 3 of the<br />

barriers where the view of the education sector is significantly different to that of others.<br />

Unreliable ICT is considered a barrier by relatively few educational organisations (8%)<br />

compared to 26% of those in other sectors. Additionally access to PCs is cited by fewer<br />

educational organisations, 4% as opposed to 9% of others. Half of them perceive a lack of<br />

skills to manage e-learning in the future as a barrier and this compares with only 31% of those<br />

in other sectors. This is somewhat supported by Table 10.2 which shows the difference in<br />

agreement on a variety of statements related to Training Function capability.<br />

Table 10.2 Capability of the training function<br />

Education<br />

sector<br />

Other<br />

sectors<br />

We have the skills to manage external e-learning providers effectively 5.6 6.8<br />

We have good links/relationships with the IT department 6.7 6.9<br />

We have a clear understanding of what types of e-learning our internal IT<br />

systems can support 6.4 7.3<br />

Our internal training team is willing to embrace new ways of working with<br />

technology 6.5 7.3<br />

We have audited the skills of those in the training function against the<br />

skills required for e-learning 3.7 4.8<br />

<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 127


9 The education sector<br />

This table compares the average agreement with the 5 statements that were grouped within<br />

the survey under the heading ‘Capability of the training function’. As reported in Appendix<br />

A 4 of these statements have a close agreement in the way they behave. We can see from<br />

the ratings that the education sector does have a more pessimistic view of the capability of<br />

its training function than those in other sectors. The 2 largest differences relate to the skills of<br />

the training function, both audit and perceived capability to manage external providers. It<br />

would appear that the ICT capability within the education sector is greater than that in other<br />

sectors but that the training functions have not yet risen to the challenge presented by the<br />

opportunity that this infrastructure presents.<br />

This barrier does not prevent the education sector being more enthusiastic about the future<br />

of e-learning than other sectors.<br />

The upper half of Figure 10.5 lists those technologies that the education sector is more likely<br />

to plan for than others. In the majority of cases these are the technologies they are already<br />

making more use of. The education sector intends to do more of what it is currently doing.<br />

The greatest difference in expected growth is the use of content management systems,<br />

currently in use in almost 75% of respondents in the education sector. A response of 25%<br />

indicates that 100% of the education sector will using content management systems by 2010.<br />

It is worth pointing out that the question included VLEs (Virtual Learning Environments). For<br />

many in the education sector these will be interpreted as an environment in which students<br />

and tutors can exchange content in a safe and secure environment. Some current VLEs<br />

implemented in the education sector are in fact devoid of content; such content being<br />

provided by the users which include tutors as well as learners. When we also see that the<br />

education sector expects to make more use of chat rooms and blogs and wikis the pattern<br />

that emerges is one that is of significantly greater use of social learning software tools.<br />

The growth of open source tools within the education sector is set to continue, however it<br />

would appear that the education sector is likely to take a greater interest in rapid<br />

development tools in the future.<br />

It is likely that the education sector will continue to take the lead in collaborative learning,<br />

evidenced by its greater interest in the technology tools that support social learning and the<br />

greater effort they put into supporting learners, before, during and after study.<br />

<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 128


11 The future of e-learning<br />

11 The future of e-learning<br />

Overview: This chapter looks at the plans organisations are making for the future, particularly<br />

in relation to maturity, and explores how barriers to increasing uptake of e-learning are<br />

changing.<br />

Respondents were asked the extent to which they agreed with 5 statements about e-<br />

learning within the next 3 years. A specific question was “How do you see e-learning in your<br />

organisation in 3 year’s time?” Their responses are shown in Figure 11.1.<br />

Figure 11.1 Predictions for the future of e-learning<br />

We will place greater emphasis on<br />

supporting informal learning within the<br />

organisation<br />

The organisation will have electronic access<br />

to the training records of every employee<br />

All employees will have learning records they<br />

can access and an electronic learning plan<br />

e-learning will replace all traditional methods<br />

of corporate training like classroom training<br />

e-learning will be part of all training and<br />

development programmes<br />

0% 20% 40% 60% 80% 100%<br />

Agree Don't know Disagree<br />

Four out of 5 employer respondents agreed that they would place greater emphasis on<br />

informal learning, they would have access to electronic training records and employees<br />

would have access to those records and an on-line learning plan. For informal learning 80%<br />

exceeds the percentage of organisations planning and using informal services. The<br />

increasing importance of electronic records explains the high current and planned usage of<br />

Learning Management Systems. There is less universal agreement (66%) that e-learning will be<br />

part of all training and development programmes. This slightly exceeds the current<br />

penetration based upon respondents’ answers concerning the use of e-learning by topic.<br />

Based upon the results from all respondents 53% of the total possible occurrences of training<br />

taking place do so with some element of e-learning included. Every topic includes the use e-<br />

learning, in whole or in part, from at least one of the employer respondents. e-learning alone<br />

was selected as an option for a topic in just 5% of cases (3% if programmes and topics are<br />

included together).<br />

<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 129


11 The future of e-learning<br />

Only 6% of respondents agree with the statement that e-learning will replace all traditional<br />

methods of corporate training. It is very clear that the significance of a blended approach,<br />

in which e-learning forms part of an offer, is now widespread. The majority of topics and<br />

programmes are delivered, either with no e-learning component, or with e-learning as part<br />

of the mix. Furthermore, about half of all training by topic and respondent contains some<br />

element of e-learning. These predictions are compared by the maturity of the respondents.<br />

Figure 11.2 Predictions of e-learning futures by maturity<br />

Greater emphasis on informal learning<br />

77%<br />

electronic access to the training records<br />

All employees will have learning records<br />

58%<br />

e-learning will replace traditional<br />

methods<br />

12%<br />

e-learning will be part of all training<br />

programmes<br />

0% 20% 40% 60% 80% 100%<br />

Less mature (n=39) Becoming mature (n=58) More mature (n=66)<br />

Note the numbers included in the above figure are results from a 2004 study. 5<br />

More mature organisations are more likely to agree with the statements that there will be a<br />

greater emphasis on informal learning and that training records will be used, which<br />

employees have access to. Interestingly, one in 10 of more mature users believe that e-<br />

learning will replace traditional methods.<br />

The greatest difference reported in the figure above relates to the statement that e-learning<br />

will be part of all training programmes. Less than 2 in 5 of the less mature organisations agree<br />

with this statement compared to 4 out 5 of the more mature. This indicates one of the<br />

changes that maturity brings about is an appreciation that e-learning can be used for a<br />

greater range of topics.<br />

In 2004 77% of respondents agreed that organisations would have electronic access to the<br />

training records of every employee (now 82%.) Then 58% agreed that employees would have<br />

access to learning records (now 76%). In 2004 12% of respondents believed that e-learning<br />

would replace traditional methods of corporate training, like classroom training, now in 2006<br />

5 Embedding e-learning in large Organisations, Hills (2004)<br />

<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 130


11 The future of e-learning<br />

only 6%. In 2004 35% agreed that e-learning would only be used for a few specialist<br />

applications and in 2006 21% disagree with the statement that e-learning will be part of all<br />

training programmes although this changes with maturity; 40% of the less mature, 16% of<br />

those becoming mature and 13% of the more mature. This reinforces the view that maturity<br />

brings with it a more wide spread realisation that e-learning is suitable for more than just<br />

specialist application and that this realisation has become more wide spread since 2004.<br />

The 2004 study did not include any discussion or collection of data in regards to informal<br />

learning.<br />

11.1 Challenges for e-learning<br />

Respondents were asked what they thought were the main barriers to their company<br />

increasing the use of e-learning over the next 3 years. They were asked to select the 3 most<br />

significant from a list although no limit was applied. They were also given an opportunity to<br />

comment on additional barriers not provided in the list. Many respondents selected up to 6<br />

barriers (average number selected by all respondents is 3.3, including the ‘other’ option).<br />

Figure 11.3 Barriers to e-learning in the next 3 years<br />

Cost<br />

Staff resistance<br />

Lack of knowledge about potential<br />

Lack of e-learning management skills<br />

Lack of relevant, quality material<br />

Available content too generic<br />

Inadequate ICT infrastructure<br />

Poor past experience<br />

Staff ICT skills<br />

Hype from suppliers<br />

No staff access to PCs<br />

No need to change<br />

0% 10% 20% 30% 40% 50% 60%<br />

Less mature (n=38) Becoming mature (n=58) More mature (n=66)<br />

More mature organisations are less likely to perceive cost, staff resistance, lack of knowledge<br />

of potential and lack of e-learning management skills as barriers. As these are the 3 barriers<br />

most likely to be selected by less mature organisations (both less mature and becoming<br />

mature in the figure above) this indicates that maturity brings with it the appreciation and<br />

skills to reduce the barriers, as they are first perceived. Cost is perceived as less of a barrier as<br />

organisations become more mature, as does the resistance of staff. Less mature<br />

<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 131


11 The future of e-learning<br />

organisations are slightly less likely to say they have a lack of knowledge about the potential<br />

of e-learning, as those who are becoming mature. This may indicate that early exposure to<br />

e-learning increases the realisation that it requires some skill and knowledge to bring out its<br />

full potential and that the less mature do not yet have this appreciation. Of those who are<br />

less mature and becoming mature about 40% select management skills as a barrier, but this<br />

drops by half to 21% for the more mature organisations.<br />

Lack of relevant quality material remains an issue more or less independent of maturity,<br />

although the importance of this barrier does reduce at an early stage of e-learning<br />

development. Almost half of less mature organisations are concerned that available<br />

content is too generic for their organisation and this drops to 17% for the most mature<br />

organisations. The inference is that this demonstrates a growing confidence with maturity<br />

that bespoke e-learning that is industry and company specific can be readily created.<br />

Poor ICT infrastructure remains a barrier for about one-fifth of all organisations, irrespective of<br />

their maturity. The more mature are less likely to allow poor past experiences, if any, to<br />

impede the development of e-learning. Staff ICT skills also drop off as a barrier very sharply<br />

as organisations become more mature. Only 5% of the most mature organisations perceive<br />

this to be a barrier. The report does find that IT user skills are most likely to be delivered at an<br />

early stage of adopting e-learning and an assumption is that this quickly impacts on staff ICT<br />

skills, the lack of them sharply reducing as a barrier as organisations gain experience. Access<br />

to PCs also reduces as a barrier with maturity; however, this may be because more mature<br />

organisations are more innovative and flexible about the locations at which they make e-<br />

learning available rather than a wider availability of PCs. More mature organisations are<br />

more likely to make e-learning available in a wider range of locations thus making it easier for<br />

staff to gain access to PCs.<br />

Figure 11.4 Barriers to e-learning over the next 3 years by business sector<br />

Cost<br />

Staff resistance<br />

Lack of knowledge about potential<br />

Lack of e-learning management skills<br />

Lack of relevant quality material<br />

Available content too generic<br />

Poor past experience<br />

Inadequate ICT infrastructure<br />

Hype from suppliers<br />

Staff ICT skills<br />

No staff access to PCs<br />

No need to change<br />

0% 50% 100% 150% 200% 250% 300% 350%<br />

c) Manufacturing h) Transport, storage and communications<br />

i) Financial intermediation j) Real estate, renting and business activities<br />

k) Public admin and defence l) Education<br />

m) Health and social work o) Computing<br />

<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 132


11 The future of e-learning<br />

This figure has been assembled by adding together the percentage occurrence of each<br />

barrier by each sector. With an average number selected of 3.3 the possible maximum of this<br />

graph is 330%. The public admin sector has greater staff resistance than other sectors and is<br />

more likely to cite inadequate ICT as a barrier. The manufacturing sector is more likely to cite<br />

lack of staff IT skills and the lack of skills to manage e-learning. Not surprisingly the sector that<br />

reports fewest barriers is IT and telecommunication, followed by education. The sectors most<br />

likely to report barriers are health, public administration and manufacturing as shown in<br />

Figure 11.5. This ranges from an average of 2.6 to 3.7 and includes the selection of “others”.<br />

Figure 11.5 Propensity for organisations to report barriers<br />

m) Health and social work<br />

k) Public admin and defence<br />

l) Education<br />

j) Real estate, renting and business activities<br />

c) Manufacturing<br />

i) Financial intermediation<br />

h) Transport, storage and communications<br />

n=150<br />

o) Computing<br />

11.2 Geographic differences<br />

The barriers selected were analysed by geography. Those with many branch locations are<br />

more likely to cite poor access to PCs (13%), poor ICT skills (22%) and inadequate ICT<br />

infrastructure (27%). Not surprisingly those operating from a single UK site are least likely to<br />

select poor ICT as a barrier (6%) but most likely to select a lack of e-learning management<br />

skills (33%) and a lack of relevant quality material (39%). They are slightly less likely to select<br />

lack of knowledge about potential (22%) or staff resistance (25%). Organisations operating<br />

from a few large sites are least likely to select a lack of relevant quality material as a barrier<br />

(16%). There were no other major differences based upon the geography.<br />

11.3 Progress since 2004<br />

In 2004 respondents were asked what main challenges they faced. The question specifically<br />

said: “What would you consider to have been the main challenges for your organisation,<br />

either in implementing e-learning or in building a case for it?” Responses are grouped as<br />

follows:<br />

<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 133


11 The future of e-learning<br />

Challenges faced 2004<br />

Percentage selecting<br />

this barrier<br />

Responses 2006<br />

Culture change and user objections 42% 42%<br />

Poor ICT infrastructure 28% 23%<br />

Difficult to prove financial potential 15% 38%<br />

Convincing management 9% Not applicable<br />

Insufficient relevant quality content 8% 34%<br />

Cost 7% 44%<br />

Web access 7% 8%<br />

No need to change 7% 7%<br />

Lack of ICT management skills 7% 23%<br />

Learning has a low priority 4% Not applicable<br />

Lack of resources 4% Not applicable<br />

Lack of user ICT skills 4% 17%<br />

The data in 2004 was collected by telephone survey; users were not prompted for the<br />

categories but their responses were placed in the categories as appropriate. The data from<br />

2006 required users to select responses from a list provided. Making allowances for the<br />

difference in the way the data has been collected valid comparisons can still be made.<br />

Cost is seen as a far more significant barrier in 2006 than it was in 2004. This may be because<br />

organisations are seeking to implement e-learning far more widely across organisations or this<br />

may be because increased experience has shown that the process is not as inexpensive as<br />

first considered.<br />

Culture and staff resistance remain the most frequently cited barrier, as significant in 2006/7<br />

as it was in 2004. Clearly organisations have to put considerably more effort into winning the<br />

hearts and minds of learners if e-learning is to become a significant offering of corporates to<br />

their employees.<br />

The lack of relevant quality material is now much more significant as a barrier than it was 3<br />

years ago. Poor ICT skills amongst staff is less of a barrier than it was in 2004 and this is<br />

supported by further evidence collected and reported on elsewhere in this study.<br />

ICT continues to be a problem for about a quarter of organisations, little changed over the<br />

last 2 years although this conflicts with other data in this report. A comparison of the Likert<br />

scale opinion based question reveals that ICT is significantly less of a problem in 2006 than it<br />

was in 2004 (see the next Table).<br />

Respondents in both 2004 and 2006 were asked to make a self-assessment judgement<br />

against a number of key statements. The average ratings and percentage agreeing for this<br />

and previous studies are shown in Table 11.1.<br />

<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 134


11 The future of e-learning<br />

Table 11.1 Comparisons in e-learning implementation 2004-2007<br />

<strong>Towards</strong><br />

<strong>Maturity</strong><br />

Mean<br />

%<br />

agree Mean<br />

Embed<br />

ded 6 LL2B 7<br />

Staff can access e-learning at any time 7.40 70% 6.3 59%<br />

Staff can access e-learning from anywhere 7.09 68% 6.3 59%<br />

We have a clear understanding of what types<br />

of e-learning our internal IT systems can support 7.17 67% 5.7 50%<br />

Our internal training team is willing to embrace<br />

new ways of working with technology 7.16 64% 8.5 88%<br />

Managers appraise staff at regular intervals and<br />

plan their development 6.73 63% 7.7 77%<br />

Tracking e-learning progress is essential for<br />

compliance purposes 6.67 58% 6.4 61%<br />

We have the skills to manage external e-<br />

learning providers effectively 6.66 58% 6.2 55%<br />

Front<br />

line 8<br />

%<br />

agree Mean Mean<br />

When we implement a new e-learning initiative<br />

we start with a pilot project before embarking<br />

on a company wide rollout 6.50 57% 7.2<br />

Staff are empowered to request their own<br />

training and take ownership of their<br />

development 6.48 57% 6.9 64%<br />

We can quickly implement new learning<br />

programmes across the organisation 6.08 52% 7.3<br />

Staff know what training is available to them<br />

and how to obtain it 6.37 51% 7.4 73%<br />

Managers coach their own teams 5.79 46% 6.5 64%<br />

Change management is an integral part of our<br />

deployment and planning of e-learning 5.87 45% 6.5 62%<br />

Managers make time for staff to learn at work 5.41 41% 5.5<br />

6Embedding e-learning in large Organisations, Hills et al (2004) see www.e-skills.com\work-based-elearning/research-and-policy\989#education.<br />

7 Linking learning to Business, Overton (2004) published by Bizmedia.<br />

8 Frontline case study report, Library Workforce Development, published by e-skills UK, see www.e-skills.com\cgibin\go.pl\wbel\case\index.html.<br />

<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 135


11 The future of e-learning<br />

<strong>Towards</strong><br />

<strong>Maturity</strong><br />

Embed<br />

ded 6 LL2B 7<br />

Front<br />

line 8<br />

Staff quickly put into practice what they learn<br />

from e-learning 5.67 36% 8.4<br />

e-learning has made a positive contribution to<br />

changing attitudes to learning and training in<br />

our organisation 5.55 34% 30%<br />

Managers allow staff work time to learn at home<br />

or locally 5.00 33% 5.5 50%<br />

Senior Management regularly demonstrate<br />

commitment to e-learning 4.82 31% 5.8<br />

We regularly communicate e-learning successes<br />

to managers 4.70 31% 6.4<br />

We have audited the skills of those in the<br />

training function against the skills required for e-<br />

learning 4.61 29% 4.1 28%<br />

We provide line managers with training and<br />

briefings relating to specific e-learning courses 4.54 26% 5.8<br />

e-learning has made us focus better on business<br />

requirements 4.72 25% 6<br />

Staff are more interested in professional<br />

development since the introduction of e-<br />

learning 4.47 18% 5.5<br />

This table shows the mean ratings in the <strong>Towards</strong> <strong>Maturity</strong> study together with the<br />

percentage of respondents who agreed with the statements. Where the information is<br />

available this is shown for previous reports (see Footnote). The Frontline case study was<br />

written in 2005 and is a comparison from an isolated sector reviewing a single<br />

implementation of e-learning. A quick review of the figures in the table above indicates a<br />

disappointing lack of progress in almost all aspects of e-learning implementation. The<br />

Frontline case was a particularly effective implementation of e-learning as demonstrated by<br />

the impact on staff with mean scores significantly in excess of those collected from the<br />

<strong>Towards</strong> <strong>Maturity</strong> respondents. The Frontline case study mean scores indicate a level that<br />

organisations should aspire to.<br />

The importance of compliance in relation to the implementation of e-learning has not<br />

changed in the preceding 2 years. Sixty percent of respondents, both now and then,<br />

indicate that tracking progress is a required feature of e-learning implementation. As<br />

reported in this study, compliance is a driver linked to the financial return of e-learning. It is<br />

less strongly linked to both the take-up and impact on staff within organisations.<br />

<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 136


11 The future of e-learning<br />

There has been an improvement in the last 2 years in the availability of e-learning, coupled<br />

with an increased understanding of the capability of internal IT systems.<br />

The willingness and capability of the training function shows little change and perhaps a<br />

rather disappointing drop in their apparent willingness to embrace new ways of working.<br />

One possible explanation may be that a much greater proportion of the internal training<br />

teams are required to change their working practices in 2006 than were required to do so in<br />

2004. Neither management support through appraisal and coaching nor the empowerment<br />

of staff show any significant change, indeed a slight reduction in both the percentage of<br />

respondents agreeing with the statements and the mean ratings.<br />

The observation that e-learning makes a positive contribution to changing attitudes was<br />

identified as a one of the main successes for e-learning by 30% of respondents in 2004 but<br />

was not included as a self rated questions. A very similar percentage of respondents in 2006<br />

now agree with that statement.<br />

In general this table shows a rather gloomy picture with little evidence of any significant<br />

improvement in the last 2 to 3 years. However an analysis by maturity reveals a slightly more<br />

optimistic situations.<br />

Figure 11.6 Changes in managerial commitment and availability of e-learning<br />

8<br />

7<br />

6<br />

5<br />

4<br />

3<br />

2<br />

1<br />

0<br />

Novices Sporadic Developers Established Embedded Innovators<br />

Commitment of Senior Managers<br />

Availability of e-learning<br />

2004 benchmark 2004 benchmark<br />

<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 137


11 The future of e-learning<br />

Figure 11.7 Changes in skills and IT capability<br />

9<br />

8<br />

7<br />

6<br />

5<br />

4<br />

3<br />

2<br />

`<br />

1<br />

0<br />

Novices Sporadic Developers Established Embedded Innovators<br />

Training skills audited Skills to manage providers Good IT infrastruct<br />

2004 benchmark 2004 benchmark 2004 benchmark<br />

The good news in both these figures is that more mature organisations do better against the<br />

2004 benchmarks, so progressing towards maturity does enable organisations to improve<br />

their performance compared to the average of 2 years ago. Figure 11.7 shows the particular<br />

positive improvement in the good IT infrastructure as almost all maturity segments now rate<br />

their IT infrastructure better than the mean of all respondents in 2004. What is perhaps<br />

disappointing is the much poorer rating in relation to organisations auditing their training skills.<br />

It is not until organisations have become embedded users and innovators that they are more<br />

likely to audit the skills of their training team than they were in 2004. Although auditing the<br />

skills of the training team falls within the sphere of the training function capability, this action is<br />

part of the change management process for moving towards maturity in e-learning. The<br />

small percentage of organisations who agree with this statement and the fact that even<br />

those in a middle ranking for maturity report a low mean rating, indicates that many<br />

organisations are making a poor start to the change management process by not auditing<br />

the skills of their internal training teams.<br />

<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 138


11 The future of e-learning<br />

11.4 Sources of advice<br />

Figure 11.8 Sources of advice used by respondents<br />

Websites<br />

Exhibitions and conferences<br />

On-line newsletters<br />

Suppliers of e-learning systems<br />

Books/journals<br />

Other Users<br />

Training providers<br />

E-learning communities<br />

Industry bodies (trade associations)<br />

Independent advisers<br />

Academia<br />

Sector Skills Councils<br />

Business Link<br />

Chambers of Commerce<br />

0% 20% 40% 60% 80% 100%<br />

Frequently use Sometimes use Never used<br />

Respondents were asked which sources they turned to for advice on learning and<br />

development. They were offered the list shown in the figure above and made a selection<br />

based on: they never used that source, they had used it, or they were regular users. They<br />

were also offered the option of entering other sources of advice, 3 did so but named<br />

organisations that may be included in the above figure. It’s very clear from this that users<br />

tend to select sources of advice that they can go to reasonably anonymously, most<br />

noticeably Web sites, exhibitions and conferences. They are more likely to seek advice from<br />

suppliers of e-learning systems than training providers. Newsletters and journals are slightly<br />

more frequently used than other similar organisations to themselves. Government funded<br />

sources such as SSCs and Business Link are used by less than one out of 5 respondents.<br />

Respondents were also asked what type of additional support would be helpful. Given the<br />

low probability of respondents having audited the skills of their training team it is also<br />

disappointing to see that from the figure below only one in 5 request help associated with<br />

implementing and managing e-learning.<br />

<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 139


11 The future of e-learning<br />

Figure 11.9 What type of additional support would be helpful?<br />

Method of evaluating the effectiveness of e-learning<br />

Examples how others have implemented e-learning<br />

solutions successfully<br />

Examples of how to promote e-learning to staff<br />

Information on how to analyse costs/benefits of e-<br />

learning<br />

Database/website of typical e-learning applications<br />

for our sector<br />

Training in implementing e-learning solutions<br />

Identifying training needs<br />

Training in using e-learning solutions<br />

Defining the skills required by the workforce<br />

Defining the skills required by IT users<br />

Training in specifying components of e-learning<br />

solutions<br />

0% 10% 20% 30% 40% 50% 60% 70%<br />

Given the issues surrounding the evaluation of the effectiveness of training in general, it is no<br />

surprise to see that help in evaluating the effectiveness of e-learning is most frequently<br />

selected by respondents as support required. Indeed, the top 4 most popular choices for<br />

additional support are associated with: promotion, implementation and evaluation.<br />

Respondents were offered the opportunity of adding additional support but no respondent<br />

added anything that cannot be included in the above list.<br />

<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 140


12 Conclusions<br />

12 Conclusions<br />

12.1 Introduction<br />

An analysis of the factual responses by segmentation against maturity supports this concept<br />

of e-learning maturity and the validity of its application by self-assessment. There are 5<br />

objective measures which show a consistent difference across maturity segments. The<br />

category of innovator attracts respondents for reasons that do not fit into a pattern of<br />

maturity. This is not the most mature category and its use in the report has disrupted several<br />

patterns discernible in the rest of the data. The survey has too few responses from novice<br />

users. We are not able to make reliable conclusions about this segment.<br />

12.2 Chapter 2 – Investment<br />

The most significant benefits as perceived in 2004 but not listed as drivers then have emerged<br />

as the most significant drivers in 2006. This indicates a more widespread appreciation of the<br />

benefits of e-learning and its specific contribution to business impact: flexibility and<br />

accessibility.<br />

The pattern of which drivers are selected changes with maturity, primarily in that more<br />

mature organisations select more drivers. This indicates that maturity brings with it an<br />

appreciation that e-learning delivers additional benefits other than those commonly<br />

perceived by the less mature. Reduction in costs and administrative benefits are less<br />

important to the more mature. More e-learning mature organisations are more likely to<br />

select response to regulatory and legal requirements and the need to improve quality as<br />

important drivers, than do the less mature.<br />

The financial sector is more likely to be driven by the need to meet regulatory requirements<br />

and the education sector more likely to be driven by the need for organisational change<br />

and the requirement to maintain a public image of a progressive organisation.<br />

More mature organisations are more likely to agree they get financial impact and business<br />

impact from e-learning. Those organisations that put learners and line managers first as<br />

sources of influencing success are more likely to gain business impact from e-learning.<br />

The groups most likely to have e-learning delivered to them are administrators, professionals<br />

and line managers. They seem to be the easiest group to market e-learning to or the easiest<br />

to develop or buy material for, perhaps by virtue of the nature of their jobs. Those<br />

organisations which increase their use of e-learning by directors, technician grade staff and<br />

those in skilled roles are most likely to improve their perception of business benefit.<br />

Organisations can improve their success at e-learning by focusing development and delivery<br />

of e-learning towards these 3 roles.<br />

An analysis of learner responses and a comparison with employer responses supports a view<br />

that the business impact of e-learning is due in part to the quick application of learning to<br />

the job in hand by learners. If the rapid response and roll out by employers is added to the<br />

picture this becomes a compelling argument that the business impact of e-learning is related<br />

to its speed of application to job performance through a chain of circumstances, moving<br />

<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 141


12 Conclusions<br />

from speed of delivery to speed of application by learners. The speed of response as an e-<br />

learning benefit is surfacing in this report as a statement with which a significant proportion of<br />

both learners and employees agree with in relation to e-learning from their different<br />

perspectives.<br />

Those who achieve more business impact from e-learning are more likely to agree that they<br />

have the skills within the training function to manage e-learning. About 15% of respondents<br />

agree they do not have the capability in the training function to manage e-learning (this is<br />

3% for those in the top quartile for business impact and 39% for those in the bottom quartile).<br />

An implication is that training function capability is an essential foundation for achieving<br />

business impact from e-learning.<br />

Improving line management coaching increases the probability of achieving business<br />

impact, as does the provision of reference books, reassessment and electronic job aids as<br />

support to learners. These latter 3 methods of support are less frequently used than line<br />

management coaching. Those organisations who achieve more business impact are more<br />

likely to provide these 4 types of support to learners.<br />

Organisations driven by compliance are more likely to achieve financial impact with e-<br />

learning but not as likely to achieve staff impact or be more e-learning mature. Compliance<br />

is a driver for business and financial impact but makes less of an impact on staff.<br />

Those who achieve greater staff impact from e-learning are more likely to perceive an<br />

improvement in customer satisfaction, greater take-up and better financial impact. Staff<br />

who feel e-learning makes a greater impact on them seem to perceive an improved<br />

satisfaction by customers as a result.<br />

Organisations make a greater impact on staff if the implementation of e-learning includes<br />

change management procedures, if they ensure learners are empowered and increase the<br />

availability of e-learning both for place and time. The evidence shows that flexibility by<br />

place (at home, at the desk, travelling or in a quiet area) has a greater impact on staff than<br />

flexibility by time. Only 41% of line managers are likely to make time available for e-learning<br />

but 57% of organisations can deliver e-learning to places convenient to staff. For learners<br />

42% agree that managers make time for them to learn at work, but 69% agree they can<br />

learn at places convenient for them and 51% say e-learning is convenient for their work<br />

schedule. The benefit of flexibility delivered by e-learning is more important in relation to<br />

place than to time.<br />

The particular target group of learners responding were all regular PC users, 92% felt they<br />

managed their own time and 60% were graduates. Of this group about 6 out of 10 felt they<br />

were empowered by e-learning and 4 out of 10 felt detached from it.<br />

12.3 Chapter 3 - People and organisational capability<br />

Making decisions about e-learning based upon a Board strategy improved the probability of<br />

achieving successful business impact from 25% to 55%. Only a third of respondents agreed<br />

they had such a strategy. Those that did were 10% more satisfied with the business impact<br />

they achieved.<br />

Ensuring directors personally use e-learning improves the probability of business impact, staff<br />

impact, take-up of e-learning, its availability and the commitment of senior managers.<br />

Ensuring directors use e-learning and that a Board strategy is in place are 2 actions that<br />

<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 142


12 Conclusions<br />

increase the probability of e-learning being successful. An example relates to the speed of<br />

application of learning to the job. When directors use e-learning half of all organisations<br />

agree that what is learnt is quickly applied, as opposed to a quarter of those organisations<br />

where directors do not use e-learning. More significant is the number of organisations who<br />

agree that learning is not quickly applied; this changes from 4% of organisations where<br />

directors are users to 29% for those where directors are not users. Leadership from the top is a<br />

key element that influences a number of factors relating to the success of e-learning. Aiming<br />

to involve directors and being successful in doing so pays significant dividends. Where<br />

directors set an example organisations are twice as likely to perceive take-up as successful<br />

and the number of roles who use e-learning will treble.<br />

For individuals their own manager has a greater influence than do directors or senior<br />

executives. For learner respondents half select their line manager as the person most likely to<br />

influence their take-up of e-learning. Just over a quarter select a work colleague. This<br />

pattern changes slightly with age (60% of those under 25 will select their manager as the<br />

prime influence on them for doing e-learning, as opposed to 45% of those over 55).<br />

Colleagues become more important for older learners. Senior executives are more likely to<br />

influence those who work away from a regular place (approximately 15% in those situations<br />

will select senior executives, as opposed to 9% of those in regular workplaces). Managers are<br />

less likely to influence those without the freedom to manage their own time (44%).<br />

Comparing the results for who influences you, we may assume that managers with direct<br />

hands-on contact with staff are less likely to encourage learning than those where learners<br />

have a greater responsibility to manage their own time. It would appear that an individual<br />

learner is not significantly influenced by a senior executive and yet the behaviour of senior<br />

executives significantly influences uptake. It is not unreasonable to suggest that there is a<br />

chain of impact commencing with directors. Directors set a Board strategy and personally<br />

use e-learning; as a result senior managers show commitment; managers then encourage e-<br />

learning at a local level and make it more available to learners, encouraging them to learn.<br />

An analysis by sector in relation to those who use e-learning shows that the manufacturing<br />

sector directs more e-learning effort at the less skilled employees. The financial sector puts<br />

more effort into training knowledge workers and senior management than do other sectors.<br />

The business activity sector puts less effort into providing e-learning for less skilled and more<br />

junior staff. The education sector is least likely to train all roles other than those of professional<br />

grade staff.<br />

The majority of organisations use their own internal budget to fund the majority of their<br />

expenditure on e-learning. The exceptions are the health and education sector, although<br />

organisations in these sectors actually seek funding from within their sectors (strategic health<br />

authorities within the health sector and learning and skills council funding within the<br />

education sector). Regional development authorities are not used to any significant extent<br />

as sources of funding and the only sector to seriously consider European funding is the<br />

education sector.<br />

The principal ways in which organisations source e-learning are through commercial boughtin<br />

products, in partnership with e-learning vendors, or in-house with simple rapid<br />

development tools or slightly less probable in-house with development tools for experts.<br />

Fifteen percent of all respondents use only in-house development tools with the implication<br />

that they are not seeking to source e-learning externally. More e-learning mature<br />

organisations are more likely to use in-house development but more likely to work in<br />

partnership with an e-learning vendor.<br />

<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 143


12 Conclusions<br />

The attributes of suppliers that purchasers regard as most important are those of: value for<br />

money, expertise and proven reliability; which are regarded as important by 4 out of 5<br />

purchasers. However the attributes that are least likely to be selected: knowledgeable,<br />

innovative, long-term partners, good after sales support, a wide range of products and an<br />

experienced needs analysis, are still regarded as vital by one in 5 purchasers. This is a<br />

marketplace in which purchasers have high expectations and a wide variability in the criteria<br />

for choosing suppliers.<br />

A total of 139 suppliers were mentioned by employer respondents, of whom only 5 were<br />

mentioned by more than ten respondents. The market is dominated by many small suppliers,<br />

characterised as a cottage industry; with only 5 large suppliers apparent in the marketplace.<br />

12.4 Chapter 4 – E-learning – technology, software, and topics delivered<br />

Respondents were offered a list of 18 topics and asked whether they delivered these topics<br />

with or without a component of e-learning. All but 3 of the topics are delivered by 3 out of<br />

five respondents; the exceptions being foreign language, literacy and numeracy, delivered<br />

by about a third of respondents. Eleven of the topics are delivered by more than 4 out of 5<br />

respondents. All but 3 of the topics are generic in nature and may be delivered with off the<br />

shelf products or generic face-to-face courses. The exceptions are company-specific skill,<br />

industry-specific skills and induction. These latter 3 topics require companies to invest in<br />

development, either of content or customised delivery through specialised trainers.<br />

The penetration of e-learning within these topic areas varies, with IT skills (both general and<br />

professional) having a penetration of more than 70%. Company and industry-specific skills<br />

are the two topics with the next greatest penetration; approximately 60%. The penetration<br />

for e-learning components within induction is approximately 50%. The implication is that<br />

organisations are able to create e-learning content for these non-generic topics; either by<br />

internal development or purchasing external development. Based on this analysis about half<br />

of organisations have the capability to develop specific e-learning content that meets their<br />

particular business needs.<br />

The IT and telecommunications sector does more induction and sales and marketing training<br />

using e-learning than other sectors, the financial sector does more company-specific and<br />

health and safety training using e-learning and is the sector most likely to use an e-learning<br />

component within the topics offered.<br />

The penetration of e-learning is analysed by maturity. All but 2 topics show an increased<br />

probability of being delivered by more e-learning mature organisations; these 2 topics are<br />

literacy and numeracy. For the remainder, 3 adoption patterns can be seen.<br />

1. IT skills are rapidly adopted by organisations at an early stage of maturity and reach a<br />

penetration in excess of three quarters; that is where these topics are offered, three<br />

quarters of organisations doing so will include an e-learning component.<br />

2. Company and industry-specific skills show little increase in e-learning penetration at<br />

early stages of maturity but this penetration rises steeply at later stages of maturity,<br />

achieving a similar probability of being delivered with e-learning as IT skills.<br />

3. All the other topics, mainly interpersonal and generic skills, show a steady growth in<br />

penetration as organisations become more e-learning mature. One group of topics<br />

starts from a low probability of use (close to zero) whereas another group starts from a<br />

penetration of approximately 20%.<br />

<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 144


12 Conclusions<br />

Companies deliver a wider range of topics as they gain confidence and at later stages of<br />

maturity use this confidence to develop specific content that meets their particular business<br />

needs. For those organisations that wish to develop in maturity, the experience of delivering<br />

e-learning IT skills are a good starting point, concentrating later on other topics, particularly<br />

industry and company-specific skills.<br />

Programmes supporting industry certification are offered by 3 out of 5 companies, learning<br />

for customers and professional body qualifications being offered by about half and all other<br />

programmes offered by less than 2 out of 5 organisations. There is less use of e-learning in<br />

programmes leading to qualifications than in the delivery of stand alone topics. Learning for<br />

customers is the style of programme most likely to include an e-learning component; possibly<br />

because of the low cost of delivery. All programmes for industry qualifications offered by the<br />

finance sector use an e-learning component. The business activities sector is least likely to<br />

use e-learning within any training programmes. The penetration of e-learning by<br />

programmes has been analysed by maturity. As organisations become more mature there is<br />

a greater probability that they will use on-line resources to deliver N/SVQ programmes. The<br />

penetration rises from 20% to 60%; only 2 other styles of programmes show an increase in<br />

penetration with maturity; learning for suppliers, rising from zero for the least mature to 20%<br />

penetration for the more mature and job related qualifications rising from 25% to 40%. As<br />

with e-learning being delivered to customers, the driving force behind delivering e-learning<br />

for suppliers may be the low cost of delivery and an increased perception of the potential for<br />

increasing the quality of the supply chain. The significant growth in N/SVQ programmes using<br />

e-learning is likely to be driven by the benefits of reducing the cost of administration since<br />

these programmes have a requirement for assessment and workplace monitoring, which<br />

without electronic support is relatively expensive for employers to deliver.<br />

Ninety percent of respondents deliver electronic learning material. This is frequently the<br />

narrow definition of e-learning accepted by many. Four out of 5 respondents use, or will use,<br />

e-learning for assessment and administration; almost half for collaboration between learners,<br />

competency management and e-tutor support; with 2 out of 5 using, or planning to use, e-<br />

learning for the evaluation of business impact. As organisations become more mature they<br />

deliver a greater range of formal learning services on-line. Each one of these services is<br />

delivered by more than half of the most mature organisations. This demonstrates that<br />

maturity brings with it a greater appreciation of the capability of e-learning to offer a wider<br />

range of formal learning services.<br />

More than 3 out of 5 respondents offer on-line books and approximately half of respondents<br />

offer search portals, on-line company experts and on-line communities. The two informal<br />

services most likely to be offered, on-line books and search portals, are both designed to<br />

enable learners to find things out for themselves from a large source of information made<br />

available to them. This is appropriate as learners report that 60% of what they learn is by<br />

finding things out for themselves, as opposed to the delivery of content through Courses.<br />

More mature organisations offer more informal services. Although the number of<br />

organisations currently planning to offer e-learning services is relatively small (approximately<br />

10% of those currently offering these services) the probability of organisations using these<br />

services increases from about 25% to 70% as organisations move from less mature to more<br />

mature.<br />

<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 145


12 Conclusions<br />

12.5 Chapter 5 – Take-up of software tools in support of e-learning<br />

We can predict the growth of the use in various software tools that support e-learning by<br />

combining an analysis of users’ plans from the survey with the change in probability of use<br />

with maturity. All software tools are more likely to be used by more mature organisations.<br />

However, open-source tools are more likely to be used by the less mature than those<br />

becoming mature. An assumption is that the availability of open-source tools provides an<br />

entry point for training functions to experiment with e-learning in the absence of a strategy or<br />

business case. A comparison of use by maturity their growth is unlikely to be significantly<br />

different from the 18% predicted on the basis of organisation’s plans up to 2010. The most<br />

frequently occurring e-learning software is the Learning Management System, for which a<br />

growth rate of 30% is predicted. Based upon users’ plans, competency management<br />

appears to be growing at 83%. However, the difference in maturity indicates a lower growth<br />

rate, perhaps nearer 40%, from its current usage level. Rapid development tools on the other<br />

hand show a greater difference between the less and more mature, indicating a growth rate<br />

of 30 to 35% rather than the 19% predicted from users’ plans. E-portfolios show one of the<br />

smallest differences between the less and the more mature, supporting the probable growth<br />

rate of 20% of current usage, with a prediction that by 2010 only a third of companies will be<br />

adopting e-portfolios.<br />

Mobile learning is the only delivery tool that does not consistently increase with greater<br />

maturity, being used by slightly more of the less mature than those becoming mature. The<br />

definition of mobile learning included laptops and tablet PCs and we can make a<br />

reasonable assumption that mobile learning will increase perhaps by a third. Twice as many<br />

of the more mature organisations use pod casting than the less mature. This together with the<br />

forecast of future use by all respondents, indicates that the use of pod casting will more than<br />

double by 2010. The use of games/simulations/in-tray exercises will grow by 15% based on<br />

combining the differences between more mature and less mature users, with the forecast of<br />

13% growth based upon users’ plans. The definition of games includes simulations and in-tray<br />

exercises which is a wider definition than might be understood by the term ‘computer<br />

games’. Video on demand shows a modest change with maturity and we can expect an<br />

overall growth rate of 50%. The electronic performance support systems are twice as likely to<br />

be used by the more mature as compared to the less mature, which supports an overall<br />

growth prediction of 60%.<br />

The majority of software tools supporting collaboration show an adoption curve that rises<br />

more steeply at later stages of maturity. The exceptions are video conferencing and virtual<br />

classrooms, both of which show a steady growth rate, with a difference of 20% in their<br />

probability of use between the less and the more mature organisations. Video conferencing<br />

is a relatively mature software tool with a reasonably high penetration and a predicted<br />

growth rate, based on these figures, of 10%. Virtual classrooms have a much lower<br />

probability of being used and therefore have a higher growth rate of perhaps 25%.<br />

Wikis/blogs are least likely to be used and show the smallest difference between the less and<br />

the more mature. We may expect a growth rate by 2010 of at least 80%. Both moderated<br />

and un-moderated chat shows a similar difference in usage between the less mature and<br />

the more mature, being twice as likely to be used by the more mature. Comparing users’<br />

plans with current levels of use and change with maturity, we can expect a growth in both<br />

types of chat of 60%. However, un-moderated chat may grow at a slower rate. The<br />

CMS/VLE is likely to be used by 70% of the more mature but only 50% of the less mature.<br />

Based upon a comparison of maturity and users’ plans we might expect an actual growth<br />

rate closer to 25% somewhat less than the 30% predicted from user’s plans.<br />

<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 146


12 Conclusions<br />

Global companies are more likely to choose the collaborative tools of video conferencing<br />

and virtual classrooms together with electronic performance support systems, so are likely to<br />

lead the growth in these technologies. Companies with many locations are less likely to be<br />

using almost all of the technologies listed so far. Larger companies are more likely to be<br />

using Learning Management Systems (88% compared to 52% of SMEs). Video conferencing is<br />

more likely to be used by the largest companies (67% compared to 33% of SMEs). Apart from<br />

video conferencing the other collaborative software tools discussed in this report are not<br />

more likely to be used by larger organisations.<br />

12.6 Chapter 6 - IT capability<br />

Organisations were segmented on IT capability, the definition of which is that learners are<br />

familiar with PCs and need little technical support and technology is capable of delivery e-<br />

learning to places convenient to staff. Organisations which have greater IT capability, based<br />

on this definition, achieve greater business impact, staff impact, improved availability and<br />

greater take-up.<br />

IT capable organisations<br />

IT not capable organisations<br />

More likely to have capable IT functions<br />

Offer about seven online services<br />

Offer about 5.5 online services<br />

Select seven drivers for e-learning<br />

Select 5 ½ drivers for e-learning<br />

More likely that directors use e-learning Less likely that directors use e-learning (41%)<br />

(62%)<br />

Offer more topics using a component of e-<br />

learning (60%)<br />

Offer fewer topics using a component of e-<br />

learning ( 50%)<br />

Offer e-learning in more locations (3.1) Offer e-learning in less locations (2.6)<br />

More likely to offer virtual classrooms and<br />

reference books (20%), electronic job aids,<br />

web support (about 40%), line manager<br />

coaching (60%),<br />

Less likely to offer virtual classrooms and<br />

reference books (10%), electronic job aids,<br />

web support (about 25%), line manager<br />

coaching (45%),<br />

Less likely to offer printed job aids (12%) More likely to offer printed job aids (25%)<br />

Twice as likely to use regular surveys of user<br />

satisfaction (61%)<br />

Less likely to use regular surveys of user<br />

satisfaction (35%) (13% collect no feedback<br />

at all)<br />

Given the significance of directors using e-learning IT capability may be a response to<br />

directors using e-learning rather than vice versa. Training functions rise to the challenge of an<br />

adequate IT infrastructure and confident users, by offering more services, seeing more<br />

opportunities, using more technologies and seeing fewer barriers.<br />

The role of support functions is more important for those organisations lacking an IT capability;<br />

we may assume that it is more difficult to deliver e-learning in such organisations and<br />

therefore training functions need more support from the other support functions, either<br />

practical help or financial endorsement. Business sponsors appear less likely to perceive e-<br />

learning as a suitable route for achieving their business aims in organisations which lack IT<br />

capability.<br />

<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 147


12 Conclusions<br />

The difference in probability of line manager coaching being offered may be because staff<br />

are more confident about requesting such support from line managers when they are also<br />

confident about using PCs, or line managers themselves are more confident about delivering<br />

coaching. Bearing in mind that half the employer respondents have more than 90% of their<br />

staff using PCs regularly confidence in using PCs is a critical element for job performance for<br />

the employer respondents in this survey.<br />

IT capable organisations are more likely to have capable training functions, more likely to<br />

have part of their training function dedicated to e-learning, more likely to demand e-<br />

learning to exact specifications, less likely to use suppliers, more likely to use in-house<br />

development tools but also more likely to be using commercial products. There are a<br />

number of related factors which link the capability of the training function, the infrastructure<br />

and the confidence of learners. Greater capability in all 3 areas increases the number of<br />

ways in which e-learning can be used, who it is delivered to, what technologies are used and<br />

its impact on the business and on staff.<br />

12.7 Chapter 7 – Supporting learners<br />

Learners appreciate the availability of study and consolidation support. Of the 15 options to<br />

learner respondents at least 69%, of those where it was available, found all forms of study<br />

support useful. The most useful, at 88%, are job related assignments, provided by 38% of<br />

employers. Email contact from a tutor, provided by 42% of employers, was useful to 74% of<br />

those where it was available. Learner respondents place a high value upon support in the<br />

workplace with both job related assignments, electronic help, job aids and reference books<br />

valued by more than 80% of those to whom it was available. There is no significant<br />

difference between the method of delivery, either electronic, in person or in print in the<br />

proportion of recipients who considered it useful. All help delivered directly to learners is<br />

considered valuable. Even support mechanism only rarely available, (for example: virtual<br />

learning classrooms, available in 16% of employers and to 17% of learner respondents), is still<br />

considered useful by 72% of those to whom it was available. The method used to deliver<br />

support is of less importance to learners than the fact that it is available.<br />

When making investment decisions about support, organisations need to balance the cost of<br />

that support against the perceived value to recipients. For example, a virtual classroom<br />

which may be expensive to implement, is valued by only 72% of those to whom it is available,<br />

compared to Web reference valued by 81% of those to whom it is available.<br />

There is a consistent difference between synchronous and asynchronous support. The<br />

proportion of respondents who value synchronous methods is 74% and 83% for those who<br />

value asynchronous methods. This supports a conclusion developed elsewhere that<br />

convenience as to time and place for learners is one of the most significant attributes of e-<br />

learning, irrespective of its form or method of delivery. On average most respondents use<br />

about two and a half different methods of support.<br />

Worldwide companies are least likely to offer learner support in person, whereas those with a<br />

relatively few number of UK sites are most likely to offer such support. Global companies are<br />

more likely to provide electronic support through reference sites, organisations with a single<br />

UK site do not fit into the pattern since they make a greater use of electronic support,<br />

however this sector is dominated by the education and health and social work sector, who<br />

are most likely to seek learning support from other organisations also within their sector.<br />

<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 148


12 Conclusions<br />

Those organisations that put more effort into supporting learners in the workplace are more<br />

likely to be found in the upper quartile for business impact. The support mechanisms that are<br />

most closely linked with business impact are reference books, electronic job aids,<br />

reassessment and line manager coaching. Investing effort into these support mechanisms is<br />

likely to show the greatest impact on potential business return from e-learning.<br />

Almost half of learner respondents find e-learning convenient, and are able to put it into<br />

practice and 65% feel empowered and able to take charge of their own development.<br />

Forty percent are interested in recognition and qualifications, the same proportion who<br />

regard e-learning as relevant to their job. Ensuring learners feel empowered and take action<br />

to manage their own development is a significant benefit from e-learning. Twice as many<br />

learner respondents feel empowered as feel they have support from management. Learners<br />

who are empowered also feel they have greater control over their learning, that e-learning is<br />

more directly relevant to their job, they are less likely to feel detached and more likely to feel<br />

supported by management.<br />

12.8 Chapter 8 – Promoting e-learning<br />

The most frequently provided method of promoting e-learning is via email, with newsletters,<br />

management briefings and posters frequently used. Differences emerge with maturity in that<br />

the more mature organisations are more likely to use any one particular communication<br />

method except email and newsletters. The more mature organisations are more likely to use<br />

a greater range of communication methods, both at launch and to sustain interest.<br />

Organisations in the upper quartile for business impact are more likely to use a wider range of<br />

communication methods significantly newsletters, where three quarters in the top quartile will<br />

use newsletters compared to half or less in the 3 lower quartiles, half will use posters<br />

compared to less than 40% of those in the lower quartiles.<br />

Similar differences emerge when we analyse the use of communication methods based<br />

upon the take-up of e-learning. Increased effort into promotion by email, newsletter,<br />

management briefings, posters and open days results in improved take-up. The greatest<br />

difference comes from the use of posters, management briefings and newsletters. Learners<br />

themselves report that email is the communication method most likely to sustain their interest,<br />

with line management briefings, company newsletters and peer testimonies all being<br />

important. Posters were only selected as important for sustaining interest by 10% of the<br />

population and do not appear to be effective for launching e-learning, as less than 2% said<br />

they found out about e-learning from a poster. Email, line management briefings and<br />

company newsletters are the most likely ways in which learners find out about e-learning.<br />

Some slight differences emerge by age, with older learners more likely to respond to email<br />

and younger learners more likely to respond to line management briefings. Those who work<br />

at customer sites tend to find out from emails, those who work from home find out from<br />

newsletters. Line management briefings are least effective for these 2 groups.<br />

In general email is both the most frequently used method of communication and also the<br />

one learner’s are most likely to respond to. There are differences by age and working<br />

pattern. There are learners in special situations and perhaps with personal preferences who<br />

are more likely to respond to other methods of communication. A successful organisation will<br />

use multiple channels of communication, using different styles and types of communication<br />

to learners in different situations. The use of management briefings, newsletters and posters<br />

are effective ways of supporting email and increasing take-up and improving the probability<br />

of e-learning being successful.<br />

<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 149


12 Conclusions<br />

Delivering e-learning at locations which are convenient for learners makes a difference to<br />

the impact e-learning has on them as does giving them the freedom and information to<br />

manage their own development. The aspect that learners feel most positive about e-<br />

learning is that it allows them to learn in a place that is convenient for them. Seven out of 10<br />

learners agree with the statement that technology allows them to learn in a place<br />

convenient for them. Although the provision of e-learning at home is convenient, we may<br />

infer that about a quarter of those who could study at home did actually do so. About 15%<br />

of those who could have used an in-house internal learning centre did so. It would appear<br />

that a quiet place at work is a key enabler for convenience to learners as to place. Learners<br />

were asked who motivated them to learn and about a half chose managers, a quarter<br />

colleagues, training managers 10% and senior executives 5%. There are some differences<br />

that emerge based upon age and management responsibility. Those who do not manage<br />

their own time are least likely to respond to their line manager and younger members of staff<br />

are more likely to respond to their line manager, from whom they are also more likely to find<br />

out about e-learning, as previously reported.<br />

More mature organisations put more effort into collecting feedback from learners. Most<br />

organisations use feedback sheets following each course so this method of collecting<br />

feedback shows little difference with maturity, business impact or staff impact. The<br />

probability of regular surveys being used increases consistently with business impact, maturity<br />

and staff impact.<br />

The self-rated perception questions help us identify a number of key actions that correlate<br />

strongly with improved success at e-learning. These are: demonstrating e-learning success<br />

within the business, enabling staff to quickly put into practice what they learn from e-<br />

learning, personalise the learning experience for each learner, quickly implementing learning<br />

across the organisation, communicating success to managers, the demonstration of<br />

commitment to e-learning by senior management, deploying change management<br />

methodologies to implement e-learning, providing e-learning with a specific identify and<br />

brand and having a clear understanding of what type of e-learning internal IT systems<br />

support. Business impact can also be improved by providing line managers with training and<br />

briefings related to specific e-learning courses and ensuring that staff can access e-learning<br />

at any time.<br />

12.9 Chapter 9 – the changing face of learning<br />

Learners were asked how they went about learning outside of formal programmes and 4 out<br />

of 5 search the Web and use conversations with others, 3 out of 3 use on-line reference<br />

materials and books, 2 out of 5 use industry publications, a quarter use job aids, either printed<br />

or electronic, and 18% participate in on-line discussions. All these methods enable learners to<br />

find things out for themselves (60% of what they learn is by finding things out for themselves).<br />

The 4 technologies that are most likely to be considered useful by learners are all associated<br />

with searching facilities: search engines, general Web reference sources, specific Web<br />

reference sources and searchable on-line books.<br />

It appears that users perceive on-line communities, discussion boards and blogs/wikis as<br />

serving very different purposes. For example, it may be that on-line communities are<br />

perceived as formal structures, it may be that those working from home have difficulty<br />

accessing company-specific internal sources and therefore are more likely to resort to<br />

external resources. In general those of lower educational attainment are less likely to use<br />

any of the informal services offered, although this changes when users are specifically asked<br />

<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 150


12 Conclusions<br />

if they use Web reference sources, as those of lower educational attainment are more likely<br />

to use these resources. It may be that those of lower educational attainment are less<br />

comfortable about participating in collaborative tools, but more comfortable about using e-<br />

learning as a reference source.<br />

Learners were asked if they were willing to use technology to share their knowledge with<br />

others and 84% of respondents agreed that they were either already doing so, or would do<br />

so if they had the opportunity. Twenty-six percent of respondents who already provide this<br />

help is a close match to the 27% who find discussion boards useful. As on-line communities<br />

are only considered helpful by 18% of respondents, it would appear that learners have a<br />

preference for using other forms of collaborative technology rather than on-line<br />

communities. It would appear that learners are willing to work collaboratively but that<br />

existing tools are not giving them the type of collaboration they would prefer. In all cases<br />

reference sources are considered more valuable and helpful to learners than collaborative<br />

services.<br />

A comparison of employer’s plans clearly demonstrates that there is a greater interest in the<br />

particular technologies that support informal learning, rather than the services delivered<br />

through those technologies. It appears that employer respondents think about the<br />

technology first and its application to learning second. Given the possible lack of enthusiasm<br />

by learners for the particular collaborative tools offered, it may be that organisations have to<br />

define more clearly how they will use social software and the types of services they will be<br />

delivering through them. In both cases there is a need to consult users so that the services<br />

and technology provided are attractive to learners ensuring that organisations can benefit<br />

from the willingness of learners to help others learn through an application of technology.<br />

The current and planned provision of informal services and supporting technologies is<br />

analysed by maturity, based upon this we may predict the following growth rates: for<br />

communities of practice 80% by 2010, for search portals and on-line company experts a 20%<br />

growth rate by 2010 and for on-line books and job aids a growth rate of perhaps 10% by<br />

2010.<br />

The provision of these informal services is linked to business impact, with those in the top<br />

quartile significantly more likely to be delivering those services than the bottom quartile. The<br />

use of on-line books/job aids has the greatest effect on business impact: 40% of the bottom<br />

quartile providing this service compared to 85% of those in the top quartile. The availability<br />

of on-line communities and search portals, on the other hand, has the greatest effect on staff<br />

impact. Therefore the investment on on-line books and job aids will give greatest business<br />

return and investment in search portals and on-line communities will give the biggest<br />

changes in staff motivation and behaviour.<br />

Of the 113 respondents providing information about budgets, on average 17% of overall<br />

training budgets were spent on e-learning with an estimated forecast growth of 70% to 26%<br />

as a proportion of training budgets to be spent on e-learning by 2010. Although all sectors<br />

forecast some growth the largest expected growth occurs within IT, telecommunications,<br />

education and transport. Education and IT/ telecommunications already spend more of<br />

their budget on e-learning than organisations in other sectors. The more mature<br />

organisations spend more of their budget on e-learning; almost a quarter compared to<br />

approximately 5% of the less mature. The proportion of budget spent on e-learning does<br />

have an impact on take-up, availability, business impact and staff impact. Those who spend<br />

a greater proportion of their budget on e-learning achieve improved take-up, availability,<br />

business impact and staff impact. Increasing spend from 10% of budget to 30% of budget<br />

improves the self-rating of staff impact from 4.3 to six, take-up from 4.4 to 6.3, business impact<br />

from five to seven and availability from 5.9 to 6.8. The change in availability shows least<br />

<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 151


12 Conclusions<br />

difference with an increased proportion spent on e-learning. Those organisations that spend<br />

more must therefore be channelling this expenditure into areas that have a greater effect on<br />

business impact than on the availability of e-learning. The assumption is that this goes<br />

towards change management and promotional activities and it is these activities that<br />

increase the business impact, staff impact and take-up of e-learning.<br />

12.10 Chapter 10 – Comparison of education sector with others<br />

The education sector achieves less business impact, staff impact, availability of e-learning<br />

and take-up than do other sectors. It would appear that non-educational organisations are<br />

more successful at e-learning than those in the education sector. Significantly the education<br />

sector perceives itself to be less successful at using change management, improving record<br />

keeping, applying a brand and identity to e-learning, providing information that is easy to<br />

use, using appraisal, having managers coach their teams, having the skills to manage<br />

providers, completing an audit of their training functions, paying attention to compliance<br />

and tracking and ensuring that learners know what is available for them. It would appear<br />

that the education sector could learn from other sectors as regards the promotion,<br />

marketing and change management for e-learning. The education sector is less likely to<br />

select any of the drivers listed except for the requirement to maintain the public image of a<br />

progressive and innovative organisation (selected by 35% in the education sector, 15% of<br />

others), organisational change (35% in education, 23% of others) and pressure from senior<br />

management (10% in education, 4% of others). Image and organisational change matters<br />

more to those in the education sector and cost qualifications and administration matters less.<br />

Companies in the education sector are less likely to provide training in every topic area<br />

except that of literacy and numeracy. Where training is offered e-learning is less likely to be<br />

used than by any other sector, except for foreign language training. However, educational<br />

organisations are more likely to use e-learning to support programmes leading to<br />

qualifications. The education sector is leading the way in deploying e-learning for<br />

programmes which lead to qualifications. The education sector is less likely to deliver e-<br />

learning to every role except professional grade staff; this is most noticeable at a senior level.<br />

Given the importance of the leadership role for directors it may be that ensuring senior staff<br />

use e-learning personally is the most significant lesson educational organisations can learn<br />

from other sectors.<br />

Educational organisations are more likely to have a strategy (42%) than others (31%). Useful<br />

lessons other sectors can learn from the education sector is to have an e-learning strategy<br />

and to seek ways in which e-learning can be used to support qualification programmes.<br />

The education sector is less likely to use rapid development tools and more likely to use tools<br />

designed for Web experts and programmers. This may be because rapid development tools<br />

are most appropriate to training procedures and IT practices and the education sector has<br />

less need of this type of training and a greater need for training that requires more<br />

interactive and innovative e-learning, which is better developed with the use of more<br />

sophisticated development tools. Educational organisations are less likely to work in<br />

partnership with an e-learning vendor, possibly because they perceive they have the e-<br />

learning expertise themselves, although this is not borne out by the responses to the selfperception<br />

questions. It would appear that the education sector develops more complex<br />

and less procedurally based e-learning and is more likely to work with others in the same<br />

sector rather than seek support from elsewhere.<br />

<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 152


12 Conclusions<br />

The education sector makes more effort to support learners than those in other sectors. They<br />

are twice as likely to use telephone and in-person support than other sectors and this is also<br />

true for technical support. The education sector puts more effort into supporting learners<br />

when studying e-learning, particularly when the personal touch is required, and makes a<br />

greater provision for personal contact for technical support.<br />

Apart from the provision of line management coaching in general the education sector is<br />

less likely to provide support to consolidate learning on the job. An apparent difference in<br />

two sets of questions relating to line management coaching may be that the greater<br />

occurrence of line management coaching support after learning does not translate to<br />

effective coaching as normal practice.<br />

The education sector is more likely to be using the collaborative tools of chat rooms, VLEs,<br />

virtual classrooms and blogs and wikis. They are less likely to be using the more procedural<br />

tools of LMS, Competency Management Systems and EPSS. It is probable that the education<br />

sector recognises the value and importance of collaborative learning and takes steps to<br />

provide the on-line tools for this to occur. They make more use of open-source tools, perhaps<br />

because of probable budget constraints.<br />

The education sector is less likely to perceive unreliable ICT as a barrier and slightly less likely<br />

to perceive access to PCs as a barrier. They are more likely to perceive that a lack of skills to<br />

manage e-learning in the future will be a barrier. They are also in general less positive about<br />

their view of their own training function capability.<br />

They are more enthusiastic about the future of e-learning than other sectors and more likely<br />

to be making plans. They are more likely to be planning to introduce CMS/VLEs, chat rooms,<br />

blogs/wikis, pod casting, video on demand, games and simulations, open-source tools and<br />

rapid development tools than those in other sectors. In other words, what they are already<br />

doing more of they intend to continue doing more of; if anything, opening the lead over<br />

other sectors. However, they are less likely to be planning the use of Competency<br />

Management Systems, LMS, EPSS, e-portfolios and virtual classrooms. This latter software tool<br />

is the only one to show a discrepancy since the educational sector already makes a greater<br />

use of this tool but in fact the non-educational sector is more likely to be planning for its<br />

future use. An analysis of the various responses in relation to CMS/VLE indicates that most of<br />

the education sector will be using Content Management Systems by 2010. However, this<br />

question did include the definition of Virtual Learning Environments and the education sector<br />

may be interpreting these as environments in which students and learners can exchange<br />

content in a safe and secure environment. The education sector will continue to take the<br />

lead in collaborative learning, evidenced by its greater interest in the technology tools that<br />

supports social learning and the greater effort they put into supporting learners, both before,<br />

during and after study.<br />

12.11 Chapter 11 – the future of learning<br />

Four out of 5 employers will place greater emphasis on informal learning in the future. There<br />

will be an increase in the availability and use of electronic learning records and e-learning<br />

will continue to be considered as a component in the learning on offer, rather than a sole<br />

delivery method. However, many organisations are likely to continue to perceive that e-<br />

learning will not be suitable for every topic. Sixty percent of the less mature do not think this<br />

will happen. At an early stage organisations primarily use e-learning for IT skills. As they<br />

become more mature they increasingly use e-learning for a wider range of topics.<br />

<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 153


12 Conclusions<br />

Since 2004 there is a wider appreciation of the importance of training records and a greater<br />

understanding that e-learning is not a sole delivery method. There is slightly less change in<br />

the view that e-learning will be suitable for all applications, although as previously discussed<br />

this does change significantly with maturity.<br />

The most frequently selected barriers were: cost, staff resistance, lack of knowledge about<br />

the potential of e-learning, lack of e-learning management skills, the lack of relevant quality<br />

material and, for the less mature, the content that is available is too generic and that their<br />

staff lack IT skills. <strong>Maturity</strong> is therefore linked to a greater appreciation that content can be<br />

created, or that generic content can be modified to make it more specific and relevant.<br />

<strong>Maturity</strong> also brings with it a reduction in the probability of staff ICT skills being a barrier, most<br />

likely because generic IT skills are part of the e-learning offer and most likely to be provided<br />

by the less mature organisations. The more mature organisations are also significantly less<br />

likely to select a lack of e-learning management skills as a barrier.<br />

The public administration sector is more likely to report staff resistance and inadequate ICT<br />

than other sectors. The manufacturing sector is more likely to cite a lack of staff IT skills and<br />

lack of skills to manage e-learning as barriers. The sector that reports fewest barriers is IT and<br />

telecommunication, followed by education. The sectors most likely to report barriers are<br />

health, public administration and manufacturing.<br />

A comparison with 2004 shows that culture change, user objections and staff resistance<br />

remain as one of the most frequently cited barriers. In 2004 cost was selected by only 7% of<br />

respondents and this has risen to 44% in 2006. This may because organisations are seeking to<br />

implement e-learning far more widely across organisations, or it may be because increased<br />

experience has shown that the process is not as inexpensive as first considered. Part of the<br />

cost may be the increased effort organisations have to put in to winning the hearts and<br />

minds of e-learners to overcome user resistance. The lack of relevant quality content is a<br />

much more significant barrier than it used to be, perhaps because there is a greater<br />

understanding that company and industry-specific skills are an area where organisations<br />

have to create material and that there is a greater interest in doing so. ICT remains a barrier<br />

for about a quarter of organisations, although much of this report indicates that the barrier is<br />

significantly less of a problem in 2006 than it was in 2004. This latter view is principally<br />

supported by respondents having a significantly more positive view about e-learning and its<br />

availability and implementation now than they did in 2004. More respondents perceive that<br />

it is difficult to prove the financial return now than did in 2004; more than twice as many.<br />

There has been an improvement in the availability of e-learning and ICT infrastructure but<br />

otherwise there does not appear to have been much improvement since 2004. More<br />

mature organisations do better against the average of the 2004 results, so progression<br />

towards maturity does enable organisations to improve their performance compared to the<br />

averages reported in 2004.<br />

Employer respondents tend to seek advice from sources where they can be reasonably<br />

anonymous, Web sites, exhibitions and conferences being top of the list. Government<br />

funded sources, such as SSCs and Business Link, are used by less than one out of 5<br />

respondents. Additional help that employer respondents seek are associated with<br />

promotion, implementation and evaluation of e-learning. Given the low probability of<br />

respondents having audited the skills of their training team and the part that this plays in the<br />

change management process it is disappointing to see that only one in 5 of respondents<br />

request help associated with implementing and managing e-learning.<br />

<strong>Towards</strong> <strong>Maturity</strong>: Insights for Employers and Training Providers| © 2007 e-skills UK 154

Hooray! Your file is uploaded and ready to be published.

Saved successfully!

Ooh no, something went wrong!