Elements of Quality Online Education cation

Implementing Curricula Using a Variety of Learning Modalities at Liberty Mutual GroupE. Front-Line Manager AssessmentOne year following a new manager’s completion of Building the Capabilities for Success, the managerparticipates in the Front-Line Manager Assessment. This portion of the curriculum uses an onlineassessment independently completed by the Front-Line Manager and his/her immediate manager. Theassessment is based on 17 Front-Line Manager capabilities, each containing three to four dimensions.These capabilities were identified through an extensive job task analysis in 2003. The analysis providedadditional depth to the initial analysis that was conducted in 1997.Once the assessment results are completed, the Front-Line Manager and his/her manager meet to discussthe results and reach agreement on the focus of future development activities. Managers can assesssuggested development activities on the web to plan development activities mapped to capability areas.F. Front-Line Manager Curriculum Results Mapped against the Sloan-CPillars1. Learning EffectivenessLiberty measures learning effectiveness at three points in time. First, in each portion of the curriculumLiberty asks learners to rate their own ability to meet the course objectives. In some programs this is apre/post session comparison. In other programs only a post-session evaluation is used. Second, criterionreferencedtests are used [1]. These tests help learners assess the degree to which they have acquired thetargeted knowledge and skills. Finally, course participants are also surveyed three to six months after theclassroom session and asked if they have applied the skills acquired in the course back on the job.These results can be mapped against the core curriculum objectives to determine the success of thetraining. The table below presents 2003 results for the Front-Line Manager classroom program.Building the Capabilities Session forSuccessful Program ObjectivesTable 5. Front-Line Manager Classroom ResultsSelf-AssessmentPre PostKnowledgeTestUse tools for creating customer value 66% 89% 80% 60%OTJApplicationPractice Liberty’s management principles and 52% 94% 82% 90%beliefs and management-leadership frameworkApply HR strategy 45% 89% 91% 76%Use 4-step selection process 58% 90% 84% 53%*Make valid performance decisions and 60% 90% 93% 82%communicate them to employeesApply and communicate compensation 44% 87% 86% 92%philosophiesUse coaching and feedback techniques to 57% 90% 97% 97%address employee performance development*Note: 39% indicated no opportunity to select a new staff memberOverall, these results document successful transfer of knowledge and skill from the instructional domainto actual on-the-job application. The on-the-job application results with lower application percentages138