30.07.2015 Views

Proceedings in pdf format. - Sociotechnical Systems Engineering ...

Proceedings in pdf format. - Sociotechnical Systems Engineering ...

Proceedings in pdf format. - Sociotechnical Systems Engineering ...

SHOW MORE
SHOW LESS

You also want an ePaper? Increase the reach of your titles

YUMPU automatically turns print PDFs into web optimized ePapers that Google loves.

Field studiesTraditional field studies require watch<strong>in</strong>g users<strong>in</strong>teract with the application <strong>in</strong> their own environments.Users have to be observed complet<strong>in</strong>g the course, either<strong>in</strong> person or via Web or phone conferenc<strong>in</strong>g.As mentioned earlier, EDUSA comb<strong>in</strong>es elements offield studies and usability tests <strong>in</strong> order to give user mostconvenient environment while perform<strong>in</strong>g the evaluationof his/her satisfaction <strong>in</strong> the background.Time consum<strong>in</strong>g solutionsMany of traditional e-learn<strong>in</strong>g assessment methodsare very time consum<strong>in</strong>g. They often require hours(sometimes even weeks) to perform an evaluation cycle(Shilwant and Haggarty 2005). In most cases, theseapproaches require writ<strong>in</strong>g reviews, fill<strong>in</strong>g questionnairesor evaluation reports manually.Event Monitor shows graphical representation of (1)selected user participation activities; (2) selected systemresponse activities and/or (3) a value calculated fromparticipation and response data accord<strong>in</strong>g to the selectedmodel to be described <strong>in</strong> this paper.Event Log shows time, type, and textualrepresentation of (1) selected user participation events,(2) selected system response events. Evaluator can usethe scrollbar to review each of the Event Log entriestogether with its graphical representation with<strong>in</strong> EventMonitor.Figure 1 shows graphical user <strong>in</strong>terface of EDUSAAmbient Usability Assessment Meter.Expensive solutionsPerson-hours of hired usability experts can be veryexpensive. Traditional non-automated e-learn<strong>in</strong>g test<strong>in</strong>gsolutions normally depend on experts’ availability.Technology loaded solutionsMak<strong>in</strong>g <strong>in</strong>terviews and the subsequent audio/videopost-production requires usage of correspond<strong>in</strong>gtechnology (video cameras, microphones, tape recorders,etc.). Only well equipped highly professional usabilityevaluation labs have the necessary means to produce thatsort of good quality materials.New approach of assess<strong>in</strong>g learn<strong>in</strong>g tasks for multitask<strong>in</strong>glearners us<strong>in</strong>g EDUSAIntegrated system-wide scann<strong>in</strong>g skillsEDUSA evaluation method emphasizes the organicand functional relation between all parts (tasks) and thewhole system (<strong>in</strong> broader sense – human, computer andsurround<strong>in</strong>g ambience).EDUSA acts task <strong>in</strong>dependently at the very core ofthe operational system. It connects to the humancomputer<strong>in</strong>terface to scan all the communicationbetween user and system. The result<strong>in</strong>g <strong>in</strong><strong>format</strong>ion issearched for programmatically recognizable patterns ofhuman behaviour (e-gestures) and used to identifylearner’s subjective satisfaction with the learn<strong>in</strong>gmaterial. Optionally EDUSA can build and exportlearner’s profile that can be later used with other multitask<strong>in</strong>gevaluation sessions.Figure 1. EDUSA Ambient Usability Assessment Meter.Display at the top of the screen shows the real-timevalues for (1) weighted cumulative value of userparticipation and system response values, (2) degree ofuser participation, (3) degree of system response, (4)current session time and (5) current Event Monitor time.File menu is used to access functionality forload<strong>in</strong>g/sav<strong>in</strong>g the (1) environment parameters, (2) userprofiles and (3) session log files.Tools menu is used to access functionality for (1)creat<strong>in</strong>g/edit<strong>in</strong>g hotspots (evaluator-def<strong>in</strong>ed areas <strong>in</strong>sidetask w<strong>in</strong>dows that can capture specified user activities),(2) analyz<strong>in</strong>g currently loaded session and (3) generat<strong>in</strong>gsummary (currently <strong>in</strong> MS Excel file <strong>format</strong>).Help menu is used to access software documentationand client support files.Annual <strong>Proceed<strong>in</strong>gs</strong> of Vidzeme University College “ICTE <strong>in</strong> Regional Development”, 200632

Hooray! Your file is uploaded and ready to be published.

Saved successfully!

Ooh no, something went wrong!