23.07.2013 Views

View the presentation - Dr. Gregory L. Plett

View the presentation - Dr. Gregory L. Plett

View the presentation - Dr. Gregory L. Plett

SHOW MORE
SHOW LESS

You also want an ePaper? Increase the reach of your titles

YUMPU automatically turns print PDFs into web optimized ePapers that Google loves.

Web-Assisted Learning<br />

via On-Line Course Supplements<br />

<strong>Dr</strong>s. <strong>Gregory</strong> L. <strong>Plett</strong> and Mark A. Wickert<br />

Electrical and Computer Engineering Department<br />

University of Colorado at Colorado Springs<br />

P.O. Box 7150, Colorado Springs, CO 80933–7150<br />

24 June 2003 Web-Assisted Learning via On-Line Course Supplements G. L. <strong>Plett</strong> and M. A. Wickert [1]


Overview<br />

What are course supplements? How should <strong>the</strong>y be made<br />

available (style, format, media)?<br />

¡<br />

¡<br />

The EduFile Course Supplement Management System<br />

Student perspective;<br />

Faculty perspective.<br />

Assessment via data logging and survey results.<br />

Conclusions<br />

24 June 2003 Web-Assisted Learning via On-Line Course Supplements G. L. <strong>Plett</strong> and M. A. Wickert [2]


Course Supplements<br />

Some examples: Lecture notes, lecture audio/video,<br />

homework hints, homework solutions, worked example<br />

problems, sample tests and sample computer code.<br />

The Internet is an efficient means to distribute supplements.<br />

We discuss results of a project with three main objectives:<br />

1. Develop standards of style and format for supplements;<br />

2. Develop simple means whereby <strong>the</strong> instructor may add<br />

materials to <strong>the</strong> course web-site;<br />

3. Develop automatic evaluation means to determine if <strong>the</strong><br />

on-line course supplements assist student learning.<br />

24 June 2003 Web-Assisted Learning via On-Line Course Supplements G. L. <strong>Plett</strong> and M. A. Wickert [3]


Supplement Format and Style<br />

To aid accessibility, standardize file formats and style.<br />

Style: A constant template for homework assignments and<br />

solutions, documentation standards for code segments.<br />

Consistency allows a student to decode content readily.<br />

Format: Open-standard file formats provide universal<br />

access and eliminate economic prejudice; e.g., PDF files in<br />

preference to proprietary document formats. PDF<br />

preserves fonts, formatting, graphics and color of <strong>the</strong><br />

source document. Where PDF files are not appropriate, we<br />

use standard ASCII text files where possible.<br />

24 June 2003 Web-Assisted Learning via On-Line Course Supplements G. L. <strong>Plett</strong> and M. A. Wickert [4]


Delivery Method (I): The Internet<br />

The Internet is an obvious choice: It can be accessed from<br />

anywhere at any time; it may be used to transmit programs<br />

or code segments, which must be re-typed if delivered in<br />

paper media; and it is <strong>the</strong> only reasonable way to make<br />

audio, video and data files available to large numbers of<br />

students.<br />

However, a simple file repository is an untenable solution as<br />

<strong>the</strong> number of supplements becomes large. Students lose<br />

track of which files <strong>the</strong>y have downloaded, and <strong>the</strong>re is no<br />

apparent organization.<br />

24 June 2003 Web-Assisted Learning via On-Line Course Supplements G. L. <strong>Plett</strong> and M. A. Wickert [5]


Delivery Method (II): Dynamic Documents<br />

Course materials are dynamic documents. They are<br />

developed and are modified as <strong>the</strong> semester progresses.<br />

The student needs to know when a file has been updated.<br />

An Internet site could be developed that keeps a data-base<br />

of all download activity for each student and can <strong>the</strong>n mark<br />

supplement-material files as being “not yet downloaded”,<br />

“updated since last download” or “unchanged since last<br />

download” with respect to <strong>the</strong> student querying <strong>the</strong> site.<br />

We have developed such a site.<br />

24 June 2003 Web-Assisted Learning via On-Line Course Supplements G. L. <strong>Plett</strong> and M. A. Wickert [6]


EduFile<br />

We call <strong>the</strong> web-based software created to meet <strong>the</strong><br />

aforementioned needs <strong>the</strong> “EduFile Course Supplement<br />

Management System” or simply EduFile.<br />

Technical details: EduFile is written in PERL and uses a<br />

mysql database to manage information on students,<br />

supplements, courses and so forth. We use a Linux-based<br />

platform with an Apache web server.<br />

First, we describe <strong>the</strong> students’ perspective and <strong>the</strong>n <strong>the</strong><br />

faculty / instructor perspective.<br />

24 June 2003 Web-Assisted Learning via On-Line Course Supplements G. L. <strong>Plett</strong> and M. A. Wickert [7]


ˆyk<br />

Student Log-On Screen<br />

When <strong>the</strong> student<br />

browses to <strong>the</strong> course<br />

e<br />

homepage, she sees <strong>the</strong><br />

screen to <strong>the</strong> right.<br />

(sys)<br />

k<br />

The student must<br />

register <strong>the</strong> first time she<br />

uses EduFile.<br />

yk<br />

ˆyk<br />

ˆyk<br />

ˇyk<br />

˜yk<br />

After that, she types Temporal her<br />

username and password Delay<br />

to enter <strong>the</strong> system.<br />

˜dk<br />

dk<br />

e (mod)<br />

k<br />

˜e (sys)<br />

k<br />

˜εk<br />

˜εk<br />

rk− P<br />

24 June 2003 Web-Assisted Learning via On-Line Course Supplements G. L. <strong>Plett</strong> and M. A. Wickert [8]


Student Registration<br />

The student does not automatically have access to <strong>the</strong><br />

course supplements. On registration, EduFile sends an<br />

email message to <strong>the</strong> course instructor:<br />

Student user 112233 has requested to download supplements<br />

for course ECE3510. Go to http://edufile.uccs.edu/<br />

facultyadmin/ to log in and enable this user.<br />

The instructor must “enable” access for each student.<br />

EduFile will automatically send an email:<br />

Student user account for 112233 has been enabled. Go to<br />

http://edufile.uccs.edu/?course_id=ECE3510/ to log in.<br />

Only <strong>the</strong>n may <strong>the</strong> student access <strong>the</strong> supplements.<br />

24 June 2003 Web-Assisted Learning via On-Line Course Supplements G. L. <strong>Plett</strong> and M. A. Wickert [9]


ˆyk<br />

The Main Supplement Access Page<br />

On log-on, <strong>the</strong> student<br />

accesses <strong>the</strong> main page,<br />

shown to <strong>the</strong> right.<br />

Course information is one<br />

top, supplement<br />

information is below.<br />

(sys)<br />

Supplements are<br />

annotated, and marked<br />

yk<br />

yk<br />

yk<br />

ˆyk<br />

ˇyk<br />

ˆyk<br />

˜yk<br />

˜εk<br />

as downloaded or not, rk− P<br />

updated or not. Temporal<br />

Delay<br />

˜dk<br />

dk<br />

k<br />

e (mod)<br />

k<br />

˜e (sys)<br />

k<br />

˜εk<br />

24 June 2003 Web-Assisted Learning via On-Line Course Supplements G. L. <strong>Plett</strong> and M. A. Wickert [10]


yk<br />

yk<br />

ˆyk<br />

ˆyk<br />

ˇyk<br />

ˆyk<br />

Instructor Log-On<br />

˜yk<br />

˜dk<br />

All instructor log-on is done through <strong>the</strong> browser’s<br />

dk<br />

au<strong>the</strong>ntication procedure.<br />

e<br />

The log-on dialog is shown below.<br />

(sys)<br />

k<br />

e (mod)<br />

k<br />

˜e (sys)<br />

k<br />

˜εk<br />

˜εk<br />

rk− P<br />

Temporal<br />

Delay<br />

24 June 2003 Web-Assisted Learning via On-Line Course Supplements G. L. <strong>Plett</strong> and M. A. Wickert [11]


ˆyk<br />

ˆyk<br />

ˇyk<br />

ˆyk<br />

Instructor Welcome Page<br />

˜yk<br />

˜dk<br />

dk<br />

e (sys)<br />

k<br />

e<br />

The main instructor page<br />

allows creating a course,<br />

editing a course, or<br />

viewing <strong>the</strong> student<br />

activity log (for<br />

assessment).<br />

(mod)<br />

k<br />

˜e (sys)<br />

k<br />

˜εk<br />

˜εk<br />

rk− P<br />

Temporal<br />

Delay<br />

24 June 2003 Web-Assisted Learning via On-Line Course Supplements G. L. <strong>Plett</strong> and M. A. Wickert [12]


yk<br />

yk<br />

ˆyk<br />

ˆyk<br />

Edit Courseˇyk Information<br />

ˆyk<br />

˜yk<br />

The top of <strong>the</strong> course e<br />

information page allows<br />

changing instructor,<br />

changing course<br />

description or course<br />

name.<br />

(sys)<br />

k<br />

e (mod)<br />

k<br />

˜e (sys)<br />

k<br />

˜εk<br />

˜εk<br />

rk− P<br />

Temporal<br />

Delay<br />

˜dk<br />

dk<br />

24 June 2003 Web-Assisted Learning via On-Line Course Supplements G. L. <strong>Plett</strong> and M. A. Wickert [13]


yk<br />

˜yk<br />

˜dk<br />

dk<br />

e (sys)<br />

k<br />

e (mod)<br />

˜e (sys)<br />

ˆyk<br />

ˆyk<br />

ˇyk<br />

ˆyk<br />

˜yk<br />

k ˜dk<br />

˜εk<br />

Edit Supplement/Student k Information<br />

dk<br />

˜εk<br />

e<br />

The middle of <strong>the</strong> course rk− P<br />

information page allows Temporal<br />

Delay<br />

changing supplement<br />

descriptions.<br />

The bottom allows<br />

changing student access<br />

privileges.<br />

(sys)<br />

k<br />

e (mod)<br />

k<br />

˜e (sys)<br />

k<br />

˜εk<br />

˜εk<br />

rk− P<br />

Temporal<br />

Delay<br />

24 June 2003 Web-Assisted Learning via On-Line Course Supplements G. L. <strong>Plett</strong> and M. A. Wickert [14]


Noise, vk<br />

rk<br />

uk<br />

uk<br />

ũk<br />

ũk<br />

uk<br />

ũk<br />

yk<br />

yk<br />

yk<br />

ˆyk<br />

ˆyk<br />

ˇyk<br />

ˆyk<br />

˜yk<br />

˜dk<br />

dk<br />

e (sys)<br />

k<br />

e (mod)<br />

k<br />

˜e (sys)<br />

k ˜εk<br />

˜εk<br />

Number of Documents Retrieved<br />

rk− P<br />

Temporal<br />

Delay<br />

30<br />

25<br />

20<br />

15<br />

10<br />

5<br />

Noise, vk<br />

rk<br />

uk<br />

uk<br />

ũk<br />

ũk<br />

uk<br />

ũk<br />

Student Access per Day and Week<br />

0<br />

01/20 01/27 02/03 02/10 02/17 02/24 03/03 03/10 03/17<br />

Date − mm/dd of 2002<br />

yk<br />

yk<br />

yk<br />

Data logging allows flexible assessment. ˆyk For example, <strong>the</strong><br />

ˆyk<br />

figures below show histograms of student access per day<br />

ˇyk<br />

and per week.<br />

ˆyk<br />

˜yk<br />

˜dk<br />

ECE 3610 EduFile Visits Per Day<br />

ECE 3610 EduFile Visits Per Week<br />

90<br />

dk<br />

e (sys)<br />

k<br />

e (mod)<br />

k<br />

˜e (sys)<br />

k ˜εk<br />

˜εk<br />

rk− P<br />

Number of Documents Retrieved<br />

Temporal<br />

Delay<br />

80<br />

70<br />

60<br />

50<br />

40<br />

30<br />

20<br />

10<br />

0<br />

01/01 02/01 03/01 04/01<br />

Date − mm/dd of 2002<br />

24 June 2003 Web-Assisted Learning via On-Line Course Supplements G. L. <strong>Plett</strong> and M. A. Wickert [15]


k<br />

rk<br />

uk<br />

uk<br />

ũk<br />

ũk<br />

uk<br />

ũk<br />

yk<br />

yk<br />

yk<br />

ˆyk<br />

ˆyk<br />

ˇyk<br />

ˆyk<br />

˜yk<br />

˜dk<br />

dk<br />

e (sys)<br />

k<br />

e (mod)<br />

k<br />

˜e (sys)<br />

k ˜εk<br />

˜εk<br />

rk− P<br />

Temporal<br />

Number of Documents Retrieved<br />

90<br />

80<br />

70<br />

60<br />

50<br />

40<br />

30<br />

20<br />

10<br />

yk<br />

Student Access yk by Hour<br />

ˆyk<br />

Surprisingly, most students observed ˇyk reasonable hours.<br />

ˆyk<br />

Most downloads occurred directly after class.<br />

˜yk<br />

˜dk<br />

ECE 3610 EduFile Visits by Hour dk ECE 3610 EduFile Visits by Hour on Thursdays<br />

0<br />

0<br />

18:00 00:00 06:00 12:00 18:00 00:00<br />

18:00 00:00 06:00 12:00 18:00 00:00<br />

Delay Delay<br />

Time − hh/mm<br />

Time − hh/mm on Thursdays<br />

k<br />

rk<br />

uk<br />

uk<br />

ũk<br />

ũk<br />

uk<br />

ũk<br />

yk<br />

ˆyk<br />

e (sys)<br />

k<br />

e (mod)<br />

k<br />

˜e (sys)<br />

k ˜εk<br />

˜εk<br />

rk− P<br />

Temporal<br />

24 June 2003 Web-Assisted Learning via On-Line Course Supplements G. L. <strong>Plett</strong> and M. A. Wickert [16]<br />

Number of Documents Retrieved<br />

30<br />

25<br />

20<br />

15<br />

10<br />

5


Noise, vk<br />

rk<br />

uk<br />

uk<br />

ũk<br />

ũk<br />

uk<br />

ũk<br />

yk<br />

yk<br />

yk<br />

Scatter Plot<br />

Scatter plotsˆyk of student grades versus number of<br />

ˆyk<br />

downloads showed ˇyk no linear correlation between grades<br />

and supplements ˆyk (except that more downloads seemed to<br />

˜yk<br />

result in a passing grade).<br />

˜dk<br />

dk<br />

e (sys)<br />

k<br />

e (mod)<br />

k<br />

˜e (sys)<br />

k<br />

˜εk<br />

˜εk<br />

rk− P<br />

Temporal<br />

Delay<br />

Student Final Average Percent<br />

100<br />

95<br />

90<br />

85<br />

80<br />

75<br />

70<br />

65<br />

60<br />

55<br />

ECE 3610 EduFile Score vs Downloads Scatter Plot<br />

50<br />

0 5 10 15 20 25 30 35<br />

Number of Documents Retrieved<br />

24 June 2003 Web-Assisted Learning via On-Line Course Supplements G. L. <strong>Plett</strong> and M. A. Wickert [17]


Survey Responses<br />

We conducted a survey to evaluate EduFile.<br />

Students indicated that <strong>the</strong>y frequently downloaded<br />

homework assignments, solutions, and sample exams—<br />

simulation files and updated lecture notes less frequently.<br />

The utility of <strong>the</strong> supplements was highly rated, especially<br />

for homeworks, homework solutions and practice exams.<br />

They were very pleased with <strong>the</strong> convenience and were not<br />

concerned with “invasion” of privacy (by logging accesses).<br />

The most frequent comments in <strong>the</strong> write-in section were<br />

“please add more practice exams”, “please add worked<br />

problems” and “please add solutions to practice exams”.<br />

24 June 2003 Web-Assisted Learning via On-Line Course Supplements G. L. <strong>Plett</strong> and M. A. Wickert [18]


Conclusions<br />

EduFile is an Internet-based supplement management<br />

system that we have designed and implemented.<br />

We hypo<strong>the</strong>sized that benefit to student learning would be<br />

significant; however, our findings were statistically<br />

inconclusive as to whe<strong>the</strong>r grades were improved.<br />

Survey responses indicate that <strong>the</strong> students <strong>the</strong>mselves<br />

believed <strong>the</strong> supplements to be very helpful, and <strong>the</strong><br />

Internet system to be very convenient.<br />

Our plan is to incrementally add courses to <strong>the</strong> EduFile<br />

system, as we teach <strong>the</strong>m.<br />

24 June 2003 Web-Assisted Learning via On-Line Course Supplements G. L. <strong>Plett</strong> and M. A. Wickert [19]


Acknowledgment<br />

This work was supported in part by a grant from <strong>the</strong><br />

University of Colorado at Colorado Springs’ Teaching and<br />

Learning Center. Any opinions, findings, and conclusions or<br />

recommendations expressed in this paper are those of <strong>the</strong><br />

authors and do not necessarily reflect <strong>the</strong> views of <strong>the</strong><br />

University of Colorado at Colorado Springs, or of <strong>the</strong><br />

Teaching and Learning Center.<br />

The majority of <strong>the</strong> code in EduFile was written under<br />

subcontract by Mat<strong>the</strong>w Long of Mat<strong>the</strong>w Long Enterprises,<br />

http://www.mat<strong>the</strong>w-long.com.<br />

24 June 2003 Web-Assisted Learning via On-Line Course Supplements G. L. <strong>Plett</strong> and M. A. Wickert [20]

Hooray! Your file is uploaded and ready to be published.

Saved successfully!

Ooh no, something went wrong!