12.12.2012 Views

WINTER 2012 - National Association of Schools of Public Affairs and ...

WINTER 2012 - National Association of Schools of Public Affairs and ...

WINTER 2012 - National Association of Schools of Public Affairs and ...

SHOW MORE
SHOW LESS

You also want an ePaper? Increase the reach of your titles

YUMPU automatically turns print PDFs into web optimized ePapers that Google loves.

Pamela A. Gibson <strong>and</strong> Pamela Trump Dunning<br />

instructional design staff for each college provide the foundation for successful<br />

course development <strong>and</strong> the freedom to take risks in applying new technological<br />

features in courses.<br />

PEER-REVIEW PROCESS<br />

Troy University instituted QAI in the fall <strong>of</strong> 2008, when it became a QM<br />

consortium member. Four times each year, courses are selected to be peerreviewed<br />

by a faculty member or team within a teaching discipline at the<br />

university. The department chairs, college deans, <strong>and</strong> associate deans select<br />

courses to be peer-reviewed. The courses selected are based on program st<strong>and</strong>ards<br />

within each discipline. Mature courses, those that have been taught at least one<br />

full academic year, qualify for review. A review may also be triggered by the<br />

introduction <strong>of</strong> new course textbooks, a new instructor, or if a program has a<br />

pending pr<strong>of</strong>essional or accreditation review. Faculty may request that a course<br />

be reevaluated if its initial review was more than 3 years ago.<br />

The assessors are qualified, full-time faculty members who hold academic<br />

rank within the specific academic discipline <strong>and</strong> are appointed by their<br />

department chair. On occasion, a course requiring specialized expertise may call<br />

for an adjunct instructor to assess the course; however, the instructor must have<br />

at least one year <strong>of</strong> teaching experience with the university <strong>and</strong> have completed<br />

the training noted earlier. Assessors use the Quality Matters rubric <strong>and</strong> receive<br />

individualized training, depending on the knowledge level <strong>of</strong> the faculty<br />

member. To date, 12 faculty members have completed the QM Peer Reviewer<br />

Certification course. Sixty-five faculty members have completed the university<br />

training <strong>and</strong> conducted reviews that require, on average, 2 hours to complete.<br />

The QM rubric contains 40 different review st<strong>and</strong>ards. 1 These st<strong>and</strong>ards<br />

focus on course learning objectives, student assessment <strong>and</strong> evaluation,<br />

interactive strategies used between pr<strong>of</strong>essor <strong>and</strong> student, learning resources <strong>and</strong><br />

materials, learner support, <strong>and</strong>, most important, how the course is delivered in<br />

an Internet-based venue. Each st<strong>and</strong>ard is allotted a different score, depending<br />

on its significance to the course design, for a total <strong>of</strong> 85 points. According to the<br />

QM st<strong>and</strong>ards, a course must earn a total <strong>of</strong> 72 points (or an 85% pass rate) to<br />

qualify for QM recognition; <strong>of</strong> those points, 51 must be acquired by satisfying<br />

17 essential st<strong>and</strong>ards (Fortune, 2008). The assessor enters the Bb course as an<br />

unidentified registered “guest.” Therefore, the instructor is aware that the course<br />

is being reviewed but does not know who is reviewing it.<br />

By 2010, over 240 courses university-wide had been the subject <strong>of</strong> review;<br />

62% satisfied the st<strong>and</strong>ards set forth by QM (meeting the 85% threshold or<br />

above), <strong>and</strong> 38% were missing at least one essential st<strong>and</strong>ard (Fortune & Woods,<br />

2010). As <strong>of</strong> July 2011, the number <strong>of</strong> courses reviewed has increased to 420+<br />

course sections covering over 50% <strong>of</strong> all discipline areas within the five colleges<br />

(D. Fortune, personal communication, July 27, 2011). Of the 420+ courses,<br />

80% successfully met the 85% st<strong>and</strong>ard.<br />

212 Journal <strong>of</strong> <strong>Public</strong> <strong>Affairs</strong> Education

Hooray! Your file is uploaded and ready to be published.

Saved successfully!

Ooh no, something went wrong!