20.10.2015 Views

A COMPENDIUM OF SCALES for use in the SCHOLARSHIP OF TEACHING AND LEARNING

compscalesstl

compscalesstl

SHOW MORE
SHOW LESS

You also want an ePaper? Increase the reach of your titles

YUMPU automatically turns print PDFs into web optimized ePapers that Google loves.

asks students to turn <strong>in</strong> <strong>the</strong>ir papers anonymously, and later reads through <strong>the</strong> responses<br />

look<strong>in</strong>g <strong>for</strong> <strong>the</strong>mes regard<strong>in</strong>g, <strong>for</strong> example, what students are or are not learn<strong>in</strong>g well or what<br />

improvements might be made <strong>in</strong> <strong>the</strong> course to improve student learn<strong>in</strong>g.<br />

Graded Assignments and Tests<br />

Students’ graded assignments and tests are readily available yet often overlooked as evaluation<br />

tools of <strong>in</strong>struction. Grades provide an objective albeit an <strong>in</strong>direct measure of teach<strong>in</strong>g quality<br />

as well as student learn<strong>in</strong>g. Grades may be a good <strong>in</strong>dicator of how well students understand<br />

certa<strong>in</strong> material; teachers can <strong>use</strong> this <strong>in</strong><strong>for</strong>mation to improve <strong>the</strong> way <strong>in</strong> which subsequent<br />

<strong>in</strong>struction is structured and presented. Any graded assignment (e.g., tests, quizzes, papers,<br />

activities) could potentially serve this purpose, assum<strong>in</strong>g <strong>the</strong> teacher is able to directly tie <strong>the</strong><br />

material <strong>in</strong> <strong>the</strong> graded assignment to a learn<strong>in</strong>g objective <strong>for</strong> <strong>the</strong> course (e.g., a test question to<br />

identify <strong>the</strong> statistical concepts <strong>in</strong> an advertisement as a measure of statistical literacy).<br />

However, keep <strong>in</strong> m<strong>in</strong>d that graded assignments and tests may not be as easily <strong>in</strong>terpretable as<br />

o<strong>the</strong>r measures of teach<strong>in</strong>g quality beca<strong>use</strong> many factors contribute to an <strong>in</strong>dividual’s<br />

per<strong>for</strong>mance (e.g., motivation, ability, study skills, and educational history).<br />

Student Focus Groups<br />

The purpose of student focus groups is to obta<strong>in</strong> more detailed <strong>in</strong><strong>for</strong>mation than might be<br />

possible if <strong>the</strong> entire class was surveyed. To avoid bias <strong>in</strong> student feedback, it is advantageous<br />

<strong>for</strong> an outside consultant (e.g., staff from <strong>the</strong> <strong>in</strong>stitution’s teach<strong>in</strong>g and learn<strong>in</strong>g center,<br />

<strong>in</strong>structor from ano<strong>the</strong>r department) to ga<strong>the</strong>r <strong>in</strong><strong>for</strong>mation from a subset of students <strong>in</strong> a<br />

course. Instructors may work with <strong>the</strong> consultant be<strong>for</strong>ehand to determ<strong>in</strong>e <strong>the</strong> type of<br />

<strong>in</strong><strong>for</strong>mation to be ga<strong>the</strong>red from <strong>the</strong> student groups.<br />

Student Evaluations of Teach<strong>in</strong>g<br />

The most common <strong>for</strong>m of teach<strong>in</strong>g evaluation is <strong>the</strong> student evaluation of teach<strong>in</strong>g (SET),<br />

which is typically a set of written fixed-answer questions that is most beneficial when well<br />

developed and empirically supported. Numerous rat<strong>in</strong>g scales with unknown psychometric<br />

properties are accessible; however, <strong>the</strong>re are also several empirically-supported <strong>in</strong>struments<br />

available. These <strong>in</strong>struments are reliable, valid, and consistent over time, and <strong>in</strong>clude <strong>the</strong><br />

Student Evaluation of Educational Quality (SEEQ; Marsh, 1982), Barnes et al.’s (2008) measure,<br />

and <strong>the</strong> Teacher Behaviors Checklist (TBC; Buskist et al., 2002; Keeley et al., 2006). In addition<br />

to <strong>the</strong>se rat<strong>in</strong>g scales, <strong>the</strong> Office of Educational Assessment at <strong>the</strong> University of Wash<strong>in</strong>gton<br />

(2005) has developed a system consist<strong>in</strong>g of several evaluation <strong>for</strong>ms to measure teach<strong>in</strong>g<br />

effectiveness. The Office of Educational Assessment at <strong>the</strong> University of Wash<strong>in</strong>gton developed<br />

this detailed, empirically-supported evaluation system through a series of methodical<br />

<strong>in</strong>terviews with faculty, adm<strong>in</strong>istrators, and through student focus groups.<br />

Despite <strong>the</strong> valuable feedback students might provide, <strong>the</strong>y do not have <strong>the</strong> experience and<br />

expertise that professional teach<strong>in</strong>g colleagues may contribute to <strong>the</strong> evaluation process. Peers<br />

may also have <strong>the</strong> ability to assist <strong>in</strong> troubleshoot<strong>in</strong>g classroom and teach<strong>in</strong>g issues as well as<br />

162

Hooray! Your file is uploaded and ready to be published.

Saved successfully!

Ooh no, something went wrong!