20.10.2015 Views

A COMPENDIUM OF SCALES for use in the SCHOLARSHIP OF TEACHING AND LEARNING

compscalesstl

compscalesstl

SHOW MORE
SHOW LESS

Create successful ePaper yourself

Turn your PDF publications into a flip-book with our unique Google optimized e-Paper software.

jo<strong>in</strong>s a new team to teach <strong>the</strong>m about <strong>the</strong>ir area of expertise). See Angelo and Cross (1993) <strong>for</strong><br />

a detailed description of 50 CATs.<br />

Comparisons of classes that repeatedly <strong>use</strong>d CATs with those that did not <strong>use</strong> CATs yield<br />

<strong>in</strong>consistent f<strong>in</strong>d<strong>in</strong>gs regard<strong>in</strong>g <strong>the</strong>ir effect on grades. Repeated <strong>use</strong> of 5-question, multiplechoice,<br />

nongraded, <strong>for</strong>mative quizzes was found to <strong>in</strong>crease exam scores <strong>in</strong> a psychology course<br />

(Short & Mart<strong>in</strong>, 2012). However, Cottell and Harwood’s (1998) exam<strong>in</strong>ation of <strong>the</strong> effect of<br />

us<strong>in</strong>g multiple CATs (Background Knowledge Probe, M<strong>in</strong>ute Paper, Feedback Form, Directed<br />

Paraphras<strong>in</strong>g, Pro and Con Grid, What did I learn from <strong>the</strong> exam?, Classroom Assessment<br />

Quality Circle Group Instructional Feedback Technique, and Group-Work Evaluation Form) <strong>in</strong> an<br />

account<strong>in</strong>g class revealed no significant differences between classes <strong>in</strong> grades <strong>for</strong> <strong>the</strong> course or<br />

on exams, group projects, or quizzes. Similarly, <strong>in</strong> a crim<strong>in</strong>al justice class, Simpson-Beck (2011)<br />

found no significant differences <strong>in</strong> grades <strong>for</strong> <strong>the</strong> course, on chapter tests, or on a cumulative<br />

f<strong>in</strong>al exam when us<strong>in</strong>g <strong>the</strong> Muddiest Po<strong>in</strong>t, where students were asked to identify <strong>the</strong> most<br />

confus<strong>in</strong>g po<strong>in</strong>t from <strong>the</strong> day’s class. Given <strong>the</strong> variability <strong>in</strong> us<strong>in</strong>g <strong>for</strong>mative assessment (e.g.,<br />

choice of CAT, course, frequency of adm<strong>in</strong>istration, quality of implementation), additional<br />

studies are needed to determ<strong>in</strong>e <strong>the</strong> best practices of CAT application.<br />

One of <strong>the</strong> most commonly <strong>use</strong>d CATs is <strong>the</strong> M<strong>in</strong>ute Paper (also known as <strong>the</strong> One-M<strong>in</strong>ute<br />

Paper or <strong>the</strong> Half-Sheet Response), a two-question measure that has been described by<br />

multiple authors (e.g., Angelo & Cross, 1993; Lom, 2012; Stead, 2005). The first question on <strong>the</strong><br />

M<strong>in</strong>ute Paper (“What was <strong>the</strong> most important th<strong>in</strong>g you learned dur<strong>in</strong>g this class?”) requires<br />

students to practice identify<strong>in</strong>g <strong>the</strong> most important po<strong>in</strong>ts from <strong>the</strong> lecture. The second<br />

question (“What important question rema<strong>in</strong>s unanswered?”) encourages students to reflect on<br />

<strong>the</strong> overall material to determ<strong>in</strong>e what <strong>the</strong>y understood dur<strong>in</strong>g <strong>the</strong> class period and what <strong>the</strong>y<br />

did not comprehend as completely. This assessment tool is brief and easy to <strong>use</strong>, and <strong>the</strong><br />

questions can be adapted to address more foc<strong>use</strong>d, course-specific material that can <strong>in</strong><strong>for</strong>m an<br />

<strong>in</strong>structor’s <strong>in</strong>dividual learn<strong>in</strong>g objectives. The <strong>in</strong>structor can quickly read and group <strong>the</strong><br />

responses and provide feedback ei<strong>the</strong>r at <strong>the</strong> beg<strong>in</strong>n<strong>in</strong>g of <strong>the</strong> next class or via email to <strong>the</strong><br />

entire class or to <strong>in</strong>dividual students.<br />

Angelo and Cross (1993) provided an example of <strong>the</strong> <strong>use</strong>fulness of this CAT. At <strong>the</strong> end of each<br />

class session, a statistics <strong>in</strong>structor <strong>use</strong>d a slightly modified version of <strong>the</strong> M<strong>in</strong>ute Paper by<br />

ask<strong>in</strong>g students to select <strong>the</strong> five most important po<strong>in</strong>ts of <strong>the</strong> day’s class and ask one or two<br />

questions. Initially, <strong>the</strong> <strong>in</strong>structor found that <strong>the</strong> class collectively listed approximately 20 ma<strong>in</strong><br />

po<strong>in</strong>ts, some of which were less important details or <strong>in</strong>cluded partially or completely <strong>in</strong>correct<br />

<strong>in</strong><strong>for</strong>mation. This discovery prompted <strong>the</strong> <strong>in</strong>structor to modify his teach<strong>in</strong>g; at <strong>the</strong> beg<strong>in</strong>n<strong>in</strong>g of<br />

each class, he listed many of <strong>the</strong> po<strong>in</strong>ts <strong>the</strong> students had submitted and discussed <strong>the</strong>ir relative<br />

importance. Additionally, he listed <strong>the</strong> po<strong>in</strong>ts he considered most important, compared <strong>the</strong><br />

lists, and addressed common questions. This approach reduced <strong>the</strong> students’ list of ma<strong>in</strong><br />

po<strong>in</strong>ts from 20 to less than 10 with<strong>in</strong> a month. These results show how <strong>the</strong> <strong>use</strong> of a simple CAT<br />

can provide <strong>in</strong><strong>for</strong>mation about students’ level of understand<strong>in</strong>g and can lead to immediate<br />

changes <strong>in</strong> teach<strong>in</strong>g.<br />

57

Hooray! Your file is uploaded and ready to be published.

Saved successfully!

Ooh no, something went wrong!