20.10.2015 Views

A COMPENDIUM OF SCALES for use in the SCHOLARSHIP OF TEACHING AND LEARNING

compscalesstl

compscalesstl

SHOW MORE
SHOW LESS

You also want an ePaper? Increase the reach of your titles

YUMPU automatically turns print PDFs into web optimized ePapers that Google loves.

operationalization <strong>for</strong> measur<strong>in</strong>g student engagement to allow <strong>for</strong> a ref<strong>in</strong>ed understand<strong>in</strong>g of<br />

how and under what circumstances student engagement predicts learn<strong>in</strong>g (Axelson & Flick,<br />

2010). These considerations aside, much extant research has measured student <strong>in</strong>terest toward<br />

teachers and <strong>in</strong>clusion with<strong>in</strong> <strong>the</strong> classroom. However, a dearth of research has exam<strong>in</strong>ed <strong>the</strong><br />

measurement of student engagement as it perta<strong>in</strong>s to classroom material <strong>in</strong> particular,<br />

especially regard<strong>in</strong>g student engagement <strong>in</strong> postsecondary education sett<strong>in</strong>gs. In what follows,<br />

we critically review widely-utilized measures relevant to assess<strong>in</strong>g student engagement,<br />

broadly def<strong>in</strong>ed, toward class material, focus<strong>in</strong>g on <strong>the</strong>ir commonalities and dist<strong>in</strong>ctions both<br />

from pragmatic and psychometric perspectives.<br />

Researchers who study engagement have measured it at both a macro- and a micro-level. The<br />

macro-level <strong>for</strong>m of engagement foc<strong>use</strong>s on measur<strong>in</strong>g elements related to <strong>in</strong>vestment and<br />

ef<strong>for</strong>t <strong>in</strong> school-related activities (e.g., Marks, 2000; Newmann, Wehlage, & Lamborn, 1992;<br />

Sk<strong>in</strong>ner, Wellborn, & Connell, 1990) and identification or connection broadly with school and<br />

academics (F<strong>in</strong>n, 1993; F<strong>in</strong>n & Rock, 1997). The micro-level <strong>for</strong>m of engagement foc<strong>use</strong>s on<br />

measur<strong>in</strong>g engagement <strong>in</strong> one particular school-related aspect, such as a particular course or<br />

student activity (Handelsman, Briggs, Sullivan, & Towler, 2005). Although macro- and microlevel<br />

engagement measures are positively associated, micro-level measures may allow <strong>for</strong> a<br />

more nuanced understand<strong>in</strong>g of engagement toward a particular class and <strong>the</strong> relevant<br />

behavioral, cognitive, and affective factors <strong>in</strong> that context. For example, faculty can all recall <strong>the</strong><br />

example of a student who is purported to be engaged <strong>in</strong> fellow faculty members’ classes, but<br />

clearly is not <strong>in</strong> one’s own class. This example is simple but illustrates an important po<strong>in</strong>t:<br />

macro-level measures of student engagement may not be as valid <strong>in</strong> assess<strong>in</strong>g student<br />

engagement toward particular aspects of class material or a particular class. However, macrolevel<br />

student engagement measures can be especially <strong>use</strong>ful <strong>in</strong> uncover<strong>in</strong>g a student’s<br />

engagement with school more generally, which itself can have several positive outcomes. As<br />

with any measure, trade-offs exist <strong>in</strong> us<strong>in</strong>g micro, relative to macro, measures. Given our focus<br />

on student engagement toward coursework, <strong>the</strong> bulk of this chapter foc<strong>use</strong>s on micro-level<br />

measures.<br />

Macro-Level Measure<br />

National Survey of Student Engagement (NSSE)<br />

The ma<strong>in</strong> macro-level measure utilized to assess student engagement is <strong>the</strong> NSSE (Kuh, 2001).<br />

The NSSE is <strong>use</strong>d extensively by colleges and universities to evaluate engagement among<br />

freshman and senior students. The NSSE consists of a series of college activity (behavior) items<br />

directly measur<strong>in</strong>g student engagement, educational and personal growth items, and items<br />

regard<strong>in</strong>g op<strong>in</strong>ions about one’s school, as well as a variety of o<strong>the</strong>r questions. The NSSE<br />

positively predicts a variety of learn<strong>in</strong>g-related outcomes, <strong>in</strong>clud<strong>in</strong>g grade po<strong>in</strong>t average, critical<br />

th<strong>in</strong>k<strong>in</strong>g, and standardized test scores (Car<strong>in</strong>i et al., 2006; Ewell, 2002; Pascarella & Terenz<strong>in</strong>i,<br />

2005). Never<strong>the</strong>less, <strong>the</strong> NSSE is designed to assess self-engagement broadly toward <strong>the</strong><br />

college experience, and not particularly toward coursework from specific classes. Fur<strong>the</strong>rmore,<br />

<strong>the</strong> NSSE lacks a rigorous <strong>the</strong>oretical orientation that drives <strong>the</strong> organization and <strong>use</strong> of<br />

88

Hooray! Your file is uploaded and ready to be published.

Saved successfully!

Ooh no, something went wrong!