Teacher – Full Teacher Evaluation Information - North Dakota ...

Is online training available? Teachstone and CASTL are exploring ways to train observers
remotely. Among the challenges is that most of the learning about the CLASS happens in the context
of discussions that follow watching and scoring video segments. This dynamic interplay is difficult to
replicate online, and most trainees tell us they cannot imagine receiving the same level of training
online. But stay tuned: we are working to develop new technologies to address these concerns.
Certification of CLASS Observers
How are CLASS observers certified? Becoming a certified CLASS observer requires
attending a two-day Observation Training provided by a certified CLASS trainer and passing a
reliability test. The reliability test consists of watching and coding five 15-minute classroom video
segments online. To pass, trainees need to score within 1 point of the master code on 80% of all
codes given and demonstrate the ability to code reliably across all ten CLASS dimensions. When
trainees are not reliable after the first try, they are provided with feedback and additional testing
opportunities.
What percentage of trainees passes the CLASS reliability test? Trainings with
a CLASS certified trainer result in 60-80% of trainees passing the first reliability test. An additional
number pass on one of their secondary attempts. A small percentage of trainees (5-10%) do not pass
even after several attempts. It is recommended that these trainees not be used to score classrooms
with the CLASS. Also, new trainers sometimes have lower pass rates as CLASS observers until they
become more familiar with the material.
How do we maintain high levels of reliability
RELIABILITY
Reliability is really just another
word for consistency. Having
CLASS observers pass the
reliability test is very important
because it is one of the ways to
you help ensure that a
monitoring or evaluation system
is fair. Observers who have
passed the reliability test show
that they are able to make
objective ratings using the
CLASS tool and that any two
certified observers in the same
classroom at the same time
among our observers? Even after observers are
trained to use the CLASS and pass a reliability test, it is
important that processes are in place to help ensure that they
maintain their knowledge over time. There is a tendency for
observers to “drift” away from the criteria established by the
CLASS and back into scoring their observations based on their
own notions of quality. We suggest having regular meetings of
observers (at least once a month) throughout the data
collection period. Ideally, observers will have access to video
segments to help check for consistent coding. This also
provides an avenue through which to give the whole
observation team, as well as individual observers, feedback
about their work. Some video segments are available for this
purpose online, through www.class.teachstone.org, and
Teachstone will be adding to these in coming months.
would make very similar ratings.
CLASS Implementation Guide 37