Benchmarks of Quality (BoQ) by Nicole Martin Rogers ... - MN PBIS

Introduction to the
Benchmarks of Quality (BoQ)
Minnesota PBIS Institute
Nicole MartinRogers, Ph.D.
Wilder Research

What is Wilder Research
• Nonprofit, part of an operating Foundation
• Research and evaluation in education, health,
and human services
• About 70 researchers and 30 support staff
wilderresearch.org

Wilder’s role in MN PBIS
• Coordination of assessments: SET and BoQ
• Gathering, compiling, cleaning, analyzing,
synthesizing, and reporting implementation and
outcome data
wilderresearch.org

School-wide Benchmarks of Quality (BoQ)
• Lists 53 benchmarks of PBIS programs that
address 10 critical elements of PBIS
implementation
• Completed by school teams on an annual
basis
• Assess how schools score on a 107 point scale
with regard to developing and implementing
school-wide PBIS

School-wide Benchmarks of Quality (BoQ)
• Useful in developing action plans for
following school year
• Encourage team discussion of strengths and
weaknesses and provides ideas for action
planning
• One of the measures used by MDE to identify
model schools

Four elements of PBIS:
Supporting Social Competence & Academic Achievement
OUTCOMES
Supporting
staff behavior
Supporting
decision
making
PRACTICES
Supporting
student behavior

Need, Agreements,
Adoption, & Outcomes
1.
Local
Demonstration
with Fidelity
IMPLEMENTATION
PHASES
2.
4. Systems Adoption,
Scaling, &
Continuous
Regeneration
3.
Sustained
Capacity,
Elaboration, &
Replication

Criteria for qualifying to complete the BoQ
• Score of 80 for overall
Implementation on most
recent SET
• Out of training (next
school year – cohorts 1-6)
Local
Demonstration
with Fidelity
wilderresearch.org

Scope & Sequence
wilderresearch.org

Why learn about the BoQ now
wilderresearch.org

Three components of the BoQ
• Team Member Rating Form
─ Completed by team members independently
─ Returned to coach
• Scoring Form
─ Completed by coach using Scoring Guide
─ Used for reporting back to team
• Scoring Guide
─ Describes procedure for completing BoQ
─ Includes a rubric for scoring each item

STEP 0
• Complete BoQ training
─ This year, two short training videos
─ Training format may be different next year
wilderresearch.org

STEP 1
• PBIS Coach uses Scoring Guide to complete
the School-Wide Benchmarks of Quality:
Scoring Form

Benchmarks example:
Scoring Form
Critical
elements STEP 1
PBS Team 1. Team has administrative
support
2. Team has regular meetings
(at least monthly)
3. Team has established a
clear mission/purpose
3 2 1 0
2 1 0
1 0
STEP 2
++, +,
or -
STEP
3

Benchmarks example:
Scoring Guide
Benchmark 3 points 2 points 1 point 0 points
1. Team has
administrative
support
Administrator(s)
attended training,
play an active
role in the PBIS
process, actively
communicate
their
commitment,
support the
decisions of the
PBIS team, and
attend all team
meetings.
Administrator(s)
support the
process, take
as active role
as the rest of
the team,
and/or attend
most meetings
Administrator(s)
support the
process but
don’t take as
active role as
the rest of the
team, and/or
attends only a
few meetings
Administrator(s)
do not actively
support the
PBIS process.

STEP 2
• PBIS Coach asks every PBIS Team Member to
complete the School-Wide Benchmarks of
Quality Team Member Rating Form
independently
─ Do not give a Scoring Guide to team members
• Giving a deadline is helpful (e.g. submit at next
month’s meeting, within 1-2 weeks, etc.)

STEP 2
• Coach collects Team Member Rating Forms
• Coach tallies all responses provided by team
members using the Team Member Rating
Form: Tally Sheet

STEP 2: Scoring team member forms
• For items with a range of 0 to 1:
─ 1 = In Place
─ 0 = Needs Improvement or Not in Place
• For items with a range of 0 to 2:
─ 2 = In Place
─ 1 = Needs Improvement
─ 0 = Not in Place
• For items with a range of 0 to 3:
─ 3 = In Place
─ 2 or 1 = Needs Improvement
─ 0 = Not in Place

Tally sheet
I I l
l l
I
I I l

Benchmarks example:
Scoring Form
Critical
elements STEP 1
PBS Team 1. Team has administrative
support
2. Team has regular meetings
(at least monthly)
3. Team has established a
clear mission/purpose
3 2 1 0
2 1 0
1 0
STEP 2
++, +,
or -
++
++
-
STEP
3

STEP 3
• PBIS Coach places a “√” next to any item where
there is a discrepancy between the coach’s
rating and the item’s most frequently responded
by the team.

Benchmarks practice:
Scoring Form, Scoring Guide
Critical
elements STEP 1
PBS Team 1. Team has administrative
support
2. Team has regular meetings
(at least monthly)
3. Team has established a
clear mission/purpose
3 2 1 0
2 1 0
1 0
STEP 2
++, +,
or -
STEP
3
++ √
++
-

STEP 3
• The coach will then complete the Team
Summary on page 3 of the Benchmarks of
Quality Scoring Form recording areas of
discrepancy, strength, and weakness.

Areas of Discrepancy
Item
#
Team
Response
1 ++, ++, ++
Coach’s
Score
0
Scoring Guide Description
Administrator does not actively
support the process
Areas of Strength
Critical
Element
Description of areas of strength
Areas in Need of Development
Critical
Element
Description of areas in need of development

Adjusting scores in areas of discrepancy
• If upon sharing areas of discrepancy, the item
and the adjusted final score should be recorded
on the Scoring Form
• It is recommended that changes be noted with a
different color ink

Adjusting scores after discussion
Critical
elements STEP 1
PBS Team 1. Team has administrative
support
2. Team has regular meetings
(at least monthly)
3. Team has established a
clear mission/purpose
3 2 1 0
2 1 0
1 0
STEP 2
++, +,
or -
STEP
3
++ √
++
-

STEP 4
• Coach will report back to the team using the
Team Report page of the Benchmarks of
Quality: Scoring Form
• Coach leads team through a discussion of the
identified areas of strength and weakness
• This information should be conveyed as
“constructive feedback” to assist with action
planning

STEP 5
• Coach adds up all the points on the
Benchmarks of Quality: Scoring Form
• Coach submits scores on pbisassessment.org
• 70% score or higher equals implementing PBIS
with fidelity (75 points or higher)

Entering scores into pbisassessment.org

Viewing scores on pbisassessment.org

Questions about the BoQ

Most effective ways for Wilder Research
to work with PBIS teams and schools
Discussion
• Timeline
• Communication
• Training
• Technical assistance
• Questions about the data calendar
wilderresearch.org

Timeline for 2012-2013 school year
• January 2013: Notification sent to schools
qualifying for the BoQ
• February 2013: BoQ training, sent by Wilder
Research
• March-May 2013: Complete BoQ and submit
scores on pbisassessment.org
wilderresearch.org

Contact
Wilder Research
pbisevalmn@wilder.org
651-280-2960
wilderresearch.org