What is the School Progress Index? - Baltimore City Public Schools

1
SCHOOL PROGRESS INDEX
Data Release
Office of Achievement and Accountability
BALTIMORE CITY
PUBLIC SCHOOLS

What is the School Progress Index?
2
• The School Progress Index (SPI) is the measure Maryland has
developed to replace Adequate Yearly Progress (AYP), the
federal accountability measure used for schools under No
Child Left Behind.
• On December 17, MSDE will release an SPI for all schools
statewide based on 2011-12 data.
◦ The SPI for 2011-12 has zero stakes
◦ Next fall schools will receive a score for the SPI for the 2012-13 year—with
stakes

How is the SPI different from AYP?
• AYP measured student proficiency for schools and required all
schools to achieve a universal level of proficiency for all
students over 12 years.
◦ Goal: all students at all schools are proficient by 2014
• The SPI measures student progress for schools and requires
schools to meet a yearly progress standard based on their level
or proficiency the prior year.
◦ Goal: Cut the number of non-proficient students in half by 2017
• Also:
◦ The SPI has more realistic and comprehensive indicators
◦ With the SPI, schools are measured against their own progress, not
compared to other schools
3

What does the SPI measure?
• For all grades, the SPI looks at three key indicators
◦ For elementary and middle schools these are achievement, gap
reduction and growth
◦ For high schools these are achievement, gap reduction and
college and career readiness
• Each of these indicators is weighted based on its
importance in assessing overall school progress
◦ For elementary and middle school SPIs: Achievement = 30%;
Gap Reduction = 40%; Growth = 30%
◦ For high school SPIs: Achievement = 40%;
Gap Reduction = 40%; College/Career Readiness = 20%
4

Maryland’s School Progress Index
Meeting
Performance
Targets
(AMO)
Grades PreK-8
Achievement* 30%
• 33.3%- Mathematics Proficiency (MSA)
• 33.3%- Reading Proficiency (MSA)
• 33.3%- Science Proficiency (MSA)
Meeting
Performance
Targets
(AMO)
Grades 9-12
Achievement* 40%
• 33.3%- Mathematics Proficiency (Algebra/
Data Analysis HSA)
• 33.3%- English Proficiency (English HSA)
• 33.3%- Science Proficiency (Biology HSA)
Gap* 40%
Gap between lowest subgroup and highest
subgroup within a school:
• 33.3%- Mathematics Proficiency (MSA)
• 33.3%- Reading Proficiency (MSA)
• 33.3%- Science Proficiency (MSA)
Growth* 30%
Percent of students making one year’s growth:
• 50%- Mathematics Proficiency (MSA)
• 50%- Reading Proficiency (MSA)
*ALT-MSA is included in the index component
Source: Maryland State Department
of Education
Gap*
Gap between lowest subgroup and highest
subgroup within a school:
• 20%- Mathematics Proficiency (Algebra/
Data Analysis HSA)
• 20%- English Proficiency (English HSA)
• 20%- Science Proficiency (Biology HSA)
• 20%- Cohort Graduation Rate
• 20%- Cohort Dropout Rate
College-and Career-Readiness*
20%
40%
• 60%- Cohort Graduation rate
• 40%- College and Career Preparation (CCP)
• Advanced Placement or International Baccalaureate
• Career and Technology Education (CTE)
Concentrators
• College Enrollment
Revised
11/26/12

Annual Measureable Objectives (AMO)
6
• For each indicator there are Annual Measureable
Objectives, or AMOs
◦ AMOs are performance targets that assess the progress of
schools and subgroups
◦ AMOs are based on schools’ performance in prior years
• AMOs reflect the goal to reduce the number of
“non-adequate” students between a baseline year 1
and target year 2
1
For most metrics, the baseline year was 2011; exceptions are for metrics that are lagged by one or two years.
2
The target year is 2017 for all metrics except graduation and dropout rates. For these, the target year is 2020.
Source: Maryland State Department
of Education

ELEMENTARY/MIDDLE/HIGH SCHOOL
Indicator: Achievement
• Percentage of “all students” group scoring proficient
or advanced on Maryland standardized assessments
progressing toward targets
• This is about progress, not performance
• PreK-8
◦ MSA Math Proficiency
◦ MSA Reading Proficiency
◦ MSA Science Proficiency
• Grades 9-12
◦ HSA Algebra/Data Analysis Proficiency
◦ HSA English Proficiency
◦ HSA Biology Proficiency
7
Source: Maryland State Department
of Education

ELEMENTARY/MIDDLE/HIGH SCHOOL
Indicator: Gap Reduction
8
• Decrease in performance gap between the highest and lowest
performing subgroups
• Gap score calculated for each subgroup category in each
measured area
• Pre-K-8
◦ MSA Math Proficiency
◦ MSA Reading Proficiency
◦ MSA Science Proficiency
• Grades 9-12
◦ HSA Algebra/Data Analysis Proficiency
◦ HSA English Proficiency
◦ HSA Biology Proficiency
◦ 5-Year Adjusted Cohort Graduation Rate
◦ 4-Year Adjusted Cohort Dropout Rate
Source: Maryland State Department
of Education

ELEMENTARY/MIDDLE
Indicator: Growth
9
• The change in student performance for the “all
students” group between the current year and prior
year
• PreK-8
◦ MSA Math Proficiency
◦ MSA Reading Proficiency
Source: Maryland State Department
of Education

HIGH SCHOOL
Indicator: College & Career Readiness (CCR)
• Met annual targets on measures that assure students are
ready for college or career upon graduation
10
◦ 5-year cohort adjusted graduation rate
◦ College and Career Preparation—students who have exited high school with a
Maryland high school diploma and meet any one of the following:
Advanced Placement (AP) or International Baccalaureate (IB)
Earned a score of 3 or greater on an AP exam
Earned a score of 4 or greater on an IB exam
Career and Technology Education (CTE) Concentrators
Attained advance standing in a state-approved CTE program of study
College Enrollment
Entered a post-secondary institution within 16 months of graduation
Source: Maryland State Department
of Education

SPI Strands
•The SPI score is used to place each school into 1 of 5 strands, 1 being the highest and 5 being
the lowest.
•Strands are designed to categorize schools to provide support, intervention and
recognition.
Strand
SEA/LEA
11
1 The school should be able to identify the professional development and training that can lead
to additional improvement in achievement. The LEA may provide this resource or schools can
seek training beyond their own LEAs.
2 MSDE will dictate no specific support for schools in strand 2. It is expected that LEAs will take
particular interest in the specific needs in these schools.
3 All schools in strand 3 will develop School Improvement Plans to be monitored by the LEA.
Title I schools that fall into this Strand will be eligible to apply for 1003(a) School
Improvement Grant funds.
4 Improvement of instruction, the replacement or the retraining of the leadership staff, and
intensified outreach to families to become involved with their child’s school should be
addressed by the schools with LEA oversight.
5 Those Title I schools in this strand will have access to additional school improvement dollars.
For non- Title I schools, the SIG process which provides clear needs assessments and support
through the LEA Turnaround offices will continue to be employed.
BALTIMORE CITY
PUBLIC SCHOOLS

Strand Categorization
12
Strand
Overall Score
Number of Indicators Met
E, M, H EM, MH, EH EMH
1 1.0 or greater All 3 All 6 All 9
2
2 of 3 4-5 of 6 6-8 of 9
Greater than or
3 1 of 3 2-3 of 6 3-5 of 9
equal to 0.9
4 0 of 3 0-1 of 6 0-2 of 9
5 Less than 0.9 0-2 of 3 0-4 of 6 0-6 of 9
• Number of indicators met includes:
◦ indicators where the percent proficient of target for the overall indicator is greater than or equal to 1
◦ indicators that were not evaluated due to small population
• E, M, H defines a particular grade span for a school.
◦ E – Elementary
◦ M – Middle
◦ H – High
*Some schools may have multiple grade spans (i.e. a school with grades 6-12 is e a MH school).
Source: Maryland State Department
of Education

Number of Schools in Each SPI Strand
in 2012
13
Based on 2012 data, nearly all schools fell into the top 3 strands
78
53
49
6 4
Strand 1 Strand 2 Strand 3 Strand 4 Strand 5
Note: 2012 SPI Results are not for stakes.
BALTIMORE CITY
PUBLIC SCHOOLS

2012 SPI Results for Maryland and Baltimore City
14
City Schools had a higher proportion of schools in the top 3 strands and a
lower proportion of schools in the bottom 2 strands than Maryland overall
37.3
41.1
26.3
27.9
24.1
25.8
8
3.2 4.3
2.1
Strand 1 Strand 2 Strand 3 Strand 4 Strand 5
Maryland
Baltimore City
Note: 2012 SPI Results are not for stakes. Results for Maryland are taken from mdreportcard.org
BALTIMORE CITY
PUBLIC SCHOOLS

ELEMENTARY/MIDDLE
SPI Example Calculation
15
Calculations Achievement Gap Growth
% of Students who
Scored Advanced or
Proficient
Math Read Sci Math Read Sci Math Read
89.24% 93.72% 65.82% 74.55% 86.24% 66.00% 57.04% 89.63%
AMO 87.57% 87.94% 75.48% 74.92% 78.20% 59.20% 74.06% 84.82%
= Measure PSV 1.0191 1.0657 0.8720 0.9951 1.1028 1.1150 0.7702 1.0567
Proportional
Significance
= Measure
Contribution
33.33% 33.33% 33.33% 33.33% 33.33% 33.33% 50% 50%
0.3397 + 0.3552 + 0.2906 0.3317 + 0.3676 + 0.3717 0.3851 + 0.5284
= Indicator PSV 0.9855 1.0709 0.9134
Proportional
Significance
= Indicator
Contribution
30% 40% 30%
0.2957 + 0.4284 + 0.2740
= School Index Progress Scale Value 0.9981
Source: Maryland State Department
of Education

Percent of City Schools’ Elementary Schools
Meeting 2012 AMO’s by Subject
16
Achievement Gap Reduction Growth
92.1
57.8 57.1
47.2
73.2
67.5 66.9
34.4
N= 128 128 125 126 126 90 127 127
NA
Math Reading Science
*The Growth Indicator does not include Science as a measure because students are not assessed in consecutive years.
BALTIMORE CITY
PUBLIC SCHOOLS

Percent of City Schools’ Middle Schools
Meeting 2012 AMO’s by Subject
17
Achievement Gap Reduction Growth
67.7
85.9
77.4
54.7
54.4 55.7
30.2
37.4
N= 106 106 99 102 103 71 106 106
NA*
Math Reading Science
*The Growth Indicator does not include Science as a measure because students are not assessed in consecutive years.
BALTIMORE CITY
PUBLIC SCHOOLS

HIGH SCHOOL
SPI Calculation Example
18
Variable Achievement Gap CCR
Assessment Alg Eng Bio Alg Eng Bio Grad Drop Grad CCP
% Proficient CY 0.9608 0.9083 0.9233 0.6816 0.6100 0.8224 0.6248 0.7590 0.9265 0.8880
Target 0.8591 0.8662 0.8981 0.7240 0.7407 0.8577 0.8852 0.9489 0.8113 0.8794
% Prof of Target 1.1184 1.0486 1.0281 0.9414 0.8236 0.9589 0.7058 0.7998 1.1420 1.0098
Content Weight 0.3333 0.3333 0.3333 0.2000 0.2000 0.2000 0.2000 0.2000 0.6000 0.4000
Weighted
% Prof of Target 0.3728 0.3495 0.3427 0.1883 0.1647 0.1918 0.1412 0.1600 0.6852 0.4039
Sum Weighted %
Prof of Target 1.0649 0.8459 1.0891
Indicator Weight 0.40 0.40 0.20
Indicator
Contribution 0.4260 0.3384 0.2178
School Index 0.9822
% Prof of Target = % Proficient CY ÷ Target
Weighted % Prof of Target = % Prof of Target x Content Weight
Indicator Contribution
= (Math + Read + Sci) x Indicator Weight
School Index
= (Achievement + Growth + Gap)
* Source: Maryland State
Department of Education

Percent of City Schools’ High Schools
Meeting 2012 AMO’s by Subject
19
Achievement Gap Reduction College/Career
Readiness
86.1
78.6
72.1
61.1
66.7 68.4
38.3
46.8
42.6
32.4
N= 47 47 47 42 43 43 36 33 38 34
Math Reading Science Graduation Rate Dropout Rate College/Career Prep
BALTIMORE CITY
PUBLIC SCHOOLS