01.08.2013 Views

Stanford 10 Longitudinal Data Analysis Tutorial.pdf - Alex

Stanford 10 Longitudinal Data Analysis Tutorial.pdf - Alex

Stanford 10 Longitudinal Data Analysis Tutorial.pdf - Alex

SHOW MORE
SHOW LESS

Create successful ePaper yourself

Turn your PDF publications into a flip-book with our unique Google optimized e-Paper software.

<strong>Stanford</strong> <strong>10</strong><br />

Use with Excel 2007<br />

<strong>Longitudinal</strong> <strong>Data</strong> <strong>Analysis</strong><br />

2011<br />

School Improvement Team<br />

Alabama Department of Education


Purpose:<br />

Why should we use longitudinal data?<br />

One year’s data cannot pinpoint trends. Many factors can cause variations in test scores if we look at<br />

only one year. When a pattern emerges from analysis of several years’ data---this points to curriculum<br />

and/or instruction issues which must be addressed.<br />

How many years of data should be included in a longitudinal data study?<br />

When we review data over a period of 3 to 5 years, we are looking for gaps in curriculum or instruction.<br />

This type of data analysis is valuable when identifying goals for continuous improvement.<br />

What are the benefits of longitudinal data analysis?<br />

Looking at the current year’s data gives a school only a snap-shot of student performance for that one<br />

test, one assessment, or one year’s data. One year’s data cannot pinpoint trends, instructional gaps, or<br />

curriculum and pacing issues. Many factors could be responsible for the variation in test scores.<br />

<strong>Longitudinal</strong> data gives a school data of how students are achieving over time.<br />

I. Materials Needed<br />

Laptop or computer<br />

<strong>Stanford</strong>-<strong>10</strong> 3+ Year <strong>Analysis</strong> Excel File<br />

o "<strong>Stanford</strong> <strong>10</strong> 3-5 Year <strong>Analysis</strong> stanines 1 - 3" file<br />

o “<strong>Stanford</strong> <strong>10</strong> 3-5 Year <strong>Analysis</strong> stanines 7 – 9” file<br />

<strong>Stanford</strong>-<strong>10</strong> Group Reports<br />

<strong>Stanford</strong>-<strong>10</strong> Graphing Instructions for computers using Excel ‘2007<br />

II. <strong>Stanford</strong>-<strong>10</strong> Graphing Instructions<br />

III. Utilizing the <strong>Data</strong> Charts


<strong>Longitudinal</strong> <strong>Data</strong> <strong>Analysis</strong><br />

<strong>Stanford</strong>-<strong>10</strong><br />

Graphing Instructions using Microsoft Excel ‘2007<br />

Reports Needed: “<strong>Stanford</strong>-<strong>10</strong> Group Reports”<br />

for the last 3 years for each<br />

grade level tested in your school.<br />

Step One: Inputting the <strong>Data</strong><br />

From the <strong>Stanford</strong>-<strong>10</strong> folder:<br />

Open the "<strong>Stanford</strong>-<strong>10</strong> 3+ Year <strong>Analysis</strong>" file. It will have an icon indicating<br />

that it is an EXCEL spreadsheet.<br />

o "<strong>Stanford</strong> <strong>10</strong> stanines 1 - 3" file<br />

Or<br />

o “<strong>Stanford</strong> <strong>10</strong> stanines 7 – 9” file<br />

If using the file " Stanines 1 - 3" enter each year's content cluster scores from the 1-3 column of<br />

"percent in each” Stanine range


If using the file " Stanines 7 - 9" enter each year's content cluster scores from the 7-9 column of<br />

"percent in each” Stanine range<br />

Each tab in the Excel Spreadsheet Workbook contains content cluster lists for grades 3-8.<br />

Graphs will be made from this grid.<br />

3rd grade<br />

Workbook<br />

Workbook Tabs<br />

8 th grade<br />

Workbook<br />

Using your “<strong>Stanford</strong>-<strong>10</strong> Group Report” for one grade at a time; enter the percent<br />

correct from the “below average” (Stanines 1-3) or “above average” (Stanines 7-9)<br />

column for each content cluster.<br />

6th grade<br />

Workbook


Step Two: Making the graphs in Microsoft Excel ’2007<br />

Highlight the EXACT area of each Content Cluster<br />

on the spreadsheet that contains any words or<br />

numbers starting in the A1 column on the left.<br />

Click on the "Insert” Tab on the toolbar<br />

at the top of your screen.<br />

Click on the “Column” Icon<br />

A “Chart Tools” tab will appear at the<br />

top of your screen.<br />

Choose the type graph you like best.<br />

o A small graph will appear<br />

on your screen.


Choose the Tab: “Lay Out”<br />

Click on "Chart Title"<br />

Choose “Above Chart”<br />

Type your chart name<br />

(Ex. “ Grade Level and Content Cluster”)<br />

Choose the Tab "Legend"<br />

Decide where you best like the<br />

legend to be placed.<br />

Choose the Tab "<strong>Data</strong> Labels"<br />

(decide if you like it with or without the numbers)<br />

Choose the Tab “Design”<br />

Decide which color scheme<br />

You like best.


In the Tab “Design”<br />

Click on “Switch Row/Column”<br />

Decide which format you like best<br />

Click on "Move Chart Location” (top right corner of the screen)<br />

A “Move Chart” box will appear on your screen.<br />

Click on "New Sheet" Type the name of your chart again.<br />

Click “OK/finish”<br />

Step Three: Viewing the final Graph<br />

Workbook Tabs<br />

Look back at your Excel Workbook Tabs at the bottom of the screen. You should now<br />

see the the title of your graph that you created.<br />

Click on the title


Do you see the graph that you created?<br />

Drawing the 23 rd percentile line<br />

Click on the Tab “Insert” and “Shapes”<br />

Choose the “Line” shape<br />

Place the cross on the left side of the graph border.<br />

Click and drag the line across all bars shown at approximately the 23 rd percentile mark.<br />

Options for a line color and to make a thicker line is in the “Shape Outline”<br />

What do the bars mean in a <strong>Stanford</strong> <strong>10</strong> graph of Stanines 1-3? Since the bars indicate the percent of<br />

students scoring in Stanines 1-3…bars at or below the 23% mark is good. Bars that are tall in this case<br />

(above the 23% mark) indicate that too many students are performing in the lower three stanines for a<br />

particular content cluster.<br />

What do the bars mean in a <strong>Stanford</strong> <strong>10</strong> graph of Stanines 7-9? Since the bars indicate the percent of<br />

students scoring in Stanines 7-9…bars at or above the 23% indicate good representation in those stanines<br />

in the testing population.


Utilizing the <strong>Data</strong> Charts<br />

What are some of the issues revealed through longitudinal data analysis?<br />

Academic progress from grade to grade.<br />

Effectiveness of school programs.<br />

Strengths and weaknesses in school programs (high performing areas and low-performing areas)<br />

Best practices that significantly impact student achievement.<br />

Effects of teacher preparation and professional development on student achievement.<br />

Curriculum or achievement gaps in the instructional program.<br />

<strong>Data</strong> is compiled and placed in Excel spread sheets by grade levels/standards. Graphs are made from<br />

the spreadsheets in order to provide teachers useful visual displays of strengths and weaknesses by<br />

content clusters on the <strong>Stanford</strong> <strong>10</strong>. <strong>Analysis</strong> questions are completed from the graphs in order to<br />

develop specific actions to address the hole(s).<br />

This represents a sample from the <strong>Stanford</strong> <strong>10</strong> 3-5 Year <strong>Longitudinal</strong> analysis using Excel.<br />

The <strong>Stanford</strong> <strong>10</strong> scores are reported in clusters. Each cluster represents a content area. <strong>Data</strong> can be<br />

compiled in stanines to assess improvement of specific sub-groups. This chart represents the bottom<br />

three stanines and represents students who have scored in stanines 1-3. The red bar represents the<br />

statistical limit for this data. On a standard Bell Curve, no more than 23% of students should be placing<br />

in the bottom 3 stanines. This data shows that a disproportionate number of students are scores in the<br />

bottom 3 stanines. This should raise the question as to why these students are not achieving and what<br />

steps need to be taken to move the students forward.


<strong>Longitudinal</strong> <strong>Data</strong> <strong>Analysis</strong> questions:<br />

These questions can be used to help study the graphs and to draw purposeful conclusions from the<br />

information represented in the data and graphs. NEXT STEPS ARE AN IMPORTANT PART OF THE<br />

LONGITUDINAL DATA ANALYSIS AND SHOULD NOT BE LEFT OUT OF THE PROCESS.<br />

<strong>Longitudinal</strong> <strong>Data</strong>: Guiding Questions:<br />

What do you notice?<br />

What are our “holes” in the curriculum?<br />

What time of year are these standards normally taught?<br />

What resources do you use when teaching these standards?<br />

Are you teaching the standards how they are tested? (Are you aligning instruction and practice with<br />

the Item Specifications?)<br />

From the identified strengths and weaknesses, next steps are created to address the weaknesses.<br />

Next Steps:<br />

Talk with your grade level and/or content cohorts about the following:<br />

o Instructional strategies focused on engaging students<br />

o Resources that align with the Item Specifications<br />

o Intervention for non-mastery students<br />

Develop a grade level and/or a department plan of action to improve student learning based on<br />

your longitudinal data analysis.<br />

o Pacing of standards<br />

o Resources<br />

o Method of instruction/strategies<br />

o Alignment to Item Specifications<br />

o Intervention<br />

o Other data (student/teacher attendance, discipline referrals, grade level/departmental<br />

planning, common assessments, etc.)


<strong>Longitudinal</strong> <strong>Data</strong> <strong>Analysis</strong> Questions<br />

What do you notice?<br />

What are our "holes" in the curriculum?<br />

What time of year are these standards normally taught?<br />

What resources do you use when teaching these standards?<br />

Are you teaching the standards how they are tested? (Are you<br />

aligning instruction and practice with the Item Specifications?)

Hooray! Your file is uploaded and ready to be published.

Saved successfully!

Ooh no, something went wrong!