NeSA Linking Study

MAP/NeSA LINKING STUDY A Study of the Alignment of the RIT Scales of NWEA’s MAP® Assessments with the Nebraska State Accountability Assessment

Agenda • • • • • • •

Sampling Cut Scores: Reading & Math Probabilities Chart Correlations (Pearson r) Accuracy Chart Uses & Misuses of this Information Q-N-R

Methods: Sample Test

Unique District Count

Test Season

NeSA 14 Spring 2011 Scores Total Matched Record Pairs

Unique Student Count 7081 7081

Definitions: “Current Season” = spring testing, used “equipercentile” method was used (50% probability of being proficient) “Prior Season” = fall testing, used a percent of population at the proficiency cut point method

Sample by Grade

Normal sample size is 1000 per grade

11th grade has fewer students than a normal alignment study

TABLE SET 1 – MINIMUM ESTIMATED SAME‐SEASON (SPRING) RIT CUT SCORES CORRESPONDING TO STATE PERFORMANCE LEVELS

*Note: the cut scores shown in this table are the minimum estimated scores. Meeting the minimum MAP cut score corresponds to a 50% probability of achieving that performance level.

TABLE SET 1 – MINIMUM ESTIMATED SAME‐SEASON (SPRING) RIT CUT SCORES CORRESPONDING TO STATE PERFORMANCE LEVELS

*Note: the cut scores shown in this table are the minimum estimated scores. Meeting the minimum MAP cut score corresponds to a 50% probability of achieving that performance level.

TABLE SET 2 – MINIMUM ESTIMATED PRIOR‐SEASON (FALL) RIT CUT SCORESCORRESPONDING TO STATE PERFORMANCE LEVELS

TABLE SET 2 – MINIMUM ESTIMATED PRIOR‐SEASON (FALL) RIT CUT SCORESCORRESPONDING TO STATE PERFORMANCE LEVELS

TABLE SET 3 –ESTIMATED PROBABILITY OF SCORING AS PROFICIENT OR HIGHER ON THE STATE TEST IN SAME SEASON (SPRING)

This table provides the estimated probability of passing the state test based on a MAP test score taken during that same (spring) season. Example: if a fifth grade student scored 200 on a MAP test taken during the spring season, her/his estimated probability of passing the state test is 17%.

TABLE 5 – CORRELATION COEFFICIENTS BETWEEN MAP AND STATE TEST FOR EACH GRADE AND TEST SUBJECT

* Note: Correlations range from 0 (indicating no correlation between the state test score and the NWEA test score) to 1 (indicating complete correlation between the state test score and the NWEA test score).

TABLE 6 – PERCENTAGE OF STUDENTS WHOSE PASS STATUS WAS ACCURATELY PREDICTED BY THEIR MAP PERFORMANCE USING REPORTED CUT SCORES

Projected Proficiency Report

What is this Information telling us? • Cut Points are “estimates” • Probabilities related to reaching “meets” or “exceeds” levels on NeSA • Students do not always perform similarly on two tests: – – – – –

Motivation Physical wellbeing Emotional wellbeing Paper format vs. Computer format 80-90% chance of similar scores

What is the PURPOSE? • Purpose is NOT for reporting • Better purpose is to make some preliminary estimates of proficiency in the fall based on MAP results • Mostly for internal use – identify students needing intervention • Using MAP data to report “proficiency” defeats the purpose and design of MAP assessments • The Major Purpose of MAP is to describe academic growth – Report on Growth to stakeholders

Reporting Growth Data • Key Reporting Metric: Percent of students meeting or exceeding a Growth Projection • Reports to Use: – “Student Growth Summary Reports” – “Achievement Status & Growth Reports” – “Dynamic Reporting Suite – Summary Data” • Correlates growth with projected proficiency