National Assessment of Educational Progress (NAEP) Overview and Tools Workshop
NAEP: The Nation’s Report Card • NAEP is the Nation’s only monitor of what students know and can do in various subject areas • NAEP is a survey designed to produce national and state level results • NAEP produces results for populations, not individuals
NAEP Components MAIN
LONG -TERM National
Public and Nonpublic (Grades 4, 8, and 12) State Public (Grades 4 and 8)
National Public and Nonpublic (9-, 13-, and 17-year olds)
TUDA (Grades 4 and 8)
3
NAEP Assessments • Main NAEP – – – – –
Grades 4, 8 and 12 Began in 1969 Follow NAGB Frameworks, content change about every 10 years Every two years for mathematics and reading State and TUDA in odd years, national in even years
• Long Term Trend – – – – – –
Ages 9, 13 and 17 Began in 1970s National assessment only Every four years Mathematics and Reading only, content mostly unchanged Last given in 2008
• Special assessments – High School Transcript Study – National Indian Education Survey
NAEP Organization U.S. Department of Education
Institute of Education Sciences (IES) National Assessment Governing Board (NAGB)
National Center for Education Statistics (NCES) Assessment Division NAEP Program
Contractors
NAEP Contractors 8.Quality Assurance HumRRO
7.Disseminat ion & Outreach Hager Sharp
6. Web Operations and Maintenance GMRI
1. Alliance Coordination ETS
NCES Assessment Division
5.Sampling & Data Collection, Training and Support Westat
2. Design, Analysis & Reporting ETS
3. Item Development AIR ETS
4. Material Preparation, Distribution & Scoring Pearson
6
NAEP Frameworks • Each NAEP assessment is built around an organizing framework, which is the blueprint that guides the development of the assessment instrument and determines the content to be assessed. • The High Schools That Work program develops its assessments from the NAEP frameworks.
NAEP Frameworks • Frameworks have been developed for: – Reading - Economics – Mathematics - Civics – Science - Foreign Language – U.S. History - Writing – Geography - Arts
Participation • The Elementary and Secondary Education Act (ESEA – formerly NCLB) requires states/districts who receive Title I funding to participate in the biennial NAEP assessment in reading and mathematics at grades 4 and 8. • Georgia law and State Board of Education rules require participation in all NAEP assessments.
School Sampling • School samples are randomly selected from groups of schools that have been stratified by variables such as: – Region – Extent of urbanization – Minority enrollment – Median household income – Results of state achievement assessments – Unique to the state/district
Student Sampling • Student samples are randomly selected from each school – All students are included – New students also have opportunity to be included – IEP guidelines may be disregarded
Contextual Background Variables • In addition to assessing subject area knowledge and abilities, NAEP collects information from students, teachers, and principals about contextual or background variables that are related to student achievement: – student questionnaires, which examine background characteristics and subject area instructional experience; – teacher questionnaires, which gather data on teacher training and classroom instruction; – school questionnaires, which gather information about school characteristics and policies; and – SD/ELL questionnaires, which provide information about students within the sample who have disabilities or are limited-English-proficient.
Analysis and Reporting Average scale scores and achievement levels reported for reading, mathematics, and science – Scale Scores • Subgroup comparisons (e.g., SD, ELL) • State and regional comparisons • Reading and Mathematics scale score range is 0-500 • Science scale score range is 0-300 – Achievement Levels • Indicate the students within the total population, or in a particular subgroup, that meet or exceed expectations of what they should know and be able to do • Advanced, Proficient, Basic
Results • State and national results only (No student, classroom, school, county, or RESA results) • Trial Urban District Assessment (TUDA) in Atlanta Public Schools will report district level results • State results are usually reported within six months of the assessment cycle.
Future Assessments
15
Resources • • • • • • • • •
General information Assessment results Item maps Frameworks Data analysis tool Released questions Scoring detail State profiles http://www.nces.ed.gov/nationsreportcard
16
Resources
17
20
21
Important Information • NAEP website: http://nces.ed.gov/nationsreportcard • NAEP Data Tool: http://nces.ed.gov/nationsreportcard/naepda ta/ • NAEP Questions Tool: http://nces.ed.gov/nationsreportcard/itmrls
Workshops • NAEP Questions Tool workshops are available to systems and schools • The workshops provide participants with hands-on training with an interactive-internet based item bank and data analysis tool • For more information or to schedule a workshop, contact Bobbie Bable at the GADOE
Contact Information Bobbie Bable NAEP State Coordinator
[email protected] 404-657-6168
