NAEP 2009 Preparedness Standard Setting: Technical Report

National Assessment of Educational Progress Judgmental Standard Setting (JSS) Studies: Technical Report

MEASURED PROGRESS
WESTED, 2012, GRADE 12

Description of the technical procedures implemented for the judgmental standard setting sessions led by WestEd and Measured Progress, to establish preparedness reference points on the 12th grade NAEP score scales in reading and mathematics.

This is the Technical Report for the series of judgmental standard-setting (JSS) studies conducted to establish preparedness reference points on the 12th grade NAEP score scales in reading and mathematics. For each NAEP assessment, these points represent the academic performance required for placement in an entry-level, credit-bearing college course or for enrollment in a postsecondary job-training program.

This Technical Report serves as a supplement to the Process Report (WestEd & Measured Progress, 2011). It provides a description of the technical and computational procedures implemented before, during, and after the JSS sessions. These technical procedures were guided by the advice of a JSS Technical Advisory Committee (JSS-TAC)—a five-member group that collectively represents expertise in standard setting, expertise in vocational/post-secondary activity education and certification, and experience with NAEP. This Report is divided into three main sections: materials and procedures, cut score evaluation, and special analyses.

Judgmental Standard Setting: JOB TRAINING | COLLEGE | READING | MATHEMATICS