Journal article
The phantom collapse of student achievement in New York
2014
By: John Cronin, Nate Jensen

Abstract
When New York state released the first results of the exams under the Common Core State Standards, many wrongly believed that the results showed dramatic declines in student achievement. A closer look at the results showed that student achievement may have increased. Another lesson from the exams is that states need to closely coordinate new data with existing data when they switch to different measuring instruments.
See MoreThis article was published outside of NWEA. The full text can be found at the link above.
Topics: Measurement & scaling
Related Topics


Do response styles affect estimates of growth on social-emotional constructs? Evidence from four years of longitudinal survey scores
This study explored how response style affects estimates of growth.
By: James Soland, Megan Kuhfeld
Topics: Social-emotional learning, Growth modeling, Measurement & scaling


An investigation of examinee test-taking effort on a large-scale assessment
Most previous research involving the study of response times has been conducted using locally developed instruments. The purpose of the current study was to examine the amount of rapid-guessing behavior within a commercially available, low-stakes instrument.
By: Steven Wise, J. Carl Setzer, Jill R. van den Heuvel, Guangming Ling
Topics: School & test engagement, Measurement & scaling, Student growth & accountability policies


The potential of adaptive assessment
In this article, the authors explain how CAT provides a more precise, accurate picture of the achievement levels of both low-achieving and high-achieving students by adjusting questions as the testing goes along. The immediate, informative test results enable teachers to differentiate instruction to meet individual students’ current academic needs.
By: G. Gage Kingsbury, Mike Nesterak, MA, Edward Freeman
Topics: Measurement & scaling, Innovations in reporting & assessment, Student growth & accountability policies


The utility of adaptive testing in addressing the problem of unmotivated examinees
This integrative review examines the motivational benefits of computerized adaptive tests (CATs), and demonstrates that they can have important advantages over conventional tests in both identifying instances when examinees are exhibiting low effort, and effectively addressing the validity threat posed by unmotivated examinees.
By: Steven Wise
Topics: School & test engagement, Innovations in reporting & assessment, Measurement & scaling


Propensity score stratification using multilevel models to examine charter school achievement effects
Of particular debate is the impact of transferring from a traditional public school to a charter school on student achievement and growth. We employ propensity score stratification and multilevel models to balance key covariates between treatment and control groups of a cross-state sample of students, which provides a more complex picture of charter school achievement effects in a quasi-experimental context.
By: Beth Tarasawa, Yun Xiang
Topics: Measurement & scaling, Student growth & accountability policies


Evaluating content alignment in computerized adaptive testing
This article describes the decisions made in the development of CATs that influence and might threaten content alignment. It outlines a process for evaluating alignment that is sensitive to these threats and gives an empirical example of the process.
By: Steven Wise, G. Gage Kingsbury, Norman Webb
Topics: Measurement & scaling


Effort analysis: Individual score validation of achievement test data
Whenever the purpose of measurement is to inform an inference about a student’s achievement level, it is important that we be able to trust that the student’s test score accurately reflects what that student knows and can do. Such trust requires the assumption that a student’s test event is not unduly influenced by construct-irrelevant factors that could distort his score. This article examines one such factor—test-taking motivation—that tends to induce a person-specific, systematic negative bias on test scores.
By: Steven Wise
Topics: School & test engagement, Innovations in reporting & assessment, Measurement & scaling