Student test engagement and its impact on achievement gap estimates
By: James Soland
In this Brookings Institute Chalkboard blog, James Soland shares his work investigating how student test engagement may shape achievement gaps.View blog
Four-day school weeks have proliferated across the United States, but little is known about their implementation or their effects on students. This study uses district-level data from Oklahoma to provide estimates of the causal effect of the 4-day school week on high school students’ ACT scores, attendance, and disciplinary incidents during school.
By: Emily Morton
This study compared the test taking disengagement of students taking a remotely administered an adaptive interim assessment in spring 2020 with their disengagement on the assessment administered in-school during fall 2019.
By: Steven Wise, Megan Kuhfeld, John Cronin
There has been increasing concern about the presence of disengaged test taking in international assessment programs and its implications for the validity of inferences made regarding a country’s level of educational attainment. In this paper, the author discusses six important insights yielded by 20 years of research on this and implications for assessment programs.
By: Steven Wise
This study investigated test-taking engagement on a large-scale state summative assessment. Overall, results of this study indicate that disengagement has a material impact on individual state summative test scores, though its impact on score aggregations may be relatively minor.
By: Steven Wise, Jonghwan (Jay) Lee, Sukkeun Im
The more frequent collection of response time data is leading to an increased need for an understanding of how such data can be included in measurement models. Models for response time have been advanced, but relatively limited large-scale empirical investigations have been conducted. We take advantage of a large data set from the adaptive NWEA MAP Growth Reading Assessment to shed light on emergent features of response time behavior.
This paper describes a method for identifying partial engagement and provides validation evidence to support its use and interpretation. When test events indicate the presence of partial engagement, effort-moderated scores should be interpreted cautiously.
By: Steven Wise, Megan Kuhfeld
This study uses reading test scores from over 728,923 3rd–8th-grade students in 2,056 schools across the US to compare threshold-setting methods to detect noneffortful item responses. and so helps provide guidance on the tradeoffs involved in using a given method to identify noneffortful responses.
Topics: School & test engagement