School & test engagement
Educators need accurate assessment data to help students learn. But when students rapid-guess or otherwise disengage on tests the validity of scores can be affected. Our research examines the causes of test disengagement, how it relates to students’ overall academic engagement, and its impacts on individual test scores. We look at its effects on aggregated metrics used for school and teacher evaluations, achievement gap studies, and more. This research also explores better ways to measure and improve engagement and to help ensure that test scores more accurately reflect what students know and can do.
Comparability analysis of remote and in-person MAP Growth testing in fall 2020
How have COVID-19 school closures impacted student academic growth and achievement? New research using fall 2020 MAP Growth assessment data for 4.4 million students provides new insights, key findings, and actionable recommendations.
Topics: COVID-19 & schools, Measurement & scaling, School & test engagement
Parameter estimation accuracy of the effort-moderated IRT model under multiple assumption violations
This session from the National Council on Measurement in Education 2020 virtual conference presents new research findings on understanding and managing test-taking disengagement.
Using retest data to evaluate and improve effort-moderated scoring
This session from the National Council on Measurement in Education 2020 virtual conference presents new research findings on understanding and managing test-taking disengagement (presentation begins at 22:55).
This session from the 2020 National Council on Measurement in Education virtual conference presents new research findings on understanding and managing test-taking disengagement. (Presentation begins at 22:55).
Topics: School & test engagement
Using retest data to evaluate and improve effort-moderated scoring
This study investigated effort‐moderated (E‐M) scoring, in which item responses classified as rapid guesses are identified and excluded from scoring, and its affect on score distortion from disengaged test taking.
Topics: Innovations in reporting & assessment, Measurement & scaling, School & test engagement
A cessation of measurement: Identifying test taker disengagement using response time
This chapter explores both what happens when test takers disengage and how this disengagement should be managed during scoring.
Topics: School & test engagement
An intelligent CAT that can deal with disengaged test taking
This book presents varied applications of artificial intelligence (AI) in test development, including research and successful examples of using AI technology in automated item generation, automated test assembly, automated scoring, and computerized adaptive testing.
Topics: Innovations in reporting & assessment, Measurement & scaling, School & test engagement
