Research brief
The impact of test-taking disengagement on item content representation
2020
By: Steven Wise

Description
Rapid-guessing can distort test scores and adversely affect measurement. New research shows how disengaged responses can also distort content representation.
Read the briefAssociated Research
Related Topics


Longitudinal models of reading and mathematics achievement in deaf and hard of hearing students
New research using longitudinal data provides evidence that deaf and hard of hearing (DHH) students continue to build skills in math and reading throughout grades 2 to 8, challenging assumptions that DHH students’ skills plataeu in elementary grades.
By: Stephanie Cawthon, Elizabeth Barker, Johny Daniel, North Cooc, Ana Vielma
Topics: Equity, Measurement & scaling


Achievement and growth norms for English MAP Reading Fluency Foundational Skills
This report documents the norming study procedure used to produce the achievement and growth user norms for English MAP Reading Fluency Foundational Skills.
By: Wei He
Products: MAP Reading Fluency
Topics: Measurement & scaling


This study compared the test taking disengagement of students taking a remotely administered an adaptive interim assessment in spring 2020 with their disengagement on the assessment administered in-school during fall 2019.
By: Steven Wise, Megan Kuhfeld, John Cronin
Topics: Equity, Innovations in reporting & assessment, School & test engagement


This study evaluates the effects of asking items throughout the passage (i.e., embedding items) to achieve a more precise measure of reading comprehension by removing barriers for students to demonstrate their understanding. Results showed a significant impact of embedding comprehension items within reading passages on the measurement of student achievement in comparison to answering items at the end of the passage.
By: Meg Guerreiro, Elizabeth Barker, Janice Johnson
Topics: Equity, Innovations in reporting & assessment, Reading & language arts


The MAP Growth theory of action describes key features of MAP Growth and its position in a comprehensive assessment system.
By: Patrick Meyer, Michael Dahlin
Products: MAP Growth
Topics: Equity, Measurement & scaling, Test design


Bayesian uncertainty estimation for Gaussian graphical models and centrality indices
This study compares estimation of symptom networks with Bayesian GLASSO- and Horseshoe priors to estimation using the frequentist GLASSO using extensive simulations.
By: Joran Jongerling, Sacha Epskamp, Donald Williams
Topics: Measurement & scaling


School officials regularly use school-aggregate test scores to monitor school performance and make policy decisions. In this report, RAND researchers investigate one specific issue that may contaminate utilization of COVID-19–era school-aggregate scores and result in faulty comparisons with historical and other proximal aggregate scores: changes in school composition over time. To investigate this issue, they examine data from NWEA’s MAP Growth assessments, interim assessments used by states and districts during the 2020–2021 school year.
By: Jonathan Schweig, Megan Kuhfeld, Andrew McEachin, Melissa Diliberti, Louis Mariano
Topics: COVID-19 & schools, Measurement & scaling