What happens when test takers disengage? Understanding and addressing rapid guessing
How does rapid-guessing differ from solution behavior? Research provides insight into test disengagement and how disengagement should be managed in scoring.
View research brief
To avoid the subjectivity of having a single person evaluate a construct of interest (e.g., a student’s self-efficacy in school), multiple raters are often used. This study provides a model for estimating growth in the presence of multiple raters.
Comparing different response time threshold setting methods to detect low effort on a large-scale assessment
This study uses reading test scores from over 728,923 3rd–8th-grade students in 2,056 schools across the US to compare threshold-setting methods to detect noneffortful item responses. and so helps provide guidance on the tradeoffs involved in using a given method to identify noneffortful responses.
Topics: School & test engagement
This paper describes a method for identifying partial engagement and provides validation evidence to support its use and interpretation. When test events indicate the presence of partial engagement, effort-moderated scores should be interpreted cautiously.
Important educational policy decisions, like whether to shorten or extend the school year, often assume that growth in achievement is linear through the school year. This research examines this untested assumption using data from seven million students in kindergarten through 8th grade across the fall, winter, and spring of the 2016-17 school year.
In this National Institute of Statistical Sciences (NISS) Ingram Olkin “Statistics Serving Society” Forum, experts from around the country share statistical and data-analytic challenges they have faced as they have reported on and researched issues around the impact of COVID-19 in U.S. schools. Read more on the forum and presenters on the NISS webpage.
By: Megan Kuhfeld
In this Brown Center Chalkboard (Brookings Institution) blog, NWEA researchers share findings from new research that sheds light on the impact that the COVID-19 pandemic has had on student learning.
How have COVID-19 school closures impacted student academic growth and achievement? New research using fall 2020 MAP Growth assessment data for 4.4 million students provides new insights, key findings, and actionable recommendations.