Design Challenge winner: Student assessment engagement
By: James Soland
In this CASEL Measuring SEL blog, James Soland shares how work with Santa Ana Unified School District led to new insights on how item response times and test metadata may provide insight into student SEL.
This guide explains the analyses, statistics, terms, and data included in the NWEA state dashboard, Exploring the Educational Impacts of COVID-19, as well as what they can tell us about unfinished learning in the state.
By: Greg King
Comparing different response time threshold setting methods to detect low effort on a large-scale assessment
This study uses reading test scores from over 728,923 3rd–8th-grade students in 2,056 schools across the US to compare threshold-setting methods to detect noneffortful item responses. and so helps provide guidance on the tradeoffs involved in using a given method to identify noneffortful responses.
Topics: School & test engagement
This paper describes a method for identifying partial engagement and provides validation evidence to support its use and interpretation. When test events indicate the presence of partial engagement, effort-moderated scores should be interpreted cautiously.
How have COVID-19 school closures impacted student academic growth and achievement? New research using fall 2020 MAP Growth assessment data for 4.4 million students provides new insights, key findings, and actionable recommendations.
Avoiding bias from sum scores in growth estimates: An examination of IRT-based approaches to scoring longitudinal survey responses
A huge portion of what we know about how humans develop, learn, behave, and interact is based on survey data. Although there is great deal of guidance on scaling and linking IRT-based large-scale educational assessment to facilitate the estimation of examinee growth, little of this expertise is brought to bear in the scaling of psychological and social-emotional constructs. Through a series of simulation and empirical studies, we produce scores in a single-cohort repeated measure design using sum scores as well as multiple IRT approaches and compare the recovery of growth estimates from longitudinal growth models using each set of scores.
Parameter estimation accuracy of the effort-moderated IRT model under multiple assumption violations
This session from the National Council on Measurement in Education 2020 virtual conference presents new research findings on understanding and managing test-taking disengagement.
By: James Soland, Joseph Rios
This session from the National Council on Measurement in Education 2020 virtual conference presents new research findings on understanding and managing test-taking disengagement (presentation begins at 22:55).