Measurement & scaling
An information-based approach to identifying rapid-guessing thresholds
Although several common threshold methods are based on rapid guessing response accuracy or visual inspection of response time distributions, this paper describes a new information-based approach to setting thresholds that does not share the limitations of other methods.
By: Steven Wise
The emerging science of test-taking disengagement
Student performance on standardized tests reflects more than just mastery of the material.
By: Steven Wise
Topics: Measurement & scaling, Innovations in reporting & assessment, School & test engagement
The (non)impact of differential test taker engagement on aggregated scores
Disengaged test taking tends to be most prevalent with low-stakes tests. This has led to questions about the validity of aggregated scores from large-scale international assessments such as PISA and TIMSS, as previous research has found a meaningful correlation between the mean engagement and mean performance of countries.
By: Steven Wise, James Soland, Yuanchao Bo
Social-emotional learning (SEL) is gaining prominence in education practice and policy. Research shows that SEL can be improved by short-term, targeted interventions and longer-term strategies to improve school contextual factors. The present study examines the stability of academic achievement relative to four SEL domains (growth mindset, self-efficacy, social awareness, and self-management).
By: James Soland, Megan Kuhfeld, Emily Wolk, Sharon Bi
Topics: Measurement & scaling, Social-emotional learning, Student growth & accountability policies
In this study, we examine the impact of two techniques to account for test disengagementā(a) removing unengaged test takers from the sample and (b) adjusting test scores to remove rapidly guessed itemsāon estimates of school contributions to student growth, achievement gaps, and summer learning loss.
By: Megan Kuhfeld, James Soland
Topics: Measurement & scaling, School & test engagement, Student growth & accountability policies
Validating the SEDA measures of district educational opportunities via a common assessment
his study describes a convergent validity analysis of the SEDA growth estimates in mathematics and English Language Arts (ELA) by comparing the SEDA estimates against estimates derived from NWEAās MAP Growth assessments.
By: Megan Kuhfeld, Thurston Domina, Paul Hanselman
Topics: Equity, Growth modeling, Measurement & scaling
Reconciling long-term education policy goals with short-term school accountability models
Schools are increasingly held accountable for their contributions to studentsā academic growth in math and reading. Under The Every Student Succeeds Act, most states are estimating how much schools improve student achievement over time and using those growth metrics to identify the bottom 5% of schools for remediation.
Topics: Measurement & scaling, Growth modeling, Student growth & accountability policies