Working paper
Modeling student test-taking motivation in the context of an adaptive achievement test
2015
Description
This study examined the utility of response time-based analyses in understanding the behavior of unmotivated test takers. For an adaptive achievement test, patterns of observed rapid-guessing behavior and item response accuracy were compared to the behavior expected under several types of models that have been proposed to represent unmotivated test taking behavior. Test taker behavior was found to be inconsistent with these models, with the exception of the effort moderated model (S.L. Wise & DeMars, 2006). Effort-moderated scoring was found to both yield scores that were more accurate than those found under traditional scoring, and exhibit improved person fit statistics. In addition, an effort-guided adaptive test was proposed and shown to alleviate item difficulty mis-targeting caused by unmotivated test taking
See MoreView working paper
Related Topics
Research video news brief: Projecting the potential impact of COVID-19 school closures on academic achievement
In this AERA video brief, Megan Kuhfeld shares major findings and implications of preliminary projections of the potential impact of COVID-19-related school closures in spring 2020 on student learning, published this month in Educational Researcher.
Topics: COVID-19 and schools, Growth modeling, Seasonal learning patterns & summer loss
Projecting the potential impact of COVID-19 school closures on academic achievement
This study provides a series of projections of COVID-19-related learning loss based on estimates from absenteeism literature and analyses of summer learning patterns of 5 million students.
Topics: COVID-19 and schools, Growth modeling, Seasonal learning patterns & summer loss
Growth patterns and distance learning tips for students who are deaf and hard of hearing webinar
In this webinar, learn what new research shows about the academic growth trajectories of students who are deaf or hard of hearing (DHH), and tips for supporting students who are DHH in distance learning.
Topics: Accessibility, Equity, Growth modeling
Projecting the impact of the COVID-19 spring school closures on student learning
In this Stanford Center for Education Policy Analysis seminar, Megan Kuhfeld discusses projections of COVID-19-related learning loss and its potential effect on test scores in the 2020-21 school year and outlines on-going work to measure student learning between the 2019-20 and 2020-21 school years.
Topics: COVID-19 and schools, Growth modeling, Seasonal learning patterns & summer loss
A “Lost Year” of Data? What Disruptions From COVID-19 Mean For Education Research
This Bellwether Education Partners webinar examines how education research can continue to offer meaningful, relevant information to policymakers and practitioners after the “lost year” of data from COVID disruptions to schools and testing.
Topics: COVID-19 and schools, Empowering educators, Measurement & scaling
Parameter estimation accuracy of the effort-moderated IRT model under multiple assumption violations
This session from the National Council on Measurement in Education 2020 virtual conference presents new research findings on understanding and managing test-taking disengagement.
Using retest data to evaluate and improve effort-moderated scoring
This session from the National Council on Measurement in Education 2020 virtual conference presents new research findings on understanding and managing test-taking disengagement (presentation begins at 22:55).
