Modeling student test-taking motivation in the context of an adaptive achievement test
This study examined the utility of response time-based analyses in understanding the behavior of unmotivated test takers. For an adaptive achievement test, patterns of observed rapid-guessing behavior and item response accuracy were compared to the behavior expected under several types of models that have been proposed to represent unmotivated test taking behavior. Test taker behavior was found to be inconsistent with these models, with the exception of the effort moderated model (S.L. Wise & DeMars, 2006). Effort-moderated scoring was found to both yield scores that were more accurate than those found under traditional scoring, and exhibit improved person fit statistics. In addition, an effort-guided adaptive test was proposed and shown to alleviate item difficulty mis-targeting caused by unmotivated test takingSee More
View working paper
Using achievement data from fall and spring of grades K-8 for 840,000 students in 8,800 public schools, this study provides novel evidence on how achievement and growth differ between rural and nonrural schools. Rural students start kindergarten slightly ahead of nonrural students but fall behind by middle school. The divergence is driven by larger summer losses for rural students. In both rural and nonrural schools, Black–White achievement gaps widen during the school year.
There has been increasing concern about the presence of disengaged test taking in international assessment programs and its implications for the validity of inferences made regarding a country’s level of educational attainment. In this paper, the author discusses six important insights yielded by 20 years of research on this and implications for assessment programs.
By: Steven Wise
This study investigated test-taking engagement on a large-scale state summative assessment. Overall, results of this study indicate that disengagement has a material impact on individual state summative test scores, though its impact on score aggregations may be relatively minor.
The more frequent collection of response time data is leading to an increased need for an understanding of how such data can be included in measurement models. Models for response time have been advanced, but relatively limited large-scale empirical investigations have been conducted. We take advantage of a large data set from the adaptive NWEA MAP Growth Reading Assessment to shed light on emergent features of response time behavior.
This paper describes a method for identifying partial engagement and provides validation evidence to support its use and interpretation. When test events indicate the presence of partial engagement, effort-moderated scores should be interpreted cautiously.
New research examining academic achievement and growth of students in special education and their peers who were never in special education during each school year and summer in grades K-4 shows that students with disabilities grow as much or more academically during the school year than their peers without disabilities during some years, but that steeper summer learning losses for students with disabilities contribute to widening disparities.
This study compares within- and across-years academic growth for students who were ever in special education (ever-SPED) to students who were never in special education (never-SPED) in grades K-4. Ever-SPED students grew more in math and reading than never-SPED students during many school years, but lost more learning during every summer than their peers, leading to expanding disparities. These findings suggest that summer learning opportunities are crucial for improving educational outcomes for students with disabilities.