Measurement & scaling
Is Moneyball the next big thing in education?
Predictive analytics in education can offer a benefit as long as educators heed the differences between how the tools are used in industry and how they should be used differently in schooling. Perhaps most important, teachers already know a great deal about their students ā far more than an investor knows about a stock or a baseball scout about an up-and-coming pitcher.
By: James Soland
Get it right: Common sense on the common core
In this podcast, Nate Jensen discusses the value of assessments aligned to the Common Core State Standards and the misconceptions that accompanied the implementation of new assessments in some states.
Learning First Alliance, Get It Right podcast
Modeling student test-taking motivation in the context of an adaptive achievement test
This study examined the utility of response timeābased analyses in understanding the behavior of unmotivated test takers. For the data from an adaptive achievement test, patterns of observed rapidāguessing behavior and item response accuracy were compared to the behavior expected under several types of models that have been proposed to represent unmotivated test taking behavior.
Topics: Innovations in reporting & assessment, Measurement & scaling, School & test engagement
Concurrent validity of the independent reading level assessment framework and a state assessment
This study investigates the use of screening assessments within the increasingly popular Response to Intervention (RTI) framework, specifically seeking to collect concurrent validity evidence on one potential new screening tool, the Independent Reading Level Assessment (IRLA) framework.
By: Beth Tarasawa, Nicole Ralston, Jacqueline Waggoner, Amy Jackson
Topics: Empowering educators, Measurement & scaling, Reading & language arts
A large-scale, long-term study of scale drift: The micro view and the macro view
This study examined the measurement stability of a set of Rasch measurement scales that have been in place for almost 40 years.
This article addresses the issue by estimating teacher value added, then applying extremely mild nonlinear transformations to the original scale and re-estimating the value added. Although by definition at most one of these scales can be equal-interval, all are treated as if interval-scaled when estimating value added.
By: James Soland
Topics: Measurement & scaling, Student growth & accountability policies
A general approach to measuring test-taking effort on computer-based tests
The current study outlines a general process for measuring item-level effort that can be applied to an expanded set of item types and test-taking behaviors (such as omitted or constructed responses). This process, which is illustrated with data from a large-scale assessment program, should improve our ability to detect non-effortful test taking and perform individual score validation.
By: Steven Wise, Lingyun Gao
Topics: Measurement & scaling, Innovations in reporting & assessment, Student growth & accountability policies