Of particular debate is the impact of transferring from a traditional public school to a charter school on student achievement and growth. We employ propensity score stratification and multilevel models to balance key covariates between treatment and control groups of a cross-state sample of students, which provides a more complex picture of charter school achievement effects in a quasi-experimental context.
By: Beth Tarasawa, Yun Xiang
Topics: Measurement & scaling, Student growth & accountability policies
Effort analysis: Individual score validation of achievement test data
Whenever the purpose of measurement is to inform an inference about a student’s achievement level, it is important that we be able to trust that the student’s test score accurately reflects what that student knows and can do. Such trust requires the assumption that a student’s test event is not unduly influenced by construct-irrelevant factors that could distort his score. This article examines one such factor—test-taking motivation—that tends to induce a person-specific, systematic negative bias on test scores.
By: Steven Wise
Topics: Measurement & scaling, Innovations in reporting & assessment, School & test engagement
Response time as an indicator of test taker speed: assumptions meet reality
The growing presence of computer-based testing has brought with it the capability to routinely capture the time that test takers spend on individual test items. This, in turn, has led to an increased interest in potential applications of response time in measuring intellectual ability and achievement. Goldhammer (this issue) provides a very useful overview of much of the research in this area, and he provides a thoughtful analysis of the speed-ability trade-off and its impact on measurement.
By: Steven Wise
Topics: Measurement & scaling, Innovations in reporting & assessment, School & test engagement
Modeling student test-taking motivation in the context of an adaptive achievement test
This study examined the utility of response time-based analyses in understanding the behavior of unmotivated test takers. For an adaptive achievement test, patterns of observed rapid-guessing behavior and item response accuracy were compared to the behavior expected under several types of models that have been proposed to represent unmotivated test taking behavior.
Topics: Measurement & scaling, Growth modeling, School & test engagement
Concurrent validity of the independent reading level assessment framework and a state assessment
This study investigates the use of screening assessments within the increasingly popular Response to Intervention (RTI) framework, specifically seeking to collect concurrent validity evidence on one potential new screening tool, the Independent Reading Level Assessment (IRLA) framework.
By: Beth Tarasawa, Nicole Ralston, Jacqueline Waggoner, Amy Jackson
Topics: Empowering educators, Measurement & scaling, Reading & language arts
Students improve even amid evaluation controversy
Positive student achievement and growth results for students in New York suggest that improvements to the teacher evaluation process that emphasize the importance of strong evaluation procedures, the systematic collection of evidence of teacher performance, and the use of data to inform the process, have promise for improving educator effectiveness far more than a narrower punitive approach.
Modeling student test-taking motivation in the context of an adaptive achievement test
This study examined the utility of response time‐based analyses in understanding the behavior of unmotivated test takers. For the data from an adaptive achievement test, patterns of observed rapid‐guessing behavior and item response accuracy were compared to the behavior expected under several types of models that have been proposed to represent unmotivated test taking behavior.
Topics: Innovations in reporting & assessment, Measurement & scaling, School & test engagement