Journal article
Construct validity and measurement invariance of computerized adaptive testing: Application to Measures of Academic Progress (MAP) using confirmatory factor analysis
2013
Journal of Educational and Developmental Psychology, 3(1)
Abstract
There are many challenges to providing validity evidence for CAT tests because of its uniqueness compared to fixed form tests. This study, using real data, provides empirical evidence of construct and invariance construct of MAP scales across grades at different academic calendars for 10 different states. Results show the consistency and reasonableness of interpretation of the MAP RIT scale across grades and academic calendar years for the different states.
See MoreThis article was published outside of NWEA. The full text can be found at the link above.
Topics: Measurement & scaling, Test design
Related Topics
For decades, researchers and practitioners have made a great deal of effort to study a variety of methods to increase parameter accuracy, but only recently can researchers start focusing on improving parameter estimations by using a joint model that could incorporate RT and students information as CI.
Topics: Test design
An investigation of examinee test-taking effort on a large-scale assessment
Most previous research involving the study of response times has been conducted using locally developed instruments. The purpose of the current study was to examine the amount of rapid-guessing behavior within a commercially available, low-stakes instrument.
Topics: Measurement & scaling, School & test engagement, Student growth & accountability policies
These studies are conducted based on assumptions under regular conditions for fixed test forms, such as no missing responses and normal distribution of unidimensional ability for a population.
Topics: Measurement & scaling, Computer adaptive testing, Item response theory
The current investigative study uses a multiple-indicator, latent-growth modelling (MLGM) approach to examine the longitudinal achievement construct and its invariance for MAP Growth.
Topics: Measurement & scaling, Growth modeling
The phantom collapse of student achievement in New York
When New York state released the first results of the exams under the Common Core State Standards, many wrongly believed that the results showed dramatic declines in student achievement. A closer look at the results showed that student achievement may have increased.
Topics: Measurement & scaling
The utility of adaptive testing in addressing the problem of unmotivated examinees
This integrative review examines the motivational benefits of computerized adaptive tests (CATs), and demonstrates that they can have important advantages over conventional tests in both identifying instances when examinees are exhibiting low effort, and effectively addressing the validity threat posed by unmotivated examinees.
Topics: Measurement & scaling, Innovations in reporting & assessment, School & test engagement
