Technical brief
Comparability analysis of remote and in-person MAP Growth testing in fall 2020
November 2020
By: Megan Kuhfeld, Karyn Lewis, Patrick Meyer, Beth Tarasawa
Description
This study compared the psychometric characteristics and indicators of test quality of fall 2020 MAP Growth tests administered remotely and in-person. Using test scores from over 535,000 K-8 students in 147 school districts (92 operating fully remotely this fall, 55 offering in-person instruction to all students), this study provides insight into the comparability of remote versus in-school assessment. We found high levels of marginal reliability and test engagement across all grades, as well as consistent trends in test scores for remote and in-person tests for students in grades 3-8. Taken together, these findings increase confidence in the quality of data gathered from remotely administered MAP Growth assessments in grades 3 and up.
See MoreAssociated Research
Technical brief
Related Topics
High dosage tutoring for academically at-risk students
This brief provides a review of the research on high dosage tutoring as an intervention strategy for supporting at-risk students. It highlights the benefits and the non-negotiable factors for effective implementation and usage.
By: Ayesha K. Hashim, Miles Davison, Sofia Postell, Jazmin Isaacs
Topics: COVID-19 & schools, Equity, Growth, Informing instruction
Typical learning for whom? Guidelines for selecting benchmarks to calculate months of learning
To describe the impact of the COVID-19 pandemic on students, researchers have translated test scores into months of learning to claim how many months/years students are behind in school. Despite its perceived accessibility, there are major downsides to this translation. To inform future uses by researchers and media, we discuss in this brief how to calculate this metric as well as its trade-offs.
By: Megan Kuhfeld, Melissa Diliberti, Andrew McEachin, Jon Schweig, Louis T. Mariano
Topics: COVID-19 & schools, Equity, Growth, Growth modeling, Seasonal learning patterns & summer loss
Exploring the educational impacts of COVID-19
This visualization was developed to provide state-level insights into how students performed on MAP Growth in the 2020ā2021 school year. Assessments are one indicator, among many, of the student impact from COVID-19. Our goal with this tool is to create visible data that informs academic recovery efforts that will be necessary in the 2022 school year and beyond.
By: Greg King
Topics: COVID-19 & schools, Innovations in reporting & assessment
New research shows progress toward academic recovery stalled in 2022-23. This research brief covers data from 6.7 million US students examining academic gains relative to pre-pandemic years as well as tracking the gap in achievement between COVID year student groups compared to their pre-pandemic peers.
By: Karyn Lewis, Megan Kuhfeld
Products: MAP Growth
Topics: COVID-19 & schools, Equity
Technical appendix: 2022-23 achievement data reveal stalled progress toward pandemic recovery
The purpose of this technical appendix is to share more detailed results and describe the sample and methods used in the research in Educationās long COVID: 2022-23 achievement data reveal stalled progress toward pandemic recovery report.
By: Jazmin Isaacs, Megan Kuhfeld, Karyn Lewis
Topics: COVID-19 & schools, Equity
Achievement and Growth Norms for Course-Specific MAP Growth Tests
This report documents the procedure used to produce the achievement and growth user norms for a series of the course-specific MAPĀ® Growthā¢ subject tests, including Algebra 1, Geometry, Algebra 2, Integrated Math I, Integrated Math II, Integrated Math III, and Biology/Life Science. Among these tests, Integrated Math I, Integrated Math II, Integrated Math III, and Biology/Life Science were the first time to have their norms available. The remaining tests, i.e., Algebra 1, Geometry, and Algebra 2, had their norms updated including receiving more between-term growth norms by using more recent test events. Procedure for norm sample selection and a model-based approach using the multivariate true score model (Thum & He, 2019) that factors out known imprecision of scores to generate the norms are also provided in detail, along with the snapshots of the achievement and growth norms for each test.
By: Wei He
Products: MAP Growth
Topics: Measurement & scaling
The purpose of this technical appendix is to share more detailed results and describe the sample and methods used in the research in Progress towards pandemic recovery: Continued signs of rebounding achievement at the start of the 2022-23 school year.
By: Megan Kuhfeld, Karyn Lewis
Topics: COVID-19 & schools, Equity