Urban Charter Schools Impact Study in Massachusetts March 2015
Explore the impact of urban charter schools in Massachusetts through an in-depth study conducted in March 2015, comparing academic progress between charter and traditional public school students. The study delves into various aspects such as academic growth, student subgroups, and performance relative to peer schools. Methodologies like the Virtual Twin approach are employed to ensure accurate assessment.
Download Presentation
Please find below an Image/Link to download the presentation.
The content on the website is provided AS IS for your information and personal use only. It may not be sold, licensed, or shared on other websites without obtaining consent from the author. If you encounter any issues during the download, it is possible that the publisher has removed the file from their server.
You are allowed to download the files provided on this website for personal or commercial use, subject to the condition that they are used lawfully. All files are the property of their respective owners.
The content on the website is provided AS IS for your information and personal use only. It may not be sold, licensed, or shared on other websites without obtaining consent from the author.
E N D
Presentation Transcript
Urban Charter Schools IMPACT in Massachusetts March 2015
Notice This presentation contains interactive graphics which should be viewed in the context of a powerpoint presentation. Viewing presentation as static slides will cause some data to be hidden from the viewer and may cause labels to appear with the wrong graph. 2
Impact Research Questions This impact study answers the following questions: How does the academic progress of charter school students compare to their traditional public school (TPS) counterparts in Massachusetts? We examine: Total average academic growth for all charter students relative to TPS Average academic growth for charter school students for separate time periods Charter school student growth by elementary / middle / high school grade levels Charter school student growth by prior year academic achievement Charter school student growth by the major student subgroups Charter school student growth by the number of years student continuously attended charter schools For the group of charter schools in Boston, how do they perform compared to their peer schools in the same community? 3
A Quick Word About Methods Charter school students may be different than a typical student in TPS, so care is needed in testing their learning gains. We use a Virtual Twin approach to match each charter school s students to TPS students who look just like them drawn from the TPS schools that have lost students to the charter school. A Technical Appendix provides a full explanation of our research methodology. 4
A Quick Word About Methods Unlike other recent CREDO studies, this study does not include a conversion of effect sizes to days of learning. As the days of learning computation is based on the national NAEP scores, it would not be appropriate to apply it to the limited regional samples which almost certainly DO NOT progress at the same rate as the national population. 5
Understanding the Slides AVERAGE ACADEMIC GROWTHFOR CHARTER SCHOOLSTUDENTSRELATIVETO PERFORMANCEOF VIRTUAL TWINSIN TRADITIONAL PUBLIC SCHOOLSIN URBAN REGION for reading. The left is for TPS students and the right for Charter students There are two growth values There are also two growth values for math. As before, the left is for TPS students and the right for Charter students 0.15 0.10 0.08** 0.05** This graph looks at the difference between the charter and TPS growth values. reading and the right for math. These are the marginal effects of charter enrollment. The left is for 0.05 0.03** 0.03 0.08 - 0.05 -0.01 0.05 - 0.06 Average TPS Growth 0.00 0.15 -0.01 0.10 -0.05 0.05 Average TPS Growth 0.00 -0.10 To compute the difference, we take the Charter growth value minus the TPS growth value for each subject. -0.05 -0.15 -0.05** -0.06** -0.10 TPS Charter TPS Charter Reading Math -0.15 Reading Math 6
BOSTON BOSTON Results Results 7
Student-Level Results AVERAGE ACADEMIC GROWTHFOR CHARTER SCHOOLSTUDENTSRELATIVETO PERFORMANCEOF VIRTUAL TWINSIN TRADITIONAL PUBLIC SCHOOLSIN BOSTON ALL STUDENTS 0.45 0.37** 0.40 0.35 0.30** 0.30 0.25 0.20 0.40 0.15 0.07** 0.35 0.10 0.06** 0.31** 0.30 0.25 0.05 0.23** Average TPS Growth 0.20 0.00 0.15 0.10 -0.05 0.05 -0.10 Region Average TPS Growth 0.00 -0.05 -0.15 TPS Charter TPS Charter -0.10 Reading Math -0.15 Reading Math 8
Student-Level Results AVERAGE ACADEMIC GROWTHFOR CHARTER SCHOOLSTUDENTSRELATIVETO PERFORMANCEOF VIRTUAL TWINSIN TRADITIONAL PUBLIC SCHOOLSIN BOSTON ALL STUDENTS BY GROWTH PERIOD 0.40 0.34** 0.35 0.30** 0.27** 0.27** 0.29** 0.26** 0.26** 0.30 0.24** 0.25 0.19** 0.20 0.16* 0.15 0.10 0.05 Average TPS Growth 0.00 -0.05 -0.10 -0.15 Reading Math 2007 2008 2009 2010 2011 9
Student-Level Results AVERAGE ACADEMIC GROWTHFOR CHARTER SCHOOLSTUDENTSRELATIVETO PERFORMANCEOF VIRTUAL TWINSIN TRADITIONAL PUBLIC SCHOOLSIN BOSTON ALL STUDENTS BY GRADESPAN 0.40 0.35** 0.34** 0.35 0.31** 0.31** 0.30** 0.30 0.25** 0.22** 0.25 0.20 0.14** 0.15 0.10 0.05 Average Elementary TPS Growth 0.00 -0.05 -0.10 -0.15 Reading Math Elementary Middle High Multi_level 10
Student-Level Results AVERAGE ACADEMIC GROWTHFOR CHARTER SCHOOLSTUDENTSRELATIVETO PERFORMANCEOF VIRTUAL TWINSIN TRADITIONAL PUBLIC SCHOOLSIN BOSTON ALL STUDENTS BY YEARSOF CHARTER SCHOOL ENROLLMENT 0.45 0.39** 0.40 0.31** 0.34** 0.35 0.30 0.25** 0.25** 0.25** 0.24** 0.23** 0.25 0.20 0.15 0.10 0.05 Average TPS Growth 0.00 -0.05 -0.10 -0.15 Reading Math Years in Charter School 1 Year 2 Years 3 Years 4 Years This analysis includes only students who entered a charter school after 2006-2007. 11
Student-Level Results AVERAGE ACADEMIC GROWTHFOR CHARTER SCHOOLSTUDENTSRELATIVETO PERFORMANCEOF VIRTUAL TWINSIN TRADITIONAL PUBLIC SCHOOLSIN BOSTON ALL WHITE STUDENTS 0.25 0.21** 0.20 0.15 0.13** 0.10 0.25 0.21** 0.20 0.05 0.15 0.13** 0.00 0.00 Average White TPS Growth 0.10 0.00 0.05 0.00 -0.05 Average White TPS Growth TPS Charter TPS Charter -0.05 Reading Math Reading Math 12
Student-Level Results AVERAGE ACADEMIC GROWTHFOR CHARTER SCHOOLSTUDENTSRELATIVETO PERFORMANCEOF VIRTUAL TWINSIN TRADITIONAL PUBLIC SCHOOLSIN BOSTON ALL ASIAN STUDENTS 0.40 0.34** 0.35 0.30 0.23** 0.25 0.20 0.17** 0.15** 0.15 0.20 0.10 0.18* 0.15 0.05 Average White TPS Growth 0.00 0.10 -0.05 0.07 0.05 -0.10 Average Asian TPS Growth 0.00 -0.15 TPS Charter TPS Charter -0.05 Reading Math Reading Math 13
Student-Level Results AVERAGE ACADEMIC GROWTHFOR CHARTER SCHOOLSTUDENTSRELATIVETO PERFORMANCEOF VIRTUAL TWINSIN TRADITIONAL PUBLIC SCHOOLSIN BOSTON ALL NATIVE AMERICAN STUDENTS 0.35 0.30 0.25 0.20 0.15 0.10 0.05 Average White TPS Growth 0.00 0.60 0.55 -0.05 0.50 0.45 -0.10 0.40 0.35 -0.15 0.30 0.25 -0.20 0.20 -0.25 0.15 0.10 -0.30 0.05 0.00 -0.35 Average Native American TPS Growth TPS Charter TPS Charter -0.05 -0.10 -0.15 Reading Math Reading Math There were not enough Boston Native American students in Reading or Math to compute an effect size. 14
Student-Level Results AVERAGE ACADEMIC GROWTHFOR CHARTER SCHOOLSTUDENTSRELATIVETO PERFORMANCEOF VIRTUAL TWINSIN TRADITIONAL PUBLIC SCHOOLSIN BOSTON ALL BLACK STUDENTS 0.15 0.12** 0.10 0.03 0.05 0.00 Average White TPS Growth -0.05 0.30 0.27** 0.25 -0.10 -0.11** 0.20 -0.15 0.14** 0.15 -0.16** 0.10 -0.20 0.05 -0.25 Average Black TPS Growth 0.00 TPS Charter TPS Charter -0.05 Reading Math Reading Math 15
Student-Level Results AVERAGE ACADEMIC GROWTHFOR CHARTER SCHOOLSTUDENTSRELATIVETO PERFORMANCEOF VIRTUAL TWINSIN TRADITIONAL PUBLIC SCHOOLSIN BOSTON ALL HISPANIC STUDENTS 0.25 0.22** 0.20 0.16** 0.15 0.10 0.35 0.05 0.29** 0.30 Average White TPS Growth 0.25 0.00 0.20** 0.20 0.15 -0.05 -0.04 0.10 -0.07** 0.05 -0.10 Average Hispanic TPS Growth TPS Charter TPS Charter 0.00 -0.05 Reading Math Reading Math 16
Student-Level Results AVERAGE ACADEMIC GROWTHFOR CHARTER SCHOOLSTUDENTSRELATIVETO PERFORMANCEOF VIRTUAL TWINSIN TRADITIONAL PUBLIC SCHOOLSIN BOSTON ALL STUDENTS ELIGIBLE FOR FREE / REDUCED PRICE LUNCH 0.15 0.10 0.05 0.00 Average Non-Poverty TPS Growth 0.10 0.08** -0.01 -0.02 0.04* 0.05 -0.05 Average TPS in Poverty Growth -0.06** 0.00 -0.10 -0.09** -0.05 -0.10 -0.15 TPS Charter TPS Charter -0.15 Reading Math Reading Math 17
Student-Level Results AVERAGE ACADEMIC GROWTHFOR CHARTER SCHOOLSTUDENTSRELATIVETO PERFORMANCEOF VIRTUAL TWINSIN TRADITIONAL PUBLIC SCHOOLSIN BOSTON ALL BLACK STUDENTS IN POVERTY 0.15 0.08** 0.10 0.05 Average White, Non- Poverty TPS Growth 0.00 -0.01 -0.05 -0.10 -0.15 -0.20 -0.25 -0.23** -0.22** -0.30 TPS Charter TPS Charter Reading Math 18
Student-Level Results AVERAGE ACADEMIC GROWTHFOR CHARTER SCHOOLSTUDENTSRELATIVETO PERFORMANCEOF VIRTUAL TWINSIN TRADITIONAL PUBLIC SCHOOLSIN BOSTON ALL HISPANIC STUDENTS IN POVERTY 0.25 0.19** 0.20 0.15 0.12** 0.10 0.05 Average White Non- Poverty TPS Growth 0.00 -0.05 -0.10 -0.15 -0.14** -0.15** -0.20 TPS Charter TPS Charter Reading Math 19
Student-Level Results AVERAGE ACADEMIC GROWTHFOR CHARTER SCHOOLSTUDENTSRELATIVETO PERFORMANCEOF VIRTUAL TWINSIN TRADITIONAL PUBLIC SCHOOLSIN BOSTON ALL ENGLISH LANGUAGE LEARNERS 0.05 0.00 Average Non-ELL TPS Growth 0.00 -0.01 -0.05 -0.10 0.25 -0.11** 0.20 0.16* 0.15 -0.15 0.11 0.10 -0.17** 0.05 -0.20 Average ELL TPS Growth 0.00 -0.05 -0.25 TPS Charter TPS Charter -0.10 -0.15 Reading Math Reading Math 20
Student-Level Results AVERAGE ACADEMIC GROWTHFOR CHARTER SCHOOLSTUDENTSRELATIVETO PERFORMANCEOF VIRTUAL TWINSIN TRADITIONAL PUBLIC SCHOOLSIN BOSTON ALL STUDENTS WITH SPECIAL EDUCATION NEEDS 0.15 0.10 0.05 Average Non-SPED TPS Growth 0.00 -0.05 -0.10 -0.15 0.15 -0.20 -0.25 0.10 -0.30 0.06 0.05 -0.28** 0.05 -0.35 -0.33** -0.35** Average SPED TPS Growth 0.00 -0.40 -0.41** -0.05 -0.45 -0.10 -0.50 TPS Charter TPS Charter -0.15 Reading Math Reading Math 21
Student-Level Results AVERAGE ACADEMIC GROWTHFOR CHARTER SCHOOLSTUDENTSRELATIVETO PERFORMANCEOF VIRTUAL TWINSIN TRADITIONAL PUBLIC SCHOOLSIN BOSTON ALL STUDENTS WHO WERE RETAINED IN PRIOR YEAR 0.20 0.15 0.15 0.11 0.10 0.10 0.03 0.05 0.15 0.00 Average Non- Retained TPS Growth 0.10 0.05 -0.05 0.01 Average Retained TPS Growth 0.00 -0.10 -0.05 -0.10 -0.15 TPS Charter TPS Charter -0.12 -0.15 Reading Math Reading Math 22
