
Insights from Accountability Feedback Survey Results in Education
Gain valuable insights from the presentation of the Accountability Feedback Survey Results to the Board of Elementary and Secondary Education on December 18, 2018. Understand respondent demographics, perceptions of the new accountability system, and the correlation between understanding and satisfaction.
Download Presentation

Please find below an Image/Link to download the presentation.
The content on the website is provided AS IS for your information and personal use only. It may not be sold, licensed, or shared on other websites without obtaining consent from the author. If you encounter any issues during the download, it is possible that the publisher has removed the file from their server.
You are allowed to download the files provided on this website for personal or commercial use, subject to the condition that they are used lawfully. All files are the property of their respective owners.
The content on the website is provided AS IS for your information and personal use only. It may not be sold, licensed, or shared on other websites without obtaining consent from the author.
E N D
Presentation Transcript
Accountability Feedback Survey Results Presented to the Board of Elementary and Secondary Education December 18, 2018
Background Survey sent to Superintendents, principals and various stakeholder organizations in the state Open from October 29thto November 16th (reminder sent November 12th) 439 responses with at least one question answered beyond name Choice type questions had a much higher response rate than open- ended suggestions Small majority of respondents reported as being Satisfied or Very Satisfied with the new accountability system 2 Massachusetts Department of Elementary and Secondary Education
Who responded to the survey? Group All Respondents District Leader School Leader School Committee Educator/Content Coach Advocacy Organizations* Urban Supts. Network Charter Regional Vocational Response # 439 179 144 90 22 4 48 26 23 Response % 100% 41% 32% 21% 5% 1% 11% 6% 5% * Included MASC, MCPSA and MBAE 3 Massachusetts Department of Elementary and Secondary Education
How well did respondents understand the system? Understand Well 29% 42% 26% 7% 27% 50% 38% 42% 18% Understand Most 49% 49% 51% 49% 36% 50% 48% 58% 57% Understand Some 20% 8% 23% 39% 27% 0% 10% 0% 22% Do Not Understand 2% 0% 1% 6% 9% 0% 4% 0% 4% Group Response # All Respondents District Leader School Leader School Committee Educator/Content Coach Advocacy Organizations Urban Supts. Network Charter School Regional Vocational/Tech. 438 178 144 90 22 4 48 26 23 4 Massachusetts Department of Elementary and Secondary Education
How satisfied were respondents with the new system? Very Satisfied 2% 2% 2% 2% 5% 0% 8% 0% 0% Very Group Response # Satisfied Dissatisfied Dissatisfied 5% 2% 8% 9% 5% 0% 8% 8% 4% All Respondents District Leader School Leader School Committee Educator/Content Coach Advocacy Organizations Urban Supts. Network Charter School Regional Vocational/Tech. 439 179 144 90 22 4 48 26 23 51% 58% 42% 52% 50% 25% 48% 50% 83% 42% 38% 48% 37% 41% 75% 35% 42% 13% 5 Massachusetts Department of Elementary and Secondary Education
How did understanding impact satisfaction? Very Satisfied 2% 6% 1% 0% 0% Very Group Response # Satisfied Dissatisfied Dissatisfied 5% 8% 3% 6% 38% All Respondents Understand Well Understand Most Understand Some Do Not Understand 438 126 215 89 8 51% 50% 53% 51% 25% 42% 36% 44% 44% 38% 6 Massachusetts Department of Elementary and Secondary Education
How valuable is the normative component (school percentile)? Very Valuable Somewhat Valuable Not Group Response # Valuable Valuable All Respondents District Leader School Leader School Committee Educator/Content Coach Advocacy Organizations* Urban Supts. Network Charter School Regional Vocational/Tech. 377 161 121 73 18 4 42 23 19 16% 15% 19% 14% 22% 25% 26% 30% 21% 49% 47% 48% 55% 56% 25% 52% 30% 68% 30% 32% 28% 26% 17% 25% 14% 35% 11% 6% 6% 5% 5% 6% 25% 7% 5% 0% 7 Massachusetts Department of Elementary and Secondary Education
How valuable is the criterion-referenced component (target percentage)? Very Valuable Somewhat Valuable Not Group Response # Valuable Valuable All Respondents District Leader School Leader School Committee Educator/Content Coach Advocacy Organizations* Urban Supts. Network Charter School Regional Vocational/Tech. 378 161 121 74 18 4 42 23 19 15% 20% 10% 14% 5% 25% 31% 22% 11% 42% 39% 45% 45% 61% 0% 43% 30% 63% 33% 32% 32% 35% 33% 75% 24% 35% 21% 9% 9% 13% 7% 0% 0% 2% 13% 5% 8 Massachusetts Department of Elementary and Secondary Education
How valuable were different components of the system? Very Valuable Somewhat Valuable Not Group Response # Valuable Valuable Need for Assistance/Not Reason for Classification Lowest Performing Students Lowest Performing Subgroups Participation Chronic Absence Dropout Extended Engagement Rate Advanced Coursework 378 378 377 366 376 372 372 372 372 7% 8% 18% 20% 6% 15% 12% 10% 11% 30% 30% 42% 48% 39% 32% 49% 41% 38% 39% 44% 30% 31% 39% 29% 29% 33% 33% 24% 17% 9% 4% 17% 24% 11% 16% 19% 9 Massachusetts Department of Elementary and Secondary Education
How should indicators in non-high schools be weighted? Increase Weight Keep the Same Decrease Weight Indicator Response # Achievement (60%) District Leader School Leader School Committee Growth (20%) District Leader School Leader School Committee EL Progress (10%) Chronic Absenteeism (10%) 340 151 109 59 341 151 110 59 340 340 16% 13% 22% 15% 42% 48% 43% 24% 9% 4% 51% 52% 46% 64% 50% 49% 45% 64% 73% 48% 33% 35% 32% 20% 8% 3% 13% 12% 19% 48% 10 Massachusetts Department of Elementary and Secondary Education
How should indicators in high schools be weighted? Increase Weight Keep the Same Decrease Weight Indicator Response # Achievement (40%) District Leader School Leader School Committee Growth (20%) District Leader School Leader School Committee HS Completion (20%) EL Progress (10%) Chronic Abs./Adv. Course (10%) 339 151 108 59 339 151 108 59 339 339 339 31% 32% 26% 27% 33% 37% 33% 25% 9% 6% 9% 53% 52% 48% 61% 57% 57% 53% 63% 68% 73% 49% 17% 16% 26% 12% 10% 7% 14% 12% 22% 21% 42% 11 Massachusetts Department of Elementary and Secondary Education
What additional indicators should be included for non-HS? Only 130 responses to this open question Most frequent response was some variation of None (52) Others mentioned included: o School climate/student feedback o Access to the arts o Educator attendance o Suspension o School spending o K-2 Accountability 12 Massachusetts Department of Elementary and Secondary Education
What additional indicators should be included for high school? Only 130 responses to this open question Many of the same as non-HS Additional ideas mentioned included: o Broader definition of advanced coursework o Postsecondary enrollment o Extra-curricular participation o 9thgrade success 13 Massachusetts Department of Elementary and Secondary Education
What else is on your mind? Last question on survey was open for respondents to tell us anything about the new system. Some more common themes: o N-size issues in small schools and participation o Chronic absenteeism is out of our control (excused absences) o Use of standardized testing o High-performing districts are penalized o Need consistency we keep changing system o State funding for accountability 14 Massachusetts Department of Elementary and Secondary Education