Oregon Department of Education Accountability Details & Appeals 2024

2023-24 School and District Accountability Details June 20, 2024 Elyse Bean Jon Wiens Oregon Department of Education 1

Webinar Outline Important Dates Applicable Validations Accountability Appeals Overview Updates & Changes Indicators and School Identification How to preview your Accountability Detail Sheets Contacts Oregon Department of Education 2

Accountability Details Important Dates Event Date Accountability Details Validation Opens July 18, 2024 Accountability Appeals Due by 5:00 PM Aug. 14, 2024 Last day to make edits to 3rd Period ADM Aug. 23, 2024 Last day to make edits to the 9th Grade On-Track Collection Sept. 6, 2024 Accountability Details Validation Closes Sept. 30, 2024 Accountability Details Final Refresh Oct. 3, 2024 Accountability Details and At-A-Glance Profiles Published TBA Schedule of Due Dates Assessment and Accountability Checklist Oregon Department of Education 3

Validations Validation = data feed into the Accountability Detail Sheets Dates Grad Cohort Closed and Final! Student Enrollment June 6 Aug. 23, 2024 Regular Attenders June 6 Aug. 23, 2024 Assessment June 13 Aug. 23, 2024 9th Grade On-Track July 11 Aug. 23, 2024 Class Size July 11 Sept. 1, 2024 At-A-Glance Narrative Collection July 11 Sept. 20, 2024 On-Track to English Language Proficiency July 18 Aug. 23, 2024 Accountability Details Validation July 18 Sept. 30, 2024 Student Mobility July 25 Aug. 23, 2024 At-A-Glance Validation July 25 Sept. 30, 2024 Oregon Department of Education 2023-24 Accountability Reporting Validation Calendar 4 2023-24 Validation Refresh Schedule

School and District Accountability Appeals The Oregon Department of Education (ODE) will consider appeals regarding accountability data displayed on the 2023-24 Accountability Detail Sheets and/or the At-A-Glance School and District Profiles. Districts, on behalf of their respective schools, may submit the a written request to ODE from the school district superintendent or the superintendent s designee. Appeals are due Wednesday August 14, 2024 by 5 PM PDT Appeals must be accompanied by appropriate documentation. Email to: Elyse.Bean@ode.oregon.gov Visit the Accountability Details page for more information: School Accountability Appeals Notice Appeals Process Oregon Department of Education 5

Accountability Details Overview The Accountability Detail Sheets report school and district performance and improvement using the accountability model developed in Oregon s State Plan under the Every Student Succeeds Act (ESSA). Identify levels of support for schools under ESSA Comprehensive Support and Improvement (CSI) Targeted Support and Improvement (TSI) Four report types Elementary/Middle Schools High Schools Combined Schools (e.g., KG-12) Districts Oregon Department of Education 6

Updates & Changes Oregon Department of Education 7

Updates & Changes - Years of Data Available Indicator Years of Data Used Regular Attenders 2023-24, 2022-23, 2021-22 ELA Achievement 2023-24, 2022-23, 2021-22 ELA Average Gap Score Change 2023-24, 2018-19 ELA Participation 2023-24, 2022-23, 2021-22 Math Achievement 2023-24, 2022-23, 2021-22 Math Average Gap Score Change 2023-24, 2018-19 Math Participation 2023-24, 2022-23, 2021-22 On-Track to English Language Proficiency 2023-24, 2022-23, 2021-22 9th Grade On-Track 2023-24, 2022-23, 2021-22 4-Year Graduation 2022-23, 2021-22, 2020-21 (graduation year) 5-Year Completers 2022-23, 2021-22, 2020-21 (completion year) Oregon Department of Education 8

Updates & Changes Students Experiencing Poverty ESSA requires state accountability systems to include economically disadvantaged students as an accountable student group. In previous years, ODE defined the Economically Disadvantaged student group as those students eligible to receive free or reduced-price school meals. ODE updated the definition for this student group and relabeled it as, Students Experiencing Poverty Starting this year, ESSA accountability system will use Students Experiencing Poverty Oregon Department of Education 9

Updates & Changes Students Experiencing Poverty The Students Experiencing Poverty student group includes those students that meet any of the following criteria: Received Supplemental Nutrition Assistance (SNAP) or Temporary Assistance for Needy Families (TANF) Were in foster care Experienced houselessness Received migrant education services Oregon Department of Education 10

Updates & Changes Students Experiencing Poverty In order to maintain a consistent definition across all years included in the ESSA accountability system, ODE calculated prior year rates for the Students Experiencing Poverty student group for all included indicators The Students Experiencing Poverty data will always be suppressed when student counts are <10 and when rates are <5% or >95% Oregon Department of Education 11

Updates & Changes Students Experiencing Poverty No prior year comparison arrows for the Student Experiencing Poverty ratings on the front page Oregon Department of Education 12

Questions? Oregon Department of Education 13

Indicators and School Identification Oregon Department of Education 14

Indicators by School Type Indicator Elementary and Middle Schools Combined Schools (e.g., KG-12) High Schools Regular Attenders Included Included Included ELA Achievement Included Included Included Math Achievement Included Included Included ELA Average Gap Score Change Included Included Not Used Math Average Gap Score Change Included Included Not Used On-Track to English Language Proficiency Included Included Included 9th Grade On Track Not Used Included Included 4-year Graduation Not Used Included Included 5-year Completers Not Used Included Included Total Number Available to Rate 6 9 7 Oregon Department of Education 15

Level Cuts Student groups are assigned levels on each indicator, provided that the student group meets the minimum n-size of 20. Level Description Level 5 2026-27 State Long Term Goal Level 4 Halfway to the Long Term Goal Level 3 The 2016-17 state average (2021-22 state average for the ELA and Math Gap Score Change) The 2022-23 10th Percentile of schools Level 2 Below the 2022-23 10th Percentile Level 1 Oregon Department of Education 16

Level Cuts by Indicator Grades Used K-5 6-8 9-10 3-8, 11 3-8, 11 3-8 3-8 K-12 9 9-12 9-12 Indicator Level 5 Level 4 Level 3 Level 2 Level 1 Regular Attenders Regular Attenders Regular Attenders ELA Achievement Math Achievement ELA Average Gap Score Change Math Average Gap Score Change On-Track to English Language Proficiency 9th Grade On-Track Four-year Graduation Rate Five-year Completers Rate 93% 93% 93% 80% 80% 5 4 80% 95% 90% 97% 89% 88% 86% 67% 62% -7 -11 68% 90% 82% 90% 85% 83% 78% 54% 43% -19 -24 56% 84% 74% 82% 52% 54% 41% 18% 8% -42 -49 22% 63% 67% 74% <52% <54% <41% <18% <8% <-42 <-49 <22% <63% <67% <74% Oregon Department of Education 17

Indicator Ratings Table Front page of the school Detail Sheets Displays the level rating for each student group on each indicator Not Rated indicates the student group didn t meet the minimum n of 20 ESSA Supports Column Targeted Not Identified Oregon Department of Education 18 *Preliminary mockup! Text/layout may change slightly prior to publication.*

Comprehensive Support and Improvement (CSI) No additional schools will be identified as CSI in 2023-24 A new cohort of CSI schools were identified in 2021-22 CSI schools are only identified every three years Oregon Department of Education 19

Targeted Support and Improvement (TSI) Does not apply to the All Students group Student group not identified as TSI if the student group is rated on fewer than 5 indicators All Schools If a student group is rated on 5 or more indicators AND 50% or more of the rated indicators are Level 1 Students Experiencing Poverty Oregon Department of Education 20 *Preliminary mockup! Text/layout may change slightly prior to publication.*

Overall School Information Suggested Level of Support Not Identified Targeted Comprehensive Met Participation Target Title I Status Oregon Department of Education 21 *Preliminary mockup! Text/layout may change slightly prior to publication.*

Questions? Oregon Department of Education 22

Indicator Pages Level Cuts Multiple years of data Average Rate Level Level 1 5 Not Rated Suppression * if denominator < 10 <5% if denominator 10 AND rate < 5% >95% if denominator 10 AND rate > 95% Oregon Department of Education 23 *Preliminary mockup! Text/layout may change slightly prior to publication.*

ESSA 95% Performance Denominator ESSA requires that the denominator for the ELA and Math Achievement indicators be the greater of: 95% of the number of resident, full academic year students enrolled on the first school day in May OR The total number of assessment participants Oregon Department of Education 24

ESSA 95% Performance Denominator Example Number of students 100 Number of participants 80 Number of students meeting the achievement standard 40 95% Denominator (100 0.945) 95 ESSA 95% Performance Denominator (adjusted denominator) 95 ESSA Met Percent (40 95) 100 42.1% Oregon Department of Education 25

ELA and Math Average Gap Score Change Pages 2018-19 Average Gap Score and denominator 2023-24 Average Gap Score and denominator Difference between the two years Level Rating *Preliminary mockup! Text/layout may change slightly prior to publication* Oregon Department of Education 26

Questions? Oregon Department of Education 27

Accountability Details Validation Oregon Department of Education 28

Accountability Details Validation Achievement Data Insight (ADI) Application District Security Administrator Oregon Department of Education 29

Accountability Detail Sheet Validation Oregon Department of Education 30

Resources Accountability Details Webpage Supplemental guidance, technical, and policy documents District Website At-A-Glance Profiles & Accountability Details validation page Validation Refresh Schedule Accountability Reporting Validation Calendar Regional ESD Partners Oregon Department of Education 31

Topic Elyse Bean Contact Elyse Bean Accountability Details and At-A-Glance Validations Cindy Barrick Cindy Barrick Assessment Performance / Participation Stephanie Evers Stephanie Evers Assessment Average Gap Score Change Bianca Llamas Bianca Llamas At-A-Glance Narrative Collection Robin Stalcup Robin Stalcup Class Size Paul Skomsvold Paul Skomsvold College Going Amanda Leopard Amanda Leopard Contacts Cumulative ADM Collections Paul Skomsvold Paul Skomsvold Graduation Data Amanda Leopard Amanda Leopard Institutions Ryan Clark Ryan Clark (collection) Paul Skomsvold (validation) Ninth Grade On-Track Paul Skomsvold Paul Skomsvold Paul Skomsvold Regular Attenders Ryan Clark Ryan Clark Staff Data Robin Stalcup Robin Stalcup Student Enrollment Stephanie Evers Stephanie Evers Student Mobility Oregon Department of Education 32

Thank you! Oregon Department of Education 33