Overview Dave Moyer Data Governance and Analysis Branch S chool accountability amp improvement systems help us Shine a light on school performance and progress Provide summative data a picture of overall school ID: 778677
Download The PPT/PDF document "STRIVE HI PERFORMANCE SYSTEM" is the property of its rightful owner. Permission is granted to download and print the materials on this web site for personal, non-commercial use only, and to display it on your personal computer provided you do not modify the materials and that you retain all copyright notices contained in the materials. By downloading content from our website, you accept the terms of this agreement.
Slide1
STRIVE HI PERFORMANCE SYSTEM
Overview
Dave Moyer, Data Governance and Analysis Branch
Slide2School accountability & improvement systems help us…
Shine a light
on school performance and progress
Provide summative
data (a picture of overall school health) to inform school improvement efforts and transparent info to parents and communitiesInform the deployment of resources, technical assistance, and support to schools that need improvementIdentify schools to look to for best practices and success stories
2
KEEP IN MIND:
The focus is
not
ranking schools against each other.
No accountability system is perfect
Slide3How does Strive HI work?
Achievement
Reading
Math
Science
Growth
Reading
Math
Readiness
Chronic
Absenteeism
8
th & 11th grade ACT examsGraduation ratesCollege-going ratesAchievement GapCurrent year gap rate2-Year reduction rate
Total Index Points
(out of 400)
Additional factors
(if applicable)
Based on their performance on multiple indicators, schools earn points on the Strive HI Index.
A school’s total points and other triggers
determine
the school’s classification on one of the 5 Strive HI
Steps – which determines its level of support.
3
Slide4Achievement
Reading
Math
Science
Growth
Reading
Math
Readiness
Chronic
Absenteeism
8
th
& 11th grade ACT examsGraduation ratesCollege-going ratesAchievement GapCurrent year gap rate2-Year reduction rateSY2013-14 Results: Interim Year
Total Index Points
(out of 400)
Additional factors
(if applicable)
4
Strive HI operates on a 2-year cycle. While schools receive their data & point total annually, most are reclassified
every
other
year. SY13-14 is an interim year, meaning most schools retain their classification, except for newly recognized Recognition schools.
Slide5SY13-14 Statewide Snapshot
5
SY12-13
SY13-14
AchievementMath proficiency60
59
Reading Proficiency
72
70*
Science Proficiency
34
41*
Growth
Readingn/an/aMathn/an/aReadinessChronic absenteeism18118th Grade ACT (percent scoring ≥15)505011th grade ACT(percent scoring ≥19)3434
Graduation
Rate81
82
College-Going
6363GapNon-High Needs Proficiency
8382High Needs Proficiency
56
53
Current year33
35
2 year reduction
12
-4
*updated post-appeals process
Key Findings
During
a year of tremendous change
students & staff continue
to make every effort to Strive
High.
Data shows includes bright
spots and areas of needed improvement.
Significant student improvements in chronic absenteeism & science proficiency.
Slightly lower reading & math proficiency as schools continue to adjust to Hawaii Common Core standards and assessments.
Results for college-readiness, graduation rates, and college-going rates remained steady amidst other positive indicators.
New classifications: new Recognition Schools; 1 Priority school exited
Slide6Moving toward a new baseline: Common Core Standards & Assessments
Reading Proficiency
Math Proficiency
HSA
Bridge
SBAC
SY 2013-2014
SY 2015 -
Slide7Area of Improvement: Closing proficiency gaps
7
Slide8Signs of improvement: chronic absenteeism, attendance, behavior
Slide9Understanding your RESULTS
9
Slide10Strive HI Performance Index
Multiple measures to understand & school performance & progress
10
Schools receive a total score out of 400 points
Achievement
Reading proficiency
Math proficiency
Science proficiency
Growth
Reading growth
Math growth
Readiness
ElementaryChronic absenteeismMiddle8th grade ACT/ExploreHigh11th grade ACTHS Grad RateCollege-going rateAchievement GapCurrent Year Gap Rate2-Year Gap Reduction Rate
Slide11Strive HI Performance Index Weights
Indicators are weighted differently for elementary, middle, and high schools
11
Achievement
These metrics measure the proportion of students
who scored
proficient or higher on the Hawaii
State Bridge Assessment this year.Transitioning to new testsSY13-14: The “bridge” assessment: a subset of the HSA questions that are Common Core-alignedSY14-15: Common Core-aligned Smarter Balanced AssessmentThe transition to new standards and assessments means we should expect a new baseline.Only students enrolled for the entire school year count in the total.
12
Slide13Student Growth
Similar to a pediatrician's
growth chart,
Student Growth Percentile (SGP) helps
us understand a student's growth on state tests relative to other students who scored similarly in the pastSchools receive a median (or middle) student’s growth score. Half of the students in the school had higher growth than the median, and half had lower growth.A growth percentile of 50 is sometimes understood as a year’s worth of progressGrowth can be measured this way even when different tests are used from one year to the next. 13
Slide14Readiness: Elementary
Chronic AbsenteeismMeasures the proportion of students in the school who missed 15 or more days last year
All absences (excused and unexcused) count
National & local research = students who miss large portions of school are more likely to fall behind academically
Only students enrolled the entire year countKindergarten didn’t count this year because it wasn’t yet mandatory14
Slide15Chronic Absenteeism
15
Points
assigned: use scoring rubric:
Slide16Readiness: Middle School
8th
Grade EXPLORE
This test predicts success on the ACT, which helps benchmark college-readiness.
The metric measures the proportion of the school’s students who earned a composite score of 15 or more.Principal notes:Last year the data were reported differently (as the median score in the school)8th grade EXPLORE being discontinued: will revisit options for Hawaii16
Slide17ACT
17
8th Grade ACT EXPLORE:
Scored on a scale of 1 to 25.
Index uses a school’s percentage of students achieving a composite score of 15 or higher. Points assigned: multiple percentage by 60.
Slide18Readiness: High School
11th
Grade ACT
Percentage of students earning a 19 (out of 36) on the ACT, which is the threshold for success in UH courses
On-Time GraduationPercentage of students who graduate in four years or less with a regular diplomaCollege-Going RatePercentage of graduates who enroll in any college (2- or 4-year, throughout the country) within 16 months of graduating high school18
Slide19Readiness: High School19
11th Grade ACT Test:
Points
assigned: multiply percentage by 90. Graduation Rate: Points assigned: multiply graduation rate by 100 College-Going Rate: Points
assigned: multiply college-going rate by 10
Slide20Achievement Gap
Achievement gaps are calculated in the current year and over
time between
High-Needs Students
(students who are learning English, economically disadvantaged or have disabilities) and non High-Needs Students.Current Gap Rate = most recent gap
(A smaller gap rate is better)Two-Year Gap Reduction Rate
= how
much
gap
has closed over the past
2 years.
(A higher gap closing rate is better).
20
Slide21Current Year Gap Rate
Current Year GAP :
(Non-High Needs Students proficiency) – (High Needs Students proficiency)
80%
50%
20%
Non-High Needs students
High Needs Students
30
SCHOOL B
Non-High Needs students
High Needs Students
30
SCHOOL A
Current
Year
GAP RATE:
The Index uses GAP RATE to differentiate between schools with equal GAPS but different PROFICIENCY RATES.
(Non-High Needs Students proficiency) – (High Needs Students proficiency)
(Non-High Needs Students proficiency)
SCHOOL A = 30 pp
SCHOOL B = 30 pp
SCHOOL A = 38%
SCHOOL B = 60%
Proficiency rate
21
Current Year Gap Rate
(Non-High Needs Students proficiency) – (High Needs Students proficiency)
(Non-High Needs Students proficiency)
Current Year Gap Rate:
Definition: ** Look at excel file for data
22
Slide23Two Year Gap Reduction Rate
90%
50%
30%
30
Non-High Needs students
High Needs Students
20
2012
2013
2014
2012
Gap Rate: 60%
2014
Gap Rate: 33%
2 YEAR GAP
REDUCTION RATE =
2012 Gap Rate – 2014 Gap Rate
2012 Gap Rate
2 Year Gap Reduction Rate = 45
70%
10%
Proficiency rate
SCHOOL B
23
Achievement Gap
Frequent questions:Why do I have no Achievement Gap indicators on my report?
Why do I have a negative gap rate or gap reduction rate?
24
Slide25Misc Questions
Why do I have no {fill in the indicator} on my report?
What are the “triggers” on my report?
What about n-size?
Public Reporting: For student privacy purposes, data is suppressed on public reports if there are less than 20 students involved in the indicator.Index calculations: For index calculations, a minimum count of 30 students is required. If the current year's data does not meet the minimum count, then data from the previous year are included in the calculation. If the minimum student count is still not met, then the 2nd previous year's data are included. If the minimum student count is still not met after including three (3) years of data, then the calculation is done based upon the pooled three (3) years of data.Student Group report: For the Student Group Report, the minimum is 40 students. 25
Slide26Schools
classifications: Strive HI Steps
26
Schools are classified based on Index scores & additional factors and receive
targeted rewards & support.
Slide27Classifications
: Recognition Criteria
27
Schools are classified based on Index scores & additional factors and receive
targeted rewards & support.
Criteria:
High Performance
:
All student groups met or exceed targets
Grad rates=top 10%
Gap rate <
30%ORHigh Progress:All students proficiency increased >15% over 3 yearsGrad rates (top 10% of schools with increase of 10% over 3years)Gap reduction rate >10% over 3 years
Slide28C
lassifications: Focus Triggers
28
Schools are classified based on Index scores & additional factors and receive
targeted rewards & support.
Triggers:
Large graduation gap (20%+
)
Large Achievement gap (50%+
)
Low graduation rate (<70% 2 consecutive years)
Slide29C
lassifications: Priority Triggers
29
Schools are classified based on Index scores & additional factors and receive
targeted rewards & support.
Triggers:
Implementing SIG grant
Low graduation rate (<70%
3
consecutive years)
Slide302. Improving Strive HI System design
30
Slide315/2013:
USED
approved HI’s proposal
SY13-14
- Implementation begins6/2014 - Approval extended to SY14-15Refresher: USED Approved HI ESEA Flexibility Waiver
Lack of Alignment
Opportunity to Align
Approval & Implementation
Federal NCLB accountability system
was outdated, ineffective, & out of sync with Hawaii’s Strategic Plan
Congressional reauthorization stalls;
USED provided
states opportunity to design new system
to replace components of NCLB9/2012: Hawaii seized opportunity & with stakeholder input, designed and proposed new system to align with Strategic Plan
31
TBD
Stakeholder engagement on potential improvements has begun.
Amendments and/or Renewal
Slide3232
Refresher: E
SEA Flexibility Waiver:
3 Principles
Transition to Common Core State Standards Transition from Hawaii State Assessment to Smarter Balanced Assessments
WASC Accreditation
for all schools
Replace NCLB goals, AYP and interventions with
Strive HI Performance System
Support all schools along performance spectrum to implement
6 Priority Strategies
Educator Effectiveness System (EES)
Comprehensive Evaluation System for School Administrators (CESSA)Principle 2: Differentiated Recognition, Accountability & Support(school accountability & improvement)Principle 3: Supporting Effective Instruction & Leadership(teacher /principal evaluation & support systems)Principle 1: College- and Career-Ready Expectations for All Students(standards & assessments)Waiver’s primary purpose to replace NCLB’s school accountability & improvement provisions was supplemented with additional obligations regarding standards & assessments and educator effectiveness. For Hawaii:Today’s Focus
Slide33Opportunity for changes: Amendment and Renewal
SY14-15: Housekeeping
amendment:
possibilities
Language clarificationUpdated strategiesSBAC transition alignmentNew complex targets2-year gap ratePossibly extend classifications and restart with new baseline33SY15-16 – SY16-17 renewal/amendment: design improvementsUNKNOWN:USED’s:Parameters for amendment/renewalTimelineExtent of flexibilityOverhaul vs. tweaks
Slide34Big Picture34
Classification year
SY12-13
SY13-14SY14-15
SY15-16
SY16-17
SY17-18
Original waiver
Modified waiver
(if renewal approved)
SBAC
Classification year
Classification year
SY14-15 Amendment
Purpose:
SBA
transition
alignment
SY15-16 + Renewal & Amendment
Purposes
:
Improve Strive HI as fair, discerning tool for measuring performance and differentiating rewards and support
Notes:
USED’s
parameters still being “unpacked”
Due Mid-March