Dr Beverly L Hall Superintendent Atlanta Public Schools August 16 2010 Blue Ribbon Commission Response Agenda Purpose and Overview Recommendations and APS Approach Next Steps 2 Purpose ID: 645096
Download Presentation The PPT/PDF document "Response to the Blue Ribbon Commissionâ€..." is the property of its rightful owner. Permission is granted to download and print the materials on this web site for personal, non-commercial use only, and to display it on your personal computer provided you do not modify the materials and that you retain all copyright notices contained in the materials. By downloading content from our website, you accept the terms of this agreement.
Slide1
Response to the Blue Ribbon Commission’s Recommendations of the 2009 Criterion Referenced Competency Test (CRCT) Erasure Investigation
Dr. Beverly L. HallSuperintendentAtlanta Public Schools
August 16, 2010Slide2
Blue Ribbon Commission Response
Agenda
Purpose and Overview
Recommendations and APS Approach
Next Steps
2Slide3
PurposeAtlanta Public Schools has begun the work to implement each of the recommendations in the report presented by the Blue Ribbon Commission. We are committed to ensuring that
100 percent of the recommendations are addressed and fully implemented.
3Slide4
Overview
Work that has already startedCaveon security measures
Accelerated Academic Recovery Program
Investigation of employees referred by the
BRC
Reassigned 12 principals
Twenty-nine recommendations outlined in the BRC report
Plan to address each recommendation
Plan to track and ensure implementation
4Slide5
Background
Blue Ribbon Commission’s report included 29 recommendations:
Security (in addition to Caveon recommendations provided in April)
Process
Leadership
Comparison
Recommendation Owners
Each recommendation has been assigned to a division and individual owner
Each owner is a member of my leadership team
Action Plans
Each recommendation owner has submitted initial action plans outlining how each recommendation will be achieved
5Slide6
Security Recommendations
Security recommendations encompass:Developing a comprehensive test security plan that includes best-in-class test administration procedures
Continuing to research the unusually high number of erasures
Reinforcing and communicating existing policies and any new policies or changes
6Slide7
Security Recommendations
7
BRC Security Recommendation 1
Implement a well-defined program for follow-up and continued monitoring of CRCT test security
Administration’s Response
A comprehensive APS security manual is being developed
Manual will include annual security goals and input from the Georgia Department of Education and/or the Governor’s Office of Student Achievement
APS Internal Auditor will develop a plan to conduct regular internal audits for each CRCTSlide8
Security Recommendations
8
BRC Security Recommendation 2
Research and identify causes of unusually high number of erasures with the district and implement best practices
Administration’s Response
Requested erasure data from GOSA
Conduct statistical analysis of erasure data received
Identify and implement best practices in test preparation
Analyze test results extensivelySlide9
Security Recommendations
9
BRC Security Recommendation 3
Reinforce APS' testing policies and procedures, and ensure that all appropriate training takes place for employees involved in the administration of the CRCT
Administration’s Response
All security measures and annual enhancements will be posted to the district website
School-based and central office staff will be trained annually
All APS staff involved with testing will have clearly defined security duties and responsibilitiesSlide10
Security Recommendations
10
BRC Security Recommendation 4
Communicate a policy that emphasizes ethics and accountability for adherence to the policies and training requirements -- as well as the ramifications for violating such policies and requirements
Administration’s Response
Ethics training will be provided to employees district-wide
Testing workshops will reinforce and review ethics policies
Employees will be required to annually acknowledge receipt and understanding of district ethics policiesSlide11
Security Recommendations
11
BRC Security Recommendation 5
Formally document any policy or schedule changes related to the CRCT test materials
Administration’s Response
Formal documentation was implemented for schedule changes during the Spring 2010 CRCT
This process will be formalized as part of the Security planSlide12
Security Recommendations
12
BRC Security Recommendation 6
Establish a test security plan and ongoing budget for test security
Administration’s Response
A comprehensive test security plan in development
Cost of implementation part of annual budgetSlide13
Security Recommendations
13
BRC Security Recommendation 7
Implement annual compliance and ethics certifications and approvals
Administration’s Response
Ethics training/certification program will be provided annually to employees district-wideSlide14
Security Recommendations
14
BRC Security Recommendation 8
Establish ongoing external monitoring and reporting for standardized testing at all APS schools
Administration’s Response
The district will continue to utilize a three-tiered monitoring process
State-level monitoring will be requestedSlide15
Process Recommendations
The process recommendations involve:Follow up to ensure immediate assistance is given to students impacted by testing irregularities
Developing a plan to track implementation of all of the recommendations
Following up on the results of the investigation
Enhancing existing protocols for future CRCT administrations and new audit routines
15Slide16
Process Recommendations
16
BRC Process Recommendation 1
Commit publicly to aggressively follow-up on the results of the investigation by establishing a well-defined plan to consider the findings and recommendations in the BRC report
Administration’s Response
Public acceptance of the BRC report
Provide a plan of action to address the findings of the BRC
reportSlide17
Process Recommendations
17
BRC Process Recommendation 2
Develop a plan that includes a project leader, clear objectives, work plan, schedule and deliverables
Administration’s Response
A project leader has been appointed
An APS owner has been assigned to each recommendation
Initial action plans have been created and appropriate monitoring and status reporting will be scheduledSlide18
Process Recommendations
18
BRC Process Recommendation 3
Conduct further investigation of the referred individuals within the Identified Schools and take whatever administrative, legal or professional action APS considers appropriate
Administration’s Response
The BRC report and all relevant documents are being reviewed
Each matter is being referred to appropriate counsel or another government agency
Investigations will be conducted and disciplinary actions will be processed as appropriateSlide19
Process Recommendations
19
BRC Process Recommendation 4
Conduct an analysis of individual student performance of those students APS determines may have been impacted by testing irregularities to determine if additional academic assistance and support are needed. If support is warranted, immediate action should be taken to mobilize appropriate assistance for the students for as long as necessary
Administration’s Response
Analysis of individual student performance has been completed
12 week accelerated academic recovery plans are being implemented
Regular communications with parentsSlide20
Process Recommendations
20
BRC Process Recommendation 5
Develop protocols to pro-actively conduct erasure analysis after future CRCT administrations
Administration’s Response
Erasure data has been requested from GOSA and will be requested each year
Conduct statistical analysis of erasure data receivedSlide21
Process Recommendations
21
BRC Process Recommendation 6
Develop regular internal audit routines for each administration of the CRCT focused on: test security protocols; test administration; and detailed APS erasure analysis
Administration’s Response
APS Internal Auditor will develop a plan to conduct regular audits for each CRCT test administrationSlide22
Process Recommendations
22
BRC Process Recommendation 7
Document any testing irregularities identified and specific plans for follow-up and resolution, including referrals to the Georgia Professional Standards Commission and/or Fulton County District Attorney's Office, as appropriate
Administration’s Response
Strictly adhere to all of the Georgia Department of Education’s testing and assessment processes for reporting testing irregularities
Establish a reporting timetable to facilitate communication among relevant implementing departments
Identify resources for collection, review, entry and reporting of dataSlide23
Leadership Recommendations
Leadership recommendations involveDriving culture change
Re-assessing current incentive, performance and evaluation systems
Utilizing new forms of review and feedback
Publishing and addressing any additional findings related to the 2009 testing period
Reinforcing and communicating existing, supporting policies
23Slide24
Leadership Recommendations
24
BRC Leadership Recommendation 1
Drive culture change throughout the district to create an environment that effectively balances attention to measurable student outcomes with attention to positive, ethical behavior
Administration’s Response
All educators will be required and held accountable for providing effective instructional environments while complying with all ethics standards
Encourage employees to be transparent in internal and external communicationsSlide25
Leadership Recommendations
25
BRC Leadership Recommendation 2
Proactively re-assess incentive systems and performance evaluation processes for all district employees with a focus on achieving this appropriate balance
Administration’s Response
The current incentive programs and performance evaluation processes will be reviewed as APS develops future compensation approachesSlide26
Leadership Recommendations
26
BRC Leadership Recommendation 3
Establish annual goals and performance plans that include a significant emphasis on leadership, integrity and ethics
Administration’s Response
Ethics training/certification program will be provided annually to employees district-wideSlide27
Leadership Recommendations
27
BRC Leadership Recommendation 4
Incorporate self-assessment into the annual plan evaluation processes for leadership
Administration’s Response
A self-assessment process will be developed and implemented within the existing evaluation process for all instructional leadersSlide28
Leadership Recommendations
28
BRC Leadership Recommendation 5
Incorporate surveys of teachers and support staff into annual performance planning for principals to provide qualitative evidence on principal performance
Administration’s Response
A standardized survey instrument will be used to assess school climate district-wide
School climate survey results will be utilized as an artifact to provide feedback to principals in the evaluation processSlide29
Leadership Recommendations
29
BRC Leadership Recommendation 6
Provide observations of principals, which may include shadowing or other efforts, for assessments of leadership ability compared to the critical skills determined for the position. Incorporate data on observed behaviors into the annual assessment process for leaders to assess their competency relative to those skills deemed to be critical for each position
Administration’s Response
Coordinate site visits or instructional audits to assess the use of instructional best practices and procedures
Feedback from site visits and instructional audits will be provided to principals and used to inform the principal evaluation processSlide30
Leadership Recommendations
30
BRC Leadership Recommendation 7
Provide opportunities for regular, anonymous peer and upward feedback as well as processes for following through and managing this information
Administration’s Response
School Climate Survey referenced in Recommendation 5
Research being conducted on other feedback instruments to provide this information Slide31
Leadership Recommendations
31
BRC Leadership Recommendation 8
Conduct principal peer reviews and incorporate this information into annual evaluation processes
Administration’s Response
A peer review process will be standardized for district principalsSlide32
Leadership Recommendations
32
BRC Leadership Recommendation 9
Provide the ABE additional recommendations on plans to monitor the principals and other leaders of the schools being referred by the BRC
Administration’s Response
An experienced educational specialist has been appointed to support and monitor principals during implementation of accelerated academic recovery plansSlide33
Leadership Recommendations
33
BRC Leadership Recommendation 10
Reinforce and publicize externally and internally APS' policies that protect APS employees who report misconduct or violations from reprisals, retaliation, and other hostile workplace actions
Administration’s Response
An external company has been selected to provide a confidential hot line for employees to report misconduct
A plan will be developed and implemented to facilitate on-going communication with employees regarding school district policies in the areas of whistle blower protection, ethics, and conflict of interestSlide34
Leadership Recommendations
34
BRC Leadership Recommendation 11
Publish additional findings made with respect to events that may have occurred during the 2009 testing period
Administration’s Response
A communication plan has been developed
The district website will be utilized for regular updates to the CRCT portalSlide35
Leadership Recommendations
35
BRC Leadership Recommendation 12
Given that the findings relate to events that may have occurred during the 2009 CRCT and that personnel changes may have occurred since that time period, APS must provide appropriate support for the implementation of recommendations by the current leadership of schools
Administration’s Response
An educational specialist will support and monitor the implementation of recommendations
Leadership and staff will be provided necessary support, training and resources to implement the recommendations district-wideSlide36
CRCT Comparison Recommendations
36
BRC CRCT Comparison recommendations encompass:
Additional recommendations focused on the findings related to the comparison of the 2009 and 2010 CRCT resultsSlide37
CRCT Comparison Recommendations
37
BRC CRCT Comparison Recommendation 1
Given the high number of declines in Math (2010 CRCT), the BRC recommends that APS conduct a broad assessment of math outcomes to further determine the root causes of the declines
Administration’s Response
The use of state instructional frameworks will be standardized district-wide and the monitoring process will be updated and aligned to ensure the correct use of frameworks
Existing mathematics coaching structures will be revised to ensure job embedded support for all schools with mathematics performance declines
The professional development strategy for improving mathematics will be reviewedSlide38
CRCT Comparison Recommendations
38
BRC CRCT Comparison Recommendation 2
The BRC recommends that the District conduct a further in-depth assessment in the 33 schools that demonstrated a significant decline in 2010 CRCT test results
Administration’s Response
Based upon spring CRCT scores, the district will conduct further in-depth analysis to determine root causes
The district will provide support, progress monitoring and targeted intervention strategies for the selected schools to improve instructional qualitySlide39
Next Steps
Committed to implementing 100% of recommendations
Collaborative effort across several divisions and departments
Ensure full implementation, we will utilize:
APS Project Management Methodology
Balanced Scorecard (BSC) for reporting progress
Semi-annual report
Annual report
Quarterly reports to ABE
39Slide40
Our highest responsibility is to provide the best possible education for our students in every classroom and in every school
We will continue to follow up on the BRC investigative report while staying focused on our main purpose – greater student achievement
Next Steps
40