Sarah Pies Sandi Cole Hardy Murphy Indiana
Description: Sarah Pies Sandi Cole Hardy Murphy Indiana University Educators Perceptions of Indianas Teacher Evaluation Law: A Follow up to 2014 Survey Purpose Purpose: Survey educators on beliefs and confidence in the teacher evaluation process since
Related Topics
Download Presentation
"Sarah Pies Sandi Cole Hardy Murphy Indiana" is the property of its rightful owner. Permission is granted to download and print the materials on this website for personal, non-commercial use only, and to display it on your personal computer provided you do not modify the materials and that you retain all copyright notices contained in the materials. By downloading content from our website, you accept the terms of this agreement.
Presentation Transcript
slide1. Sarah Pies Sandi Cole Hardy Murphy Indiana University Educators Perceptions of
Indiana’s Teacher Evaluation Law:
A Follow up to 2014 Survey<br>
slide2. Purpose Purpose: Survey educators on beliefs and confidence in the teacher evaluation process since 2014
To inform policy and practice in Indiana related to teacher evaluation<br>
slide3. Methodology Survey questions aligned with the Indiana Teacher Appraisal System of Supports (INTASS) Rubric Components
Questions constitute follow up of 2012 survey
Survey distributed through ISTA, Indiana AFT, Indiana Principals Association, Indiana Superintendents’ Association, and through Learning Connections
Sample size:
1817 Teachers
126 Principals
151 Superintendents<br>
slide4. Methodology Questions allowed responses on a 7 point Likert Scale
strongly agree, agree, somewhat agree, neither agree nor disagree, somewhat disagree, disagree and strongly disagree
T-test statistical analyses were conducted with a .95 confidence interval in order to determine the significance of mean differences in item responses between the 2014 and 2016 surveys
Adjustments were made for multiple comparisons using the Tukey HSD tests<br>
slide5. Beliefs About Teacher Evaluation Survey asked superintendents, principals, and teachers to rate their beliefs about different aspects of teacher evaluation, the new Indiana legislation and its impact, and their local plans and their impact:
“I believe that teacher effectiveness …”
“I believe that student academic growth…”
“I believe that instruction can be…”<br>
slide6. Confidence Level in Evaluators and Evaluator Confidence In Themselves Survey asked teachers to rate their level of agreement with statements concerning evaluator capabilities:
“I am confident that evaluators in my district…”
Survey asked Principals to rate their confidence in their evaluation skills:
“ I am confident that I….”<br>
slide7. Significant Mean Changes from 2014 to 2016 Teachers
A significant and positive mean change in 17 of 18 questions related to beliefs
A significant and positive mean change in all of the questions related to confidence in their evaluators
Principals
significant and positive mean change in 5 of 18 belief questions
significant and negative mean change for three questions related to their confidence as evaluators
Superintendents
13 questions had a change in a significant and negative way on the survey related to beliefs<br>
slide8. Significant Mean Changes from 2014 to 2016 Overall, the favorability of teachers regarding teacher evaluation increased in the 2016 survey
Principal favorability is essentially unchanged
Superintendents’ favorability decreased so much so that principals are now the group with the most favorable viewpoint of the new educator evaluation requirements.<br>
slide9. INTASS vs. Non-INTASS Teacher responses from INTASS districts are significantly more positive than those from teachers in Non-INTASS districts in 37 of the 41 questions
Teacher responses from INTASS districts are significantly more favorable for 15 out of 18 belief questions and 21 of 21 confidence questions
INTASS principal responses are significantly more positive than Non-INTASS principals for 21 of the 41 questions
INTASS superintendents are significantly more positive than Non-INTASS superintendents in 10 of the 19 questions asked of superintendents<br>
slide10. Years of Experience for Teachers Overall, the same response patterns associated with years of teacher experience are found in the 2016 and 2014 survey responses
Teachers with less than four years of experience are more favorable with their responses than teachers with more than four years of experience
The least favorable survey responses are found with teachers having 16-25 years of experience and 25+ years of experience<br>
slide11. Rurality Urban teachers are less positive in general with teacher evaluation changes than suburban and rural.<br>
slide12. Discussion Points In 2014, superintendents most favorable; 2016 principals most favorable
In 2016, there was a shift towards a more positive view of the changes in evaluation from teachers, that this improvement is driven by more confidence in their evaluators and the process
Questions related to linking compensation and student growth to evaluations across the two survey administrations show teachers, principals and superintendents still are not favorable.
Teachers still do not believe the changes in teacher evaluation have improved teaching and learning in their districts.<br>
slide13. Discussion Points, Continued Teachers are significantly more agreeable and have more confidence in a number of questions involving their evaluation experiences and the capability of their evaluators in conducting their evaluations
Number of years of experience, type of district, and plan development and implementation processes make a difference in how teacher evaluation is perceived.
The difference between INTASS districts is worth noting as evidence for the effectiveness of an affirmative and professionally respectful approach to change and the development and implementation of an evaluation system that is focused on support and success<br>
slide14. Recommendations Ensure a continuous improvement process that supports the implementation of teacher evaluation plans with fidelity and provide resources to districts to make necessary improvements
Continued research into educator perceptions of teacher evaluation in Indiana
Continue to recognize plan quality through the INTASS, Indiana Department of Education and State Board of Education recognition system
Require and support the annual training of teachers as well as administrators in the evaluation process<br>
slide15. Recommendations, Continued 5. Review and revise how teacher evaluations are linked to compensation.
6. Clearly express the role and significance of a supportive teacher evaluation process in educator effectiveness and school improvement.
7. Reframe the message of teacher evaluation so that teachers and evaluators see it as a tool for ensuring the success of teachers and students in the teaching and learning process.<br>
slide16. Acknowledgements Michael Frisby, Department of Statistics, IU
Indiana State Teachers Association
Indiana Association of School Principals
Indiana Association of Public School Superintendents
Indiana Federation of Teachers
Indiana School Boards Association
Indiana Department of Education<br>
Indiana’s Teacher Evaluation Law:
A Follow up to 2014 Survey<br>
slide2. Purpose Purpose: Survey educators on beliefs and confidence in the teacher evaluation process since 2014
To inform policy and practice in Indiana related to teacher evaluation<br>
slide3. Methodology Survey questions aligned with the Indiana Teacher Appraisal System of Supports (INTASS) Rubric Components
Questions constitute follow up of 2012 survey
Survey distributed through ISTA, Indiana AFT, Indiana Principals Association, Indiana Superintendents’ Association, and through Learning Connections
Sample size:
1817 Teachers
126 Principals
151 Superintendents<br>
slide4. Methodology Questions allowed responses on a 7 point Likert Scale
strongly agree, agree, somewhat agree, neither agree nor disagree, somewhat disagree, disagree and strongly disagree
T-test statistical analyses were conducted with a .95 confidence interval in order to determine the significance of mean differences in item responses between the 2014 and 2016 surveys
Adjustments were made for multiple comparisons using the Tukey HSD tests<br>
slide5. Beliefs About Teacher Evaluation Survey asked superintendents, principals, and teachers to rate their beliefs about different aspects of teacher evaluation, the new Indiana legislation and its impact, and their local plans and their impact:
“I believe that teacher effectiveness …”
“I believe that student academic growth…”
“I believe that instruction can be…”<br>
slide6. Confidence Level in Evaluators and Evaluator Confidence In Themselves Survey asked teachers to rate their level of agreement with statements concerning evaluator capabilities:
“I am confident that evaluators in my district…”
Survey asked Principals to rate their confidence in their evaluation skills:
“ I am confident that I….”<br>
slide7. Significant Mean Changes from 2014 to 2016 Teachers
A significant and positive mean change in 17 of 18 questions related to beliefs
A significant and positive mean change in all of the questions related to confidence in their evaluators
Principals
significant and positive mean change in 5 of 18 belief questions
significant and negative mean change for three questions related to their confidence as evaluators
Superintendents
13 questions had a change in a significant and negative way on the survey related to beliefs<br>
slide8. Significant Mean Changes from 2014 to 2016 Overall, the favorability of teachers regarding teacher evaluation increased in the 2016 survey
Principal favorability is essentially unchanged
Superintendents’ favorability decreased so much so that principals are now the group with the most favorable viewpoint of the new educator evaluation requirements.<br>
slide9. INTASS vs. Non-INTASS Teacher responses from INTASS districts are significantly more positive than those from teachers in Non-INTASS districts in 37 of the 41 questions
Teacher responses from INTASS districts are significantly more favorable for 15 out of 18 belief questions and 21 of 21 confidence questions
INTASS principal responses are significantly more positive than Non-INTASS principals for 21 of the 41 questions
INTASS superintendents are significantly more positive than Non-INTASS superintendents in 10 of the 19 questions asked of superintendents<br>
slide10. Years of Experience for Teachers Overall, the same response patterns associated with years of teacher experience are found in the 2016 and 2014 survey responses
Teachers with less than four years of experience are more favorable with their responses than teachers with more than four years of experience
The least favorable survey responses are found with teachers having 16-25 years of experience and 25+ years of experience<br>
slide11. Rurality Urban teachers are less positive in general with teacher evaluation changes than suburban and rural.<br>
slide12. Discussion Points In 2014, superintendents most favorable; 2016 principals most favorable
In 2016, there was a shift towards a more positive view of the changes in evaluation from teachers, that this improvement is driven by more confidence in their evaluators and the process
Questions related to linking compensation and student growth to evaluations across the two survey administrations show teachers, principals and superintendents still are not favorable.
Teachers still do not believe the changes in teacher evaluation have improved teaching and learning in their districts.<br>
slide13. Discussion Points, Continued Teachers are significantly more agreeable and have more confidence in a number of questions involving their evaluation experiences and the capability of their evaluators in conducting their evaluations
Number of years of experience, type of district, and plan development and implementation processes make a difference in how teacher evaluation is perceived.
The difference between INTASS districts is worth noting as evidence for the effectiveness of an affirmative and professionally respectful approach to change and the development and implementation of an evaluation system that is focused on support and success<br>
slide14. Recommendations Ensure a continuous improvement process that supports the implementation of teacher evaluation plans with fidelity and provide resources to districts to make necessary improvements
Continued research into educator perceptions of teacher evaluation in Indiana
Continue to recognize plan quality through the INTASS, Indiana Department of Education and State Board of Education recognition system
Require and support the annual training of teachers as well as administrators in the evaluation process<br>
slide15. Recommendations, Continued 5. Review and revise how teacher evaluations are linked to compensation.
6. Clearly express the role and significance of a supportive teacher evaluation process in educator effectiveness and school improvement.
7. Reframe the message of teacher evaluation so that teachers and evaluators see it as a tool for ensuring the success of teachers and students in the teaching and learning process.<br>
slide16. Acknowledgements Michael Frisby, Department of Statistics, IU
Indiana State Teachers Association
Indiana Association of School Principals
Indiana Association of Public School Superintendents
Indiana Federation of Teachers
Indiana School Boards Association
Indiana Department of Education<br>