2012-2013 Assessment Report - PowerPoint Presentation

2012-2013 Assessment ReportSchool of Health And Human PerformanceDepartment: Health Science Chair: Patti Follansbee Assessment Coordinator: Katie Cardina Presented by: Jessica Sniatecki Date of Presentation: October 23, 2013

Health ScienceDepartmental Program OfferingsAlcohol and S ubstance Abuse Studies School & Community Health Education Healthcare Administration Liberal Arts Graduate Programs in School & Community Health Education

Alcohol and substance abuse studiesPrepared by Jessica Sniatecki

Alcohol and Substance Abuse Studies Program (ASAP)Student Learning Outcomes ASAP Program SLOs: Students will identify the various foundations for addiction professionals. Students will be able to perform a clinical evaluation. Students will be able to construct a treatment plan based on client needs. ** Students will identify appropriate referral sources to meet client needs. Students will explain how to network with other professionals to facilitate client care. Students will practice and evaluate various counseling techniques. Student will practice delivering psychoeducation to clients, families, or communities. Students will construct appropriate documentation for client needs. Students will identify and apply professional, ethical standards relevant to working with addicted populations.

How was the assessment accomplished? Student Work Assessed: HLS 422 Individual Treatment Planning n = 15 Third Treatment Plan Scored with Rubric HLS 497/HLP 498 Internship Seminar/Internship n = 12 Final Supervisor Addiction Counselor Evaluation Scale (ACES) – Items 37-48 Mean Supervisor Rating

Actual Assessment Data Criterion HLS 422 Student Benchmarks (Score) HLS 422 (Treatment Plan) Results HLS 497/498 Student Benchmarks (Mean Rating) HLS 497/ 498 (Supervisor Evaluation) Results Exceeding 16 or more 87% 3 or more 67% Meeting 13 – 15.99 7% 2 – 2.99 25% Approaching 12 – 12.99 0% 1 – 1.99 8% Not Meeting Below 12 7% Below 1 0% SLO Benchmark: 90% of students will meet or exceed expectations Met benchmark? Yes Yes

Assessment Results: What Have the Data Told Us? SLO assessment was favorable and benchmarks were met One student did not meet the benchmark in HLS 422 (Individual Treatment Planning) One student did not meet the benchmark in HLS 497/HLP 498 (Internship Seminar/Internship)

Data-driven Decisions: How the Department Has or Plans to “Close the Loop” Despite adequate performance on the SLO, the ASAP committee met to discuss the results The student who was not successful in HLS 422 did not pass the course A follow-up phone call was made to the internship site coordinator who worked with the student who under-performed on the artifact for HLS 497/HLP 498 since score did not align with narrative comments It was indicated that the assessment may have been completed incorrectly New evaluation was sent to the internship supervisor to complete (however, this data was not included in the Spring 2013 assessment report)

What resources were used or have been requested to close the loop?The only resources used to “close the loop” for Spring 2013 were faculty time and energy No additional resources are requested at this time

School & community Health EducationPrepared by Michael Ray

School & Community Health Education (HLE)Student Learning Outcomes HLE Program SLOs: Students will be able to plan health education strategies. ** Students will be able to serve as a health education person. Students will be able to assess needs for health education. Students will be able to implement health education strategies. Students will be able to conduct evaluation related to health education. Students will be able to advocate for health. Students will be able to administer health education strategies.

How was the assessment accomplished? Student Work Assessed: HLP 491 Health Education Methods n = 18 Unit Plans Scored with Rubric HLP 495/496 Practicums in School and Community Health n = 13 Education Internship Evaluations, Responsibility II items Mean Site Supervisor Item Scores

Actual Assessment Data Criterion Student Benchmarks (means) HLP 491 Unit Plan Results HLP 495/496 Internship Evaluation Results Exceeding 3.5 – 4.0 6% 62% Meeting 3.0 – 3.4 50% 38% Approaching 2.5 – 2.9 39% 0% Not Meeting Below 2.5 6% 0% SLO Benchmark: 90% of students will meet or exceed expectations Met benchmark? No Yes

Assessment ResultsWhat Have the Data Told Us? The percentage of students meeting or exceeding the benchmark for the HLP 491 unit plan (56%) was well below the 90% SLO benchmark Site supervisor evaluations (HLP 495-496) were generally favorable with 100% of students meeting or exceeding a mean of 3.0

Data-driven DecisionsHow the Department Has or Plans to “Close the Loop” HLE committee review of the Unit Plans assignment indicated that “use of technology” was a problematic area for students This finding was shared with the HLP 491 instructor with the following suggestions: Modification of unit plan instructions Additional classroom time devoted to education technology integration within lessons No actions were planned for the internship evaluations

What resources were used or have been requested to close the loop? Closing the loop for this Spring 2013 assessment involved time for the faculty to meet, review the data, r evise the unit plan assignment, and explore additional educational technologies that could be brought into the classroom No additional resource requests are planned at this time

Healthcare AdministrationPrepared by Sam Booth

Healthcare Administration Program (HLA)Student Learning Outcomes HLA Program SLOs: Students will be able to communicate clearly with individuals and groups within a healthcare environment. ** Students will be able to apply effective leadership skills within a healthcare environment. Students will be able to behave in accordance with professional standards. Students will be able to apply knowledge to the healthcare environment. Students will be able to apply business principles, including systems thinking, to the healthcare environment.

How was the assessment accomplished?Student Work Assessed:HLS 411 Management Communications in Healthcare Administration n = 28 4 exams and Team Presentations % Answered Correctly/Scored with Rubric HLS 496 Internship in Healthcare Administration n = 10 Preceptor evaluation pertaining to communication Mean supervisor rating

Actual Assessment Data Criterion Student Benchmarks HLS 411 Team Presentations Results HLS 411 Exam Results Exceeding 90% or above 54% 36% Meeting 80 - 89.9% 46% 43% Approaching 70 – 79% 0% 14% Not Meeting Below 70% 0% 7% SLO Benchmark: 80% of students will meet or exceed expectations Met benchmark? Yes No

Actual Assessment Data Criterion Student Benchmarks HLS 496 Preceptor Evaluation Results Exceeding Average Score of 3 50% Meeting Average Score 2- 2.99 50% Approaching Average Score 1-1.99 0% Not Meeting Average Score ˂ 1 0% SLO Benchmark: 90% of students will meet or exceed expectations Met benchmark? Yes

Assessment ResultsWhat Have the Data Told Us? HLS 411 assessment indicated that: On the team presentation, 100% of students met or exceeded the established benchmark On the four exams, 79% of students met or exceeded expectations Preceptor evaluations (HLS 496) were very favorable with 100% of students meeting or exceeding expectations

Data-driven DecisionsHow the Department Has or Plans to “Close the Loop” HLA faculty and the department chair met in May 2013 to review results HLS 411 examinations: student performance will continue to be monitored to evaluate the true need for any future adjustments, such as questions modified for clarification, additional time spent on course content/instructional techniques, or utilizing other types of artifacts HLS 496 Preceptor Evaluations will continue to be monitored Assessment information will be shared with new HLA faculty

What resources were used or have been requested to close the loop?Closing the loop for this Spring 2013 assessment involved time for the faculty to meet, review the data, and revise the rubric. No additional resource requests are planned at this time.

Liberal arts programPrepared by Michael Ray

Health Science Liberal Arts Program (HLL)Student Learning Outcomes HLL Program SLOs: Students will be able to discuss underlying knowledge of human cultures as it relates to health . ** Students will be able to employ critical thinking in the use of practical skills across the discipline. Students will be able to employ behaviors that reflect social responsibility to the community. Students will be able to synthesize information across a range of health problems.

How was the assessment accomplished? Student Work Assessed: HLS 317 Intro to Public Health (2 sections) n = 71 Documentary Project Scored with Rubric HLS 317 Intro to Public Health (2 sections) n = 71 Set of 23 Exam Questions % Answered Correctly

Actual Assessment Data Criterion Student Benchmarks Documentary Results Exam Question Results Exceeding 90% or above 99% 32% Meeting 75 - 89.9% 0% 37% Approaching 70 – 74.9% 0% 10% Not Meeting Below 70% 1% 21% SLO Benchmark: 80% of students will meet or exceed expectations Met benchmark? Yes No

Assessment ResultsWhat Have the Data Told Us? The overwhelming proportion of students exceeded expectations on the documentary project Though the students (in groups) produced high quality results (and high scores per the given rubric), the rubric did not adequately differentiate between those who meet and those who exceeded expectations In addition, there was little differentiation of individual efforts within each group

Assessment ResultsWhat Have the Data Told Us? A large percentage (31%) of students did not meet expectations on the exam question set artifact Possible reasons for this outcome: S tudents in this introductory core course are new to the program and not yet displaying competency in the question areas S tudents did not read critically early on in the course Recent shifts to more full-time faculty instruction of this course has possibly resulting in more rigorous questions

Data-driven DecisionsHow the Department Has or Plans to “Close the Loop” HLL faculty and the department chair met in May 2013 to review results The documentary rubric will be modified to increase the use of peer reviews within the grading scheme Exam question performance will continue to be monitored to evaluate the true need for any future adjustments

What resources were used or have been requested to close the loop?Closing the loop for this Spring 2013 assessment involved time for the faculty to meet, review the data, and revise the rubric No additional resource requests are planned at this time

Graduate programs in school & community health educationPrepared by Joe Balog

Graduate ProgramsStudent Learning Outcomes Grad Program SLOs: Students will be able to apply the knowledge of a health literate educator to address student health. Students will be able to assess needs to determine priorities for school health education. Students will be able to plan effective comprehensive school health education curricula. Students will be able to implement health education instruction. Students will be able to assess student learning. Students will be able to plan a coordinated school health education program. Student will be able to serve as a resource person in health education. Students will be able to advocate for school health education. **

How was the assessment accomplished? Student Work Assessed: HLS 600 Issues in Health and Wellness n = 10 Selling Points Assignment Scored with Rubric HLS 600 Issues in Health and Wellness n = 10 Advocacy Letter Assignment Scored with Rubric

Actual Assessment Data Criterion Student Benchmarks Selling Points Results Advocacy Letter Results Exceeding Score of 90% or above 60% 80% Meeting Score of 80-89% 30% 10% Approaching Score of 70-79% 10% 10% Not Meeting Score below 70% 0% 0% SLO Benchmark: 90% of students will meet or exceed expectations Met benchmark? Yes Yes

Assessment ResultsWhat Have the Data Told Us? The benchmarks were met for both assessment artifacts with 90% of students meeting or exceeding expectations However, the instructor explained that 8 of the 10 students were allowed to resubmit their two projects/artifacts, as they were not completed correctly on first submission

Data-driven DecisionsHow the Department Has or Plans to “Close the Loop” Graduate faculty and the department chair met in May 2013 to review results Consequently, a contingency plan was developed and implemented to promote skill mastery. To successfully address this issue in the future, it was recommended that the instructor revised his or her lesson plans to increase instructional time spent on the important themes of these projects.

What resources were used or have been requested to close the loop? Closing the loop for this Spring 2013 assessment involved time for the faculty to meet, review the data, r evise the unit plan assignment, and explore the idea providing additional preparation time for the projects and to consider adding educational methodologies that could be brought into the classroom No additional resource requests are planned at this time