Download Presentation - The PPT/PDF document "Program evaluation Sebastian" is the property of its rightful owner. Permission is granted to download and print the materials on this web site for personal, non-commercial use only, and to display it on your personal computer provided you do not modify the materials and that you retain all copyright notices contained in the materials. By downloading content from our website, you accept the terms of this agreement.
Presentation on theme: "Program evaluation Sebastian"— Presentation transcript:
Slide1
Program evaluation
Sebastian
Uijtdehaage
bas@mednet.ucla.edu
310.794.9009
Slide2
Why do you evaluate?
Slide3
Five reasons of evaluating
FORMATIVE
informs program development
SUMMATIVE
demonstrate program’s success and impact
UNDERSTANDINGhow and why did program work?DISSEMINATIONsharing best practicesRECOGNITIONscholarship, academic credit, leadership
Stufflebeam
2003
Slide4
What type of evaluation
should I conduct?
Slide5
Outcome & Impact
Did it work?
Slide6
Dan
Stufflebeam
:
CIPP Model of Program Evaluation
INPUT
CONTEXT
PROCESS
PRODUCT
Slide7
What type of evaluation
should I conduct?
Formative or Summative?
Slide8
formative & summative evaluation
Formative Evaluation
Context
What needs to be done?
Input
How should it be done?
Process
Is it
being done?
Product
Is it working?
Stufflebeam
2003
Slide9
formative & summative evaluation
Formative Evaluation
Summative
Evaluation
Context
What needs to be done
?
Were
important
needs addressed?
Input
How should it be done?
Was program plan
defensible
?
Process
Is it
being done?
Was the plan
well executed?
Product
Is it working?
Did the effort make a difference?
Stufflebeam
2003
Slide10
What type of evaluation
should I conduct?
Quantitative or Qualitative?
Slide11Slide12
Quantitative or qualitative measures?
Quantitative measures
HOW MUCH…?
How much did the participant change?
How much did the community change?
Qualitative measures
WHY and HOW?
Why did the program work?
How did participants change as result?
Slide13
What makes good evaluation?
Slide14
Evaluation must be planned ahead
Evaluation should be part of program planning
Planning and resource allocation makes evaluation more successful
Example: long-term tracking of participants
Slide15
Confidence being admitted in a medical school
Slide16
What else makes good evaluation?
Scientific rigor
Evaluation produces useful information that helps make decisions
Assessment should be done with a particular purpose in mind
Evaluation is tailored to your program objectives
Evaluation is done with conceptual framework in mind
Slide17
LOGIC MODEL
The Planned Work
The Intended Results
CONDITIONS and DRIVERS
Slide18
LOGIC MODEL
CONDITIONS and DRIVERS
Current situation that precipitates the need for the program
Slide19
LOGIC MODEL
CONDITIONS and DRIVERS
Resources and inputs needed to operate the program:
personnel, facilities, materials, equipment
Slide20
LOGIC MODEL
CONDITIONS and DRIVERS
Everything the program does if it had access to the resources
Slide21
LOGIC MODEL
CONDITIONS and DRIVERS
The “deliverables”—the events, products and services
Number of participants, classes, brochures, advisors,
etc
Slide22
LOGIC MODEL
CONDITIONS and DRIVERS
If the program delivers, the participants will
benefit
in certain ways:
Knowledge, skills, behavior, attitudes
Immediate, mid-term and long-term outcomes
Slide23
LOGIC MODEL
CONDITIONS and DRIVERS
If these benefits to participants are achieved, then certain changes in organizations and communities might be expected to occur
