Uijtdehaage. bas@mednet.ucla.edu. 310.794.9009. Why do you evaluate?. Five reasons of evaluating. FORMATIVE. informs program development. SUMMATIVE. demonstrate program’s success and impact. UNDERSTANDING. ID: 674818
DownloadNote - The PPT/PDF document "Program evaluation Sebastian" is the property of its rightful owner. Permission is granted to download and print the materials on this web site for personal, non-commercial use only, and to display it on your personal computer provided you do not modify the materials and that you retain all copyright notices contained in the materials. By downloading content from our website, you accept the terms of this agreement.
Program evaluation
Sebastian
Uijtdehaage
bas@mednet.ucla.edu
310.794.9009
Slide2Why do you evaluate?
Slide3Five reasons of evaluating
FORMATIVE
informs program development
SUMMATIVE
demonstrate program’s success and impact
UNDERSTANDINGhow and why did program work?DISSEMINATIONsharing best practicesRECOGNITIONscholarship, academic credit, leadership
Stufflebeam
2003
Slide4What type of evaluation
should I conduct?
Slide5Outcome & Impact
Did it work?
Slide6Dan
Stufflebeam
:
CIPP Model of Program Evaluation
INPUT
CONTEXT
PROCESS
PRODUCT
Slide7What type of evaluation
should I conduct?
Formative or Summative?
Slide8formative & summative evaluation
Formative Evaluation
Context
What needs to be done?
Input
How should it be done?
Process
Is it
being done?
Product
Is it working?
Stufflebeam
2003
Slide9formative & summative evaluation
Formative Evaluation
Summative
Evaluation
Context
What needs to be done
?
Were
important
needs addressed?
Input
How should it be done?
Was program plan
defensible
?
Process
Is it
being done?
Was the plan
well executed?
Product
Is it working?
Did the effort make a difference?
Stufflebeam
2003
Slide10What type of evaluation
should I conduct?
Quantitative or Qualitative?
Slide11Slide12Quantitative or qualitative measures?
Quantitative measures
HOW MUCH…?
How much did the participant change?
How much did the community change?
Qualitative measures
WHY and HOW?
Why did the program work?
How did participants change as result?
Slide13What makes good evaluation?
Slide14Evaluation must be planned ahead
Evaluation should be part of program planning
Planning and resource allocation makes evaluation more successful
Example: long-term tracking of participants
Slide15Confidence being admitted in a medical school
Slide16What else makes good evaluation?
Scientific rigor
Evaluation produces useful information that helps make decisions
Assessment should be done with a particular purpose in mind
Evaluation is tailored to your program objectives
Evaluation is done with conceptual framework in mind
Slide17LOGIC MODEL
The Planned Work
The Intended Results
CONDITIONS and DRIVERS
Slide18LOGIC MODEL
CONDITIONS and DRIVERS
Current situation that precipitates the need for the program
Slide19LOGIC MODEL
CONDITIONS and DRIVERS
Resources and inputs needed to operate the program:
personnel, facilities, materials, equipment
Slide20LOGIC MODEL
CONDITIONS and DRIVERS
Everything the program does if it had access to the resources
Slide21LOGIC MODEL
CONDITIONS and DRIVERS
The “deliverables”—the events, products and services
Number of participants, classes, brochures, advisors,
etc
Slide22LOGIC MODEL
CONDITIONS and DRIVERS
If the program delivers, the participants will
benefit
in certain ways:
Knowledge, skills, behavior, attitudes
Immediate, mid-term and long-term outcomes
Slide23LOGIC MODEL
CONDITIONS and DRIVERS
If these benefits to participants are achieved, then certain changes in organizations and communities might be expected to occur
Slide24LOGIC MODEL
The Planned Work
The Intended Results
CONDITIONS and DRIVERS
Slide25LOGIC MODEL
Links processes and outcomes:
Funders love this!
Great for program planning
Work backwards
Evaluation is built in!Ain’t perfect
Slide26Your turn…
Slide27
Next Slides
Program evaluation webinar series part 2:
Program evaluation
Program evaluation webinar series part 1:
An evaluation primer: a plan for measuring program quality
My name is sebastian, i am 6 years old and i
The secret to establishing a rural cit program
Basic principles of program evaluation
Basic steps in conducting an evaluation
Evaluation 101 workshop