Program evaluation Sebastian
7K - views

Program evaluation Sebastian

Similar presentations


Download Presentation

Program evaluation Sebastian




Download Presentation - The PPT/PDF document "Program evaluation Sebastian" is the property of its rightful owner. Permission is granted to download and print the materials on this web site for personal, non-commercial use only, and to display it on your personal computer provided you do not modify the materials and that you retain all copyright notices contained in the materials. By downloading content from our website, you accept the terms of this agreement.



Presentation on theme: "Program evaluation Sebastian"— Presentation transcript:

Slide1

Program evaluation

Sebastian

Uijtdehaage

bas@mednet.ucla.edu

310.794.9009

Slide2

Why do you evaluate?

Slide3

Five reasons of evaluating

FORMATIVE

informs program development

SUMMATIVE

demonstrate program’s success and impact

UNDERSTANDINGhow and why did program work?DISSEMINATIONsharing best practicesRECOGNITIONscholarship, academic credit, leadership

Stufflebeam

2003

Slide4

What type of evaluation

should I conduct?

Slide5

Outcome & Impact

Did it work?

Slide6

Dan

Stufflebeam

:

CIPP Model of Program Evaluation

INPUT

CONTEXT

PROCESS

PRODUCT

Slide7

What type of evaluation

should I conduct?

Formative or Summative?

Slide8

formative & summative evaluation

Formative Evaluation

Context

What needs to be done?

Input

How should it be done?

Process

Is it

being done?

Product

Is it working?

Stufflebeam

2003

Slide9

formative & summative evaluation

Formative Evaluation

Summative

Evaluation

Context

What needs to be done

?

Were

important

needs addressed?

Input

How should it be done?

Was program plan

defensible

?

Process

Is it

being done?

Was the plan

well executed?

Product

Is it working?

Did the effort make a difference?

Stufflebeam

2003

Slide10

What type of evaluation

should I conduct?

Quantitative or Qualitative?

Slide11

Slide12

Quantitative or qualitative measures?

Quantitative measures

HOW MUCH…?

How much did the participant change?

How much did the community change?

Qualitative measures

WHY and HOW?

Why did the program work?

How did participants change as result?

Slide13

What makes good evaluation?

Slide14

Evaluation must be planned ahead

Evaluation should be part of program planning

Planning and resource allocation makes evaluation more successful

Example: long-term tracking of participants

Slide15

Confidence being admitted in a medical school

Slide16

What else makes good evaluation?

Scientific rigor

Evaluation produces useful information that helps make decisions

Assessment should be done with a particular purpose in mind

Evaluation is tailored to your program objectives

Evaluation is done with conceptual framework in mind

Slide17

LOGIC MODEL

The Planned Work

The Intended Results

CONDITIONS and DRIVERS

Slide18

LOGIC MODEL

CONDITIONS and DRIVERS

Current situation that precipitates the need for the program

Slide19

LOGIC MODEL

CONDITIONS and DRIVERS

Resources and inputs needed to operate the program:

personnel, facilities, materials, equipment

Slide20

LOGIC MODEL

CONDITIONS and DRIVERS

Everything the program does if it had access to the resources

Slide21

LOGIC MODEL

CONDITIONS and DRIVERS

The “deliverables”—the events, products and services

Number of participants, classes, brochures, advisors,

etc

Slide22

LOGIC MODEL

CONDITIONS and DRIVERS

If the program delivers, the participants will

benefit

in certain ways:

Knowledge, skills, behavior, attitudes

Immediate, mid-term and long-term outcomes

Slide23

LOGIC MODEL

CONDITIONS and DRIVERS

If these benefits to participants are achieved, then certain changes in organizations and communities might be expected to occur

Slide24

LOGIC MODEL

The Planned Work

The Intended Results

CONDITIONS and DRIVERS

Slide25

LOGIC MODEL

Links processes and outcomes:

Funders love this!

Great for program planning

Work backwards

Evaluation is built in!Ain’t perfect

Slide26

Your turn…

Slide27