Now we are ready to write our evaluation report Basically we are going to fill our content to the checklist boxes we learned in lec2 Putting them together S519 The Key Evaluation Checklist Dp 67 ID: 477250
Download Presentation The PPT/PDF document "Evaluation Result" is the property of its rightful owner. Permission is granted to download and print the materials on this web site for personal, non-commercial use only, and to display it on your personal computer provided you do not modify the materials and that you retain all copyright notices contained in the materials. By downloading content from our website, you accept the terms of this agreement.
Slide1
Evaluation ResultSlide2
Now we are ready to write our evaluation report.Basically we are going to fill our content to the checklist boxes we learned in lec2.
Putting them together
S519Slide3
The Key Evaluation Checklist (D-p. 6-7)
I. Executive
Summary
II. Preface
III. Methodology
1. Background
& Context
2. Descriptions
& Definitions
3.
Consumers
4.
Resources
5. Values
6. Process
Evaluation
7. Outcome
Evaluation
8 & 9. Comparative
Cost-Effectiveness
10.
Exportability
11. Overall Significance
12.
Recommendations
& Explanations
13. Responsibilities
14.
Reporting
&
Follow-up
15. Meta-evaluation
S519Slide4
To orient readers to the basics of :what the evaluation is
and
why the evaluation was done
What the main approach was
KEC Preliminary checkpoints
S519Slide5
Shows a short overview (1-2 pages) of what was evaluated and what the main findings were.
You can consider to include the followings:
Very short description of the program
The overall conclusion about the quality or value of the evaluationThe graphical profile of the evaluand‘s performance (see Exhibit7.6)
Several (<7) bullet points about the most important strengths and weaknesses.
I. Executive summary
S519Slide6
Address the following questions:
Who asked for the evaluation and why?
What are the main evaluation questions?
Is this a formative or summative evaluation?
Who are the main audiences for this evaluation report?
Mainly based on your work in Ch2
Please always provide justifications for your conclusionsII. Preface
S519Slide7
The main methodologies used in the evaluation
How you set up your experiments
How you collect data
How you analyze your data?How you draw conclusionAnd each with why.
III. Methodology
S519Slide8
To represent all the initial ingredientsBackground
Context
What it is
Whom it servesThe nature and limitation of any resourcesWhere the values come from
KEC foundations checkpoints
S519Slide9
Incude just enough information for readers to be able to understand the basic retionale for the program
Contents are:
Why did this program or product come into existence in the first place (needs assessment)
How is the evaluation supposed to address the needs and problems?
What are the main context of evaluands (e.g. Physical, economic, political) to facilitate or constrain the evaluation?
1. Background and Context
S519Slide10
Describe your evaluand in enough detailsDefinition of important terms
2. Description and definitions
S519Slide11
Identify the actual and potential recipients or users of the evaluand
Describe consumers in geographic locatoin, demographics
Downstream impactees
3. Consumers
S519Slide12
Describe the available and important resources (which helps to understand the conclusion of the evaluation)
Funds/budget
Physical space
Experiencenetworks
4. Resources
S519Slide13
To convey to the audience how the evaluation team determinded what should be considered as „valuable“ or „high quality“ for the evaluand.
Justify the validity
5. Values
S519Slide14
Getting evaluation explicitly
KEC Sub-evaluation checkpoints
S519Slide15
The issues of evaluation, content and implementation (see Ch4)
Ethics, the priniciple of equity and fairness
Consistency with professional and scientific standards
Efficiency (i.e, minimal wasted effort or resource)
Needs of consumers (e.g., timeliness, learning style, current knowledge)
Needs of staff (e.g., performance on tasks and activities)
6. Process evaluation
S519Slide16
The outcomes are what happened to the consumers as a result of coming into contact with the evaluand
Intended and unintended
Short-term and long-term effects
A good way to doList the main outcome dimensions with a brief explanation of how the list was generated.
Rate each dimension on importance
Explain the used methods (ch7)
Rate the each outcome dimension (ch8)Provide the justification (evidence, logic, methods) for your rate7. Outcome evaluation
S519Slide17
It is important to know whether the evaluand is cost-effective
See D-p62-63
8&9. Comparative cost-effectiveness
S519Slide18
Whether your evaluation could also have value outside its current context.
It is always worth considering the possibility
10. Exportability
S519Slide19
Combining Checkpoints6-10 to draw an overall conclusion
KEC conclusions checkpoints
S519Slide20
Using synthesis methodology to draw a summary covering Checkpoints 6-10
Graphical representation (e.g., Exhibit7.6)
Summary of strengths and weaknesses
11. Overall significance
S519Slide21
Recommendations for furture improvement
12. Recommendations and explanations (possible)
S519Slide22
Who is repsonsible for good or bad resultsYou have to be highly skilled
13. Responsibilities (possible)
S519Slide23
Who get the copies of the evaluation reports and in what forms
What are follow-ups to ensure that the findings are used
14. Report and support
S519Slide24
Self review of the evaluation itselfThe validity of their conclusions
Utility to relevant stakesholders
The methodology used for evaluations
CredibilityCost
Lessoned learned during this evaluation.
15. Meta-evaluation
S519Slide25
Go back to your evaluation group
Discuss all these checkpoints and how are you going to put all your result together
Exercise
S519