Food for Peace Monitoring and Evaluation Workshop for FFP Development Food Assistance Projects Session Objectives By the end of the session participants will have Shared their thoughts about the benefits of MampE ID: 448439
Download Presentation The PPT/PDF document "Food for Peace Monitoring, Evaluation an..." is the property of its rightful owner. Permission is granted to download and print the materials on this web site for personal, non-commercial use only, and to display it on your personal computer provided you do not modify the materials and that you retain all copyright notices contained in the materials. By downloading content from our website, you accept the terms of this agreement.
Slide1
Food for Peace Monitoring, Evaluation and Reporting Requirements
Food for Peace Monitoring and
Evaluation
Workshop for
FFP
Development Food Assistance
ProjectsSlide2
Session Objectives
By the end of the session participants will have:
Shared their thoughts about the benefits of M&E
Reviewed the FFP M&E and Reporting Requirements and identified those that seem challenging to their projects
Food for Peace Monitoring, Evaluation and Reporting RequirementsSlide3
Who will benefit from the results of your M&E work and how/why?
Activity 1:
Share
your thoughts…
Food for Peace Monitoring, Evaluation and Reporting RequirementsSlide4
Session Objective
Session Objective
Review FFP M&E and reporting requirements for the lifecycle of a project
Food for Peace Monitoring, Evaluation and Reporting RequirementsSlide5
Midway Requirements
Start Up Stage Requirements
Project End Requirements
Annual Requirements
Next Section
Project Lifecycle, M&E and Reporting Requirements
Food for Peace Monitoring, Evaluation and Reporting RequirementsSlide6
Project Lifecycle, M&E and Reporting Requirements
Project Lifecycle:
What are the M&E and Reporting Requirements at Each Stage?
Proposal
stage
Start Up
Midway
End of project
End of Year 1
End of Year 2
End of Year 3
End of Year 4
Learning
Information from M&E system
closed
Food for Peace Monitoring, Evaluation and Reporting RequirementsSlide7
Requirement
1
:
LogFrame
Project Lifecycle, M&E and Reporting Requirements
Narrative Summary
Indicators
Data Sources
Assumptions
Goal
Project Purpose
Sub-purpose
Immediate
Outcome
Output
Input
Food for Peace Monitoring, Evaluation and Reporting RequirementsSlide8
LogFrame
is a matrix that summarizes the Theory of Change and shows what the project intends to do and how, what the key assumptions are, and how outputs and outcomes will be monitored and evaluated.
Levels of
LogFrame: goal, purpose, sub-purpose, immediate outcomes, outputs, inputs
Goal, purpose, sub-purpose, and immediate outcomes should be stated as results
(not activities).
All elements of the
LogFrame
should be measurable and context specific.
Requirement
1
:
LogFrame
Project Lifecycle, M&E and Reporting Requirements
Food for Peace Monitoring, Evaluation and Reporting RequirementsSlide9
Theory of Change
LogFrame
Indicator Performance Tracking Table (IPTT
)Performance Indicator Reference Sheets (PIRS)
Plans on: annual monitoring, data analysis, management, safeguard, dissemination, use, quality assurance, evaluation
M&E staffing plan and structure
Project Lifecycle, M&E and Reporting Requirements
Requirement 2
: M&E Plan
Food for Peace Monitoring, Evaluation and Reporting RequirementsSlide10
IPTT should include:
Baseline/final evaluation and annual monitoring indicators
All applicable FFP “required” and “required if applicable” indicators
Mission/F indicators, gender and environmental indicators (linked to performance of project activities only)
Indicators related to all levels of the
LogFrame
Levels of disaggregation and targets for all indicators
Project Lifecycle, M&E and Reporting Requirements
Requirement 2: M&E Plan (continued)
Food for Peace Monitoring, Evaluation and Reporting RequirementsSlide11
Aims
to help USAID learn more systematically from its work and increases
accountability
Calls for “large” and “
pilot/innovative” projects (of any size) to undergo evaluations that are
external
Projects designed based on a proven Theory of Change should
undergo
performance evaluations
, whereas “pilot/innovative”
projects should
undergo
impact evaluations
(the latter only if feasible
)
USAID Evaluation Policy issued in
January 2011
Project Lifecycle, M&E and Reporting Requirements
Food for Peace Monitoring, Evaluation and Reporting RequirementsSlide12
Most evaluations
will be
external (i.e. third-party contractor or grantee managed by USAID, not by the implementing partners)
Decision on whether impact or performance evaluation at discretion of operating unit (FFP)
Most
FFP food
security
projects
will likely undergo performance evaluations (not impact evaluations)
for the
time being
USAID Evaluation Policy (continued)
Project Lifecycle, M&E and Reporting Requirements
Food for Peace Monitoring, Evaluation and Reporting RequirementsSlide13
Project Lifecycle, M&E and Reporting Requirements
Midway Requirements
Start Up Stage Requirements
Project End Requirements
Annual Requirements
Next Section
Food for Peace Monitoring, Evaluation and Reporting RequirementsSlide14
PVOs should attend the FFP M&E workshop (held by FANTA)
Madagascar: November 4-13, 2014
Burundi: November 17-25, 2014
Malawi: December 8-17, 2014
Two
days intro sessions followed by technical assistance one-on-one for each award
Requirement
3:
FFP M&E workshop
Start Up Stage Requirements
Food for Peace Monitoring, Evaluation and Reporting RequirementsSlide15
Submit
revised
LogFrame, IPTT, Theory of Change (ToC) -
due 20 days to FFP after the M&E workshop.
Target
values for
baseline/final evaluation indicators are submitted as percentage point change during proposal stage. No need to update these targets until
after
baseline
survey
conducted
BUT
target values for annual monitoring indicators required with submission of revised IPTT
20
days after
workshop
Requirement
4:
ToC, Logframe, IPTT
Start Up Stage Requirements
Food for Peace Monitoring, Evaluation and Reporting RequirementsSlide16
Requirements #5
:
Submit comprehensive M&E Plan and Detailed Implementation Plan (DIP)—due 60 days after the M&E workshop to
FFP
Strongly encouraged:
Attend new M&E Plan workshop held by TOPS in coordination with FFP.
Start Up Stage Requirements
Start Up Stage: Requirement 5
Food for Peace Monitoring, Evaluation and Reporting RequirementsSlide17
Third-party survey firm (not PVO) to conduct baseline study
Projects
can start implementation before data collection for the baseline is complete!
Quantitative study must use population-based household survey (simple pre-post designs required only)
Baseline survey must be comparable to the final evaluation survey
Data collected for impact and some outcome indicators from IPTT; includes FFP gender indicators
Start Up Stage Requirements
Requirement 6:
Baseline Study
Food for Peace Monitoring, Evaluation and Reporting RequirementsSlide18
Third-party survey firm (not PVO) to conduct baseline study
Study will include a qualitative component to add richness and context to the quantitative results
Completed
within first year of implementation as early as possible (and ideally during the “lean season
”)
Baseline
report will provide results by
PVO
and for the
overall FFP program implementation
areas
Datasets
also required to be submitted to comply with USG Open Data
requirements
PVO
can conduct other formative research, as needed
Start Up Stage Requirements
Baseline Study (continued)
Food for Peace Monitoring, Evaluation and Reporting RequirementsSlide19
Project Lifecycle, M&E and Reporting Requirements
Midway Requirements
Start Up Stage Requirements
Project End Requirements
Annual Requirements
Next Section
Food for Peace Monitoring, Evaluation and Reporting RequirementsSlide20
Submit annual results report (ARR)—retrospective reporting
r
elative to US fiscal year (Oct 1–Sept 30)
Annual Requirements
Annual Results Report
ARR
Narrative
Attachments
to FFPMIS
FFPMIS
Data
Entry
Requirement
7: Annual Results Report
Food for Peace Monitoring, Evaluation and Reporting RequirementsSlide21
ARR Narrative containing:
Annual
Food Assistance Project Activities and Results
Lessons Learned
Annual Requirements
Annual Results Report (continued)
Food for Peace Monitoring, Evaluation and Reporting RequirementsSlide22
2
. Attachments
to FFPMIS:
Success StoriesIndicator
Performance Tracking Table (IPTT)IPTT Data Source Descriptions
Detailed
Implementation Plan (DIP)
Expenditure
Report
Technical
Sectors Tracking Table
Program
Design and Performance Reports
Supplemental
Materials
Annual Requirements
Annual Results Report (continued)
Food for Peace Monitoring, Evaluation and Reporting RequirementsSlide23
3. FFPMIS Data Entry:
Monetization and Cost Recovery Tables
Standardized Annual Performance Questionnaire (SAPQ)
Beneficiary and Resource Tracking Tables
Annual Requirements
Annual Results Report (continued)
Food for Peace Monitoring, Evaluation and Reporting RequirementsSlide24
Project Lifecycle, M&E and Reporting Requirements
Midway Requirements
Start Up Stage Requirements
Project End Requirements
Annual Requirements
Next Section
Food for Peace Monitoring, Evaluation and Reporting RequirementsSlide25
Reasons
for conducting
MTE:
Learn from successes, acknowledge problemsAssess implementation progress and roadblocks
Participatory, qualitative assessments are encouragedProcess evaluation
Team
leader must be
external
MTE team should comprise expertise in all technical sectors and cross-cutting issues addressed by project
No
MTE team members should have previous responsibility in design/implementation of project under
evaluation
Midway Requirements
Requirement
8 (PVO): Mid-term Evaluation
Food for Peace Monitoring, Evaluation and Reporting RequirementsSlide26
MTE finalized for FFP 5-year development projects by
mid
PY3
Not required to include quantitative component or be population-based like baseline/final evaluationMidterm report to be submitted to FFP 3 months after data collection ends or qualitative study conducted
Midway Requirements
Mid-term Evaluation (continued)
Food for Peace Monitoring, Evaluation and Reporting RequirementsSlide27
Project Lifecycle, M&E and Reporting Requirements
Midway Requirements
Start Up Stage Requirements
Project End Requirements
Annual Requirements
Next Section
Food for Peace Monitoring, Evaluation and Reporting RequirementsSlide28
Third-party survey firm to conduct final evaluation
s
tudy (quantitative and qualitative)
Quantitative study must use population-based household survey (simple pre-post designs required only)
Final evaluation survey must be comparable to the baseline survey
same
impact and outcome
indicators and questionnaires
same
time of year
Most
will be performance evaluations with pre-post designs.
Project End Requirements
Requirement
9:
Fin
al Evaluation Study
Food for Peace Monitoring, Evaluation and Reporting RequirementsSlide29
FFP Request for Applications
http
://
www.usaid.gov/what-we-do/agriculture-and-food-security/food-assistance/programs/development-programs
FFP ARR Guidance http://
www.usaid.gov/what-we-do/agriculture-and-food-security/food-assistance/guidance/implementation-and-reporting
USAID Evaluation Policy
http://www.usaid.gov/evaluation/
Resources
Resources
Food for Peace Monitoring, Evaluation and Reporting RequirementsSlide30
This presentation is made possible by the generous support of the American people through the support of the Office of Health, Infectious Diseases and Nutrition, Bureau for Global Health;
and the Office of Food for Peace, Bureau for Democracy, Conflict and Humanitarian Assistance
,
United States Agency for International Development (USAID), under terms of Cooperative Agreement No
. AID-OAA-A-12-00005
,
through FANTA, managed by FHI 360. The contents are the responsibility of FHI 360 and do not necessarily reflect the views of USAID or the United States Government.
Food for Peace Monitoring, Evaluation and Reporting Requirements