Public Spending Code Guidance Laura Watts Central Expenditure Evaluation Unit Department of Public Expenditure and Reform What is a pilot study Trialling and testing of new programmes Focus here on new SPENDING ID: 366192
Download Presentation The PPT/PDF document "Pilot studies" is the property of its rightful owner. Permission is granted to download and print the materials on this web site for personal, non-commercial use only, and to display it on your personal computer provided you do not modify the materials and that you retain all copyright notices contained in the materials. By downloading content from our website, you accept the terms of this agreement.
Slide1
Pilot studiesPublic Spending Code Guidance
Laura Watts
Central Expenditure Evaluation Unit
Department of Public Expenditure and ReformSlide2
What is a pilot study?Trialling and testing of new programmes
Focus here on new SPENDING
Three main types:
Impact pilots – how does the new scheme affect outcomes?
Process pilots – is the process efficient?
Hybrid – a combination of impact and processSlide3
Why conduct pilots?Test before full-scale implementation
Back to design stage if pilot not “successful”
Identify teething issues
Note: should not be case-making
Informing decisions, reducing risk
Culture of innovation
Helps to evaluation-proof scheme
….Slide4
Why conduct pilots?
Required
under the Public Spending Code
All new
current spending
proposals require a
pilot before implementation
Current expenditure greater than €20 million over 5 years require a full appraisal
Recommended that spending below this threshold has some form of pilot conducted Slide5
How to conduct a pilot?Depends on the nature of the scheme and the level of spending
Proportionality
Analytically robust
some pilots will require randomised control trials or some other form of counterfactual impact evaluation – will depend on nature of the proposalSlide6
Included in GuidancePrinciples of good practice
Approvals and sequencing
Issues to consider when designing a pilot
Suggested methods to evaluate
Stakeholders
Ethical considerations
Review of findingsSlide7
Next stepsDraft guidance will be issued for consultation in the coming months
Let us know if you have run pilots in your areas
this will help inform the guidance if there were lesson learnt in the operation of the pilotsSlide8
Laura Watts
Central Expenditure Evaluation Unit,
Department of Public Expenditure & Reform
Upper
Merrion
Street
Dublin 2
01 604 5204
laura.watts@per.gov.ie