DR Angela Veale, School of Applied Psychology,

Transcript:DR Angela Veale, School of Applied Psychology,:
DR Angela Veale, School of Applied Psychology, University College Cork. Establishing Baselines – Sources of Information for Indicators and Developing Participatory Indicators Overview Evaluation is a central feature of programme design and project cycle management. Aim of session is to reflect on how to identify and develop the best indicators for evaluation purposes. Look at some case studies of psychosocial programme evaluations Establishing baselines: Developing your evaluation tools Establishing baselines- role of indicators For each project objective at output, outcome and impact levels, we need to define how we would measure results An indicator is a simple, clear statement that helps measure and communicate change If there is an objective there should be a means of measuring if it has been achieved Intervention Group Standard practice Waitlist Group no intervention (yet) When standardised measures don’t cut it? UNICEF- Consultancy to Provide Technical Assistance on Pilot to Develop a New Stress Measure for Adolescents and Caregivers UNICEF currently utlising a validated stress scale Programme showing a lack of impacts- may be that existing measures of perceived stress have mainly been developed and validated in the United States and western settings and may not capture the concept of stress in all settings. In order to capture stress as a potential pathway for positive outcomes in poverty alleviation programs and other interventions, it is important to adequately measure stress and thus a A measure of perceived stress suitable for the context is needed- a need for participatory indicator development? How would you go about doing this? Developing participatory evaluation indicators The project: Supporting the social reintegration of former child soldier young mothers in Liberia, Sierra Leone & northern Uganda The approach: Highly participatory; ‘meaningful participation’ was a central principle How could we know if the programme was successful in having a positive impact on the social reintegration of young mothers? Who decides what is ‘effective social reintegration’? How best to measure social reintegration? Standardised measures possible (e.g. Harvard Trauma Questionnaire; Child War Trauma Questionnaire; Retention in School etc.) used in other studies; not suitable here Decision to develop participatory and culturally relevant indicators. Evaluation Methodology Free listing At a workshop with representatives of young mothers from the 3 countries, they generated lists of important indicators of successful reintegration. This generated 47 items Ranking In northern Uganda, indictors were ranked in order of importance. Similar items were grouped together. Low ranking and highly similar