ACE IMPACT PROJECT MEETING 27052021 Agenda ACE IMPACT AND DLI 2 DEVELOPMENT IMPACT WORKING GROUP AND DLI 2 EVALUATION EVALUATION CRITERIA COMMENTS AND EXPECTATIONS ACE IMPACT AND DLI 2 DEVELOPMENT IMPACT ID: 1045498
Download Presentation The PPT/PDF document "DEVELOPMENT IMPACT AND DLI 2" is the property of its rightful owner. Permission is granted to download and print the materials on this web site for personal, non-commercial use only, and to display it on your personal computer provided you do not modify the materials and that you retain all copyright notices contained in the materials. By downloading content from our website, you accept the terms of this agreement.
1. DEVELOPMENT IMPACT AND DLI 2 ACE IMPACT PROJECT MEETING. 27/05/2021
2. AgendaACE IMPACT AND DLI 2. DEVELOPMENT IMPACTWORKING GROUP AND DLI 2 EVALUATIONEVALUATION CRITERIACOMMENTS AND EXPECTATIONS
3. ACE IMPACT AND DLI 2. DEVELOPMENT IMPACT
4. ACE ImpactImprove the quality, quantity and development impact of postgraduate education Reduce the higher-level skills gaps Improve applied research and technology uptakeStrengthen higher education training and applied research programs
5. DLI 2. Development ImpactMeasure the development impact of each Center through independent, external evaluation……both at national and regional level, in terms of the extent of their contribution to their sector/industriesAssess the quality of the postgraduate graduates and applied researchDLI 2 varies between countries from US$25,000 to US$35,000 equivalent per point in the score (1 to 5 scale)
6. Evaluating DLI2ACE Impact is a results-based initiative, under which Centers must achieve DLIs to earn fundsDLI 2 entails an evaluation of each Center by an External Evaluator Evaluation in year 2 or 3 (for renewal and new Centers, respectively) and then in year 4To ensure quality and transparency in the evaluation, a Working Group was created to guide on the criteria and methodology for evaluating DLI 2
7. Evaluating DLI2Evaluation shall include:Number of student internships Relevance and impact of graduates on society, including the number of graduates hired in the sectorNumber of short courses delivered in response to sectoral stakeholder requests Impact of research / innovation (startups / prototypes)Progress on other DLIs / DLRsEvaluation of Center and SAB annual reportsInterviews with graduates, sectoral stakeholders, employers,…
8. WORKING GROUP AND DLI 2 EVALUATION
9. Working GroupDiverse constitution: 3 Center Leaders, 2 Reps from AAU, 2 Reps from WB, 2 ExpertsResponsibilities: draft the TOR for the external evaluation of DLI 2, define methodology, disseminate outputs to assure transparency, support evaluation process, help with recommendationsThree web meetings: between 1st of March and 15th of AprilDeliverables: TOR for independent evaluation of DLI 2 with proposed methodology, meeting reports, present in regional workshop, webminar
10. Broad objectives of the evaluationEvaluate the contribution of the Centers towards development impact, in terms of graduates and applied research Make an overall independent assessment (by an external consultant) of the performance of the project, with attention to the impacts of the project activities against its objectivesAnalyse the spillover effects and outcomes of the development impactIdentify key lessons and propose practical recommendations for follow-up actions
11. Methodology of the evaluation (external consultant)Diversity of methods/tools: participatory and self assessment methods, qualitative and quantitative, desk reviews, surveys, interviews,…Engage with the Working Group, the AAU, and all relevant supportive service/data providers Produce a detailed workplan, an inception report, a detailed scoring process (share with the Centers), and a final report with the evaluation and recommendations / lessons learnedStart in May and end in October 2021Done remotely (including virtual interviews)
12. Methodology of the evaluation (external consultant)Evaluation is expected to account for the variation among Centers (one size does not fit all) – criteria may vary with the sector/CenterOpen surveys/interviews: allowing for Centers, and their stakeholders, to fully express their opinionsCriteria divided in human capital and researchCriteria are proposed as a guidance, and should be later selected, or increased, according to the sector/Center
13. EVALUATION CRITERIA
14. Evaluation criteria as proposed by the Working Group: human capitalNumber of ACE student internships in the sector Number of ACE graduates placed in sector related jobs (for renewals only) Impact of Center graduates in society and in the sector Impact of Center studies on graduatesQuality and relevance of ACE skills that ACE graduates are bringing to internships/jobsExamples of excellence Dissemination and outreach Relationship with ACE alumni
15. Evaluation criteria as proposed by the Working Group: researchNumber of short courses delivered in response to sector requests Impact of Center research on regional development of the sector Technology transfer (e.g.: startups and prototypes) KPIs referring to C&D activitiesOutreach and collaboration with society Number of research grants Dissemination of information within sector Intellectual property Presence of the Center as a regional hub for ideas and excellence
16. COMMENTS & EXPECTATIONS
17. Comments / expectationsEvaluation of DLI 2 is complex and difficultWG process was participatory and transparentEvaluation needs to be flexible & openExternal consultant is key for the success of the evaluation (independent, experienced, rigorous) Success means quality of the evaluation & recommendationsFull collaboration of the Centers, and all stakeholders, is determinant
18. Thank you!