Information session: - PDF document

Information session: Knowledge translation Outputs, outcomes, impacts 6 May 2014 Introduction Information session: 1pm – 3pm Presentations: 40 - 60 minutes  Context  Knowledge Translation  Outputs, outcomes and impacts Question & Answer session Goals of the cluster program 1. Support multidisciplinary research programs, which have a specific major objective / basic theme; 2. Support innovative and cutting - edge research that advances Manitoba as a national / international leader in the field; 3. Address research questions that cannot be accomplished by an individual researcher's program; and 4. Support research that engages appropriate end - users in the development of the research question and to apply the findings which are relevant and will have an impact on the health of Manitobans and the health system. Expression of interest requires description of 1. Engagement of and relevance to end users 2. Potential impact on the health of Manitobans Full proposal requires 1. Knowledge Translation plan 2. Demonstrate relevance and benefit to Manitoba Increased focus on measuring impact 1. Governments are faced with competing demands for public funds 2. Funding for research has remained stable 3. Greater competition for available research funding 4. Increased pressure to demonstrate value - for - money 5. Global interest on impacts of health research  Knowledge translation  Outputs, outcomes and impacts of research Knowledge translation Dr Kristy Wittmeier Outputs, outcomes and impacts Outline of presentation 1. Definition of outputs, outcomes and impact 2. The CAHS impact evaluation framework 3. Examples  Outputs , outcomes and impact  Science Foundation Ireland What is impact?  Impact is the overall results of research on society and may include additional contributions to the health sector or to society (CIHR 2005 ) .  Outputs  Outcomes  Impacts Outputs, outcomes, impacts (1)  Outputs represent the tangible findings of research, and can be  Primary outputs (e.g. publications and products from the funded research), and  Secondary outputs which arise because of the results of the research (e.g. systematic reviews, guidelines, policies, etc.) (Wooding, Hanney , et al. 2004) .  Outcomes are the effect that these outputs have on different stakeholders, either desired or unexpected (Development Assistance Committee Working Party on Aid Evaluation 2002 ) .  Impact is the overall results of research on society and may include additional contributions to the health sector or to society (CIHR 2005) . Outputs, outcomes and impacts (2)  Health impacts are changes in the healthy functioning of individuals (physical, psychological, and social aspects of their health), changes to health services, or changes to the broader determinants of health.  Social impacts are changes that are broader than health impacts, and include changes to working systems, ethical understanding of health interventions, or population interactions.  Economic impacts can be regarded as the benefits from commercialization, the net monetary value of improved health, and the benefits from performing health research. CAHS impact evaluation framework CAHS impact evaluation framework Impacts feed back into inputs for future research Health care appropriateness, access etc Prevention, treatment Determinants of health Health research contributes to building a healthy and economically vibrant Manitoba. Canada/Global Research Manitoba Health Research • Biomedical • Clinical • Health services • Population and public health • Cross - pillar research Research Capacity Health Industry Other Industry Government Research Agenda Public Information Groups Improvements in health and wellbeing Economic Social prosperity Research Results Knowledge pool Interaction and feedback Initiation and Diffusion of Health Research Impacts Research activity That produces… That influences decision - making in That contributes to changing health, well - being, and economic and social prosperity Manitoba Health Research Strategy That affects health care, health risk factors, and other health determinants Examples of outputs of research  Published papers in peer - reviewed journals  Conference contributions and reports  Books, book chapters and research monographs  Standards documents, technical reports  Research based clinical case studies that add new knowledge  Clinical case studies  Patents  Software, computer code and algorithms  Digital artefacts such as datasets, archives, film and other non - print media, web content such as interactive tools  Teaching and curriculum materials  Trained students and postdocs  Others Examples of outcomes  Change(s) in clinical/professional practice  Change(s) in healthcare guidelines, policy  New models of conducting research  Establishing libraries/banks  Informing/change in theory or research methods  Informing research agenda  Adding to knowledge base  Products/ drugs  Services/ databases  Licenses  Spin - offs  Others Examples: health impacts  Patient health outcomes have improved e.g. through a new drug, treatment or therapy, diagnostic or medical technology, improvements to patient care practices or processes, or improvements to clinical or healthcare guidelines.  Public health and well - being has improved e.g. disease prevalence.  Disease prevention or markers of health have been enhanced by research.  Public awareness of a health risk or benefit has been raised.  A new diagnostic or clinical technology has been adopted.  The costs of treatment or healthcare have reduced .  Others Examples: economic impact  Existing businesses have been improved, through the introduction of new, or the improvement of existing, products, processes or services; the adoption of new, updated or enhanced technical standards and/or protocols, or the enhancement of strategy, operations or management practices.  A spin - off or new business has been created, established its viability, or generated revenue or profits.  A business or sector has adopted a new or significantly improved technology or process, including through acquisition and/or joint venture.  Employment has been created or increased through the production of a highly educated and relevant workforce in demand by industry .  Others Examples: socio/societal impact  Improved public quality of life through changes in social equality, welfare or inclusion  Greater public interest and engagement in health issues arising from research  Awareness , attitudes, education and understanding of the public enhanced by engaging them with research results.  W ork of organizations/agencies/institutions has been improved or enhanced by the research .  Others Change the way hospitals and government regulators around the world view HES Expecting that hospitals will re - examine their decision to carry this... or to carry it without restrictions Expecting that physicians will immediately reconsider the use of (HES) on a day - to - day basis Paper in Journal of the American Medical Association Finding of meta - analysis: Hydroxyethyl starches (HES) can cause increased kidney failure and higher mortality rates than other products Published in Winnipeg Free Press February 20, 2013 33 clinical Trials Research (?) Several alternatives to HES -- some of them far less expensive By using the product less, more people will actually live Outputs Outcomes Example: research findings in Manitoba KT template: where impacts fit in integrated KT KT template: where impacts fit in integrated KT CHHR’s end of grant KT  Covers any activity aimed at diffusing , disseminating or applying the results of a research project  Conference presentations and publications in peer - reviewed journals - best approach at the early stages of discovery, when the knowledge is more relevant to academics who are contributing to a body of evidence that is not yet appropriate for application .  O pen - access journals or repositories – reach broader audiences increasing uptake by academic community, knowledge users and the general public  Potential knowledge - user audiences beyond the research community – tailor to audience; change language; engage print, TV and radio; upload to websites, YouTube, podcasts; use creative media e.g. film, theatre, art CIHR’s outcomes Key questions To what extent … What does this really mean? A description of the potential results expected from the successful completion of the project Will the project have relevant findings that may ultimately have a substantive impact on health outcomes, practice, programs and/or polices? Consider the potential impact of the study and its transferability  If not transferable, acknowledge and justify Will the project’s findings be transferable to other practice, programs and/or policy context? Will k nowledge users be involved in interpreting results and informing KT plans/activities? Does the end of grant KT plan detail strategies appropriate for its goals and target audiences? Include a detailed plan for end of grant KT Does the evaluation plan demonstrate that it will enable researchers to assess the project’s impact? Develop a reasonable evaluation plan to measure outcomes/impacts Guide to Knowledge Translation Planning at CIHR: Integrated and End - of - Grant Approaches Science Foundation Ireland (SFI ): an example Impact statements should be written primarily in lay non - technical language, be as specific and comprehensive as possible and cover potential impacts by answering the following questions:  Who will benefit from this research?  How will they benefit from this research? Considerations (SFI)  Some research projects will have immediate impact whereas other projects may take much longer to achieve impact.  Impact from research and especially basic research does not necessarily follow a linear process. What makes a good impact statement? (1)  Should be as specific as possible about potential impact and actions proposed to help realize the impact  Provides information that reviewers will find helpful in assessing the potential impact and actions  Good knowledge of the relevant beneficiaries of the proposed research  Clear description about how to reach and engage with the beneficiaries of the research, including clear deliverables & milestones What makes a good impact statement? (2)  Genuine inclusion of appropriate collaborators in the research program, especially in the application area of the research if interdisciplinary in nature  Brief description of track record and relevant accomplishments for knowledge exchange and impact generating activities in the context of the proposed research project  Good knowledge of national priorities and activities in the relevant areas  Demonstrates clear commitment to maximizing the impact of the research Useful links  The Return on Investments in Health Research: Defining the Best Metrics http://www.cahs - acss.ca/completed - projects /  Science Foundation Ireland http://www.sfi.ie/funding/sfi - research - impact /  Additional questions should emailed to info@mhrc.mb.ca