PPT-Assessing Threats to Validity and Implications for Use of Impact Evaluation Findings

Michael Woolcock Development Research Group World Bank Kennedy School of Government Harvard University mwoolcockworldbankorg InterAction May 13 2013 Overview Background The art science and politics of evaluation. Professor Alicia . O’Cathain. ScHARR. University of Sheffield. 22 June 2015. What is qualitative research?. Normal in evaluation. Understanding not measuring . Set of methods. Focus groups. Semi-structured or in depth interviews. Session aims . To develop your understanding of how health threats can be conceptualised. To analyse how changing patterns of health relate to key societal events. To identify the main public health issues within contemporary society . ESSAY OUTLINE. For . I.b. . psychology paper 1b AND PAPER 2 . 500-800 WORD ESSAYS. Paragraph 1. Restate the question in your own . words, include the theory as an answer.. This shows you understand the question. Thinking Questions. What is an IV?. What is a DV?. What is repeated measures design?. What is matched pairs design?. What is independent groups design?. What is a hypothesis? Can you name the 3 types . Reliability gets more attention:. Easier to understand. Easier to measure. More formulas (like stats!). Base for validity. Need for validity. Does test measure what it claims?. Can test be used to make decisions?. Professor Alicia . O’Cathain. ScHARR. University of Sheffield. 22 June 2015. What is qualitative research?. Normal in evaluation. Understanding not measuring . Set of methods. Focus groups. Semi-structured or in depth interviews. Week 8, Psych 350 – R. Chris Fraley. Validity. In our last class, we began to discuss some of the ways in which we can assess the quality of our measurements.. We discussed the concept of reliability (i.e., the degree to which measurements are free of random error).. Part 2. Foundations of Measurement for Human Resource Selection. CHAPTER. 5. ©2011 Cengage Learning. All Rights Reserved. May not be scanned, copied or duplicated, or posted to a publicly accessible website, in whole or in part.. Validity . Is the translation from concept to . operationalization. accurately representing the underlying concept. . Does your variables measure what you think in abstract concepts.. This is more familiarly called Construct Validity.. Why is this so important and. why is this so difficult?. Reliability and Validity. The language for this is from the quantitative tradition—scientific . verification—positivism. . Habermas. ’ cognitive interest of . Ottusch. . H615. October 11, 2013. What is external validity?. “Concerns inferences about the extent to which a causal relationship holds over variations in persons, settings, treatments, and outcomes.” (p. 83). Basics . What is reliability? . What is validity? . Can you have one without the other? Why or why not? . Reliability. Observed score . = True score random error systematic error. Explain. Why is this important? . October 22, 2018. Self-Generation Incentive Program. Overview. Description of evaluated population and overall approach. Summary of observed findings. By customer class and PBI/non-PBI. Focus on GHG performance. Instrumentation: Validity Measuring Caring in Nursing Validity: Defined Extent to which instrument reflects abstract construct being examined; measures what it is supposed to measure Domain or Universe of Construct