PPT-Preserving Validity in Adaptive Data Analysis

Moritz Hardt IBM Research Almaden Joint work with Cynthia Dwork Vitaly Feldman Toni Pitassi Omer Reingold Aaron Roth Statistical Estimation Data domain X class labels Y Unknown distribution . IB Syllabus Says:. Discuss the validity and reliability of diagnosis. Issues related to diagnosis: . http://. www.youtube.com/watch?v=xYemnKEKx0c. . http. ://. www.youtube.com/watch?v=gu7NDUc5TD4. . Thinking Questions. What is an IV?. What is a DV?. What is repeated measures design?. What is matched pairs design?. What is independent groups design?. What is a hypothesis? Can you name the 3 types . Reliability gets more attention:. Easier to understand. Easier to measure. More formulas (like stats!). Base for validity. Need for validity. Does test measure what it claims?. Can test be used to make decisions?. Week 8, Psych 350 – R. Chris Fraley. Validity. In our last class, we began to discuss some of the ways in which we can assess the quality of our measurements.. We discussed the concept of reliability (i.e., the degree to which measurements are free of random error).. Vitaly Feldman. Accelerated Discovery Lab. IBM Research - . Almaden. . Cynthia . Dwork. Moritz . Hardt. Toni . Pitassi. Omer . Reingold. . Aaron Roth. Microsoft Res. Google Res. U. of Toronto Samsung Res. Starter. Answer the exam questions in silence, no notes! . 15 . The students thought that having a dog on a lead was a useful measure of considerate . behaviour. because it had face validity. Explain what is meant by face validity in this context. . Joe . Boninger. , . Joshua Brody. , Owen . Kephart. Swarthmore College. Cell Probe Model . [Yao81]. Memory consists of . w-bit. cells. Updates/queries charged for . # probes. All other computation . A Practical Approach. to Faith-Related Psychological Problems. David Christian, Ph.D.. Licensed Psychologist. Logan, Utah. Self-Introduction. Born/raised in the church. Multi-generational Mormon.. Served a Spanish-speaking mission in Sydney, Australia. . Validity . Is the translation from concept to . operationalization. accurately representing the underlying concept. . Does your variables measure what you think in abstract concepts.. This is more familiarly called Construct Validity.. Vagelis. . Hristidis. Eduardo Ruiz. 1. Collaborative Adaptive Data Sharing - FIU. Motivation. Many application domains where . users . collaborate and share domain-specific information. .. Disaster Management. Jamie DeLeeuw, Ph.D.. 5/7/13. Reliability. Consistency of measurement. The measure itself is dependable.. ***A measure must be reliable to be valid!***. High reliability = greater consistency = lower randomness (error). Presented By:. Humam. . Nameer. 1. CASE STUDY. Just over three years old, . Clash of Clans.  rakes in more than $. 5M.  each day and consistently charts in the top three grossing . apps. .  It’s the app that new game developers look to for . Instrumentation: Validity Measuring Caring in Nursing Validity: Defined Extent to which instrument reflects abstract construct being examined; measures what it is supposed to measure Domain or Universe of Construct Features of adaptive immunity:. Adaptive immunity is characterized by the following:. 1. Antigenic specificity: (. highly specific).. 2. Diversity : . ( each antigen there is specific T-cell and B-cell for it)..