PPT-Ensuring Meaningful Performance Assessment Results: A Reflective Practice Model for Examining

Cynthia Conn PhD Assistant Vice Provost Professional Education Programs Kathy Bohan EdD Associate Dean College of Education Sue Pieper PhD Assessment Coordinator Office of Curriculum Learning . IB Syllabus Says:. Discuss the validity and reliability of diagnosis. Issues related to diagnosis: . http://. www.youtube.com/watch?v=xYemnKEKx0c. . http. ://. www.youtube.com/watch?v=gu7NDUc5TD4. . Announcements. I. ndependent work session on the standardized test critiques next week. Meet Brigid at the Educational Diagnostician office (. Hokona. Hall, room 108) at 4:30 with your partner to pick up your assessment (one copy per pair). . Thinking Questions. What is an IV?. What is a DV?. What is repeated measures design?. What is matched pairs design?. What is independent groups design?. What is a hypothesis? Can you name the 3 types . Four-Letter Word. *Yes, I know “test” is four letters, but session titles are supposed to be catchy.. Presented by Ed Cunningham, . Ed.D. .. Eduphoria School Improvement Specialist. Instructional Coach. What works; what doesn. ’. t. Geoff Norman, Ph.D.. McMaster University. . norman@mcmaster.ca. Why, What, How, How well. Why are you doing the assessment?. What are you going to assess?. How are you going to assess it?. Validity . Is the translation from concept to . operationalization. accurately representing the underlying concept. . Does your variables measure what you think in abstract concepts.. This is more familiarly called Construct Validity.. & . Validity. Reference. The majority of this lecture was taken . from . How . to Measure Survey Reliability . & Validity. . by Mark . Litwin. , Sage Publications,1995. .. Lecture objectives. Statistical Issues Related to Assessment. Reliability. Consistency. The degree to which students’ results remain consistent over replications of an assessment procedure. . Measurement example. Popham. (Part . 1 . of 3). Cynthia . Conn, PhD. Assistant Vice Provost, Professional Education Programs. Kathy Bohan, . EdD. Associate Dean, College of Education. Sue Pieper, PhD. Assessment Coordinator, Office of Curriculum, Learning Design, & Academic Assessment. Jamie DeLeeuw, Ph.D.. 5/7/13. Reliability. Consistency of measurement. The measure itself is dependable.. ***A measure must be reliable to be valid!***. High reliability = greater consistency = lower randomness (error). Basics . What is reliability? . What is validity? . Can you have one without the other? Why or why not? . Reliability. Observed score . = True score random error systematic error. Explain. Why is this important? . Diagnosis. Diagnosis within abnormal psychology means identifying and classifying abnormal behavior on the basis of . symptoms. , . the . patients’ self-reports, . observations. , . clinical tests . Reliability of diagnosis. = the extent to which clinicians agree on the same diagnosis for the same patient. .. The extent to which the same diagnosis is given in different cultures. Reliability in diagnosis. ’. t. Geoff Norman, Ph.D.. McMaster University. . norman@mcmaster.ca. Why, What, How, How well. Why are you doing the assessment?. What are you going to assess?. How are you going to assess it?.