How do you Determine if a Test has Validity Reliability Fairness and Legal Defensibility ProfessionalfTestingfInct fPTIfxvv
273K - views

How do you Determine if a Test has Validity Reliability Fairness and Legal Defensibility ProfessionalfTestingfInct fPTIfxvv

Validity ValidityfisfarguablyfthefmostfimportantfcriteriafforfthefqualityfoffaftesttffTheftermfvalidity refersftofwhetherforfnotftheftestfmeasuresfwhatfitfclaimsftofmeasuretffOnfaftestfwithfhigh validityfthefitemsfwillfbefcloselyflinkedftoftheftestm

Download Pdf

How do you Determine if a Test has Validity Reliability Fairness and Legal Defensibility ProfessionalfTestingfInct fPTIfxvv




Download Pdf - The PPT/PDF document "How do you Determine if a Test has Valid..." is the property of its rightful owner. Permission is granted to download and print the materials on this web site for personal, non-commercial use only, and to display it on your personal computer provided you do not modify the materials and that you retain all copyright notices contained in the materials. By downloading content from our website, you accept the terms of this agreement.



Presentation on theme: "How do you Determine if a Test has Validity Reliability Fairness and Legal Defensibility ProfessionalfTestingfInct fPTIfxvv"— Presentation transcript:


Page 1
How do you Determine if a Test has Validity, Reliability, Fairness, and Legal Defensibility? ProfessionalfTestingfInct fPTIfxvv 1. Validity ValidityfisfarguablyfthefmostfimportantfcriteriafforfthefqualityfoffaftesttffTheftermfvalidity refersftofwhetherforfnotftheftestfmeasuresfwhatfitfclaimsftofmeasuretffOnfaftestfwithfhigh validityfthefitemsfwillfbefcloselyflinkedftoftheftestmsfintendedffocustffForfmanyfcertification andflicensureftestsfthisfmeansfthatfthefitemsfwillfbefhighlyfrelatedftofafspecificfjobfor

occupationtffIffaftestfhasfpoorfvalidityfthenfitfdoesfnotfmeasurefthefjobsrelatedfcontent andfcompetenciesfitfoughtftotffWhenfthisfisfthefcaserftherefisfnofjustificationfforfusingfthe testfresultsfforftheirfintendedfpurposetffTherefarefseveralfwaysftofestimatefthefvalidityfof aftestfincludingfcontentfvalidityrfconcurrentfvalidityrfandfpredictivefvaliditytffThefface validityfoffaftestfisfsometimesfalsofmentionedt 2. Reliability ReliabilityfisfonefoffthefmostfimportantfelementsfofftestfqualitytffItfhasftofdofwithfthe

consistencyrforfreproducibilityrforfanfexamineemsfperformancefonftheftesttffForfexamplerfif youfwereftofadministerfaftestfwithfhighfreliabilityftofanfexamineefonftwofoccasionsrfyou wouldfbefveryflikelyftofreachfthefsamefconclusionsfaboutfthefexamineemsfperformance bothftimestffAftestfwithfpoorfreliabilityrfonfthefotherfhandrfmightfresultfinfveryfdifferent scoresfforfthefexamineefacrossftheftwoftestfadministrationstffIffaftestfyieldsfinconsistent scoresrfitfmayfbefunethicalftoftakefanyfsubstantivefactionsfonfthefbasisfofftheftesttffThere

arefseveralfmethodsfforfcomputingftestfreliabilityfincludingftestsretestfreliabilityrfparallel formsfreliabilityrfdecisionfconsistencyrfinternalfconsistencyrfandfinterraterfreliabilitytffFor manyfcriterionsreferencedftestsfdecisionfconsistencyfisfoftenfanfappropriatefchoicet 3. Fairness TheffairnessfoffanfexamfrefersftofitsffreedomffromfanyfkindfoffbiastffThefexamfshouldfbe appropriatefforfallfqualifiedfexamineesfirrespectivefoffracerfreligionrfgenderrforfagetffThe testfshouldfnotfdisadvantagefanyfexamineerforfgroupfoffexamineesrfonfanyfbasisfother

thanfthefexamineemsflackfoffthefknowledgefandfskillsftheftestfisfintendedftofmeasuret Itemfwritersfshouldfaddressfthefgoalfofffairnessfasftheyfundertakeftheftaskfoffwriting itemstffInfadditionrfthefitemsfshouldfalsofbefreviewedfforfpotentialffairnessfproblems duringfthefitemfreviewfphasetffAnyfitemsfthatfarefidentifiedfasfdisplayingfpotentialfbiasfor lackfofffairnessfshouldfthenfbefrevisedforfdroppedffromffurtherfconsiderationt
Page 2
How do you Determine if a Test has Validity, Reliability, Fairness, and Legal Defensibility? ProfessionalfTestingfInct fPTIfxvv 4. Legal

Defensibility Forfanfexamfprogramftofhaveflegalfdefensibilityftherefmustfbefevidencefasftoftheftest’s qualityfthatfwouldfstandfupfinfafcourtfchallengetffYoufwillfneedftofbefableftofprovide evidencefthatfsoundrfprofessionallyfrecommendedfguidelinesfwereffollowedfthroughout thefdesignrfdevelopmentrfandfmaintenancefoffthefexamfprogramtffProfessionalfguidelines forftestingfarefofferedfbyfthefAmericanfPsychologicalfAssociationfnAPAorfAmerican Educationalf Researchf Associationf nAERAorf andf thef Nationalf Councilf onf Measurementf in

EducationfnNCMEotffStudiesfshouldfalsofbefconductedftofinvestigatefandfconfirmfthatfthe testfhasfreasonablefdegreesfoffvalidityrfreliabilityrfandffairnesstffAmongfthefmost importantfelementsfthatfcourtsflookfforfarefafwellsconductedfjobfanalysisfandfstrong contentfvalidityfnthatfisrfthefitemsfneedftofhavefafhighfdegreefoff“jobfrelatedness”ot Finallyrfgoodfdocumentationfoffthefdesignrfdevelopmentrfandfanalysisfoffthefexam programfshouldfbefcollectedfandfmaintainedt