/
IDWWULWLRQRFFXUVDWYHUORZOHY IDWWULWLRQRFFXUVDWYHUORZOHY

IDWWULWLRQRFFXUVDWYHUORZOHY - PDF document

emma
emma . @emma
Follow
353 views
Uploaded On 2022-08-16

IDWWULWLRQRFFXUVDWYHUORZOHY - PPT Presentation

621614891 DVHOLQHHTXLYDOHQFHLVLPSRUWDQWIRULPSDFWVWXGLHVEHFDXVHWKRVHVWX ID: 937390

baseline study outcomes program study baseline program outcomes groups treatment equivalence individuals included comparison analysis group participated impact began

Share:

Link:

Embed:

Download Presentation from below link

Download Pdf The PPT/PDF document "IDWWULWLRQRFFXUVDWYHUORZOHY" is the property of its rightful owner. Permission is granted to download and print the materials on this web site for personal, non-commercial use only, and to display it on your personal computer provided you do not modify the materials and that you retain all copyright notices contained in the materials. By downloading content from our website, you accept the terms of this agreement.


Presentation Transcript

 6+2:,1*%$6(/,1((48,9$/(1&( ,IDWWULWLRQRFFXUVDWYHU\ORZOHYHOVDQGUHDVVLJQPHQWGRHVQRWKDSSHQLQDQ5&7UHVHDUFKHUVFDQPDLQWDLQEDVHOLQHHTXLYDOHQFH$MREWUDLQLQJSURJUDPUDQGRPO\DVVLJQVLQGLYLGXDOVWRDWUHDWPHQWJURXSWKDWUHFHLYHVWHFKQLFDOWUDLQLQJDQGVHUYLFHVGXULQJSURJUDPHQUROOPHQWDQGMREVHDUFKDQGSODFHPHQWVHUYLFHVDIWHUSURJUDPFRPSOHWLRQ,QGLYLGXDOVLQWKHFRPSDULVRQJURXSUHFHLYHRQO\MREVHDUFKDQGSODFHPHQWVHUYLFHV2YHUSHUFHQWRIWKHWUHDWPHQWDQGFRPSDULVRQJURXSPHPEHUVFRPSOHWHGDIROORZXSVXUYH\$OWKRXJKILYHSHUFHQWRIFRPSDULVRQJURXSPHPEHUVZHUHDFWXDOO\HQUROOHGLQWKHSURJUDPWKH\ZHUHDQDO\]HGDVEHLQJLQWKHFRPSDULVRQJURXS%RWKWKHORZOHYHOVRIDWWULWLRQDQGODFNRIUHDVVLJQPHQWPHDQVUHVHDUFKHUVFDQFRQFOXGHWKDWWKHJURXSVKDGEDVHOLQHHTXLYDOHQFH�7KH)XUWKHU5HDGLQJVSURYLGHGHWDLOVRQZKDWFRQVWLWXWHV³ORZ´@,IKRZHYHURYHUSHUFHQWRIWKHWUHDWPHQWDQGSHUFHQWRIWKHFRPSDULVRQJURXSGLGQRWFRPSOHWHDIROORZXSVXUYH\25SURJUDPFRXQVHORUVDOORZHGSHUFHQWRIWKHFRPSDULVRQJURXSWRHQUROOLQWKHSURJUDP25WKHZHDNHVWPHPEHUVRIWKHWUHDWPHQWJURXSVWURQJHVWPHPEHUVRIWKHFRPSDULVRQJURXSGLGQRWFRPSOHWHDVXUYH\UHVHDUFKHUVPLJKWQRWEHDEOHWRFRQFOXGHWKDWWKHJURXSVKDGEDVHOLQHHTXLYDOHQFH+RZWRHVWDEOLVKEDVHOLQHHTXLYDOHQFH %DVHOLQHHTXLYDOHQFHLVLPSRUWDQWIRULPSDFWVWXGLHVEHFDXVHWKRVHVWXGLHVDUHGHVLJQHGWRVD\ZKHWKHUDSURJUDPDFWXDOO\FDXVHGRXWFRPHVWRRFFXUZRW\SHVRILPSDFWVWXGLHV²UDQGRPL]HGFRQWUROOHGWULDOV 5&7V\fDQGTXDVLH[SHULPHQWDOGHVLJQV 4('V\f²FDQDVVHVVZKHWKHUDSURJUDPFDXVHGRXWFRPHVHVWXG\KDVEDVHOLQHHTXLYDOHQFHEHWZHHQWUHDWPHQWDQGFRPSDULVRQJURXSV%DVHOLQHHTXLYDOHQFHLVREWDLQHGLQGLIIHUHQWZD\VGHSHQGLQJRQZKHWKHUWKHVWXG\LVDQ5&7RU4(')RUD5&7VWXG\SDUWLFLSDQWVDUHUDQGRPO\DVVLJQHGWRHLWKHUDWUHDWPHQWJURXSWKDWUHFHLYHVWKHSURJUDPVHUYLFHVRUWRFRPSDULVRQJURXSWKDWGRHVQRW:KHQUDQGRPDVVLJQPHQWLVGRQHFRUUHFWO\WKHVHWZRJURXSVOLNHO\KDYHQRGLIIHUHQFHVRQHLWKHUREVHUYHGRUXQREVHUYHG WKDWLVXQPHDVXUHG\fFKDUDFWHULVWLFVZKLFKDOORZVWKHVWXG\WRH[DPLQHWKHRQO\GLIIHUHQFHEHWZHHQWKHPWKHSURJUDP6WLOOUHVHDUFKHUVPXVWEHDZDUHRIFKDOOHQJHVWKDWFDQDULVHDIWHUUDQGRPDVVLJQPHQWDQGFDQDIIHFWZKHWKHUWKHVWXG\JURXSVUHPDLQVLPLODUWRHDFKRWKHU GLVFXVVHGLQWKHQH[WVHFWLRQ\f4('%HFDXVHVWXG\SDUWLFLSDQWVDUHQRWUDQGRPO\DVVLJQHGLQD4('WKHWUHDWPHQWDQGFRPSDULVRQJURXSVPLJKWQRWEHWKHVDPHDWWKHVWDUWRIWKHVWXG\HVHDUFKHUVPXVWWKHUHIRUHGHYHORSPHWKRGVWRVHOHFWDFRPSDULVRQJURXSWKDWLVDVVLPLODUWRWKHWUHDWPHQWJURXSDVSRVVLEOHDQGWKHQVKRZWKDWWKHWZRJURXSVDUHVLPLODU:KDWKDSSHQVZKHQVWXG\SDUWLFLSDQWVGRQ·WVWD\SXWDIWHUUDQGRPDVVLJQPHQW" 5DQGRPDVVLJQPHQWJHQHUDOO\UHVXOWVLQEDVHOLQHHTXLYDOHQFHEHWZHHQWKHWUHDWPHQWDQGFRPSDULVRQJURXSVKRZHYHUSUREOHPVFDQDULVHWKDWFRXOGFRPSURPLVHWKDWHTXLYDOHQFH7ZRSDUWLFXODUO\WURXEOLQJFKDOOHQJHVDUH$WWULWLRQRUORVLQJSHRSOHIURPWKHVWXG\$WWULWLRQFDQSURGXFHVWXG\JURXSVWKDWDUHQRORQJHUVLPLODUHYHQLIWKH\ZHUHVLPLODUEHIRUHWKHVWXG\EHJDQ)RUH[DPSOHLIDVWXG\UDQGRPO\DVVLJQHGLQGLYLGXDOVLQWRWUHDWPHQWDQGFRPSDULVRQJURXSVEXWDODUJHSURSRUWLRQRILQGLYLGXDOVLQWKHFRPSDULVRQJURXSFRXOGQRWEHORFDWHGIRUIROORZXSVXUYH\LQJGLIIHUHQFHVLQRXWFRPHVEHWZHHQWKHJURXSVPLJKWUHIOHFWWKHIDFWWKDWLQGLYLGXDOVLQWKHFRPSDULVRQJURXSZKRUHVSRQGHGWRWKHVXUYH\DUHQRWVLPLODUWRWKRVHLQWKHWUHDWPHQWJURXSZKRUHVSRQGHGWRWKHVXUYH\%HFDXVHGLIIHUHQWIRFXVDUHDVLQ&1&6KDYHGLIIHUHQWVWDQGDUGVIRUZKDWFRQVWLWXWHVDQDFFHSWDEOHOHYHORIDWWULWLRQSUDFWLWLRQHUVVKRXOGZRUNZLWKWKHLUHYDOXDWLRQSDUWQHUVWRXQGHUVWDQGWKHOHYHOWKDWLVDFFHSWDEOHLQWKHLUDUHD5HDVVLJQPHQWRUVZLWFKLQJVWXG\SDUWLFLSDQWVIURPWKHFR

PSDULVRQJURXSWRWKHWUHDWPHQWJURXS RUYLFHYHUVD\f5HDVVLJQPHQWXQGHUPLQHVEDVHOLQHHTXLYDOHQFHEHFDXVHVWXG\SDUWLFLSDQWVDUHXVXDOO\UHDVVLJQHGIRUDUHDVRQWKDWLVOLNHO\UHODWHGWRRXWFRPHV)RUH[DPSOHLIKLJKO\PRWLYDWHGVWXGHQWVZKRZHUHDVVLJQHGWRWKHFRPSDULVRQDVNVFKRROFRXQVHORUVWRJHWLQWRDSURJUDPDQGWKHFRXQVHORUPRYHVWKHPLQWRWKHWUHDWPHQWJURXSWKHFRPSDULVRQJURXSLVOLNHO\OHIWZLWKDKLJKHUSHUFHQWDJHRIXQPRWLYDWHGLQGLYLGXDOVWKDQWKHWUHDWPHQWJURXS,IDWWULWLRQRUUHDVVLJQPHQWRFFXUVGXULQJDQ5&7LWFRXOGMHRSDUGL]HEDVHOLQHHTXLYDOHQFHDQGUHPRYHFRQILGHQFHWKDWGLIIHUHQFHVLQRXWFRPHVEHWZHHQWKHVWXG\JURXSVZHUHFDXVHGE\WKHSURJUDP7RPLWLJDWHWKHVHFRQFHUQVUHVHDUFKHUVVKRXOG \fUHSRUWWKHH[WHQWRIDWWULWLRQWKDWRFFXUUHGDQGGHPRQVWUDWHWKDWWKH\ZHUHZLWKLQDFFHSWDEOHOHYHOVDQG \fDQDO\]HVWXG\JURXSSDUWLFLSDQWVDFFRUGLQJWRWKHLURULJLQDOJURXSDVVLJQPHQW IRUH[DPSOHDQDO\]LQJWKH³VZLWFKHG´VWXGHQWVDVEHLQJLQWKHFRPSDULVRQJURXSHYHQLIWKH\UHFHLYHGWKHSURJUDP\f  :KDWKDSSHQVZKHQUDQGRPDVVLJQPHQWLVQRWSRVVLEOH" 5DQGRPDVVLJQPHQWLVQRWDOZD\VIHDVLEOHDQGD4('WKDWVKRZVVLPLODULW\EHWZHHQWKHWUHDWPHQWDQGFRPSDULVRQJURXSVRQDYDULHW\RIFKDUDFWHULVWLFVPLJKWEHWKHVWURQJHVWGHVLJQSRVVLEOH,QVWXGLHVXVLQJD4('UHVHDUFKHUVPXVWILQGDQRWKHUZD\WRFRQVWUXFWWKHVWXG\JURXSVDQGGHPRQVWUDWHWKDWWKHWZRJURXSVDUHVLPLODUEHIRUHWKHVWXG\EHJLQV7\SLFDOO\UHVHDUFKHUVORRNIRUVLPLODULWLHVLQGHPRJUDSKLFVRFLRHFRQRPLFDQGVRFLRSV\FKRORJLFDOFKDUDFWHULVWLFVDQGPHDVXUHVRIRXWFRPHVFDSWXUHGEHIRUHWKHVWXG\EHJDQ VXFKDVWHVWVFRUHVHPSOR\PHQWERG\PDVVLQGH[\f%XWHYHQZKHQVLPLODULW\RQWKHVHREVHUYHGFKDUDFWHULVWLFVFDQEHVKRZQZLWKRXWUDQGRPDVVLJQPHQWWKHJURXSVPLJKWQRWEHVLPLODURQXQREVHUYHGFKDUDFWHULVWLFVVXFKDVPRWLYDWLRQRUDWWLWXGHV)RUWKLVUHDVRQZHKDYHDOLWWOHOHVVFRQILGHQFHWKDQDQ5&7WKDW4('VGHPRQVWUDWHFDXVDOLW\RIIHUWKUHHPHWKRGVWKDWPLJKWEHXVHGWRFUHDWHFRPSDULVRQJURXSVLQ4('VWXGLHV LQJVXUYH\RUDGPLQLVWUDWLYHGDWD5HVHDUFKHUVFDQXVHVXUYH\RUDGPLQLVWUDWLYHGDWD²GDWDWKDWLVXVHGIRUUHFRUGNHHSLQJE\JRYHUQPHQWDQGRWKHUDJHQFLHVWRFRQVWUXFWDFRPSDULVRQJURXSWKDWLVVLPLODUWRWKHWUHDWPHQWJURXS)RUH[DPSOHUHVHDUFKHUVPLJKWEHDEOHWRDGPLQLVWHUDVXUYH\WRDOODSSOLFDQWVWRDZHLJKWORVVSURJUDPRQO\VRPHRIZKRPZLOOEHVHOHFWHGIRUSURJUDPSDUWLFLSDWLRQ,QDQRWKHUH[DPSOHVFKRROPLJKWXVHWKHLUDGPLQLVWUDWLYHUHFRUGVRIVWXGHQWVZKRSDUWLFLSDWHGLQDQDIWHUVFKRROUHDGLQJSURJUDPDQGWKRVHWKDWGLGQRWHVHDUFKHUVFDQXVHVXFKGDWDDQGSURSHQVLW\VFRUHPDWFKLQJ VHHVLGHEDU\fIRUPWUHDWPHQWJURXSIURPLQGLYLGXDOVZKRHQUROOHGLQWKHSURJUDPDQGDFRPSDULVRQJURXSIURPLQGLYLGXDOVZKRGLGQRW3URSHQVLW\VFRUHPDWFKLQJKHOSVLGHQWLI\SURJUDPSDUWLFLSDQWVDQGQRQSDUWLFLSDQWVZKRDUHPRVWVLPLODUWRIRUPWKHWUHDWPHQWDQGFRPSDULVRQJURXSV2IQRWHGDWDFKDUDFWHULVWLFV VXFKDVGHPRJUDSKLFRUVRFLRHFRQRPLFFKDUDFWHULVWLFVNQRZOHGJHRUEHOLHIVRURSLQLRQV\fFDQEHXVHGWRVKRZEDVHOLQHHTXLYDOHQFHEHWZHHQWKHJURXSV/LPLWDWLRQ$OWKRXJKWHFKQLTXHVOLNHSURSHQVLW\VFRUHPDWFKLQJDUHRIWHQYLHZHGDVULJRURXVDOWHUQDWLYHVWRUDQGRPDVVLJQPHQWWKLVPHWKRGUHTXLUHVVRSKLVWLFDWHGVWDWLVWLFDONQRZOHGJHDQGDSSURSULDWHGDWD 3523(16,76&25(0$7&+,1* 3URSHQVLW\VFRUHPDWFKLQJLVIUHTXHQWO\XVHGWRFUHDWHFRPSDULVRQJURXSZKHQUDQGRPDVVLJQPHQWFDQQRWXVHG7KLVWHFKQLTXHLVLQWHQGHGWRPLPLFUDQGRPDVVLJQPHQWE\FUHDWLQJVWXG\JURXSVWKDWDUHVLPLODUEDVHGRQWKHLUFKDUDFWHULVWLFVWKDWFDQEHFDSWXUHGLQWKHGDWDVRXUFH$SURSHQVLW\VFRUHUHIOHFWVWKHSUREDELOLW\WKDWDSHUVRQZLWKDJLYHQVHWRIFKDUDFWHULVWLFV WKDWDUHFDSWXUHGLQWKHGDWDVHW\fZLOOHQUROOLQWKHSURJUDP7KHVFRUHGHYHORSHGIURPWKLVSUREDELOLW\FDQEHXVHGWRVHOHFWDPDWF

KHGJURXSRILQGLYLGXDOVZKRDUHHQUROOHGLQWKHSURJUDP WUHDWPHQWJURXS\fDQGLQGLYLGXDOVZKRDUHQRW FRPSDULVRQJURXS\fDQGWREDODQFHWKHREVHUYHGFKDUDFWHULVWLFVRISDUWLFLSDQWVEHWZHHQWKHWZRJURXSV 8VLQJDFXWRIIVFRUH6RPHWLPHVWHVWVFRUHVDUHXVHGIRUDGPLWWLQJLQGLYLGXDOVLQWRDSURJUDP)RUH[DPSOHDSSOLFDQWVPLJKWKDYHWRVFRUHSHUFHQWRQDWHVWWREHDGPLWWHGWRDSURJUDPQGLYLGXDOVZKRVFRUHFORVHWRWKHFXWRIIVFRUHDUHOLNHO\WREHVLPLODULQHYHU\ZD\H[FHSWSURJUDPDGPLVVLRQWKHOLNHO\GLIIHUHQFHLVWKDWWKHJURXSVFRULQJVOLJKWO\DERYHWKHFXWRIIVFRUHJXHVVHGFRUUHFWO\RQDFRXSOHPRUHTXHVWLRQVWKDQWKHJURXSWKDWVFRUHGVOLJKWO\EHORZLW*LYHQWKLVVLPLODULW\WKHJURXSWKDWVFRUHGMXVWDERYHWKHFXWRIIVFRUHFDQIRUPWKHWUHDWPHQWJURXSDQGWKHJURXSWKDWVFRUHGMXVWEHORZWKHFXWRIIFDQEHWKHFRPSDULVRQ/LPLWDWLRQ5HVHDUFKHUVQHHGDYHU\ODUJHJURXSRIDSSOLFDQWVWRKDYHHQRXJKLQGLYLGXDOVLQWKHWUHDWPHQWDQGFRPSDULVRQJURXSV &KRRVLQJSHRSOHLQVLPLODUFRQWH[WV5HVHDUFKHUVDQXVHGLIIHUHQWHQYLURQPHQWVWRVHOHFWFRPSDULVRQJURXSPHPEHUV)RUH[DPSOHUHVHDUFKHUVPLJKWFRPSDUHDFDGHPLFDFKLHYHPHQWIRUVWXGHQWVHQUROOHGLQDQDIWHUVFKRROUHDGLQJSURJUDPZLWKVWXGHQWVLQVLPLODUGLVWULFWVWKDWGRQRWRIIHUWKHSURJUDPRUZLWKVWXGHQWVHQUROOHGLQWKHGLVWULFW LQWKHVDPHJUDGH\fGXULQJWKH\HDUEHIRUHWKHSURJUDPEHJDQ$OWHUQDWLYHO\UHVHDUFKHUVPLJKWXVHSUHH[LVWLQJGDWDWRGHYHORSDFRPSDULVRQJURXS)RUH[DPSOHRXWFRPHVRILQGLYLGXDOVLQDQXWULWLRQSURJUDPIRUORZLQFRPHPRWKHUVPLJKWEHFRPSDUHGWRLQGLYLGXDOVLQWKH&XUUHQW3RSXODWLRQ6XUYH\RU  DGPLQLVWUDWLYHGDWDIURPDSURJUDPOLNH:RPHQ,QIDQWVDQG&KLOGUHQ5HVHDUFKHUVPXVWXVHVRPHW\SHRIPDWFKLQJWHFKQLTXHWRHVWDEOLVKWKDWWKHJURXSVKDGVLPLODUFKDUDFWHULVWLFVDQGLQIOXHQFHVRQEHKDYLRUV IRUH[DPSOHVFKRROFRQGLWLRQVRURWKHUHQYLURQPHQWDOIDFWRUV\f/LPLWDWLRQ,WLVRIWHQGLIILFXOWIRUUHVHDUFKHUVWRHVWDEOLVKWKDWWKHRQO\GLIIHUHQFHEHWZHHQWKHWUHDWPHQWDQGFRPSDULVRQJURXSLVWKHSURJUDPJLYHQWKHSOHWKRUDRIHQYLURQPHQWDODQGFRQWH[WXDOIDFWRUVWKDWOLNHO\H[LVWEHWZHHQWKHJURXSV+DYLQJLQGLYLGXDOVZKRFKRRVHWRSDUWLFLSDWHLQDSURJUDPIRUPWKHWUHDWPHQWJURXSDQGWKRVHZKRFKRVHQRWWRSDUWLFLSDWHIRUPWKHFRPSDULVRQJURXSLVJHQHUDOO\FRQVLGHUHGWREHDQH[WUHPHO\ZHDNGHVLJQ7KHFKDUDFWHULVWLFVWKDWOHDGLQGLYLGXDOVWRFKRRVHWRSDUWLFLSDWHPDNHVWKHPGLIIHUHQW2IWHQWKRVHZKRFKRVHWRSDUWLFLSDWHLQDSURJUDPDUHPRUHPRWLYDWHGKDYHIHZHUEDUULHUVWRSDUWLFLSDWLRQRUH[KLELWPRUHJULWDQGSHUVLVWHQFHWKDQWKRVHZKRFKRVHQRWWRSDUWLFLSDWH5HVHDUFKHUVXVLQJVXFKDGHVLJQPXVWGHPRQVWUDWHEDVHOLQHHTXLYDOHQFHEHWZHHQWKHJURXSVDQGUHFRJQL]HWKDWVRPHRIWKHXQREVHUYDEOHFKDUDFWHULVWLFGLIIHUHQFHVEHWZHHQWKHJURXSVPLJKWEHFUHDWLQJHVWLPDWHGLPSDFWV:KLFKGHVLJQGR,FKRRVH" :KLFKGHVLJQLVEHVW"5DQGRPDVVLJQPHQWLVWKHJROGVWDQGDUGIRUDFKLHYLQJEDVHOLQHHTXLYDOHQFH²LIORZOHYHOVRIDWWULWLRQDQGQRUHDVVLJQPHQWFDQEHDWWDLQHG+RZHYHUHDOZRUOGFRQVLGHUDWLRQVRIWHQUHTXLUHUHVHDUFKHUVWRFRQGXFWD4('DQGWKHVHGHVLJQVUHTXLUHFRQVLGHUDEOHIRUHWKRXJKWWRHVWDEOLVKWKHEDVHOLQHHTXLYDOHQFH7KHEHVW4('VWXG\XVHVWHFKQLTXHVVXFKDVSURSHQVLW\VFRUHPDWFKLQJRUDFXWRIIVFRUHWRGHYHORSDFRPSDULVRQJURXSWKDWLVVLPLODUWRWKHWUHDWPHQWJURXS6WLOOERWK5&7DQG4('VWXGLHVPXVWVKRZWKDWPHPEHUVRIWKHWUHDWPHQWDQGFRPSDULVRQJURXSIRUZKRPRXWFRPHVDUHFRPSDUHGDUHVLPLODUZLWKUHVSHFWWRWKHLUFKDUDFWHULVWLFVEHIRUHWKHVWXG\EHJDQ)XUWKHUHDGLQJ +RPH9LVLWLQJ(YLGHQFHRI(IIHFWLYHQHVV5HYLHZ2Q(TXDO)RRWLQJ7KH,PSRUWDQFHRI %DVHOLQH(TXLYDOHQFHLQ0HDVXULQJ3URJUDP(IIHFWLYHQHVV KWWSVKRPYHHDFIKKVJRY+RP9((BEULHIBSGI :KDW:RUNV&OHDULQJKRXVH5HYLHZ::&6WDQGDUGV%ULHI%DVHOLQH(TXLYDOHQFH KWWSVLHVHGJRYQFHHZZF'R

FVUHIHUHQFHUHVRXUFHVZZFBEULHIBEDVHOLQHBSGI %DVHOLQH(TXLYDOHQFH0RGXOH KWWSVLHVHGJRYQFHHZZF'RFV2QOLQH7UDLQLQJZZFBWUDLQLQJBPSGI\f  $ERXWWKH6HULHV 7KH&RUSRUDWLRQIRU1DWLRQDODQG&RPPXQLW\6HUYLFH &1&6\fVXSSRUWVWKHVFDOLQJRIHIIHFWLYHLQWHUYHQWLRQVWKDWLWIXQGVDQGKDVHQJDJHG0DWKHPDWLFD3ROLF\5HVHDUFKWRFRQGXFWWKH6FDOLQJ(YLGHQFH%DVHG0RGHOVSURMHFW FRQWUDFW*6)/&16+4)\f$VSDUWRIWKDWSURMHFW0DWKHPDWLFDGHYHORSHGDVHULHVRIJXLGHVWRKHOSSUDFWLWLRQHUVFROOHFWHYLGHQFHRQWKHLULQWHUYHQWLRQV¶HIIHFWLYHQHVVDQGLQFUHDVHWKHOLNHOLKRRGRIVXFFHVVIXOO\VFDOLQJWKRVHLQWHUYHQWLRQV(DFKJXLGHSURYLGHVDVXFFLQFWRYHUYLHZRIDWRSLFWKDWFDQKHOSSUDFWLWLRQHUV7KHJXLGHVDUHEDVHGRQUHVHDUFKDQGSUDFWLWLRQHUV¶H[SHULHQFHVEXWWKH\GRQRWSURYLGHH[KDXVWLYHUHYLHZVRIDWRSLF0RUHLQSWKDUWLFOHVFDQEHIRXQGLQWKH)XUWKHU5HDGLQJVHFWLRQ .(32,176$%287%$6(/,1((48,9$/(1&( %DVHOLQHHTXLYDOHQFHPXVWH[LVWWRDFFXUDWHO\HVWLPDWHSURJUDPLPSDFWV :KHQVWXGLHVXVHUDQGRPDVVLJQPHQWWRIRUPWUHDWPHQWDQGFRPSDULVRQJURXSVDQGWKHUHDUHORZOHYHOVRIDWWULWLRQDQGQRUHDVVLJQPHQWUHVHDUFKHUVFDQEHFRQILGHQWRIEDVHOLQHHTXLYDOHQFH (QVXULQJEDVHOLQHHTXLYDOHQFHEHIRUHDVWXG\EHJLQVLVQRWHQRXJK7KHUHVHDUFKHUVPXVWVKRZWKDWWKHLQGLYLGXDOVLQWKHWUHDWPHQWDQGFRPSDULVRQJURXSVDWWKHHQGRIWKHVWXG\ZHUHVLPLODUEHIRUHWKHVWXG\EHJDQ 6KRZLQJHTXLYDOHQFHRQO\IRUFKDUDFWHULVWLFVWKDWZHFDQPHDVXUHVXFKDVDJHHGXFDWLRQUDFHHWKQLFLW\DQGJHQGHURUDVFRUHRQDSUHWHVWGRHVQRWHQVXUHEDVHOLQHHTXLYDOHQFHEHFDXVHFKDUDFWHULVWLFVWKDWZHFDQQRWPHDVXUHVXFKDVYDOXHVPRWLYDWLRQVDQGDWWLWXGHVFDQDIIHFWDSHUVRQ¶VRXWFRPHV5DQGRPDVVLJQPHQWKHOSVHVWDEOLVKWKLVHTXLYDOHQFH ATHEMATICAMPR.COMPRINCETON, NJANN ARBOR MI – CAMBRIDGE, MA CHICAGO, IL – OAKLAND, CA- SEATTLE, WATUCSON, AZ – WASHINGTON, DC – WOODLAWN CNCS Research GuidanceSEPTEMBER 2018 Baseline Equivalence: What it is and Why it is Needed Mary Anne Anderson and Nan MaxwellLearn how determine if an impact study is likely to produce meaningful results f individuals who participated ina program have better outcomes than thosewho did notcan program managers say their program improves outcomes? –Only if the study has baseline equivalenceWhena study has baseline equivalencemembers ofthe treatment group (those who participated in the program) are, on average, the same as members of the comparison group (those who did not participate) before the study began. The only observdifference between the two groupsis that the treatment group participated in the program. All otherobservcharacteristics—those that can be measured (such as age, race/ethnicity, and education)—are the same. esearchers want these two groups to be the same so they can say that the program—and not some other factorcauseddifferences in outcomes between the groups. If the groups were different before the study beg, those differences, and not the program, may have impacted outcomes. Importantly, baseline equivalence must be established for the groups for whom outcomes are compared. Some individuals that were part of the treatment or comparison groups when the study began might not be included in the analysis because, for example, they dropped out of the study. If these individuals are not included in the analysis that compares outcomes between the treatment and comparison groups, they should not be included in analysis that shows baseline equivalence. This guide is designed to help practitioners andresearcherswork together to design an impact study with baseline equivalenceor as close to it as possibleWhen funders and other stakeholders are deciding what programs to fund and scale, it’s important that they see evidence of baseline equivalence to have confidence in the program’s effectiveness. MATHEMATICAMPR.COMPRINCETON, NJANN ARBOR MI – CAMBRIDGE, MA CHICAGO, IL – OAKLAND, CA- SEATTLE, WATUCSON, AZ – WASHINGTON, DC – WOODLAWN SEPTEMBER 2018 Baseline Equivalence: What it is and Why it is Needed Mary Anne Anderson and Nan MaxwellLearn how determine if an impact study is likely to produce meaningful results If individuals who articipated ina program have better outcomes than thosewho did notcan program managers say their program improves outcomes? –Only if the study has baseline equivalenceWhena study has baseline equivalencemembers ofthe treatment group (those who participated in the program) are, on average, the same as members of the comparison group (those who did not participate) before the study began. The only observdifference between the two groupsis that the treatment group participated in the program. All otherobservcharacteristics—those that can be measured (such as age, race/ethnicity, and education)—are the same. esearchers want these two groups to be the same so they can say that the program—and not some other factorcauseddifferences in outcomes between the groups. If the groups were different before the study beg, those differences, and not the program, may have impacted outcomes. Importantly, baseline equivalence must be established for the groups for whom outcomes are compared. Some individuals that were part of the treatment or comparison groups when the study began might not be included in the analysis because, for example, they dropped out of the study. If these individuals are not included in the analysis that compares outcomes between the treatment and comparison groups, they should not be included in analysis that shows baseline equivalence. This guide is designed to help practitioners andresearcherswork together to design an impact study with baseline equivalenceor as close to it as possibleWhen funders and other stakeholders are deciding what programs to fund and scale, it’s important that they see evidence of baseline equivalence to have confidence in the program’s effectivene

Related Contents


Next Show more