Paul Jones Jennifer Davis and Maria Incrocci National Association of Boards of Pharmacy 150item SemiCAT North American Pharmacist Licensure Examination NAPLEX Adaptive ID: 694912
Download Presentation The PPT/PDF document "Re-Engineering the NAPLEX: From Semi-CAT..." is the property of its rightful owner. Permission is granted to download and print the materials on this web site for personal, non-commercial use only, and to display it on your personal computer provided you do not modify the materials and that you retain all copyright notices contained in the materials. By downloading content from our website, you accept the terms of this agreement.
Slide1
Re-Engineering the NAPLEX: From Semi-CAT to Pallet Assembly
Paul Jones, Jennifer Davis, and Maria Incrocci
National Association of Boards of Pharmacy
®Slide2
150-item
Semi-CAT
North American Pharmacist Licensure Examination
®
(NAPLEX
®
)
Adaptive:
stand-alone items
Random:
c
linical case scenariosSlide3
200-item
Pallet Assembly
NAPLEX
.
.
.
.
.
CPLEX
automated test assembly (ATA)Slide4Slide5
Design Milestones
LaunchSlide6
2011 Pallet Assembly Is Good for NAPLEX: Standard Error
Semi-CAT (computerized adaptive testing) NAPLEX 150
vs
PA NAPLEX 150Slide7
2011 Pallet Assembly Is Good for NAPLEX: Classification Accuracy
Semi-CAT NAPLEX 150
vs
PA NAPLEX 150
Semi-CAT NAPLEX 150
kappa = 0.782
PA NAPLEX 150
kappa = 0.805Slide8
2011 Pallet Assembly Is Good for NAPLEX: Item Exposure
PA NAPLEX 150
Semi-CAT NAPLEX 150Slide9
2011 Pallet Assembly Is Good for NAPLEX: Item Exposure
Highly Overused Items
PA NAPLEX 150
Semi-CAT NAPLEX 150Slide10Slide11
2014 Making the PA NAPLEX Longer
PA NAPLEX 200 “Deep”
PA NAPLEX 200 “Wide”Slide12
2014 Making the PA NAPLEX Longer
PA NAPLEX 200 “Deep”
kappa
= 0.819
PA NAPLEX 200 “Wide”
kappa
= 0.810
PA NAPLEX 200 “Deep”
PA NAPLEX 200 “Wide”Slide13
2014 Making the PA NAPLEX Longer
Standard Error of the Mean (SEM):
PA NAPLEX 200 “Wide”
vs NAPLEX Candidate DistributionSlide14
2015: Adjusting to ChangesSlide15
2015 Adjusting to a Change in Specs
Pre-2015 Semi-CAT NAPLEX 150
2015 Semi-CAT NAPLEX 150Slide16
2015 Adjusting to a Change in Specs
PA NAPLEX 200 Gold Standard
2015 Semi-CAT NAPLEX 150Slide17
2015 Adjusting to a Change in Specs
Item Use: PA NAPLEX 200 Gold Standard
Highly Overused ItemsSlide18
2015 Adjusting to a Change in Specs
Still better!
PA NAPLEX 200 New Standard
2015 Semi-CAT NAPLEX 150Slide19
2015 Adjusting to a Change in Specs
Highly Overused Items
PA NAPLEX 200 New Standard
PA NAPLEX 200 Gold StandardSlide20Slide21
2016 Deciding on a Final Configuration
Form Parallelism: PA NAPLEX New Standard v2, Forms = 100Slide22Slide23
Consider Alternative Assembly Objectives
Objective:
Minimize TIF-TCC tolerance
Item usage
controls
Constraint
Objective:
Maximize
S
(item availabilities)
TIF-TCC
tolerance
ConstraintSlide24
Credits
National Association of Boards of Pharmacy
Joy Matthews-López
Certification Management Services
Breakthrough TechnologiesPearson VUE IBM ILOGVector Psychometric GroupVan der Linden W.
Linear models for optimal test design. New York, NY: Springer; 2005