Assessment Operations May 4, 2017 - PowerPoint Presentation

Slide1

Assessment Operations

May 4, 2017

Critical Shipping Information

Receipt & ReturnAlternate ELPA Test Materials

The information in this slide deck may be augmented with special consideration appropriate for your district and school.

Spring 2017Slide2

Acronyms

Assessment SupportSystems

Manuals and Guides

User Role

OSPI: Office of Superintendent of Public InstructionMI: Measurement Inc.

AIR: American Institutes for Research

TIDE:

Test Information Distribution Engine

TDS: Test Delivery SystemORS: Online Reporting SystemDEI: Data Entry InterfaceWCAP Portal: Washington Comprehensive Assessment Program PortalDEI: Data Entry Interface (Module and User Guide)TAM: Test Administration Manual ELPA21 DFA: Directions for Administration (Writing Supplement)GTSA: Guidelines on Tools, Supports, and AccommodationsDC: District Test CoordinatorDA: District AdministratorSC: School Test CoordinatorTA: Test Administrator

Office Of Superintendent Of Public InstructionSlide3

Spring 2017 Alternate ELPA21 Assessment

ELPA21for ELs with significant cognitive challenges

Spring

2017

Grade

Content

Requirement

/ Availability

Testing Window K-12Listening, Reading, Writing, SpeakingRequired for federal and state accountability for EL students who qualify for the State Transitional Bilingual Program.Online: April 12 – May 26

Important dates are updated frequently and are available within the Key Dates Excel Calendar on the WCAP Portal.Slide4

Alternate ELPA21 AssessmentDescription

Key DatesTest Booklet (paper-pencil) arrived in district April 10ELPA21 Window 2April 12–May 26

Additional paper test materials orders closesApril 15

Scores reported in ORS (Window 1) *May 15Scores reported in WAMS EOD (Window 1) *

May 19Hard copy reports (ISRs) delivered to districts (Window 1) *May 30-31Scores reported in ORS (Window 2) *August 17

Scores reported in WAMS EOD (Window 2) *August 23 (Tentative)

Hard copy reports (ISRs) delivered to districts (Window 2) *

September 1-5

* Scores will be reported separately for students who test in Window 1 and Window 2Slide5

Test Material Receipt and TrackingThe alternate ELPA21 test materials arrived in district by April 10. Contents

included in white District Box 1:Box List District Packing List District Security Checklist School Packing List Summary (clear plastic bag)Return KitThe District Packing List and the S

chool Packing List(s) should be used to assist in tracking materials to and from schools. Follow your Test

Security and Building Plan procedures for tracking and storage of secure test materials. Do not open shrink-wrapped packages that are not intended for immediate use.Slide6

Test Material OverviewAlternate ELPA21 Assessment MaterialsSecure Materials:

Online Assessments: Grades K, 1, 2-3, 4-5, 6-8, and 9-12Paper Test Booklets—Standard Print Grades K, 1, 2-3, 4-5, 6-8, and 9-12 Paper Writing Supplement: Grades K & 1Audio Listening CDsDirections for Administration (DFA) for K- 1 writing supplement & large printNon-Secure Materials: Test Administration Manual (TAM)

*Data Entry Interface User Guide*Technology Skills Checklist*

Test Administration Time Chart*Scratch Paper Log*User Guides: TIDE, ORS* Guidelines on Tools, Supports, and Accommodations

*Tool Button Sheet** Materials with an asterisk are available on the WCAP portal ELPA21 User CardSlide7

Braille and Large

Print Accommodated Test Kits

Large Print

and Braille Accommodated KitsA cover sheet

Instructions

Regular test booklet

Large-print or Braille test bookletDirections for entering student responses for the speaking domainDFAApply: A Student Pre-ID LabelTest Administrators (TAs) will enter student data from the paper/pencil and Braille versions of the test into the DEI system. It is required that all student responses will be entered into the DEI for all items on the test, except for writing constructed response items. Test booklets are secure and will be returned to the vendor within 5 days after testing has completed.The student demographic information on the front cover of the ELPA21 test booklets do not need to be bubbled in, just affix a student pre-ID label in the box as shown in the graphic to the left.Slide8

What is Required to be Entered into TDSOSPI’s goal is to maximize the use of the existing online TDS or the DEI.  

The online test in TDS is different from the paper-pencil standard test booklet and contains different items. Students testing online must view and respond to the items on the online test for all items except for the required Kindergarten and Grade 1 writing supplement, so that these responses to the online test are sent to scoring. The student will generate responses within the online Test Delivery System (TDS) platform (with or without some level of TA assistance) for all items except the required Kindergarten and Grade 1 writing component (issued as a separate test booklet) that will be returned to MI for scoring. If necessary, the TA will enter the student’s responses into the online TDS platform for students responding to questions using the online test format.Slide9

What is Required to be Entered into the DEIThe DEI is required for use for students responding to the paper-pencil form.  When

a student tests using the standard paper-pencil format, it is required that their responses be entered by the TA into the DEI for all items on the test except for writing constructed response items and the required Kindergarten and Grade 1 writing supplement. TAs are required to enter student responses from standard test booklets into the Large Print DEI portion. An example of the DEI title is ‘ELPA21 Grade K Listening Large Print Paper Student Response Entry.’

 Students testing using Braille test booklets are

required to have all of their responses entered into the Braille DEI. An example of the Braille DEI is ‘ELPA21 Grade 1 Listening Braille Paper Student Response Entry.’Slide10

Entering Student Responses for the Speaking DomainFor the Speaking portion of the paper test, the TA must sign into the DEI for the Speaking section and the student will then record his/her responses using the microphone. The directions on how to do this

is in the DFA for the Alternate assessment that was included in your shipment.The process for transcriptions, conducted by familiar listeners on the Speaking portion of the ELPA21 Speaking domain for students with significant cognitive challenges, will be as follows:Districts contact OSPI with the student’s SSIDs via the non-standard accommodation/designated support request.OSPI will provide the district with a template for transcription and AIR with the SSID for the student approved to have their speaking assessment pulled for scoring with a transcription.The student will assess while a familiar listener scribes the student’s responses.  The student will speak into the speaking portion of the assessment and a familiar listener will.

Scribe what a student says onto a separate document to accompany the speaking assessment to the scoring floor (so the student’s score is not impacted by their articulation issues).Districts will contact the WA Help Desk once a student has completed the speaking portion of the assessment (within 24 hours) to provide them with the Results ID and SSID of the student. 

AIR will verify the SSID is on the list of allowed cases, pull/hold the assessment until the transcription is received. Districts will mail the transcription to MI immediately.MI will combine the transcription and the speaking assessment for scoring.Slide11

Handling Defective/Damaged BookletsAfter testing identify any damaged or biohazard

materials School/District Test Coordinators will:Document test booklet security barcode on the roster. Provide TA with the new booklet.If transcribed, verify completeness of transcription.The new test booklet with transcription of student work is returned with scorable materials.Damaged

booklets are returned with non-scorable materials.B

iohazard materials do not get returned to MI.Reported biohazard/ soiled booklets

must be recorded on the Test Material Variance Form and must securely destroyed according to state and district policies.

Damaged bookletSlide12

Preparing Test Materials for Return

TA role in return process:

Prior to excusing students who have completed testing, account for all materials and clear all calculator memories.

Promptly return all tests and ancillary materials to the SC.

DC role in the return process:Verify all materials have been accounted for, if any materials are missing, investigate then report using the Test Material Variance Form, a Testing Incident Report and note on your District Administration and Security Report.ELPA21 materials do not have a prescheduled pick-up date. District Test Coordinators

must contact FedEx to arrange for pickup of test materials.Materials must be returned no later than five business days after testing is complete.

SC role in the return process:

Use the chain of custody process (for material receipt, storage, and return of school testing materials to DC) outlined in your building plan, to ensure all materials have been collected and accounted for at the end of testing.

Verify placement of student pre-ID labels and process ancillary papers.Slide13

Sorting Test Materials

Separate ancillary papers, scorable, and non-scorable materials.Organize scorable test booklets by grade.Pack all

secure test materials securely in boxes. Affix a green scorable label to the top of all boxes containing scorable secure materials. Record the number of each scorable box and the total number of scorable boxes on the labels (1 of __, 2 of __, etc

.).The following materials MUST BE returned to Measurement Inc.:

All scorable and non-scorable ELPA21 test bookletsKindergarten and Grade 1 Writing SupplementsDFAsAudio Listening CDs

Sorting Test Materials for Return Shipment

Note:

Ancillary materials must be removed from test booklets. Any ancillary materials with student identifying information or student work must be securely destroyed.Slide14

Return Shipping Kit

Within your District Box 1, locate the return kit in the clear plastic bag. The contents in your return kit include:Return Material Instructions

FedEx return shipping labelsGreen Scorable labelsRed Non-scorable

labelsSlide15

Do Not Score Label PlacementIf you have exhausted your supply of DO NOT SCORE labels, promptly order additional labels.

Non-

scorable test booklets

Additional DO NOT SCORE labels can be ordered through the MI Help DeskMeasurement Incorporated: Tel 1. 866.762.1056 or

MIHelp@measinc.comCorrect

IncorrectSlide16

Packaging Test Materials for Return ShipmentPackaging Test MaterialsSeparate and remove all ancillary papers and securely destroy.

Separate scorable from non-scorable materials.Organize scorable test booklets by content and grade.Pack all scorable test/answer booklets securely in boxes they arrived in and affix a green scorable label to the tops of all scorable boxes.Record the number of each

scorable box and the total number of scorable boxes on the labels (1 of __, 2 of __, etc.). To ease tracking in case of missing materials document the ranges of serial numbers in each box of return materials.

Package all non-scorable testing materials securely in sturdy boxes and affix a red non-scorable label to the tops of all non-scorable boxes.

The following materials are secure and must be returned to MI immediately after testing concludes:test/answer booklets accommodated forms DFAs Audio Listening CDsNo materials should be retained for future administrationsSlide17

Preparing Boxes for Return Materials

Be sure to return materials in the boxes that the test materials arrived in, if you need additional boxes be sure that they are of equal or greater strength.

Copier paper boxes and boxes used for food transportation should not be used for return of test materials.

Use cushioning materials, if needed, to keep materials secure.Use only Spring 2017 Return Shipping Labels.Spring 2017 Return Shipping Labels do not have a tab to tear off like the labels that were used in past administrations. Be sure to write down your tracking number (15-digit number, no parenthesis) from the bottom of the Return Shipping Label so that you can track your shipment in case of missing materials.

MI Help Desk

Tel 1. 866.762.1056

MIHelp@measinc.comSlide18

Return Shipping Procedures

Spring 2017 ELPA21 testing materials DO NOT have a prescheduled pickup date. FedEx Return Material Instructions:Remove or black out any old shipping labelsAffix the FedEx ground return label Print the district name and address Retain the receipt tab, from the top of the return label, for your records.Contact FedEx to arrange for pickup of testing materials.

To initiate a return, use one of the following methods: Use www.fedex.com: select “Ship,” then select “Schedule and Manage Pickups” from the drop down menu, then click “Schedule Ground Return Pickup.”

Call FedEx Customer Service: 1-800-463-3339; explain that you need a “Package Returns Program” pickup. Provide materials to your regular FedEx Ground driver.

Materials must be returned five days after testing has completed. Returning materials late brings into question the security of the tests and validity of the student score results. Slide19

Non-Secure Materials

The following materials should not be returned to MI:

TAM: At completion of testing recycleUnused student Pre-ID Labels should be destroyed according to district policy to ensure the confidentiality of student information.

Unused Return Shipping Labels MUST be recycled after all materials have been returned to the contractor. Do not use for future administrations.

Tool Button Sheets, and scratch/graph paper should be destroyed according to district policy.Slide20

ELPA Test Supports on the Portal

General InformationUser Guides and Manuals ModulesCoordinator InformationELPA21

A/O ScheduleAdministration Manuals

DEI- Data Entry InterfaceApplications and Systems

DEI – Data Entry Interface Webinar ELPA Testing TimesTAM – ELPA21

ELPA21 TDS/ORSELPA Tool Button Sheet

Translated Student Directions

Coordinator

Forms and ReportsNon-Standard Accommodation RequestGuidelinesGTSA – Guidelines on Tools, Supports, and AccommodationsCoordinator, Administrator, and StaffELPA21 Test Administration TrainingTest Question AmbiguityIrregularity ReportsSecurity ReportsELPA21 Webinar SeriesTesting Irregularity LogTraining Log for State AssessmentsTA Testing Location Supports Scratch Paper LogTest MaterialELPA21 Test Material Processing Slide21

Customer SupportIssue

Before CallingContact Support

Missing MaterialsImmediately send OSPI a

Test Material Variance Form, and Test Incident Report, notate missing materials on District Administration and Security Report. Missing materials also need to be reported to MI.

Fax completed forms to OSPI Operations 360.586.2728MI Help Desk MIHelp@measinc.com1.866.762.1056 Additional Orders (A/O)

DC check district overage to see if additional materials need to be ordered, place A/O in TIDE, if needed.

Additional questions,

contact the OSPI Operations office

assessment@k12.wa.us or 360.725.6348Data, Pre-ID, TIDE Data Flow And Report Card QuestionsFor Pre-ID and TIDE issues refer to the TIDE User Guide to troubleshoot locally. Additional questions contact the OSPI Assessment Analysts assessmentanalysts@k12.wa.us 360.725.6109AccommodationsFor accommodations questions refer to the Guidelines on Tools, Supports and Accommodations to resolve locally.Additional questions, contact OSPI’s Select Assessment office at GTSA@k12.wa.us General Test InformationFor questions regarding assessment policy and test administration visit the WCAP portal and review your Washington Assessment Weekly WAW newsletters to resolve locally.Additional questions, contact the OSPI Operations office assessment@k12.wa.us or 360.725.6348Slide22

Revision LogUpdates to this slide deck after May 4, 2017 are

noted below.SectionSlideDescription of Change Revision Date