Test Security Guidelines - PowerPoint Presentation

Slide1

Test Security Guidelines

California Assessment of Student Performance and Progress (CAASPP

)Slide2

Agenda

Topics

Introductions

Requirements in the Testing Regulations

General Test Security GuidelinesSpecific Test Security Guidelines Procedures for Reporting Testing IncidentsChanges to Security and Test Administration Incident Reporting System (STAIRS) for 2017–18Types of AppealsSTAIRS Live DemoCommon Testing ScenariosTest Security Auditor ActivitiesQuestions

2

2

CAASPP 2017–18 Test Security Guidelines Webcast Slide3

Purpose and Goal

By the end of this Webcast, local educational agency (LEA) California Assessment of Student Performance and Progress (CAASPP) coordinators will be able to train their staff on test security guidelines and procedures for the 2017–18 administration of computer-based and paper-pencil tests (PPTs).

3

CAASPP

2017–18 Test Security Guidelines Webcast Slide4

Requirements in the Testing RegulationsSlide5

Requirements in the Testing Regulations (1)

CAASPP Test Security Agreement

:*

New form for

2017–18 testing is available. Agreement must be read and signed ANNUALLY.Applies to both computer-based and paper-pencil testingAll LEA CAASPP coordinators must electronically submit a signed copy to the California Technical Assistance Center (CalTAC).All CAASPP test site coordinators must electronically submit a signed copy of the form; the LEA CAASPP coordinator will receive a notification upon completion.* Pursuant to California Code of Regulations, Title 5 (5 CCR), Section 859(a)5CAASPP 2017–18 Test Security Guidelines Webcast Slide6

Requirements in the Testing Regulations (2)

CAASPP Test Security Affidavit

:*

New form for 2017–18 computer-based and paper-pencil testing is now available.

Affidavit must be read and signed ANNUALLY by:All test administrators, test examiners, proctors, translators, scribes, LEA CAASPP coordinators, CAASPP test site coordinators, and any other persons having access to any of the summative tests and test materials, the assessment technology platform, the registration system, or the adaptive engineLEA CAASPP coordinators keep affidavits on file at the LEA; they do not need to be submitted to CalTAC. * Pursuant to 5 CCR, Section 859(c)6CAASPP 2017–18 Test Security Guidelines Webcast Slide7

General Test Security GuidelinesSlide8

General Test Security Guidelines (1)

All secure test materials must be handled and stored securely.

For

computer-based

tests, lock any printed rosters in secure storage with limited access, and train staff on the security procedures.For paper-pencil tests, lock materials in secure storage with limited access, count test booklets upon receipt as well as before and after a testing session, and train staff on the security procedures.Seat students so that they cannot easily view each other’s work.8CAASPP 2017–18 Test Security Guidelines Webcast Slide9

General Test Security Guidelines (2)

Cover or remove materials on the classroom walls that may provide information to students during testing.

Actively monitor students during testing.

Report only summative testing incidents using the

STAIRS form.Test administrators and test examiners report to the CAASPP test site coordinator and/or the LEA CAASPP coordinator.9CAASPP 2017–18 Test Security Guidelines Webcast Slide10

General Test Security Guidelines (3)

Securely destroy secure test materials that do not need to be returned to Educational Testing Service (ETS).

For computer-based summative assessments, these materials include:

Student logon information (tickets)

Administrator logon information for the test delivery systemRosters of students scheduled to take the testScratch paper with students’ workPrint-on-demand passages, items, and stimulus cardsGraphic supplements that accompany the braille hybrid adaptive test (HAT) option 10CAASPP 2017–18 Test Security Guidelines Webcast Slide11

General Test Security Guidelines (4)

For

paper-pencil

tests

: Return test booklets.Securely destroy answer documents (blank with Pre-ID labels and any with student responses recorded).Securely destroy scratch paper with students’ work per the guidelines listed in Chapter 3 Test Security of the Online Test Administration Manual.11CAASPP 2017–18 Test Security Guidelines Webcast Slide12

General Test Security Guidelines (5)

Printed test items/passages,

including embossed braille

printouts and scratch paper, must

be collected and inventoried at the end of each test session and then securely destroyed according to LEA and/or California policies or procedures. But . . .Scratch paper must be collected after the first part of the full write performance task (PT) and securely stored until it is returned to the student during the second part. Scratch paper must be shredded according to LEA and/or California policies or procedures after the second part of the full write has been completed.12CAASPP 2017–18 Test Security Guidelines Webcast Slide13

Print-on-Demand Test Security Guidelines

Test administrators and test examiners are responsible for maintaining the security of printers used for printing CAASPP test content.

Before approving or printing an item or stimulus, the test administrator or test examiner must ensure that the printer is on and is being monitored by staff.

It is never acceptable to assign the task of print-on-demand to student aides.

Immediately after printing a print-on-demand item/stimulus, the file must be deleted from the test administrator’s or test examiner’s computer. It must be deleted in such a way that the file does not remain in the “recycle bin” to be undeleted.13CAASPP 2017–18 Test Security Guidelines Webcast Slide14

Hybrid Adaptive Test for Braille Readers (1)

A

new version of the online option for students using

refreshable braille for the mathematics assessments will be available this year. LEAs will be provided the option of pre-embossed tactile mathematics graphics for the online braille HAT in grades three through eight and eleven.This replaces last year’s online fixed form.14CAASPP 2017–18 Test Security Guidelines Webcast Slide15

Hybrid Adaptive Test for Braille Readers (2)

The HAT features an adaptive section with items that do not require a supplemental graphics package.

It also includes a fixed-form section that does require a tactile graphics package.

These graphic packages must be ordered through CalTAC and securely destroyed on-site after the student has completed testing

.15CAASPP 2016–17 Test Security Guidelines Webcast Slide16

Security Considerations for Interim Assessment Materials

In California, the Smarter Balanced Interim Assessments are available only to educators in California LEAs.

Nonpublic school educators who provide direct instruction to California public school students may also have access.

The interim assessments are not for public use, display, or distribution. Any use, display, or distribution of the interim assessments that results in access to individuals beyond LEA staff or students is considered a security breach.

16CAASPP 2017–18 Test Security Guidelines Webcast Slide17

Specific Test Security GuidelinesSlide18

What’s New for 2017–18

Section A2 (cheating) has been removed from the answer document

for paper-pencil testing.

The Grace Period Extension (GPE) appeal request will automatically reopen a test that is not in a paused state.LEAs no longer need to contact CalTAC if the assessed grade, disability status, or disability type is incorrect after the student has begun testing. Instead, the LEA needs to confirm that the update has been made in the California Longitudinal Pupil Achievement Data System and then reset all tests the student has taken.CAASPP 2017–18 Test Security Guidelines Webcast 18Slide19

Preventing Security Violations

LEA staff, school staff, test administrators, and test examiners play a critical role in monitoring the testing session and adhering to directions for standardized administration.

CAASPP Security Incidents and Procedures Guide

Chapter 3 of the

CAASPP Online Test Administration Manual: http://www.caaspp.org/rsc/pdfs/CAASPP.online_tam.2017-18.Chapter-3.pdf19CAASPP 2017–18 Test Security Guidelines Webcast Slide20

Test Security Before and During Testing

All test items and test materials must remain secure and must be appropriately handled.

Includes creating a secure testing environment for what students can see, hear, and/or access

The test administrator is ultimately responsible for monitoring and reporting test security issues.

Inappropriate Internet accessAny other improper displaying, printing, photographing, duplicating, and/or sharing of test questions20CAASPP 2017–18 Test Security Guidelines Webcast Slide21

As Testing Starts and During Testing

A logon ticket must include the student’s legal first name and Statewide Student Identifier (SSID).

A logon ticket may also include the student’s last name and picture.

Ensure

that the students have properly logged on and are taking the test for which they are scheduled. Monitor students taking the test for any breach of the secure browser and that it has not allowed students to access external sites or other resources on their testing device during the assessment unless it was allowed through an approved unlisted resource request.21CAASPP 2017–18 Test Security Guidelines Webcast Slide22

Student Logon Information for Computer-based Tests

Student logon information is considered secure material, so it must be provided to, and viewable only by, the student to whom the logon information pertains.

Student logon information must be returned to the CAASPP test site coordinator, stored in a secure location between testing sessions, and securely destroyed immediately after testing has been completed.

Losing student logon information is no longer a reportable incident in STAIRS (previously classified as a breach). It is still, however, considered

student personally identifiable information and must be handled at the local level.22CAASPP 2017–18 Test Security Guidelines Webcast Slide23

Test Security Guidelines for Computer-based Tests

Ensure there is adequate space between students so that they cannot see each other’s work.

If using a computer lab, consider using temporary dividers (e.g., folders taped to the sides of the monitors).

Test the equipment and network to be used during testing.

Report any programs that make it through the secure browser or if the student was able to exit the secure browser in any other way than ending the session to CalTAC.Some software (e.g., teacher-monitoring software, Apple AirPlay, etc.) may need to be disabled or monitored locally by staff to make sure security guidelines are being met.23CAASPP 2017–18 Test Security Guidelines Webcast Slide24

Test Security Guidelines forPaper-pencil Tests

Test administrators and test examiners

Receive

and return materials to

the CAASPP test site coordinator.Make sure test booklets and answer documents are distributed to the correct students.Do not allow unauthorized electronic devices (e.g., cell phones) to be used in the classroom during testing.24CAASPP 2017–18 Test Security Guidelines Webcast Slide25

Guidelines for Cell Phones

Test takers are bringing great harm to testing by posting test questions to

social

media

. It is vital that cell phones not be permitted in the testing room, unless approved as an unlisted resource.Any approved electronic devices must be monitored for their intended purpose.Test administrators who actively proctor the testing environment can prevent test takers from accessing hidden cell phones for the use of cheating and posting test content to social media.25CAASPP 2017–18 Test Security Guidelines Webcast Slide26

Social Media Breaches

Social media and other Web sites will be monitored daily for postings of secure material.

A process is in place to review and investigate all test security incidents related to social media to determine what action needs to be taken.

26

CAASPP 2017–18 Test Security Guidelines Webcast Slide27

Procedures for Reporting Testing IncidentsSlide28

Test Security and Reporting Impacts for 2017–18 (1)

Invalidated appeals will

continue to result in an invalidated score.

The condition code “C” (box A2) is no longer on the answer document for Smarter Balanced paper-pencil

tests to indicate Student observed cheating. If this occurs, the LEA needs to enter a case in STAIRS and provide the necessary information outlined in the e-mail response.28CAASPP 2017–18 Test Security Guidelines Webcast Slide29

Test Security and Reporting Impacts for 2017–18 (2)

Invalidated scores are reported in the Online Reporting System (ORS) and Student Score

Reports (SSRs),

but are not included as valid scores in aggregated test results.

Security issues for Smarter Balanced paper-pencil tests and Standards-based Tests in Spanish paper-pencil tests need to be reported in STAIRS, but an appeal does not need to be filed.29CAASPP 2017–18 Test Security Guidelines Webcast Slide30

CAASPP STAIRS Process (1)

STAIRS requires LEA CAASPP coordinators and CAASPP test site coordinators to submit an online form to report an incident.

Any incidents related to the

California Science Test

also will be submitted through STAIRS.If an appeal is required, an e-mail will be sent instructing the coordinator to file an appeal in the Test Operations Management System (TOMS).30CAASPP 2017–18 Test Security Guidelines Webcast Slide31

CAASPP STAIRS Process (2)

STAIRS and appeals are used for the summative assessments only.

Coordinators access the

CAASPP STAIRS

form in TOMS by selecting the [STAIRS/Appeals] button.You cannot submit an appeal request without first submitting the CAASPP STAIRS form.31CAASPP 2017–18 Test Security Guidelines Webcast Slide32

Live Audience Participation

Does your LEA have an established protocol for who will be responsible for reporting incidents in STAIRS?

Respond at:

www.PollEv.com/RedDog

Text RedDog to 37607 once to join, then A, B or C Yes! The LEA Coordinator will be responsible for reporting security incidents in STAIRS.Yes! The Test Site Coordinator will be responsible for reporting security incidents in STAIRS.Both the LEA CAASPP Coordinator and Test Site Coordinator will be responsible for reporting security incidents in STAIRSSlide33

Issues to NOT Report in STAIRS (1)

CAASPP 2017–18 Test Security Guidelines Webcast

33

Perceived question skipping

English learners who have been enrolled in a school in the United States for fewer than 12 months for English language arts/literacy (ELA) (still required to take mathematics), as of April 15, 2017This student’s score will not be used for federal accountability purposes and therefore does not need to be reported in STAIRS.The system calculates the exemption based on the U.S. school entry data shown in TOMS. There is no user marked condition code.Slide34

Issues to NOT Report in STAIRS (2)

Do not report when a test is accidentally administered to

a

parent/guardian–exempt student.

An Invalidate appeal does not need to be reported for media use after testing is complete.The use of electronic devices is prohibited, but the issue does not need to be reported unless the student was actively engaged in a testing session or the student completed testing but the LEA can verify that the device was being used to help other students who were engaged in a test session.34CAASPP 2017–18 Test Security Guidelines Webcast Slide35

Commonly Reported Issues and

How

to

Avoid Them (1)

How to minimize issues that lead to the most common appeal typesTo avoid having to submit a Reset appeal, make sure all test settings are properly set before the test is started.Double-check that all selected settings are needed for each student before the test is started. If the student did not need the selected settings and they need to be changed after the test has started, the LEA will have to resort to the appeals process, which will add time for processing and changes needed.35CAASPP 2017–18 Test Security Guidelines Webcast Slide36

Commonly Reported Issues and

How

to

Avoid Them (2)

To avoid having to submit a Re-open appeal, be sure to properly schedule testing times to ensure all students can test in a timely manner.Please keep in mind the ORS system does not report in real time, which may make it difficult for LEAs to pull information regarding who has or has not tested in a timely manner.Only submit a Restore appeal if the test has been inadvertently or improperly reset. To submit a Restore appeal the LEA must contact CalTAC.Only submit a GPE appeal if a technical issue has occurred that resulted in expiration of the 20-minute pause rule.36CAASPP 2017–18 Test Security Guidelines Webcast Slide37

Polling Question Results

Does your LEA have an established protocol for who will be responsible for reporting incidents in STAIRS?

Live Results

37Slide38

Test Security Incidents

There are three types of test security incidents:

Impropriety

Irregularity

Breach38CAASPP 2017–18 Test Security Guidelines Webcast Slide39

Reporting Testing Incidents—Impropriety

An

impropriety is an unusual

circumstance that has a low impact on the individual or group of students tested and low risk of affecting student performance, test security, or test

validity.It is correctable and containable at the local level.If appropriate, the incident must be reported to the LEA CAASPP coordinator. The LEA CAASPP coordinator or CAASPP test site coordinator must enter the testing incident into STAIRS within 24 hours.39CAASPP 2017–18 Test Security Guidelines Webcast Slide40

Test Security Chart—Impropriety

LOW

Impropriety

Student(s) making distracting gestures/sounds or talking during the test session that creates a disruption in the test session for other students.

Student(s) leaving the test room without authorization. Administrator or coordinator leaving related instructional materials on the walls in the testing room. 40CAASPP 2017–18 Test Security Guidelines Webcast Slide41

Process Flow for Reporting an Impropriety

41

CAASPP

2017–18

Test Security Guidelines Webcast Slide42

Reporting Testing Incidents—Irregularity

An irregularity is an unusual circumstance that impacts the testing individual or a group of students.

It may affect student performance, test security, or test validity.

It is correctable and containable at the local level.

The LEA CAASPP coordinator or CAASPP test site coordinator must enter the testing incident into STAIRS within 24 hours (5 CCR Section 859[e]). 42CAASPP 2017–18 Test Security Guidelines Webcast Slide43

Test Security Chart—Irregularity (1)

MEDIUM Irregularity

Student(s)

cheating

or providing answers to each other, including passing notes, giving help to other students during testing, or using hand-held electronic devices to exchange informationStudent(s) accessing the Internet or any unauthorized software or applications during a testing eventStudent(s) accessing or using unauthorized electronic equipment (e.g., cell phones, PDAs, iPods, or electronic translators) during testingDisruptions to a test session,

such as a fire drill, schoolwide power outage, earthquake, or other act(s)Administrator or coordinator failing to ensure administration and supervision of the Smarter Balanced assessments by qualified, trained personnelAdministrator giving incorrect instructions that are not corrected prior to testing.

Administrator or coordinator giving out his or her username/password (via e-mail or otherwise), including to other authorized users43CAASPP 2017–18 Test Security Guidelines Webcast Slide44

Test Security Chart—Irregularity (2)

MEDIUM Irregularity

Administrator allowing students to continue testing beyond the close of the testing window. For the

PT,

this is 10 calendar days. For the computer adaptive test (CAT), this is 45 calendar days. For a paper-pencil assessment, this is 3 weeks.Administrator providing a student access to another student’s work/responses (unintentional access granted)Student not receiving accessibility resource or accommodation as required by an individualized education plan (IEP) or Section 504 plan

Student without IEP or Section 504 plan did not get a designated support.Administrator or teacher coaching or providing any other type of assistance to students that may affect their responses. This includes both verbal cues (e.g., interpreting, explaining, or paraphrasing the test items or prompts) and nonverbal cues (e.g., voice inflection, pointing, or nodding head) to the correct answer. This also includes leading students through instructional strategies such as think-aloud, asking students to point to the correct answer or otherwise identify the source of their answer, or requiring students to show their work.44CAASPP 2016–17 Test Security Guidelines Webcast Slide45

Test Security Chart—Irregularity (3)

MEDIUM Irregularity

Administrator providing students with nonallowable materials or devices during test administration or allowing inappropriate designated supports and/or accommodations during test

administration

Administrator allowing designated supports not indicated by an educator (or team of educators with parent/guardian and student input) and that are not in the student’s IEP or Section 504 planAdministrator allowing inappropriate accommodations (which are not in the student’s IEP or Section 504 plan) during test administration

Administrator allowing anyone other than a student to log on to the test unless prescribed as an allowable accommodation in the student’s IEP. This includes test administrators or other staff using student information to log on or allowing a student to log on using another student’s information.Administrator providing a student access to another student’s work/responses (intentional access granted)45CAASPP 2017–18 Test Security Guidelines Webcast Slide46

Process Flow for Reporting a Testing Irregularity

46

CAASPP

2017–18

Test Security Guidelines Webcast Slide47

Reporting Testing Incidents—Breach

A breach is an

e

vent that poses a threat to the validity of the test.

The LEA CAASPP coordinator or CAASPP test site coordinator must immediately telephone the CDE and then submit a report in STAIRS within 24 hours (5 CCR Section 859[e]).To qualify as a breach, the circumstances have an external implication to the Smarter Balanced Assessment Consortium.May result in the decision to remove an item from scoring47CAASPP 2017–18 Test Security Guidelines Webcast Slide48

Test Security Chart—Breach

HIGH

Breach

Administrator or coordinator modifying student responses or records at any timeThe live student interface or Test Administrator Interface being used for practice instead of the training or practice testsAdult or student posting items or test materials on social media (Twitter, Facebook, etc.)Administrator allowing students to take home printed test items, reading passages, writing prompts, or scratch paper that was used during the test or failing to otherwise securely store test

materialsAdult or student copying, discussing, or otherwise retaining test items, reading passages, writing prompts, or answers for any reason. This includes the use of photocopiers or digital, electronic, or manual devices to record or communicate a test item. This also includes using secure test items, modified secure test items, reading passages, writing prompts, or answer keys for instructional purposes.Secure test materials being shared with the media (such as the writing prompts, test items, or reading passages) or allowing the media to observe a secure test administration

Adult or student improperly removing secure testing materials, such as test items, stimuli, reading passages, writing prompts, or scratch paper from the testing environment48CAASPP 2017–18 Test Security Guidelines Webcast Slide49

Process Flow for Reporting a Testing Breach

49

CAASPP

2017–18

Test Security Guidelines Webcast Slide50

Test Security Incident Types and Examples

Type of Security Incident

Example

Test Impropriety

Students talking during testingTest IrregularityStudents cheating or providing answers to one anotherTest IrregularityStudent accessing or using electronic equipment (e.g., cell phone)Test BreachTest administrator or CAASPP test site coordinator modifying student responses or records at any timeTest BreachTest administrator allowing students to take home test questions, passages, prompts, or scratch paper

50CAASPP

2017–18 Test Security Guidelines Webcast Slide51

Types of Appeals

Invalidate

Reset

Re-openGrace Period ExtensionRestoreSlide52

Invalidate Appeal Reasons

Test security breach by student

Validity issue

Test administrator coaching

Modifying student responsesProviding nonallowable materialsDeliberate inappropriate response to itemsStudent cheating or accessing unauthorized devices  Accidental summative access52CAASPP 2017–18 Test Security Guidelines Webcast Slide53

Reset Appeal Reasons

Accessibility issue

Incorrect assessment type opened 

Incorrect SSID (no swap)

Accidental summative access A reset because of accidently administering a summative test will only be granted if one of the following is true: The student completed less than 10 CAT or less than 1 PT. The student did not receive a designated support or accommodation as prescribed by an IEP or Section 504 plan.53CAASPP 2017–18 Test Security Guidelines Webcast Slide54

Re-open Appeal Reasons

Test expiration or accidental submission by student 

Student starts test unintentionally and is unable to complete the test before it expires

Technical issue that results in test expiration or submission prior to completion

Accidental summative access (reset criteria not met)54CAASPP 2017–18 Test Security Guidelines Webcast Slide55

Grace Period Extension Appeal Reasons

The GPE is used for CATs only and is not applicable to the PT.

There were disruptions to a test session, such as a technical difficulty, fire drill, schoolwide power outage, earthquake, or other act beyond the control of the test administrator. The GPE is only available for technical issues that resulted in expiration of the 20-minute pause rule.

The GPE appeal request will automatically reopen a test that is not in a paused state.

55CAASPP 2017–18 Test Security Guidelines Webcast Slide56

Restore Appeal Reasons

If a test was inadvertently or inappropriately reset, LEAs will have to contact CalTAC to verify eligibility.

A Restore appeal would be requested by the LEA, and CalTAC would have to determine whether it meets the requirements for a Restore.

The LEA cannot request a Restore request in the Appeals module and must request that CalTAC perform the Restore.

56CAASPP 2017–18 Test Security Guidelines Webcast Slide57

Test Security WebcastSTAIRS Live DemoSlide58

Common Testing ScenariosSlide59

Common Scenarios Before Testing and Signing On (1)

Reset appeal scenarios

S

tudent

received the incorrect test. Student was associated with the incorrect grade level.Student did not receive the needed accommodations. Test directions came up in Spanish. 59CAASPP 2017–18 Test Security Guidelines Webcast Slide60

Common Scenarios Before Testing and Signing On (2)

Issues with English learner (EL) students

The date that must be used to determine if

a student is a

12-month EL student is April 15, 2017, and is consecutive.If a 12-month EL student tests in ELA, no further action is necessary. He or she will be marked with the proper condition code at a later date. Even though he or she may get a score for this test, this does not affect accountability.Twelve-month EL students are allowed to take the ELA test and often encouraged at some districts.60CAASPP 2017–18 Test Security Guidelines Webcast Slide61

Common Scenarios Before Testing and Signing On (3)

Parent/Guardian exemption (PGE) rules

A PGE

may be entered before the student

completes testing. If a student finishes testing and the LEA failed to enter it in TOMS or the exemption was submitted after testing, the student will still receive an SSR. It is still a requirement to send the SSR to the parent. If a student needs a PGE but has already started testing, LEAs will be able to enter the PGE in TOMS before the student submits both the CAT and the PT for that subject area.61CAASPP 2017–18 Test Security Guidelines Webcast Slide62

Common Scenarios Before Testing and Signing On (4)

Accidental summative access

The student opened the test under the assumption it was a practice, a training, or an interim assessment.

If the

student completed less than 10 CAT or less than 1 PT, he or she may file for a Reset. If the student went past 1 PT or 10 CAT, this is not eligible for a Reset. The student did not receive a designated support or accommodation as prescribed by an IEP or Section 504 plan.This is eligible for a Reset and may also be eligible for a Re-open or Invalidate.62CAASPP 2017–18 Test Security Guidelines Webcast Slide63

Common Scenarios Before Testing and Signing On (5)

Accidental summative

access

Another

student used the incorrect SSID to log on. The test may be reset regardless of what number the test is on. If the student completes the test under the incorrect SSID, then the results may be swapped via the SSID swap process if he or she has not started testing under the correct SSID.63CAASPP 2016–17 Test Security Guidelines Webcast Slide64

Common Scenarios Before Testing and Signing On (5)

Clarification on setting up the test

a

dministration

windowTesting windows are set by the LEA and assigned to schools. Site test scheduling must occur within the window established by the LEA.The TOMS selected test window is when tests will be available. The LEA and the test site coordinator will receive an e-mail with the selected test window information. Once the LEA receives this e-mail, the window is open.64CAASPP 2017–18 Test Security Guidelines Webcast Slide65

Common Scenarios Before Testing and Signing On (6)

Extending test windows

As

long as the selected test window is still open, the LEA may contact CalTAC to get approval to have the window extended.

An extension will not be approved by ETS or the CDE if the window is already closed. 65CAASPP 2017–18 Test Security Guidelines Webcast Slide66

Common Scenarios During Testing (1)

Skipped test questions

A

student cannot progress to a page unless all items on that page have been answered.

If a student perceives test questions have been skipped, inform the student that he or she cannot progress to a page unless all items on that page have been answered.66CAASPP 2017–18 Test Security Guidelines Webcast Slide67

Common Scenarios During Testing (2)

Technical issues

If

a technical

issue occurs during testing that does not allow the student to continue or complete the test and cannot be resolved, the LEA must call CalTAC for technical assistance.If CalTAC is unable to resolve the technical issue within two weeks, the LEA must request PPT for the student.67CAASPP 2017–18 Test Security Guidelines Webcast Slide68

Common Scenarios During Testing (3)

A few more notes

For a not

tested medical emergency (NTE

), the student must have a doctor’s note. An NTE is a significant accident, injury, trauma, or illness—mental or physical—that precludes a pupil from taking the achievement tests. If a student responds to a mathematics question in Spanish, there are Spanish reading raters who will still score mathematics tests accordingly. If a non-embedded calculator was used during the test and the student did not have an IEP or Section 504 plan that allows it, the LEA needs to be instructed to have the test invalidated. 68CAASPP 2017–18 Test Security Guidelines Webcast Slide69

Common Scenarios After Testing (1)

Scratch paper

This does

not need to be reported if

the student kept the scratch paper and is moving on to a new test. If the student kept the scratch paper and is coming back to continue testing in the same subject, the issue needs to be reported, and the test will be invalidated.69CAASPP 2017–18 Test Security Guidelines Webcast Slide70

Common Scenarios After Testing (2)

Issues with completed tests

If a student finished

the test but

did not select submit, the system will eventually force submission of the test. This does not happen right away. (The test administrator must not select submit for the student; this is a security breach.) If a student completed the test, but was not presented with the survey questions, the LEA does not need to file an appeal; this is not an issue. If a student used a media device after testing was completed, it does not need to be reported unless the use of a media device impacted students who were actively testing.70CAASPP 2017–18 Test Security Guidelines Webcast Slide71

Test Security Auditor ActivitiesSlide72

Test Security Audits (1)

Audits are conducted throughout the state

.

Auditors will:

Observe test security processes being used; andInterview the CAASPP test site coordinator or designee before, during, and after testing.Post-test audits will be conducted for paper-pencil tests only.Summary reports will be provided to the CDE and will be shared with the LEA CAASPP coordinator.72CAASPP 2017–18 Test Security Guidelines Webcast Slide73

Test Security Audits (2)

Sites may be

selected

for an audit for any of the following reasons:

Previous security infractionsLEA request Random selectionIf your site has been selected, you will be contacted by a representative from Intouch Insight to schedule the audit.73CAASPP 2016–17 Test Security Guidelines Webcast Slide74

QuestionsSlide75

Help Desk Support

CalTAC is there to support all LEA CAASPP coordinators!

Available Monday–Friday, 7 a.m

.

–5 p.m. PTE-mail: caltac@ets.orgPhone: 800-955-2954Web site: http://www.caaspp.org/ 75CAASPP 2017–18 Test Security Guidelines Webcast