2018–19 California Assessment of Student Performance and Progress (CAASPP) California - PowerPoint Presentation

Slide1

2018–19 California Assessment of Student Performance and Progress (CAASPP) California Spanish Assessment Field Test Training Video

August 16, 2018

Presented by

Educational Testing ServiceSlide2

Topic

Slides

Topic1Agenda2Overview of the California Spanish Assessment (CSA) 3–10Roles and Responsibilities11–15Technology Requirements16–20Using the Test Operations Management System (TOMS)21–31CSA Field Test Administration32–53Test Security54–58Completion Status Reports59–62Opportunities for Involvement63–64Help Desk Support65

2018–19 CSA Field Test Training Video

2

AgendaSlide3

The California Spanish Assessment (CSA)

Replaces the Standards-based Tests in Spanish

Assesses Spanish reading/language arts (RLA)Assesses three domains:ReadingWriting mechanicsListening2018–19 CSA Field Test Training Video3Slide4

More About the CSA

Based on the Common Core State Standards en Español

Linear, nonadaptiveComputer-basedStand-alone items and passage-based items2018–19 CSA Field Test Training Video4Slide5

Purpose of the CSA

The CSA was developed to support teachers.

The purpose of the CSA is to measure a student’s competency in Spanish RLA.Once operational, the CSA will provide the following:Student-level data in Spanish competencyAggregate data for Spanish RLA programs A measure to be used, in part, for the State Seal of Biliteracy (high schools only)2018–19 CSA Field Test Training Video5Slide6

CSA Target Population

Grades three through eight and high school

Students who have learned Spanish formally or informallyIncludes, but is not limited to, students who are:Receiving instruction in Spanish in CaliforniaSeeking a measure that recognizes their Spanish-specific reading, writing mechanics, and listening skills2018–19 CSA Field Test Training Video6Slide7

About the CSA Field Test

The field

test window opens on September 17 and closes on October 12, 2018.Students in grades four through nine will take the test for the grade they were in during the 2017–18 school year. Students in grades ten through twelve will take the high school test.There are no student score reports.2018–19 CSA Field Test Training Video7Slide8

Objective of the CSA Field Test

To evaluate the CSA items and create a pool of high-quality items to be used for the operational administration

2018–19 CSA Field Test Training Video8Slide9

CSA Timeline

Event

DateCSA Field TestSeptember 17–October 12, 2018CSA Operational Assessment (first operational administration)April 1–July 15, 2019CSA Operational Assessment (second operational administration)January 20202018–19 CSA Field Test Training Video9Slide10

CSA Training Test

The CSA training test is currently available and can be accessed through the CAASPP web portal.

The Online Practice and Training Tests Portal is found at http://www.caaspp.org/practice-and-training/index.html.2018–19 CSA Field Test Training Video10Slide11

What’s next in this

v

ideo?112018–19 CSA Field Test Training VideoSlide12

Roles and Responsibilities (1)

12

2018–19 CSA Field Test Training VideoSlide13

Roles and Responsibilities (2)

Available User Roles in TOMS:

2018–19 CSA Field Test Training Video13Slide14

User Role Guidance (1)

TOMS Pre-Administration Guide for CAASPP Testing

http://www.caaspp.org/administration/instructions/User roles and definitions in TOMShttp://www.caaspp.org/administration/toms/toms-users.htmlInstructions for adding usershttp://www.caaspp.org/administration/toms/toms-upload-users.html142018–19 CSA Field Test Training VideoSlide15

User Role Guidance

(2)

User Role Guidancehttp://www.caaspp.org/administration/toms/ Videos: TOMS: Adding Users One by One and TOMS: Adding Users By Batch File Uploadhttp://www.caaspp.org/training/caaspp/Template for Batch Upload of Usershttp://www.caaspp.org/administration/toms/ 2018–19 CSA Field Test Training Video15Slide16

Technology

R

equirements162018–19 CSA Field Test Training VideoSlide17

Technology Update:

Operating Systems

http://ca.browsers.airast.org/ 2018–19 CSA Field Test Training Video17Slide18

Technology Checklist (1)

Prior to test administration,

local educational agency (LEA) CAASPP coordinators with technology coordinators should:Check for a stable high-speed internet connection (wired or wireless)Check that testing devices are workingEnsure that secure browsers are properly installed a minimum of two weeks prior to testing182018–19 CSA Field Test Training VideoSlide19

Technology Checklist

(2)

Ensure the necessary hardware is available and working (e.g., headphones, external keyboards, printers). Configure filters, firewalls, and proxy servers.Ensure that any auto updates are turned off. Updates during testing have the potential to kick students out of testing.Ensure you are using the latest mobile secure browser.2018–19 CSA Field Test Training Video19Slide20

Technology Resources

CAASPP Secure Browsers

http://ca.browsers.airast.org/ Bandwidth Checkerhttp://www.caaspp.org/about/bandwidth-checker.htmlTechnical Specifications and Configuration Guide for CAASPP Online Testinghttp://www.caaspp.org/administration/instructions/Preparing Technology for 2017–18 Online Testing webcasthttp://www.caaspp.org/rsc/videos/archived-webcast_092017.html 2018–19 CSA Field Test Training Video20Slide21

Using TOMS

21

2018–19 CSA Field Test Training VideoSlide22

Tasks to

C

omplete in TOMS for the Field TestAdd and manage all users.Select the fixed CSA field test administration window.Review student demographic data from the California Longitudinal Pupil Achievement Data System (CALPADS).Assign online test setting(s) to students.Assign students to the CSA.222018–19 CSA Field Test Training VideoSlide23

TOMS Student ProfileDemographics (2)

Data is read-only in TOMS; corrections must be made in CALPADS.

Students’ grade levels must be correct in TOMS before the first date of the testing window.Begin reviewing students’ information on September 4, 2018.The grade level is not locked on the day that the student logs onto the CSA field test.2018–19 CSA Field Test Training Video23Slide24

TOMS T

est Administrations:

Instructional Calendar (1)The fixed CSA field testing window is September 17–October 12, 2018.You must select the checkbox for the CSA field test fixed testing window.You cannot assign the test without checking the box for the fixed testing window.2018–19 CSA Field Test Training Video24Slide25

TOMS T

est

Administrations:Instructional Calendar (2)2018–19 CSA Field Test Training Video25Slide26

TOMS

S

tudent Profile:Test ModeSelect the check box for “California Spanish Assessment Field Test” to register a student.2018–19 CSA Field Test Training Video26Slide27

TOMS

S

tudent ProfileDemographics (1)All demographic data is read-only.2018–19 CSA Field Test Training Video27Slide28

TOMS

Student Profile

Demographics (3)It is not necessary to file an incident report if the student begins the test in the wrong grade.If a student begins the wrong test, update the grade in CALPADS to generate the correct test.It may take 24 to 48 hours for the correction to be visible in TOMS.2018–19 CSA Field Test Training Video28Slide29

TOMS

S

tudent Profile: Test Settings2018–19 CSA Field Test Training Video29Slide30

TOMS Student Profile:

TOMS Reminders

All universal tools, select designated supports, and select accommodations will be available and configurable through the Test Administrator Interface.There are no condition codes.2018–19 CSA Field Test Training Video30Slide31

TOMS Resources (1)

TOMS

web pagehttp://www.caaspp.org/administration/toms/index.html312018–19 CSA Field Test Training VideoSlide32

CSA Field Test Administration

2018–19 CSA Field Test Training Video

32Slide33

Systems and Processes for

Online Administration

2018–19 CSA Field Test Training Video33Slide34

CSA Field Test

Estimated Testing Times

2018–19 CSA Field Test Training Video34Grade Level# of Field Test ItemsEstimated Testing TimeGrades 4–860 items150–215 minutesHigh School60 items185–250 minutesSlide35

Establishing Appropriate

Testing Conditions (1)

Testing in classroom-sized groups is preferable.It reduces test fear and anxiety.It facilitates monitoring and control for test administrators.Room should have good lighting and ventilation and be free of noise and interruptions.Remove or cover displayed information that students could use to answer questions.2018–19 CSA Field Test Training Video35Slide36

Establishing Appropriate

Testing Conditions (2)

Make appropriate seating arrangements prior to test administration.Students should be seated so that they cannot view the answers of others.Establish procedures to maintain a quiet testing environment.Some students may finish more quickly than others.2018–19 CSA Field Test Training Video36Slide37

Establishing Appropriate

Testing Conditions (3)

Cell phones and other electronic devices must be turned off and put away during testing. Post an “Unauthorized Electronic Devices May Not Be Used at Any Time During the Testing Session” sign so that it is clearly visible to all students.Place a “TESTING—DO NOT DISTURB” sign on the door.2018–19 CSA Field Test Training Video37Slide38

Student Demographic Survey Questions (1)

Test administrators are responsible for knowing this information about the students in their test session prior to administering the

assessment.Test administrators must guide students to input the appropriate responses for the questions.2018–19 CSA Field Test Training Video38Slide39

Student Demographic Survey Questions (2)

Each

test form will present the following three demographic-related questions about the student at the beginning:Did you receive instruction in Spanish in the 2017–18 school year? ¿Recibiste educación en español en el año escolar 2017–18?Yes (Sí)No (No)2018–19 CSA Field Test Training Video39Slide40

Student Demographic Survey Questions (3)

Which

program were you enrolled in? ¿En qué tipo de programa escolar estuviste matriculado/inscrito?One-Way Immersion (Inmersión únicamente para hablantes de español)Dual-Language Immersion (Inmersión para hablantes de español y de inglés)Developmental Bilingual (Programas de desarrollo del idioma)2018–19 CSA Field Test Training Video40Slide41

Student Demographic Survey Questions (4)

Heritage Language or Indigenous Language (

Programas para hispanohablantes [hablantes de español])Spanish as a foreign language (i.e., Spanish I, Spanish II, etc.) (Español como lengua extranjera [es decir, Español I, Español II, etc.])None of the above (Ninguno de los anteriores)2018–19 CSA Field Test Training Video41Slide42

Student Demographic Survey Questions (5)

What

percentage of your school day instruction was provided in Spanish? ¿Qué porcentaje de tu educación diaria recibíste en español?0–25%26–50%51–75%76–100%2018–19 CSA Field Test Training Video42Slide43

Creating Test Session

2018–19 CSA Field Test Training Video

43Slide44

Test Administrator Interface (1)

Found on home page of

http://www.caaspp.org/Test administrator logon2018–19 CSA Field Test Training Video44Slide45

Test Administrator Interface (2)

Select the appropriate CSA field test form.

2018–19 CSA Field Test Training Video45Slide46

Test Administrator Interface (3)

The Session ID will generate in the Test Administrator Interface

.To approve a student, select the [Approvals] button and then select the check mark next to the student’s name.2018–19 CSA Field Test Training Video46Slide47

Test Administrator Interface (4)

Student’s test settings can

be reviewed through the Test Administrator Interface by selecting the icon next to the student’s information.2018–19 CSA Field Test Training Video47Slide48

Student Interface

Enter student information to log

on to the test.Review test information before beginning the test.2018–19 CSA Field Test Training Video48Slide49

Test Rules for General Assessments

Students:

Must answer all test questions in a section before moving on to the next sectionMust answer all test questions before the test can be submittedMay not return to a test once it has been submittedTest administrators:Must follow the “SAY” script exactly, each time a test session is administered2018–19 CSA Field Test Training Video49Slide50

Pausing the CSA Field Test

Test administrators can pause an individual student’s test without impacting other students.

Students can pause their test as well, but must be approved by the test administrator to enter the testing session.The general pause rules for the other CAASPP assessments also apply to the CSA field test.If the assessment is paused for more than 20 minutes, a student must log back on to the student interface.2018–19 CSA Field Test Training Video50Slide51

Test Timeout Due to Inactivity

S

tudents are automatically logged off of the test after 30 minutes of inactivity.“Activity” means selecting an answer or using a navigation option in the test (e.g., selecting [Next] or [Back], using the Questions drop-down list).Moving the mouse or selecting an empty space on the screen is not considered activity.Before the system logs off, a warning message is displayed. 2018–19 CSA Field Test Training Video51Slide52

Test Expiration Rules

The CSA field test opportunity

remains active untilthe student completes and submits the test; orthe test expires at the end of the fixed CSA field test administration window on October 12, 2018.2018–19 CSA Field Test Training Video52Slide53

Test Administration Resources

California Spanish Assessment Online Field Test Administration Manual—

http://www.caaspp.org/ rsc/pdfs/CSA.ftam.2018-19.pdf2018–19 CSA Field Test Training Video53Slide54

Test Security (1)

2018–19 CSA Field Test Training Video

54Slide55

Test Security and Appeals

The Security and Test Administration Incident Reporting System (STAIRS) requires LEA CAASPP coordinators and CAASPP test site coordinators to submit an online form to report an incident.2018–19 CSA Field Test Training Video55Slide56

Test Security (2)

There are three

types of test security incidents:ImproprietyIrregularityBreach2018–19 CSA Field Test Training Video56Slide57

STAIRS Incident Types for the CSA Field Test

2018–19 CSA Field Test Training Video

57CSA Field Test STAIRS Incidents ImproprietyIrregularityBreachAdministration ErrorYes NANA

Cheating/Accessing Unauthorized Devices

NA

Yes

NA

Disruption or Technical Issue

NA

Yes

NA

Exposing Secure Materials

NA

NA

Yes

Incorrect Statewide Student Identifier Used

NA

Yes

NA

Student Disruption

Yes

NA

NASlide58

Test Security Resources

CAASPP STAIRS Process for Summative Assessments web page—

http://www.caaspp.org/stairs/ 2018–19 CSA Field Test Training Video58Slide59

Completion Status Reports (1)

2018–19 CSA Field Test Training Video

59Slide60

Completion Status Reports (2)

Allow for the monitoring of testing progress for students who participate in the CSA field test

Help ensure all students eligible for testing begin, complete, and submit their testsNote: Once testing is under way, users who will access the Completion Status system should check the system regularly.2018–19 CSA Field Test Training Video60Slide61

Completion Status Reports (3)

Completion Status Reports are accessible via the CAASPP Portal for the summative and interim assessments using your TOMS logon.

2018–19 CSA Field Test Training Video61Slide62

Completion Status Reports Resources

Using Completion Status Reports to Plan and Manage Student Testing video—

http://www .caaspp.org/rsc/videos/archived-training_ using-completion-status.2017.html 2018–19 CSA Field Test Training Video62Slide63

CSA Operational Assessment

The CSA operational assessment testing window will be available April 1 through July 15, 2019.

You must register students separately for the CSA operational test following the CSA field test administration.2018–19 CSA Field Test Training Video63Slide64

Opportunities for Teacher Involvement

Item writing

Data reviewItem reviewRange findingTo get involved, complete the CAASPP Content Reviewer Application at http://caaspp.org/reviewers.html. 2018–19 CSA Field Test Training Video64Slide65

Help Desk Support

The California Technical Assistance Center is there to support all LEA CAASPP coordinators!

Monday–Friday from 7 a.m.–5 p.m. Pacific TimeSummative Assessments: 800-955-2954Digital Library and Interim Assessments: 855-631-1510Email: caltac@ets.orgCAASPP Portal: http://www.caaspp.org/2018–19 CSA Field Test Training Video65