Instructions for Using These Slides - PowerPoint Presentation

Instructions for Using These Slides These slides are intended to assist principals in preparing their school training for test administrators and others involved in MCAS administration (there is no requirement to use these slides). Although some slides can be used as is, many slides are meant to serve as a template to be filled in with school-specific procedures. Slides where information is meant to be filled in are generally presented in red text .

MCAS Test Administration Training Session For Test Administrators, Technology Staff, and Other School Personnel

Today’s Agenda Welcome Test security requirements (Part I of the Test Administrator’s Manuals ; TAMs) Test administration protocols (Part II of the TAMs)Tasks for test administrators Local procedures and logistics for MCAS administrationAccessibility and accommodations Procedures for paper-based testing, if the school is doing PBTQuestions and answers 2

Goals for This Training Understanding procedures to follow before, during, and after testing Understanding testing prohibitions Knowing which resources to review prior to testing, and where to find information if there are questions Knowing whom to contact with questions 3

Training and Documentation Requirement All school personnel involved in MCAS test administration must participate in a school training session before test administration. You will need to sign in today to document the following: You are being trained. You received your Test Administrator’s Manual (TAM)/test security requirements.How and where will staff sign in? Will the sample DESE forms be used? Before the session, you received the following: For test administrators: the TAM for the test you will administer For hallway monitors and others: test security requirements For technology staff: test security requirements and relevant technology troubleshooting stepsIf you did not receive your document, let me know. 4

Updates for 2019: Grades 3–8 Computer-based testing (CBT) expected for all grades and subjects Paper-based testing (PBT) available as an accommodation (or for schools that already received approval of a waiver request) Combined test & answer booklets (instead of separate test booklets and answer booklets) Recommended testing times updated CBT student questionnaire administered in grades 4, 5, and 8After Math Session 2 for grade 4After STE Session 2 for grade 5 and 8 5

Updates for 2019: High Schools Computer-based testing (CBT) expected for grade 10 ELA and Mathematics Paper-based testing (PBT) available as an accommodation (or for schools that already received approval of a waiver request) Combined test & answer booklets (instead of separate test booklets and answer booklets) Operational high school STE is a PBT administration in 2019 Separate test booklets and answer bookletsCBT field test in Biology and Introductory Physics for grade 9 students taking those subjects, in addition to operational tests Test administrators need to turn in their CBT TAM after Mathematics for the test administrators for the field tests (instructions for the field tests will be in the CBT TAM, but printed copies will not be shipped for the field tests). (Turn in to whom?) Accessibility and accommodations policy CBT student questionnaire administered in grade 10 after Mathematics Session 2 6

Components of Computer-Based Testing (CBT) PearsonAccessnext (PAN): online management system for staff to use TestNav: online testing platform for students Infrastructure Trials: an opportunity for districts, schools, and students to prepare for CBT by simulating test-day network use ProctorCache: software that allows you to load test content locally in order to reduce delays caused by Internet connection problems and provide a more seamless testing experience 7

Dates for Test Administration Insert dates for student tutorial Insert dates for practice tests List test administration dates (including information on grade 10 prescribed dates if you are a high school) Make-up testing dates Date for student questionnaire (grades 4, 5, 8, and 10) 8

Local Procedures related to Testing Times Insert the school’s length of time for each test session See DESE recommended times on the following two slides. Insert the procedure for any students arrive late Will the test administrator read the script quietly to these students in the room or will the students instead be scheduled for make-up testing? Insert plans for students who finish testing early Will they be allowed to leave the room early, or will they stay in the room until the end of the session? Insert plans for students who need extended time Note: Students should complete each test session using the same device. Will students who need more time stay in the same room where they started testing, or will they be consolidated from different groups into a room together? 9

DESE Recommended Testing Times: Grades 3–8 MCAS Subject Area Test Number of Sessions Recommended Testing Time Grades 3–8 ELA 2 sessions (updated for 2019) 2 to 2 ½ hours per session Grades 3–8 Mathematics 2 sessions 1 ½ hours per session Grades 5 and 8 STE 2 sessions (updated for 2019) 1 ¼ hours per session 10

DESE Recommended Testing Times: High School MCAS Subject Area Test Number of Sessions Recommended Testing Time Grade 10 ELA 2 sessions (updated for 2019) 2 ½ hours per session Grade 10 Mathematics 2 sessions (updated for 2019) 1 ½ to 2 hours per session Operational High School STE (Biology, Chemistry, Introductory Physics, and Technology/Engineering) 2 sessions 1 hour per session Biology Field Test 1 session 45 minutes per session Introductory Physics Field Test 1 session 45 minutes per session 11

Breaks during a Session At the test administrator’s discretion, a 3–5 minute break is allowed midway through the session for all tests except for the operational high school STE tests. Discuss school procedures and what will be allowed/not allowed during breaks How will security be maintained during a break?Closing laptop lids? Turning off computer monitors? Turning tablets facedown? 12

Highlights of the TAMs Both TAMs: Combined scripts for Mathematics and STE in the same sections (for grades 3–8) Combined ELA and Mathematics scripts for grades 3–8 and 10 Different steps to be read for different grades/subjects CBT TAM new icon for accessibility, accommodations, students with disabilities, and EL studentsAppendix C: Troubleshooting technology issuesScript-only PDFs will be available soon on the DESE website for schools to download. www.doe.mass.edu/mcas/testadmin/manual/ 13

Secure Content and Materials for CBT Content MCAS questions not publicly released by the Department Student responses to test questions Passages, questions, writing prompts, and other on-screen contentMaterialsStudent testing tickets (for all sessions)Proctor testing tickets (only used for human reader and human signer sessions) Used scratch paper (i.e., after students have written on it) 14

How can we maintain the confidentiality of the test? What’s not allowed? Viewing on-screen test content, with these strict exceptions for certain accommodations (nondisclosure form required) for reading a word aloud for Mathematics and STE tests – Universal Accessibility Feature 10 (UF10) for assisting a student with the computer (more on this in a later slide) Duplicating or reproducing test content School personnel may not copy questions by hand or photograph them. Technology staff may not photograph computer screens even when troubleshooting a problem. Discussing test content with anyone before, during, or after testing School personnel may not discuss test content with each other. Teachers may not review unreleased MCAS questions with students (e.g., “Were there any questions that you had on Session 1 that you want me to go over?”) 15

Storage of Secure Materials Secure materials must be stored in a secure central location when tests are not being administered. Secure materials cannot be stored in classrooms, even if classrooms are locked. Access to the storage area must be restricted. After each test session is completed, secure materials must be returned to the test coordinator. Secure materials may not be left unattended when not in the central secure storage location. 16

Tracking Secure Materials The chain of custody of secure materials during test administration must be maintained. Internal tracking forms must be used whenever secure materials are signed out from, or into, secure storage. Test administrators and the test coordinator must independently count testing tickets and record the separate counts on the tracking form before signing it. Sheets of scratch paper do not need to be counted; however, the return of used scratch paper must be indicated on tracking forms. The appropriate box on tracking forms must be checked when testing tickets and used scratch paper are destroyed after testing. 17

Sample Student Testing Ticket Inform test administrators if your school will be using the optional line to write down students’ device ID. 18

Monitoring Students Outside the Testing Room Students must be supervised at all times when they are out of the testing room (e.g., going to the restroom, going to the nurse, going to a supervised lunch, moving to a test completion room) Insert school’s plan for monitoring hallways Hallway monitors? Restroom monitors with sightlines to testing rooms? Call main office for escort? Second test administrator escorts student (if two test administrators are used) 19

A Secure Environment in the Testing Room Cover or remove prohibited classroom displays Describe how and when this will be done in the school . See page 26 in the CBT TAM for examples of what must be covered or removed. Testing rooms may be entered byschool administratorsdistrict staffDESE observerstechnology staff (to troubleshoot technology problems) Unauthorized persons may not enter testing rooms (including teachers not assigned to the room as test administrators) 20

A Secure Environment in the Testing Room Students must not be able to view any screen but their own Describe how rooms will be set up to ensure a secure testing environment, or whether test administrators will set up their own rooms Set up rooms in advance to test out different seating arrangements. Sit in the seats and look around. What can you see? If test administrators will set up their own rooms, who will walk around at the start of testing and check all the rooms? Students or monitors back to back? Students separated by enough space to support secure testing? Students in semicircle? Physical barriers (e.g., partitions, carrels)? If barriers such as partitions are used, emphasize the importance of active proctoring. The same barrier that shields students from each other will also shield them from test administrators, so test administrators must circulate frequently and view each student regularly to ensure they are not using prohibited materials. 21

Examples of Seating Arrangements 22

Example of Partitions between Computers 23

Prohibited MaterialsMake sure students understand that they are not allowed to have cell phones and other electronic devices (e.g., music players, e-readers, smart watches) calculators on noncalculator tests and sessions notes or reference material such as additional reference sheets (other than what they have been given), graphic organizers, multiplication grids, etc. (exceptions for certain accommodations) dictionaries access to the Internet (except as needed for testing) or other instructional materialsA more comprehensive list can be found on pages 17–18 in the CBT TAM.A poster showing examples of prohibited materials will be available at www.doe.mass.edu/mcas/testadmin/forms Inform staff whether the school will be using this poster during testing. 24

Cell Phones Cell phones give students the ability to communicate with other students, to access the Internet, and to access tools such as a calculator, camera, or dictionary. Inform test administrators how phones will be collected before testing and whether they will read the optional scripts in the TAMs. Students put phones in backpacks and backpacks at the side of the room (what the optional TAM script says)? Phones are collected and kept by the test administrator at the front of the room? Phones are put away in lockers? Convey to students that they may not have cell phones during testing and that they may not access phones, even to check the time, since their results will be invalidated. 25

An Example of Collecting Cell Phones 26

Allowable Materials Scratch paper (blank, ruled, or graph) Students receive one sheet of scratch paper at the start of testing. They may have up to three pieces at one time. If students need more than three pages, they will have to turn in sheets. (See page 13 of the CBT TAM for more information about scratch paper.) Pens, pencils, highlighters, colored pencils (for use on scratch paper) Handheld calculators (for tests and sessions where calculator use is permitted)The student testing platform (TestNav) provides an onscreen calculator for the appropriate tests and sessions, but students may use handheld calculators if they want. (See page 14 of the CBT TAM for more information.) Printed copies of bilingual word-to-word dictionaries (for EL and former EL students) 27

Allowable Materials (Continued) Printed reference sheets For tests with reference sheets (e.g., grades 5–8 and 10 Mathematics), students may use printed copies even though the reference sheet also appears in the Exhibits tab within TestNav. Students are not permitted to use additional reference sheets from class. Exceptions for students with disabilities with accommodation A9 For Mathematics and STE, printed copies of equation editor guides and (for students using tablets) symbol keysReference sheets, equation editor guides, and symbol keys are available to print from mcas.pearsonsupport.com/student Tell test administrators whether your school is going to give printed reference sheets, equation editor guides, or symbol keys to students. 28

Test Administrator Responsibilities Before Testing Begins Review the session roster in PearsonAccess next and verify that accommodated forms (e.g., text-to-speech) have been assigned to students who should have them. Start the PAN session if the principal/test coordinator has not already started it in PearsonAccess next. (Tell staff whether the principal/test coordinator will start PAN sessions or whether test administrators are expected to do so.) Unlock the session. Include instructions for these steps from the CBT TAM (e.g., pages 34–35). Ensure that all students have the proper materials. Collect cell phones and any other prohibited devices. Describe the procedures the school plans to use to prevent students from accessing phones. 29

Test Administrator Responsibilities During Testing Read the scripts in the TAMs verbatim to students. Focus your full attention on the testing room for the full test session. Circulate throughout the room periodically to prevent cheating and the use of prohibited materials. Monitor students’ testing status in PAN (e.g., step 25 on page 66 of the CBT TAM). Resume tests for any students who signed out of or were inadvertently exited from TestNav (see Appendix B of the CBT TAM for instructions).Refrain from coaching students or influencing their responses in any way. 30

Coaching is not permitted on MCAS tests.What is coaching? Providing hints or clues “Think about what we studied in class last week.” “What’s the acronym for order of operations?” “Consider it from the main character’s perspective.” “Don’t forget to use specific examples in your essay.” “What are the different parts of photosynthesis?” Indicating in any way that a student has answered a question incorrectly “Check your work.” “You might want to look at that one again.” Defining or spelling words Explaining, simplifying, or paraphrasing any part of the test Suggesting that a student write more Influencing a student’s response through gestures, facial expressions, nods, or changes in voice inflection 31

What is permitted? Reading a word or short phrase aloud on the Mathematics and STE tests – Universal Accessibility Feature 10 (UF10) Assisting students with technology-related problems Re-reading part of the TAM script to students Encouraging students if they ask questions about test content “Just do your best.” “Just give your best effort.” “Do the best you can.” 32

Providing Assistance to Students with Their Computers Students should be familiar with CBT through practice tests and the tutorial, but test administrators may assist students during testing with technology-related problems. Examples of allowable assistance: signing students into TestNav (The test administrator may type in students’ usernames and passwords.) pointing to a tool button that a student cannot find (e.g., the calculator) explaining how to move through the test using the arrow keyspointing to the fraction bar in the equation editor if a student does not know how to enter his or her answer as a fraction Examples of prohibited assistance telling a student to use the calculator or a specific tool on a question telling a student which ruler to use typing any answers into the test or clicking any answer choices (Students should enter or choose all answers themselves.) 33

Steps to Take in Case of Technology Problems Who will be the designated technology support staff? How will the test administrators contact the designated technology support staff? One technology staff member in each wing of the school building? Call a technology staff who is located centrally? Do not move a student to a new device.Do not turn off the device. Make note of which testing device the student was using. If there is a situation in which a student is waiting for more than 15 minutes, then consult with the principal/test coordinator on scheduling the student to complete the session at a later time. 34

Test Invalidation Testing irregularities must be reported to the principal and then to the Department. Students’ results may be invalidated if they use notes, books, or other reference materialsaccess a cell phone or other electronic device (other than their testing device)look at another student’s screen or allow another student to see their screenpass notes or talk to other students about test content access the Internet or use any application on their testing device other than TestNav receive accommodations they are not entitled to, especially special access accommodations such as read-aloud or text-to-speech on the ELA test calculator on noncalculator tests and sessions receive any impermissible assistance from test administrators (coaching) 35

Most Common Security Issues from 2018 Be aware of these issues in particular while monitoring the room: Cell phone use Improper read-aloud or text-to-speech Extra reference sheets/notes Going forward or back to another session (paper-based testing)Student communication (talking or passing notes)Copying another student’s work/answers Accessing the Internet Calculators on noncalculator tests/sessions 36

Responsibilities After the Session is OverMake sure you have all testing tickets and used scratch paper. Lock students’ tests in PAN (e.g., step 33 on page 67 of the CBT TAM for instructions). Make a list of any students assigned to you that were absent. These students will need to be scheduled for make-up testing. Describe the procedures for how students who need more time will continue testing. Continue testing in the same room after other students leave? Consolidated with other students into a test completion room?Return testing tickets and used scratch paper to the test coordinator and sign the tracking form after independent counts are completed. 37

Other School Procedures The TAMs contain optional scripts as described below. Inform test administrators at the training session if they will read the scripts or if the school will develop an alternative version. whether test administrators will read the recommended script instructing students to put away cell phones and other electronic devices in their backpacks at the side of the room or if a locally developed script will be used instead whether test administrators will read the scripts for students going to a supervised lunch, students moving to a test completion room, and students going to the restroom Inform staff whether testing tickets will be collected from students after they sign in to TestNav, or students will retain their tickets until the end of the session. Inform staff whether students will write down the ID numbers of their devices on their testing tickets. 38

Other School Procedures (Continued) Inform staff how to contact the school administration if there is a problem during testing. How will they contact technology staff if there is a technology problem? Inform staff whether they should come to the central secure storage area to pick up materials, or materials will be delivered to them. Inform staff whether students who finish early may be dismissed or must wait until the end of the scheduled session. If students will wait until the end of the session to be dismissed, inform staff of what they may do and what they are allowed to have with them until then. Inform staff how lunch will be handled for students whose testing extends into the lunch period. lunch brought to the room? supervised lunch in the cafeteria? 39

Additional Training Resources for CBT Printing Student Testing Tickets support.assessment.pearson.com/x/HxpgAQ Note: Printing testing tickets is usually done by the test coordinator, but a test administrator may need to do so in some circumstances. Note that the video at the link above also shows how to find seal codes, which do not exist for MCAS testing. Starting a PAN Session and unlocking a test, resuming a test, and managing student statuses support.assessment.pearson.com/display/PAsup/Session+Management+Basics Marking tests complete support.assessment.pearson.com/display/PAsup/Mark+Student+Tests+Complete Troubleshooting steps in Appendix C of the CBT TAM www.doe.mass.edu/mcas/testadmin/manual/TAM-CBT.pdf Training modules mcas.pearsonsupport.com/training/ 40

Overview of Accommodations for Students with Disabilities and EL Students Test administrators who administer certain accommodations (listed on page 21 of the CBT TAM) must sign a Nondisclosure Acknowledgment form receive additional training on what is and is not permitted Accessibility Features for All Students For high schools: some accessibility features that were formerly restricted to students with IEPs or 504 plans are now available to all students.Universal Accessibility Features (UFs) are tools and supports available to all students that are either built into the computer testing platform or provided by a test administrator. Designated Accessibility Features (DFs) are changes in scheduling, setting, group size, or other conditions of test administration, at the principal’s discretion. 41

Universal Accessibility Features (UFs) – Available to All Students UF1 – highlighter tool UF2 – alternative background and font color (must be requested in the SR/PNP)UF3 – magnifier or zoom toolUF4 – line reader toolUF5 – answer masking (must be requested in the SR/PNP)UF6 – answer eliminatorUF7 – test question flag/bookmark UF8 – audio aids UF9 – notepadUF10 – test administrator read aloud selected words on the Mathematics or STE TestUF 11 – test administrator redirects student’s attention to the test UF 12 – test administrator reads aloud, repeats, or clarifies general test administration directions 42

Designated Accessibility Features (DFs) – Available to All Students, at the Principal’s Discretion DF1 – Small group DF2 – Individual (one-to-one) test administrationDF3 – Frequent brief supervised breaksDF4 – Separate or alternate test locationDF5 – Seating in a specific area DF6 – Adaptive or specialized furniture DF7 – Noise bufferDF8 – Familiar test administratorDF9 – Student reads test aloud to selfDF 10 – Specific time of day DF 11 – “Stop Testing” policy 43

Accommodations for Students with Disabilities The full list of accommodations can be found in Appendix C of the PAM. Categories of accommodations for students with disabilities: Test presentation accommodations E.g., Braille edition, text-to-speech Response accommodations E.g., graphic organizers, scribe responses Special access accommodations E.g., text-to-speech or human read-aloud for the ELA tests Only provide accommodations listed in a student’s approved IEP or 504 plan. Who will provide additional training on accommodations and when? How will descriptions of students’ accommodations be provided – e.g., will test administrators be given copies of Appendix C of the PAM? Who should test administrators contact if they discover an accommodation is not given correctly? (There may be some additional steps for CBT.) How will accommodation refusals be handled? Will the sample DESE form be used? (Refusals by students should be documented in writing and kept on file.) 44

Accommodations for English Learners Accommodations for EL students Documentation of EL accommodations must be kept at the school. Printed bilingual word-to-word dictionaries available for current and former ELs (no documentation necessary) English/Spanish edition of the grade 10 Mathematics test available in CBT and PBT editions Who will provide additional training on accommodations and when? How will test administrators know which accommodations to provide to which students? 45

Special Instructions for Human Read-Aloud and Human Signer Accommodations Special instructions are found in Appendix D and E of the CBT TAM. Test administrators who provide these accommodations will use their own computer and print their own proctor testing ticket to access a “test administrator” edition of the test. A separate PAN Session must be created. Students will use their own student testing ticket to log into their test. Do not confuse student’s testing ticket with proctor testing ticket. 46

If a Student Refuses an Accommodation Document the student’s refusal in writing; keep in student’s file. Sample refusal form — available in Accessibility and Accommodations Manual appendix, at www.doe.mass.edu/mcas/accessibility/ Do not ask student to sign any forms. Continue to make accommodation available, if needed, for remainder of test administration. Update information in student’s SR/PNP, if an accommodation was entered incorrectly or was not used.Notify parent/guardian of student’s refusal.Amend IEP/504 plan for future testing.If appropriate, list the accommodation in the IEP/504 plan “as requested by student,” or remove it. 47

Additional Resources for Accommodations Resource Link List of accessibility features and accommodations in Appendix C of the Principal’s Administration Manual www.doe.mass.edu/mcas/testadmin/manual/PAM.pdf Accessibility and accommodations modules and previously offered training session mcas.pearsonsupport.com/training/ Accessibility and accommodations www.doe.mass.edu/mcas/accessibility/ 48

Paper-Based Testing If your school will administer paper-based tests as an accommodation, or you are a high school administering the operational STE tests in June, cover the following: whether Student ID Labels will be applied before test sessions or applied by students after answer booklets are distributed who to contact in the event that secure test materials become contaminated MCAS booklets are secure and must be tracked on internal tracking forms. Test administrators must closely monitor students during testing to ensure that they do not view one another’s booklets or turn back to previously completed test sessions. Test administrators must write their names as well as the school and district name on the board for students to copy onto their booklets at the start of testing. Most UFs and DFs have paper-based equivalents listed in Appendix C of the PAM. There is no paper-based student questionnaire. 49

Questions and Answers Opportunity for questions on material covered Additional topics as needed 50