PreAdministration Workshop 9182017 9192017 Live Repeat 9202017 Live Repeat 1 Agenda Reading and EvidenceBased Writing FT Overview Key Dates Test Setup Testing Accommodations Test Security and Irregularities ID: 740624
Download Presentation The PPT/PDF document "Georgia Milestones Reading and Evidence-..." is the property of its rightful owner. Permission is granted to download and print the materials on this web site for personal, non-commercial use only, and to display it on your personal computer provided you do not modify the materials and that you retain all copyright notices contained in the materials. By downloading content from our website, you accept the terms of this agreement.
Slide1
Georgia MilestonesReading and Evidence-Based Writing Field Test
Pre-Administration Workshop9/18/20179/19/2017 Live Repeat 9/20/2017 Live Repeat
1Slide2
AgendaReading and Evidence-Based Writing FT OverviewKey Dates
Test SetupTesting AccommodationsTest Security and IrregularitiesBefore, During, and After TestingResources and Contacts2
ExaminersSlide3
Reading and Evidence-Based Writing (REBW) Field Test Overview
3Slide4
REBW Field Test: BackgroundEach Georgia Milestones assessment includes embedded field-test items in order to sustain the item bank.
The REBW section of the ELA test (Section 1) is 90 minutes and requires students to write an essay in response to an extended writing promptThe time requirement and cognitive demand are too great to utilize an embedded field test design. 4
Important: Your schools’ participation in this field test is crucial and necessary.Slide5
REBW Field Test: Fall 2017In order to supplement the item bank, a stand-alone REBW field test is necessary.
Over 76% of survey respondents preferred a fall field test rather than a spring stand-alone field test. Because the field test will occur in the fall, it is an off-grade field test. 5Slide6
REBW Field Test: Fall 2017
Field testing items prior to their operational use is both a critical and required step in the development and maintenance of a technically sound testing program. This field test is part of the administration of the state student assessment program. While the scope of the field test is significant, we have made every effort to reduce the burden on any single school.
Only one grade or course selected at each school for the majority of schools
This field test will bolster the item bank to ensure capacity for several years.
6
Important: Your schools’ participation in this field test is crucial and necessary.Slide7
REBW Field Test: Educator Involvement
REBW item review – July 2017Educators reviewed items for alignment, bias and sensitivity, and appropriateness for the grade or course. Rangefinding – January 2018Educator committees will review student responses and determine scoring guidelines used to train and qualify scorers.
Data Review – July 2018
Additional review of items, along with student performance data from the field test.
Only items accepted by the committee are eligible to be placed in the item bank.
7Slide8
REBW Field Test:Benefits
Students will gain exposure to this section of the test and have an opportunity early in the school year to respond to an on-demand prompt. With additional prompts in our bank, we will be able to release former prompts, along with annotated and scored student exemplars. GaDOE will analyze student responses and provide qualitative feedback related to any trends that may be observed.
8Slide9
REBW Field Test:Scores
The purpose of the field test is to evaluate the quality of the REBW item sets, not to evaluate student performance.
9Slide10
Reading and Evidence-Based Writing Field TestContent Tested
10
EOG
EOC
Grades 3–8
English
Language Arts
Ninth Grade Literature & Composition
American Literature & CompositionSlide11
REBW Field Test Construction
Day 1
A set of 10 items, with associated passages, to serve as a link to previous Georgia Milestones administrations
Testing time: approximately 30 minutes (not including reading directions)
Start with one sheet of scratch paper; test ticket may be used for scratch paper
Day 2
One passage set (two short passages) with associated items:
Three (3) multiple-choice questions
One (1) two-point constructed-response item
One (1) seven-point writing prompt
Testing time: approximately 90 minutes (not including reading directions)
Start with two sheets of scratch paper (system has the option of using test ticket for one piece of scratch paper)
11Slide12
REBW Field TestGrades/Courses Tested
Students will be assessed on the previous
grade-level (or course), using an
off-grade
approach
.
A few examples (non-exhaustive) to illustrate are provided below:
Fourth grade
students will be tested on
third grade
ELA content;
Sixth grade
students will be tested on
fifth grade
ELA content;
Ninth grade
students will be tested on
eighth grade
ELA content; and
Students who completed American Literature during the 2016-2017 school year will be tested on American Literature content.
12
Note:
Because this is an off-grade field test, high schools are included on the EOG spreadsheet as they will give the grade 8 field test.Slide13
REBW Field TestSelected Schools
Participation is based on the sample selection provided to districts on May 25. Lists of selected schools were provided and each list provides the grade(s)/course(s) and minimum number of students to be tested.The approximate number of students shown in each list is the minimum
number of students to test, however, it is permissible to test more students, if desired.
If current enrollments are fewer than requested in the sample, test all students currently enrolled in the grade level or course.
13Slide14
REBW Field TestSelected Schools
Schools were selected using a stratified-random sampling approach to ensure representativeness of the state.Various demographics (e.g., race, ethnicity, gender) were considered. All districts across the state were included. Maximum “caps” were determined for each grade band (elementary, middle, high) to avoid placing an undue burden on larger schools.
One grade or course is selected at each school.
If more than one grade or course is selected at a school, the “cap” was held across the two grades/courses.
14Slide15
REBW Field TestSelected Students
Each selected school should identify a representative sample of students in the assigned grade(s)/course(s) to test based on:Various demographic backgroundsPrior performance on Georgia Milestones along the full continuum of achievement
e.g., do not select only students who are enrolled in advanced classes
15Slide16
REBW Field TestSelected Students
The representative student sample includes, but is not limited to: Students requiring accommodations, including conditional accommodationsStudents with disabilities (Braille and paper format are not available)English learners
Students who were not enrolled in the previous grade at a Georgia public school
may
be tested, especially if testing intact classes.
16Slide17
REBW Field TestScheduling Considerations
The REBW Field Test is to be administered over two days.Schools may test any time during the window.All schools within a district are not required to test on the same dates. All students within a school are
not
required to test on the same dates.
17Slide18
REBW Field TestScheduling Considerations
Make-up sessions should be scheduled for absent students. It is extremely important that all students participate in both sessions of the field test (Day 1 and Day 2). If a student is absent on the first day, he/she can participate in second day and then make-up the first day.
Schools may schedule rolling make-ups that best meet their scheduling needs.
18Slide19
Reading and Evidence-Based Writing Field Test
Key Dates
Test Setup Available to Districts
September 25
INSIGHT/eDIRECT Training
September 26
September 28 (live repeat)
Test Setup for Secure Practice Test with Response Transmission
September 28
Test Window opens for Secure Practice Test with Response Transmission
October 2
Manuals Arrive in Districts
October 2
Additional Materials (manuals only) Available to Districts
October 2
Test Administration Window
October 16 – November 3
19Slide20
Test Setup
20Slide21
Technology and REBW
Work closely with your technology teamShare technology training dates and timesShare testing schedule, number of testers, amount of time testingPlan for Secure Practice Test sessionsVerify that any new district technology works with INSIGHTReminder about the recent changes in the eDIRECT Device Toolkit
Changes to interface
Changes from ORG Units to configurations
New COS-Device Toolkit Dashboard
Documentation for the change can be found on eDIRECT
Device Toolkit Enhancements Transition GuideINSIGHT Technology User Guide Volume IIISlide22
Scheduling Test SessionsOption 1 – Preloaded Test Sessions
For Districts that submitted Student/Class File to GaDOE Data Collections by September 8, student profiles and test sessions will be preloaded by DRC.Districts can use this preloaded information as is, or if needed, modify the student profile or test session by:Uploading a supplemental file via the Upload Multiple Students function in Student ManagementManually entering/editing directly in eDIRECT
22Slide23
Test Session Placement for Preloaded Students
Grade
Test Session Name
REBW Content
4
Grade 3
Grade 3
5
Grade 4
Grade 4
6
Grade 5
Grade 5
7
Grade 6
Grade 6
8
Grade 7
Grade 7
9
Grade 8
Grade 8
10
Ninth Lit
Ninth Grade Literature
11
Undetermined
Based on prior year’s EOC; for actual assignment refer to
Assessment
from Student Test Ticket
*
12
American Lit
American Literature
23
*
Grade 11 students not loaded if no prior EOCSlide24
Scheduling Test Sessions
Option 2 – Upload Multiple Students/Manual EntryFor districts/schools that did not submit Student Class File to GaDOE Data Collections by September 8, the student profiles and test sessions may be loaded by:
Uploading a supplemental file via Upload Multiple Students function in Student Management
Manually entering student and Test Session information in eDIRECT
24Slide25
Upload Multiple Students
The layout is different from the Pre-ID, EOC Multiple Student, and EOG Multiple Student layouts.25
#
Column Name
1
District Code
2
School Code
3
Grade Level
4
Student First Name
5
Student Last Name
6
Student Gender
7
Student Date of Birth
8
SRC Code
9
Teacher Last Name
10
Teacher First Name
11
GTID
12
Ethnic Hispanic
13
Race American Indian
14
Race Asian
15
Race Black
16
Race Pacific Islander
17
Race White
Note that Teacher First Name or Teacher Last Name will need to be populated. GaDOE suggests using the same naming scheme as Pre-loaded Students.Slide26
Upload Multiple Students
26
Be sure the Reading and Evidence-Based Writing Field Test 2017 is the selected Administration when retrieving these resources from eDIRECT.Slide27
Multiple Student UploadSystem automatically enrolls students off grade testing.4
th – 9th grade students into prior year grade10th grade students into 9th Grade Literature
11
th
grade students into 9
th
Grade Literature or American Literature depending on prior enrollment12th grade students into American Literature
27Slide28
Note
Multiple Student Upload will enter students into Test Sessions according to Teacher Name.Only field test content for the assigned student sample will be available for individual testing sites.For manual entry for Grades 4-9, prior year’s content will be the only available optionFor manual entry for EOC, eDIRECT will not
verify prior student enrollment.
28Slide29
Test Tickets Test Rosters
29
To avoid a student testing under another student’s GTID, you
must
:
Print
ALL
Student Tickets.
Have students verify their name and test name are correct and sign the ticket next to their name.
If a change is made to a student record (e.g., adding an accommodation),
create a new test ticket for that student
, which will have a new login/password.
Test Tickets
will print
one to a page
, and Each
Test Ticket
contains the student’s username and password for the test session. Note that the student will have a separate
Test Ticket
for each section of the test.
Examiners
The
Student Test Roster
contains a list of students and the usernames and passwords for each student. Slide30
DRC INSIGHT Navigation30
StudentsSlide31
Navigating Pages for Reading Passages
31
Click the left-bottom corner to navigate to the prior page (if available).
Click the right-bottom corner to navigate to the next page (if available).
Current page
Total pages
The page turners are not identified within the online system. Please instruct your students on this feature.
StudentsSlide32
Constructed Response Mistakenly Deleting Responses
Student’s ResponseResponses Deleted (By Mistake)
32
Press
Ctrl+Z
(or
Command+Z
on a Mac) to revert back to recently-deleted text.
StudentsSlide33
Exiting a Test Session ProperlyIf you have any unanswered questions, select and answer the remaining questions.
Once all questions have been answered, select to properly end the test session. 33
StudentsSlide34
Testing Accommodations34Slide35
AccommodationsFollow accommodations guidance from the Accommodations Manual and the
Student Assessment Handbook.Oral reading/signing of reading passages is an accommodation that results in a Conditional Administration for English Language Arts content and requires specific coding.Scribing and transcribing procedures can be found in the
Student Assessment Handbook
and the
Coordinator’s Manuals
.
35Slide36
Accommodations
36Oral ReadingStudents receiving a read-aloud accommodation from a Human Reader must be assigned the
Human Reading/Human Signer
online Form 01
prior
to logging in to the test.
Students receiving the read-aloud accommodation from the
Text-to-Speech
online accommodation must have this accommodation assigned in eDIRECT
prior to
logging in to the online form.Slide37
Accommodations 37
Assigning the Human Reader/Signer Form LoginsExaminers will be able to access an online test form utilizing INSIGHT.
The School Test Coordinators will obtain a test login for the human readers from the eDIRECT Documents tab.
Login should remain secure and returned to the School Test Coordinator immediately following the administration.
DO
NOT
EMAIL THE LOG-IN TO USERS.
Directions for downloading Examiner Test Tickets are in the Online section of the
REBW Test Administration Manual
and on the following slide. Slide38
Accommodations
38
Assigning Oral Reading and Transcription Forms eDIRECT Test Set-Up
Assign/Activate Accommodation and Form for Student UseSlide39
Coding Accommodations Online
39
Select Accommodation Type
Basis of AccommodationSlide40
Examiner Test Tickets for Online Human Reader Administration40
Requires logging in to eDIRECT and selecting administration window Slide41
Security and Irregularities41Slide42
Testing Irregularities
Reporting and CodingAll irregularities must be coded, documentation completed and submitted on the Testing Irregularity Form in the MyGaDOE Portal. When entering the documentation into the Portal, please:Select the appropriate “Administration Cycle” –
For example, REBW
.
Select the appropriate “Administration” –
For example, REBW
.Include the form number of the test that needs to be coded as an Irregularity or Invalidation.
Enter details into comments
42Slide43
43
If directed by GaDOE, the System Testing Coordinator or designee will update for the affected course by doing the following:From the Student List in eDIRECT Test Set-Up, select the student to be coded.
Access the Testing Codes tab.
Select the Irregularity Status.
Select the Irregularity Code provided by GaDOE from the dropdown option.
Testing Irregularities
Coding OnlineSlide44
Before, During, and After Testing 44Slide45
Before Testing
System Test Coordinator Responsibilities
Receipt and inventory of test materials
Review Test Administration Manual
Review the Secure
Practice Test
examiner’s script
Organize training sessions for School Test Coordinators
Organize system security plan
Review technology readiness with Technology Director
Verify School Test Coordinators have scheduled Online Tools Training Tests (OTT)
OTT Directions from Georgia Milestones Website and eDIRECT
Examiners will find directions to help familiarize students with
the TTS in the Test Administration Manual
45Slide46
46
Before Testing
Additional Materials
Additional Materials can be ordered beginning October 2Slide47
Before Testing47
School Test Coordinator Responsibilities
Read Test Administration Manual
for System Test Coordinators,
School Test Coordinators, and Examiners
Organize training sessions for Test Examiners
Prepare the testing
site and organize testing materials for distribution
Organize training for assessment of students with accommodations
Organize school security plan and monitor test administration
Manage students and test sessions in eDIRECT
Assign
and code accommodations in eDIRECT
Print and sort by testing location
Student Test Tickets and Student Test Rosters
Administer the Secure Practice Test to students
Review technology readiness and school testing windows with local technology support including verification that Insight and the Testing Site Manager (TSM) are installed and all testing devices are prepared for testing.Slide48
During TestingSchool Test Coordinator Check daily for students who are In Progress or Locked. Follow procedures for students who did not end a section correctly.
See Sessions In Progress QuickStart Guide on eDIRECT.Monitor student activity 48Slide49
After TestingSchool Test Coordinator Confirm with technology coordinator that all responses have been cleared from each TSM used during testing.
Verify that Test Examiners have returned all materials. Includes test tickets, rosters, scratch paper, and Test Administration Manuals.System Test Coordinator
Do
NOT
return the following materials to DRC:
Manuals, test tickets, student test rosters, and scratch paper.
These must be securely destroyed AT THE SYSTEM LEVEL
immediately following the end of your local window.
49Slide50
Contact Information
DRC Customer Service TeamPhone: (866) 282-2249Email: GAHelpDesk@datarecognitioncorp.com
Hours: 7:00am to 8:00pm (Eastern)
Georgia Department of Education
Director of Assessment
Sandy Greene (404) 656-0478;
sgreene@doe.k12.ga.us
Program Manager, Test Development
Jan Reyes (404) 463-6665;
jreyes@doe.k12.ga.us
Assessment Specialists (by district assignment)
Joe Blessing (404) 232-1208;
jblessing@doe.k12.ga.us
Mary Nesbit-McBride (404) 232-1207;
mmcbride@doe.k12.ga.us
Robert McLeod (404) 656-2589;
rmcleod@doe.k12.ga.us
50