/
Georgia Milestones Reading and Evidence-Based Writing Field Test Georgia Milestones Reading and Evidence-Based Writing Field Test

Georgia Milestones Reading and Evidence-Based Writing Field Test - PowerPoint Presentation

stefany-barnette
stefany-barnette . @stefany-barnette
Follow
346 views
Uploaded On 2018-12-13

Georgia Milestones Reading and Evidence-Based Writing Field Test - PPT Presentation

PreAdministration Workshop 9182017 9192017 Live Repeat 9202017 Live Repeat 1 Agenda Reading and EvidenceBased Writing FT Overview Key Dates Test Setup Testing Accommodations Test Security and Irregularities ID: 740624

students test student grade test students grade student field testing rebw school edirect administration reading schools sessions online literature

Share:

Link:

Embed:

Download Presentation from below link

Download Presentation The PPT/PDF document "Georgia Milestones Reading and Evidence-..." is the property of its rightful owner. Permission is granted to download and print the materials on this web site for personal, non-commercial use only, and to display it on your personal computer provided you do not modify the materials and that you retain all copyright notices contained in the materials. By downloading content from our website, you accept the terms of this agreement.


Presentation Transcript

Slide1

Georgia MilestonesReading and Evidence-Based Writing Field Test

Pre-Administration Workshop9/18/20179/19/2017 Live Repeat 9/20/2017 Live Repeat

1Slide2

AgendaReading and Evidence-Based Writing FT OverviewKey Dates

Test SetupTesting AccommodationsTest Security and IrregularitiesBefore, During, and After TestingResources and Contacts2

ExaminersSlide3

Reading and Evidence-Based Writing (REBW) Field Test Overview

3Slide4

REBW Field Test: BackgroundEach Georgia Milestones assessment includes embedded field-test items in order to sustain the item bank.

The REBW section of the ELA test (Section 1) is 90 minutes and requires students to write an essay in response to an extended writing promptThe time requirement and cognitive demand are too great to utilize an embedded field test design. 4

Important: Your schools’ participation in this field test is crucial and necessary.Slide5

REBW Field Test: Fall 2017In order to supplement the item bank, a stand-alone REBW field test is necessary.

Over 76% of survey respondents preferred a fall field test rather than a spring stand-alone field test. Because the field test will occur in the fall, it is an off-grade field test. 5Slide6

REBW Field Test: Fall 2017

Field testing items prior to their operational use is both a critical and required step in the development and maintenance of a technically sound testing program. This field test is part of the administration of the state student assessment program. While the scope of the field test is significant, we have made every effort to reduce the burden on any single school.

Only one grade or course selected at each school for the majority of schools

This field test will bolster the item bank to ensure capacity for several years.

6

Important: Your schools’ participation in this field test is crucial and necessary.Slide7

REBW Field Test: Educator Involvement

REBW item review – July 2017Educators reviewed items for alignment, bias and sensitivity, and appropriateness for the grade or course. Rangefinding – January 2018Educator committees will review student responses and determine scoring guidelines used to train and qualify scorers.

Data Review – July 2018

Additional review of items, along with student performance data from the field test.

Only items accepted by the committee are eligible to be placed in the item bank.

7Slide8

REBW Field Test:Benefits

Students will gain exposure to this section of the test and have an opportunity early in the school year to respond to an on-demand prompt. With additional prompts in our bank, we will be able to release former prompts, along with annotated and scored student exemplars. GaDOE will analyze student responses and provide qualitative feedback related to any trends that may be observed.

8Slide9

REBW Field Test:Scores

The purpose of the field test is to evaluate the quality of the REBW item sets, not to evaluate student performance.

9Slide10

Reading and Evidence-Based Writing Field TestContent Tested

10

EOG

EOC

Grades 3–8

English

Language Arts

Ninth Grade Literature & Composition

American Literature & CompositionSlide11

REBW Field Test Construction

Day 1

A set of 10 items, with associated passages, to serve as a link to previous Georgia Milestones administrations

Testing time: approximately 30 minutes (not including reading directions)

Start with one sheet of scratch paper; test ticket may be used for scratch paper

Day 2

One passage set (two short passages) with associated items:

Three (3) multiple-choice questions

One (1) two-point constructed-response item

One (1) seven-point writing prompt

Testing time: approximately 90 minutes (not including reading directions)

Start with two sheets of scratch paper (system has the option of using test ticket for one piece of scratch paper)

11Slide12

REBW Field TestGrades/Courses Tested

Students will be assessed on the previous

grade-level (or course), using an

off-grade

approach

.

A few examples (non-exhaustive) to illustrate are provided below:

Fourth grade

students will be tested on

third grade

ELA content;

Sixth grade

students will be tested on

fifth grade

ELA content;

Ninth grade

students will be tested on

eighth grade

ELA content; and

Students who completed American Literature during the 2016-2017 school year will be tested on American Literature content.

12

Note:

Because this is an off-grade field test, high schools are included on the EOG spreadsheet as they will give the grade 8 field test.Slide13

REBW Field TestSelected Schools

Participation is based on the sample selection provided to districts on May 25. Lists of selected schools were provided and each list provides the grade(s)/course(s) and minimum number of students to be tested.The approximate number of students shown in each list is the minimum

number of students to test, however, it is permissible to test more students, if desired.

If current enrollments are fewer than requested in the sample, test all students currently enrolled in the grade level or course.

13Slide14

REBW Field TestSelected Schools

Schools were selected using a stratified-random sampling approach to ensure representativeness of the state.Various demographics (e.g., race, ethnicity, gender) were considered. All districts across the state were included. Maximum “caps” were determined for each grade band (elementary, middle, high) to avoid placing an undue burden on larger schools.

One grade or course is selected at each school.

If more than one grade or course is selected at a school, the “cap” was held across the two grades/courses.

14Slide15

REBW Field TestSelected Students

Each selected school should identify a representative sample of students in the assigned grade(s)/course(s) to test based on:Various demographic backgroundsPrior performance on Georgia Milestones along the full continuum of achievement

e.g., do not select only students who are enrolled in advanced classes

15Slide16

REBW Field TestSelected Students

The representative student sample includes, but is not limited to: Students requiring accommodations, including conditional accommodationsStudents with disabilities (Braille and paper format are not available)English learners

Students who were not enrolled in the previous grade at a Georgia public school

may

be tested, especially if testing intact classes.

16Slide17

REBW Field TestScheduling Considerations

The REBW Field Test is to be administered over two days.Schools may test any time during the window.All schools within a district are not required to test on the same dates. All students within a school are

not

required to test on the same dates.

17Slide18

REBW Field TestScheduling Considerations

Make-up sessions should be scheduled for absent students. It is extremely important that all students participate in both sessions of the field test (Day 1 and Day 2). If a student is absent on the first day, he/she can participate in second day and then make-up the first day.

Schools may schedule rolling make-ups that best meet their scheduling needs.

18Slide19

Reading and Evidence-Based Writing Field Test

Key Dates

Test Setup Available to Districts

September 25

INSIGHT/eDIRECT Training

September 26

September 28 (live repeat)

Test Setup for Secure Practice Test with Response Transmission

September 28

Test Window opens for Secure Practice Test with Response Transmission

October 2

Manuals Arrive in Districts

October 2

Additional Materials (manuals only) Available to Districts

October 2

Test Administration Window

October 16 – November 3

19Slide20

Test Setup

20Slide21

Technology and REBW

Work closely with your technology teamShare technology training dates and timesShare testing schedule, number of testers, amount of time testingPlan for Secure Practice Test sessionsVerify that any new district technology works with INSIGHTReminder about the recent changes in the eDIRECT Device Toolkit

Changes to interface

Changes from ORG Units to configurations

New COS-Device Toolkit Dashboard

Documentation for the change can be found on eDIRECT

Device Toolkit Enhancements Transition GuideINSIGHT Technology User Guide Volume IIISlide22

Scheduling Test SessionsOption 1 – Preloaded Test Sessions

For Districts that submitted Student/Class File to GaDOE Data Collections by September 8, student profiles and test sessions will be preloaded by DRC.Districts can use this preloaded information as is, or if needed, modify the student profile or test session by:Uploading a supplemental file via the Upload Multiple Students function in Student ManagementManually entering/editing directly in eDIRECT

22Slide23

Test Session Placement for Preloaded Students

Grade

Test Session Name

REBW Content

4

Grade 3

Grade 3

5

Grade 4

Grade 4

6

Grade 5

Grade 5

7

Grade 6

Grade 6

8

Grade 7

Grade 7

9

Grade 8

Grade 8

10

Ninth Lit

Ninth Grade Literature

11

Undetermined

Based on prior year’s EOC; for actual assignment refer to

Assessment

from Student Test Ticket

*

12

American Lit

American Literature

23

*

Grade 11 students not loaded if no prior EOCSlide24

Scheduling Test Sessions

Option 2 – Upload Multiple Students/Manual EntryFor districts/schools that did not submit Student Class File to GaDOE Data Collections by September 8, the student profiles and test sessions may be loaded by:

Uploading a supplemental file via Upload Multiple Students function in Student Management

Manually entering student and Test Session information in eDIRECT

24Slide25

Upload Multiple Students

The layout is different from the Pre-ID, EOC Multiple Student, and EOG Multiple Student layouts.25

#

Column Name

1

District Code

2

School Code

3

Grade Level

4

Student First Name

5

Student Last Name

6

Student Gender

7

Student Date of Birth

8

SRC Code

9

Teacher Last Name

10

Teacher First Name

11

GTID

12

Ethnic Hispanic

13

Race American Indian

14

Race Asian

15

Race Black

16

Race Pacific Islander

17

Race White

Note that Teacher First Name or Teacher Last Name will need to be populated. GaDOE suggests using the same naming scheme as Pre-loaded Students.Slide26

Upload Multiple Students

26

Be sure the Reading and Evidence-Based Writing Field Test 2017 is the selected Administration when retrieving these resources from eDIRECT.Slide27

Multiple Student UploadSystem automatically enrolls students off grade testing.4

th – 9th grade students into prior year grade10th grade students into 9th Grade Literature

11

th

grade students into 9

th

Grade Literature or American Literature depending on prior enrollment12th grade students into American Literature

27Slide28

Note

Multiple Student Upload will enter students into Test Sessions according to Teacher Name.Only field test content for the assigned student sample will be available for individual testing sites.For manual entry for Grades 4-9, prior year’s content will be the only available optionFor manual entry for EOC, eDIRECT will not

verify prior student enrollment.

28Slide29

Test Tickets Test Rosters

29

To avoid a student testing under another student’s GTID, you

must

:

Print

ALL

Student Tickets. 

Have students verify their name and test name are correct and sign the ticket next to their name.

If a change is made to a student record (e.g., adding an accommodation),

create a new test ticket for that student

, which will have a new login/password.

Test Tickets

will print

one to a page

, and Each

Test Ticket

contains the student’s username and password for the test session. Note that the student will have a separate

Test Ticket

for each section of the test.

Examiners

The

Student Test Roster

contains a list of students and the usernames and passwords for each student. Slide30

DRC INSIGHT Navigation30

StudentsSlide31

Navigating Pages for Reading Passages

31

Click the left-bottom corner to navigate to the prior page (if available).

Click the right-bottom corner to navigate to the next page (if available).

Current page

Total pages

The page turners are not identified within the online system. Please instruct your students on this feature.

StudentsSlide32

Constructed Response Mistakenly Deleting Responses

Student’s ResponseResponses Deleted (By Mistake)

32

Press

Ctrl+Z

(or

Command+Z

on a Mac) to revert back to recently-deleted text.

StudentsSlide33

Exiting a Test Session ProperlyIf you have any unanswered questions, select and answer the remaining questions.

Once all questions have been answered, select to properly end the test session. 33

StudentsSlide34

Testing Accommodations34Slide35

AccommodationsFollow accommodations guidance from the Accommodations Manual and the

Student Assessment Handbook.Oral reading/signing of reading passages is an accommodation that results in a Conditional Administration for English Language Arts content and requires specific coding.Scribing and transcribing procedures can be found in the

Student Assessment Handbook

and the

Coordinator’s Manuals

.

35Slide36

Accommodations

36Oral ReadingStudents receiving a read-aloud accommodation from a Human Reader must be assigned the

Human Reading/Human Signer

online Form 01

prior

to logging in to the test.

Students receiving the read-aloud accommodation from the

Text-to-Speech

online accommodation must have this accommodation assigned in eDIRECT

prior to

logging in to the online form.Slide37

Accommodations 37

Assigning the Human Reader/Signer Form LoginsExaminers will be able to access an online test form utilizing INSIGHT.

The School Test Coordinators will obtain a test login for the human readers from the eDIRECT Documents tab.

Login should remain secure and returned to the School Test Coordinator immediately following the administration.

DO

NOT

EMAIL THE LOG-IN TO USERS.

Directions for downloading Examiner Test Tickets are in the Online section of the

REBW Test Administration Manual

and on the following slide. Slide38

Accommodations

38

Assigning Oral Reading and Transcription Forms eDIRECT Test Set-Up

Assign/Activate Accommodation and Form for Student UseSlide39

Coding Accommodations Online

39

Select Accommodation Type

Basis of AccommodationSlide40

Examiner Test Tickets for Online Human Reader Administration40

Requires logging in to eDIRECT and selecting administration window Slide41

Security and Irregularities41Slide42

Testing Irregularities

Reporting and CodingAll irregularities must be coded, documentation completed and submitted on the Testing Irregularity Form in the MyGaDOE Portal. When entering the documentation into the Portal, please:Select the appropriate “Administration Cycle” –

For example, REBW

.

Select the appropriate “Administration” – 

For example, REBW

.Include the form number of the test that needs to be coded as an Irregularity or Invalidation.

Enter details into comments

42Slide43

43

If directed by GaDOE, the System Testing Coordinator or designee will update for the affected course by doing the following:From the Student List in eDIRECT Test Set-Up, select the student to be coded.

Access the Testing Codes tab.

Select the Irregularity Status.

Select the Irregularity Code provided by GaDOE from the dropdown option.

Testing Irregularities

Coding OnlineSlide44

Before, During, and After Testing 44Slide45

Before Testing

System Test Coordinator Responsibilities

Receipt and inventory of test materials

Review Test Administration Manual

Review the Secure

Practice Test

examiner’s script

Organize training sessions for School Test Coordinators 

Organize system security plan

Review technology readiness with Technology Director

Verify School Test Coordinators have scheduled Online Tools Training Tests (OTT)

OTT Directions from Georgia Milestones Website and eDIRECT

Examiners will find directions to help familiarize students with

the TTS in the Test Administration Manual

45Slide46

46

Before Testing

Additional Materials

Additional Materials can be ordered beginning October 2Slide47

Before Testing47

School Test Coordinator Responsibilities

Read Test Administration Manual

for System Test Coordinators,

School Test Coordinators, and Examiners

Organize training sessions for Test Examiners

Prepare the testing

site and organize testing materials for distribution

Organize training for assessment of students with accommodations

Organize school security plan and monitor test administration

Manage students and test sessions in eDIRECT

Assign

and code accommodations in eDIRECT

Print and sort by testing location

Student Test Tickets and Student Test Rosters

Administer the Secure Practice Test to students

Review technology readiness and school testing windows with local technology support including verification that Insight and the Testing Site Manager (TSM) are installed and all testing devices are prepared for testing.Slide48

During TestingSchool Test Coordinator Check daily for students who are In Progress or Locked. Follow procedures for students who did not end a section correctly.

See Sessions In Progress QuickStart Guide on eDIRECT.Monitor student activity 48Slide49

After TestingSchool Test Coordinator Confirm with technology coordinator that all responses have been cleared from each TSM used during testing. 

Verify that Test Examiners have returned all materials. Includes test tickets, rosters, scratch paper, and Test Administration Manuals.System Test Coordinator

Do

NOT

return the following materials to DRC:

Manuals, test tickets, student test rosters, and scratch paper.

These must be securely destroyed AT THE SYSTEM LEVEL

immediately following the end of your local window.

49Slide50

Contact Information

DRC Customer Service TeamPhone: (866) 282-2249Email: GAHelpDesk@datarecognitioncorp.com

Hours: 7:00am to 8:00pm (Eastern)

Georgia Department of Education

Director of Assessment

Sandy Greene (404) 656-0478;

sgreene@doe.k12.ga.us

Program Manager, Test Development

Jan Reyes (404) 463-6665;

jreyes@doe.k12.ga.us

Assessment Specialists (by district assignment)

Joe Blessing (404) 232-1208;

jblessing@doe.k12.ga.us

Mary Nesbit-McBride (404) 232-1207;

mmcbride@doe.k12.ga.us

 

Robert McLeod (404) 656-2589;

rmcleod@doe.k12.ga.us

 

50