Interim and Diagnostic Assessments - PowerPoint Presentation

Slide1

Interim and Diagnostic Assessments

Dr. Stacey MurrellSlide2

Agenda

Intro to Interims

Intro to Diagnostics

Differences between Interims and Diagnostics

Big

News

Using DIAs and

IABs

Webinar

Sneak Peek

Questions/AnswersSlide3

Interim AssessmentsSlide4

Interims are NOT

The tests are

NOT required or mandated by WVDE.

The interims are NOT benchmarks.

There is NOT a WVDE-set or mandated schedule for administering interims.

There is NOT a WVDE-mandated plan for aligning curriculum to interims.Slide5

Purpose

The purpose of the WV Interim Assessments is to support teaching and learning throughout the year

.

Experience a clone of the summative test

Focus on targets/skills, fewer questions

Receive reports that provide feedback on assessment claims and targets

Available for ELA and math, grades

3-11Slide6

Non-public Tests Not Secure

The

i

nterim

a

ssessments

are not released to the

public.

WVDE

purchased acces

s to

interim tests.

The tests are not secure. This means teachers can talk about and discuss interims with their students.

Teachers CAN

project interims and diagnostics on a

SmartBoard

using the Teacher Item Previewer (more on this coming in PP

)Slide7

Types of Interims

There

are two types of interim assessments

. Both are fixed form. This means they are NOT adaptive.

The

Interim Comprehensive Assessments (ICAs)

use the same test blueprints as the WV General Summative Assessment and assess the same standards.

The

Interim Assessment Blocks (IABs)

focus on smaller sets of targets and are more flexible to better support instruction.Slide8

Administration

Both

interim assessment types are assigned by teachers and taken by students online.

They

will use the same delivery software as the general summative assessments.

Teachers use the WV Assessment Portal.

Students use the WV Student Secure Browser.

Embedded designated supports and accommodations for students, such as text-to-speech

are available

to students taking

interims and diagnostics

.Slide9

Scheduling Considerations

Teachers can fit the interims around their schedule.

Once started, 45 days to complete an interim or diagnostic test.

Once started,10 days to complete an interim performance task.Slide10

IABs

Hand Scored Items and Total Items Count

7 ELA IABs

4 Math IABs

That means each grade has 11 IABs.

http

://tinyurl.com/wvnxg-interimsSlide11

ICAs Hand Scored Items and Total Items Count

http

://tinyurl.com/wvnxg-interimsSlide12

Interim

Comprehensive Assessments (ICAs

)

Have

the same testing blueprint as the general summative assessment and mirrors the summative testing

experience

Have the same item

types and formats, including performance

tasks

Give students an

overall scale score, an overall performance level

designation (Level 1, 2, 3, or 4), and claim performance designation (Below

Standard

,

At/Near Standard

, or Above Standard

)

S

ame data as summative student reportSlide13

Interim Comprehensive Assessments (ICAs)Slide14

Interim Comprehensive Assessments (ICAs)Slide15

Why should we give an ICA?

The

data

is

stored in ORS.

Longitudinal Report/Trend

Report

Trend

from ICA to ICA (2014-2015, 2015-2016, etc.)

Trend from ICA to

Summative

Clone of the summative test and its reportingSlide16

Interim

Assessment Blocks (IABs

)

S

maller

assessments that focus on sets of targets and can be used to support

instruction (approx. 13-18 questions).

C

ontain

the same item types and formats, including performance tasks, as the general summative assessments.

Students

receive an overall score for the IAB. The results for the IABs are reported as “Below Standard,” “At/Near Standard,” and “Above Standard.”Slide17

Interim Assessment Blocks (IABs)Slide18

Interim Assessment Blocks (IABs)Slide19

When should I give an ICA or IAB?

WVDE is not mandating administration. We can offer guidance, if you’d like.

ICAs cover all the content standards, so the closer to the summative the better.

More questions, students need more time.

Hand scoring, teachers need more time.

Reading reports and taking actions, teachers/teams/schools will need time.

IABs (blocks) cover a cluster or domain, so consider throughout the year use, leading up to the ICA.

Fewer questions, students may finish in a class period.

3 ELA blocks have NO hand scoring; all math IABs, but PT, have NO hand scoring.

Consider using as pretest, posttest

If there are 11 blocks available, what is a reasonable number to ask teachers to complete prior to taking ICAs? Slide20

Scoring

Automatic Scoring

Items

that are able to be automatically scored will be scored by the computer.

Teacher Hand Scoring

Constructed response

items and performance task ELA essay/ math

performance task response

items are not able to be automatically scored; therefore, these items will be scored by teachers using a scoring rubric.

NOTE: The WV General Summative items/essays are hand scored by individuals contracted by the test vendor, not the teachers of the students.Slide21

How to Hand Score Interims and Diagnostics

Teachers use the Teacher Hand Scoring System (THSS)

How-To

Videos Available

How to Hand Score a Math Item

How to Hand Score an ELA Item

How to Hand Score an ELA

Essay

How to Reassign a Hand Scored Item to Another Teacher

Videos located in my OneDrive

folderSlide22

WV Diagnostic AssessmentsSlide23

Diagnostics are NOT

The tests are

NOT required or mandated by WVDE.

They are NOT benchmarks.

There is NOT a WVDE-set or mandated schedule for administering diagnostics.

There is NOT a WVDE-mandated plan for aligning curriculum to diagnostics.Slide24

Purpose

The purpose of diagnostic assessments is to provide feedback on students’ performance.

Reports will have the content standard

that

each test question is aligned to and how the class/student answered the question.Slide25

Developed

Written by WV teachers using the same item writing specs as the general summative test and interim tests.

There are 600 diagnostic questions, but that is not as robust as interims.

We hope to add more diagnostics as we see that teachers and students find them helpful.Slide26

What are the Diagnostics?

Structured like Interim Assessment Blocks (IABs). Approx. 2-25 questions per diagnostic.

ELA Diagnostic Blocks are arranged by Clusters (Reading Literary, Reading Informational, Research)

Math Diagnostic Blocks are arranged by the Claims (Concepts and Procedures, Problem Solving, Communicating Reasoning, and Modeling and Data Analysis)Slide27

WV DiagnosticsSlide28

WV DiagnosticsSlide29

Differences between ICAs and Diagnostics

#1

ICAs give more detailed data about student performance. Clone of the summative, covers the same assessment claims and content standards and reports same data.

Diagnostics just provide how students performed on each question, do not cover all claims and content standards.Slide30

#2 IAB and DIA Reporting

Diagnostics will report out a Class/Student Item Analysis Report. Report shows the content standard or target, if no standard possible (Math Claims 2,3, and 4) that each question is aligned to and how students performed on that standard or target.

IABs only indicate for each cluster or domain if students are below, at/near, or above standard.Slide31

#3 Grades 9 and 10

Grades 9 and 10 have their own Diagnostic tests. Written by WV 9

th

and 10

th

grade teachers.

Interims are grade 11. Grade 9 and 10 students can use grade 11 interims. By default, grade 9 and 10 students can access grade 11 interims. Slide32

Interim Assessments

Interim Comprehensive Assessments (ICAs)

Interim Assessment Blocks (IABs)

Not the same as Practice Tests.

Access through the WV Portal

Operational Test AdministrationSlide33

Big News #1

Teachers can give students off-grade level interim tests

Only interims, NOT diagnostics

Interim Comprehensive Assessments (ICAs)

Interim Assessment Blocks (IABs)

Teachers have to manually search student in TIDE, edit the interim test preference, and save it.

Has to be done by the teacher and for each student individually. Could be time consuming.

As soon as teacher hits save, student can be given an off-grade level interim

test.

Quick guide was emailed to you in Nov. and also located on Stacey’s OneDrive.Slide34

Big News #2

Interim and Diagnostic Teacher Item Previewer

Teachers can VIEW and PROJECT ANY Interim and Diagnostic Test

Click on the

Card

The answer keys for DIAs and IABs are in TIDE and also in Stacey’s OneDriveSlide35

Using Diagnostics

Teachers select and give a diagnostic test

They hand score any items, if any need hand scored

See Word document DIA Hand Scored Items and Total Item Counts on Stacey’s OneDrive

ELA literary and informational passages have been added to OneDrive, if teachers want to see the passages (they can also just look at Item Previewer)Slide36

Diagnostic Hand Scoring

If teachers have a roster created by principal, they will see their reports instantly, after doing the hand scoring.

Don’t forget teachers must hit “Mark as Complete” at bottom of Hand Scoring page

Some have forgotten this step and called meSlide37

Diagnostic Reports- Class Level ScreenshotSlide38

Diagnostic Answer Keys

Available on Stacey’s OneDrive

http://tinyurl.com/wvnxg-interims

Also available in TIDE under General Information TabSlide39

Diagnostic Answer Keys

Located in Stacey’s OneDrive

Teacher can review diagnostic test and answer keys

Example, I’d locate #10 G5 Research question.

See the answer, target, content standard, and how the question is written.

Consider why 89% of my students picked the wrong answerSlide40

DIA Reading Passages

For ELA DIAs Reading Literary or Reading Informational, the passages are all available in Word documents.

Teachers can view/print/project the passages and work with the students’ reading strategies used to answer the questions.

They are located in Stacey’s OneDrive and in TIDE under General Resources tabSlide41

Using an IAB

Teachers select and give

an IAB. Use the Item Total document in Stacey’s OneDrive for names and number of test questions.

ELA blocks are by cluster (Reading Literary, Reading Informational, etc.)

Math blocks are by domain and grade specific (G4 Fractions, Operational and Algebraic Thinking, etc.)

They

hand score any items, if any need hand

scored (ELA Research, Edit/Revise, Listening = no hand scoring and Math all but PT = no hand scoring)

Remember to select “Mark as Complete” in THSSSlide42

IAB Reports- Class Level ScreenshotSlide43

IAB Answer Keys

Located in Stacey’s OneDrive

Teacher can review IABs using Item Previewer and Answer KeysSlide44

What’s Next?

Review Test and Items with Class

Use Interim and Diagnostic Teacher Item Previewer

Project the test on

SmartBoard

.

Students and teacher can discuss reasoning and rationale behind the correct and incorrect answers using the answer keys.Slide45

Additional Review Ideas

Create practice

questions/bell ringers using the same format of the DIAs and IAB test questions. Change the content of the questions to match your class materials or subject.

Incorporate classroom resources, teacher resources, Digital Library instructional resources that contain the content standards or ELA clusters/math domains that class is showing difficulty in achieving proficiency.

Have

students retake the DIAs and/or IABs and analyze the data to see if students improved.Slide46

December 16 Webinar

Spotlight on the WV Diagnostic Assessments

3:30-4:30pm webinar

Purpose:

This webinar will demonstrate how schools can use the data from the diagnostic assessments to determine strengths and weaknesses in students’ performance

.

Check DTC listserv email

for

URL and conference calling code

Will be recorded and uploaded on Assessment OneDriveSlide47

Sneak Peek-

Stay Tuned

WV is tentatively scheduled to have interim reports enhanced in Winter 2016.

ICA and IAB Reports

will “drill down” similar to DIA reports.

Teachers and schools will be able to see the content standard or assessment target that each question was aligned to and the percentage of students in the group who answered correctly or incorrectly.Slide48

Questions

slmurrell@k12.wv.us

Interim and diagnostic videos and resources available on WV Assessment Portal and

Stacey’s OneDrive

http://tinyurl.com/wvnxg-interims