What is a CAT What is a CAT COMPUTER ADAPTIVE TEST performance task What is a CAT C OMPUTER A DAPTIVE T EST Often referred to as C A T or a CAT The Computer ID: 659086
Download Presentation The PPT/PDF document "What is a CAT? Introduction" is the property of its rightful owner. Permission is granted to download and print the materials on this web site for personal, non-commercial use only, and to display it on your personal computer provided you do not modify the materials and that you retain all copyright notices contained in the materials. By downloading content from our website, you accept the terms of this agreement.
Slide1
What is a CAT?Slide2
IntroductionSlide3
What is a CAT?Slide4
What is a CAT?COMPUTER ADAPTIVE TEST
+performance taskSlide5
What is a CAT?
COMPUTER
A
DAPTIVE
T
EST
Often referred to as
C
-
A
-
T
or
a
CATSlide6
The Computer
Part of a CATSlide7
What is a CAT?
COMPUTERSlide8
What is a CAT?More
efficient and appropriate for students than a typical paper-and-pencil test
COMPUTERSlide9
What is a CAT?Allows
students to have more engaging test questions from the real world
COMPUTERSlide10
What is a CAT?Items might include
videos or audio,
PowerPoint slides, or
interactive test questions.
COMPUTERSlide11
What is a CAT?
allows students flexibility and accessibility
puts
the student in control
gives
access to helpful tools
and
resources
COMPUTERSlide12
What is a CAT?Usability, Accessibility,
and Accommodations Guidelines
Can be found on the
Smarter Balanced website
.Slide13
The Test Part
of a CATSlide14
What is a CAT?TEST
The
online assessments are designed
to assess how well a student has mastered the expectations of the
Common Core State Standards
in
both
English language arts
or
mathematics
for his or her grade level.Slide15
The Adaptive
Part of a CATSlide16
What is a CAT?
ADAPTIVE
C
OMPUTER
ADAPTIVE
T
ESTSlide17
What is a CAT?In the adaptive portion of the online assessments,
the questions (or items) are chosen for each student so that the test is neither too hard nor too easy.
ADAPTIVESlide18
What is a CAT?While the CAT is adaptive, it operates from logical rules that can be inspected or
examined, and that are known and published.
ADAPTIVESlide19
What is a CAT?C
OMPUTER ADAPTIVE
T
EST
Provides a unique and effective way to test what a student has
learned Slide20
What is a CAT?
C
OMPUTER
ADAPTIVE
T
EST
?
?
?
?
?
?
?Slide21
Copyright 2013 by Educational Testing Service. All rights reserved.Slide22
How can a CAT do that?Slide23
What is a CAT?How can a
CAT do that?
Bank of Test Items
A Recommended Blueprint
Programming (or Algorithm)
Algorithm ConstraintsSlide24
What is a CAT?Slide25
What is a CAT?
?
?
?
?
?
?Slide26
What is a CAT?
?
?
?
?
?
?Slide27
What is a CAT?
How does it know which question to pick?Slide28
What is a CAT?Test Blueprint
focuses the selection of questions from the test bank to the appropriate content so the structure of the test is similar for every student
selects the precise questions based on the individual student’s responses to previous questions in the testSlide29
What is a CAT?
ELA, Item Code: 123456
Claim 1, Target 3Slide30
What is a CAT?Important Rules to make the test
Balance
(Enough
of the C
oncept?)
Question Type
(Selected Response? Constructed Response?)
Reading Length
(Short? Medium? Long?)
Difficulty
(Appropriate
for the
Grade
L
evel
?)Slide31
How does a CAT work for the student?Slide32
What is a CAT?
How will it work for me?Slide33
How will it work for the student?
The test starts with an item from a pre-determined difficulty level. It may be based on average difficulty for the grade, or it may be based on information known about the student from previous tests.Slide34
How will it work for the student?
Question Selection
The student receives questions based on
his or her
response to the previous questions. The computer program quickly selects a new question after reviewing how well the student performed on all the previous questions. Based on the responses, the program selects a question that fits the test blueprint and gives the best information about what the student knows. This is how a CAT can customize each test so it is an accurate measure of any student’s skills.Slide35
How will it work for the student?
Questions will ADAPT
If the student continues to answer questions correctly, the questions covering the blueprint will continue to get more challenging. If the student starts missing the answers to questions, the program will start to select questions that are easier. The program adapts to how the student is performing. Slide36
How will it work for the student?
Responses
Because the program knows which questions are harder and which are easier, several students may have answered a similar number of questions correctly, but the student who has answered the more challenging questions correctly will achieve a higher score.Slide37
How will it work for the student?
That's it!
A student’s score is based on the difficulty of the items that were right or wrong, not on the
total number
of correct answers.
Of course, it all seems so simple when described like this. But there is a very complex process happening within the CAT engine to make all of these determinations simultaneously with predictability built in.Slide38
CAT ReviewSlide39
CAT Defined
Introduction
Let’s
review the parts that make up a CAT —
C
OMPUTER
A
DAPTIVE
T
EST
Computer
Adaptive
TestSlide40
CAT Defined
The COMPUTER is important in CAT
because
I
t
makes the test more efficient and appropriate for every student;
I
t
allows students more flexibility and accessibility during testing; and
I
t
has the ability to include videos, audio, PowerPoint slides, and interactive test items.
Computer
Adaptive
TestSlide41
CAT Defined
The ADAPTIVE part of the CAT makes the test unique for every student:
It
looks to see if the student response is
correct.
I
t
selects the next question to build a custom-made test for each student.
Computer
Test
AdaptiveSlide42
CAT Defined
The
online test
is testing how well a student has mastered the expectations of the Common Core State Standards
in
English language arts (ELA) and
mathematics.
The test ends when the student has answered a sufficient number of questions that satisfy the requirements of the blueprint and provide a good estimate of the student’s proficiency.
Computer
Adaptive
TestSlide43
Better Assessment ResultsSlide44
What is a CAT?How does a CAT provide better assessment results?
With a CAT, each student will demonstrate the level of his or her content knowledge based on the item selection that adjusts to his or her particular responses.Slide45
How does a CAT provide better assessment results?
It is ACCURATE
It is INDIVIDUALIZED
It is SECURE
It is EFFICIENT
It delivers FAST RESULTS
This provides a testing experience that is a more accurate way to evaluate mastery of a subject by minimizing the difference between what a test score indicates and a student’s actual knowledge and abilities.Slide46
How does a CAT provide better assessment results?
It is ACCURATE
It is INDIVIDUALIZED
It is SECURE
It is EFFICIENT
It delivers FAST RESULTS
Because the program knows which questions are harder and which are easier
,
the student will see items that are neither too easy nor too hard.Slide47
How does a CAT provide better assessment results?
It is ACCURATE
It is INDIVIDUALIZED
It is SECURE
It is EFFICIENT
It delivers FAST RESULTS
Not all students receive the same questions; therefore, cheating is more difficult than it would be on a paper test with fewer items and with paper forms that can be copied.Slide48
How does a CAT provide better assessment results?
It is ACCURATE
It is INDIVIDUALIZED
It is SECURE
It is EFFICIENT
It delivers FAST RESULTS
It provides items in an order that best determines a student’s proficiency.Slide49
How does a CAT provide better assessment results?
It is ACCURATE
It is INDIVIDUALIZED
It is SECURE
It is EFFICIENT
It delivers FAST RESULTS
Many items are scored in real time by the computer. Student test scores and reports are not delivered until the entire test, including parts requiring human scoring, has been evaluated.Slide50
How does a CAT provide better assessment results?
It is ACCURATE
It is INDIVIDUALIZED
It is SECURE
It is EFFICIENT
It delivers FAST RESULTS
The students’ testing experience will be their very own and
will provide
them with the chance to show what they know.Slide51
What is a CAT?Now you know! Slide52
For more information,
please visit:
www.smarterbalanced.org