District Test Coordinator Meeting December 17 2014 Topics Digital Library updates Classroom activities and performance tasks information 1 Digital Library Updates U ser account passwords reset November 4 2014 ID: 760100
Download Presentation The PPT/PDF document "Smarter Assessment Updates" is the property of its rightful owner. Permission is granted to download and print the materials on this web site for personal, non-commercial use only, and to display it on your personal computer provided you do not modify the materials and that you retain all copyright notices contained in the materials. By downloading content from our website, you accept the terms of this agreement.
Slide1
Smarter Assessment Updates
District Test Coordinator Meeting
December 17, 2014
Slide2Topics
Digital Library updates Classroom activities and performance tasks information
1
Slide3Digital Library Updates
User account passwords reset November 4, 2014User account training provided for District Test Coordinators (DTCs) and District Information Security Officers (ISOs)Password/account questions directed to DTCs and ISOs Lisa Alexander – lisa.alexander@doe.k12.de.us – available for further assistance
2
Slide4Classroom Activity Update
Classroom Activities will be available for access on the DeSSA portalLink will be available in February
3
Slide5Assignment of Performance Tasks
Performance tasks will be administered to all students in grades 3 through 8 and 11, in Mathematics and ELA/LiteracyStructureSeveral topics per grade/subjectTopic = theme = classroom activityEach topic has several performance tasksFixed formsOne accommodated performance task per topic
4
Slide6Assignment of Performance Tasks
TIDE will assign a topic to each schoolEvery student in a particular grade in a particular school will receive performance tasks on the same topicTDS will assign the performance tasks to students using a random selection method
5
Slide7Assignment of Performance Tasks
How will a school know which topic was assigned to it?In-box feature in Online Reporting System (ORS) and/or portalWhat if a student changes schools?Depends upon the timing of changeIf a student has already started the performance task in school X and moves to school Y prior to task completion, he or she will continue the performance task that was originally assigned to him/her in school XIf a student has not started the performance task in school X prior to moving to school Y, he or she will be assigned a new performance task based on the topic assigned to the new school
6
Slide8Accommodations/Supports
7
Accommodated forms
One accommodated performance task per topic
Most accommodations must be set up in advance in TIDE
The following accommodations can be set up in the TA Interface at the time of testing:
Second language glossary
Braille
American Sign Language (ASL)
Spanish translation
Slide9Performance Task Update
TA will access the Performance Task by category (topic)Smarter Performance Task Category examples:Smarter Summative g3-5 ELA Performance TaskSmarter Summative g6-11 Math Performance TaskSmarter Interim Comprehensive Performance Task
8
Slide10Hand Scoring Interim Assessments
December 17, 2014
Office of Assessment
Department of Education
Slide11Topics
Interim backgroundInterim Comprehensive Assessment (ICA) and Interim Assessment Block (IAB) informationIAB availability updatesHand scoring overview
10
Slide12A Balanced Assessment System
11
Slide13Interim Assessment Components
12
Will be available during the winter of 2014–2015 with a gradual rollout as the item pool supports
Slide14Interim Assessment Interim Items
Same as summative itemsItems developed together based on CCSSUniversal Design principles usedSame accessibility resources incorporatedEvidence to support claims in mathematics and English language arts/literacy providedDifferent from summative itemsConstructed response items will be scored locallySeparate open, non-secure pool
13
Slide15Two Types of Tests
Interim Comprehensive Assessments (ICAs)Use same blueprint as summative testsAssess same claims and standardsSame components and item typesYield overall scale scores, performance level designation and claim score informationIn Delaware, ICAs can be administered up to twice a yearInterim Assessment Blocks (IABs)Assess smaller sets of targetsAddress specific content areasProvide more flexibility Report as “Below Standard, “At/Near Standard,” and “Above Standard”Unlimited administration during the year
14
Slide16Interim Assessment Administration Characteristics
Grade flexibilityAvailable for students in grades 3 through high schoolInterims from any grade can be used, depending on purpose ICAs and IABs can be administered multiple times during the yearTests draw from same interim poolStudents may see some items more than onceDecisions about test choice and frequency determined by local choice
15
Slide17Initial Interim Assessments
ICAs will be offered in both ELA and Mathematics (Jan. 2015)Initial IABs available (Jan. 2015)Dependent upon item availability in the interim pool Additional items will be field tested in 2014-15, expanding the interim poolBlocks with an asterisk are not available for the 2014-15 school yearFully accessibleFixed form online, to become adaptive as item pool allow
16
Slide1817
Grade 3-5Read Literary TextsRead Informational TextsEdit/ReviseBrief WritesListen/InterpretResearchNarrative Performance Task * Gr4-5 only in 2014-15Informational Performance Task * N/A in 14-15Opinion Performance Task * Gr3 only in 2014-15
English Language Arts IABs
Slide1918
Grade 6-8Read Literary TextsRead Informational TextsEdit/ReviseBrief WritesListen/InterpretResearchNarrative Performance Task*Explanatory Performance Task*Argument Performance Task
English Language Arts IABs
* Not available in 2014-15
Slide2019
High SchoolRead Literary TextsRead Informational TextsEdit/ReviseBrief WritesListen/InterpretResearchExplanatory Performance Task*Argument Performance Task
English Language Arts IABs
* Not available in 2014-15
Slide2120
IAB NameGrade345Operations and Algebraic ThinkingaaaNumbers and Operations in Base 10*aaFractionsaaaGeometry **Measurement and Dataa**Mathematics Performance Taskaaa
* Not available in 2014-15
Mathematics IABs
Slide2221
IAB NameGrade67Ratio and Proportional RelationshipsaaNumber SystemaaExpressions and EquationsaaGeometrya*Statistics and Probability**Mathematics Performance Taskaa
* Not available in 2014-15
Mathematics IABs
Slide2322
Grade 8Expressions & Equations I (and Proportionality)*Expressions & Equations II*FunctionsGeometryMathematics Performance Task
Mathematics IABs
* Available as a single Expressions & Equations Block in 2014-2015
Slide2423
Mathematics High School IABsAlgebra and Functions - Linear FunctionsAlgebra and Functions - Quadratic FunctionsAlgebra and Functions - Exponential Functions*Algebra and Functions - Polynomials Functions*Algebra and Functions - Radicals Functions*Algebra and Functions - Rational Functions*Algebra and Functions - Trigonometric Functions*Geometry - Transformations in Geometry*Geometry - Right Triangle Ratios in GeometryGeometry - Three - Dimensional Geometry*Geometry – Proofs*Geometry – Circles*Geometry – Applications*Interpreting Categorical and Quantitative Data* Probability* Making Inferences and Justifying Conclusions* Mathematics Performance Task
* Not available in 2014-15
Slide25Interim Assessment Scoring
Scoring of non-machine scored items is a local responsibility ICAs and some IABs have items that are not machine-scoredTeacher Hand Scoring System will be provided to enter scoresScoring of tests Same scoring rules as summative tests
24
Slide26Interim Assessment Hand-Scoring Plan Overview
Focuses on TrainingEffective administrationScoringInstructional usageProfessional development and resources
25
Slide27Three Phase Approach
Phase I – Pre-Hand Scoring (December)Focuses on developing background knowledge and preparing for the administration of the Smarter Interim Assessments to be released in January Phase II – Hand-Scoring Training (January)Focuses on the hand-scoring process to promote integrity, validity, and reliability of scoring and alignment with summative scoringPhase III – Post-Hand Scoring (January–Summer)Focuses on the entry, interpretation, and usage of scores while planning forward to enhance the process.
26
Slide28Further Information
27
Carolyn Lazar
Office of Assessment
Carolyn.Lazar@doe.k12.de.us
(302) 735-4090
E-mail
any additional
questions or comments
Slide29Smarter Summative and Interim Comprehensive AssessmentOnline Reporting System
Office of Assessment
December 2014
Slide30Topics
Online Reporting System updates for Summative and ICAOverview and use of Smarter assessment score reporting
29
Slide31Online Reporting System (ORS)
Available via the DeSSA Portal Application provides two componentsScore ReportingTest Management Center
30
Slide32Scores Reported
Two overall scale scores will be reported on the vertical scaleEnglish language arts/Literacy for both computerized adaptive tests (CAT) and performance tasks (PT) componentsMathematics for both computerized adaptive tests (CAT) and performance tasks (PT) componentsError bands of the overall scoresAchievement level will be reportedLevel 1 to Level 4Claim scores
31
Slide33Claim Scores
Student performance will be reported for each claimEnglish language arts/LiteracyReadingWritingListeningResearchMathematicsConcepts and Procedures Problem Solving and Modeling and Data AnalysisCommunicating Reasoning
32
Slide34Claim Scores
Claim scores are reported in three descriptive categoriesBelow StandardAt/Near StandardAbove StandardClaim scores are derived from student performance on items/questions under each claiman estimate of the possible score (theta) for the claiman estimated score in the reporting category based on pre-determent criteria
33
Slide35Interim Assessments
Test administrations varyPurpose and intended use of test scoresTest time/schedulingRepeated testing Scoring proceduresNon-standardized testing conditionsCautions and limitations in the use of test scoresNo state level summaryNo district and school levels summariesLimited comparability of test results across schools and districtsCautions in using Interim assessment scores to compare with and/or predict summative assessment scores
34
Slide36Summative Reporting
Test scores on Smarter summative assessments will not be available until test is completedEach assessment includes computerized adaptive tests (CAT) and performance tasks (PT) componentsEach component has different types of items – selected response and constructed response (CR) itemsCR items on the Smarter Summative Assessments will be scored by scoring agency at the state levelOverall score and claim scores can be generated when all items are scoredBased on overall scale score, student achievement level is determined
35
Slide37Online Reporting System (ORS)Mathematics ICA Achievement Level
36
Accessing lower level information in ORS system by use of magnifying glass to drill down
Slide38Online Reporting System (ORS) Mathematics ICA Claim Level
37
Slide39Online Reporting System (ORS) Mathematics Summative Achievement Level
38
Slide40Online Reporting System (ORS) Mathematics Summative Claim Level
39
Slide41Online Reporting System (ORS) – Student Score Report for Smarter Interim Assessment
40
The achievement levels identified:Level 4 Level 3Level 2Level 1 The claims performance categories:Below StandardAt/Near StandardAbove Standard
Slide42Further Information
41
Lisa Alexander
Office of Assessment
Lisa.Alexander@doe.k12.de.us
(302) 735-4090
Liru Zhang
Office of Assessment
Liru.Zhang@doe.k12.de.us
(302)
735-4090
E-mail
any additional
questions or comments