Webinar will start at 100 P M To hear the presentation dial 18665511530 and enter 8375857 as the Participant Code Ohio Achievement Assessments OAA Spring 2013 Administration ID: 1046164
Download Presentation The PPT/PDF document "Welcome! The OAA Administration" is the property of its rightful owner. Permission is granted to download and print the materials on this web site for personal, non-commercial use only, and to display it on your personal computer provided you do not modify the materials and that you retain all copyright notices contained in the materials. By downloading content from our website, you accept the terms of this agreement.
1. Welcome! The OAA Administration Webinar will start at 1:00 PM. To hear the presentation, dial 1-866-551-1530 and enter 8375857# as the Participant Code.
2. Ohio Achievement AssessmentsOAASpring 2013 AdministrationJon Peterson ScholarshipApril 17, 2013Presented by the Ohio Department of EducationPaula MahaleyOffice of Curriculum and Assessment
3. Purpose of this WebinarReview functions and related areas for the 2013 Spring Administration of the Ohio Achievement Assessments (OAA) :Test Dates for OAAOAA Administration Roles and ResponsibilitiesAdministration of OAAOAA Special Versions and Accommodations
4. Contact InformationTest and Content Information – ODEPaula Mahaley – 614.466.0217Test Materials; Receipt and Shipping test materials; TIDE – AIR 888.944.5001JPS – ODEKaellen Craft – 614.466.6837
5. OAA Administration DatesReceive test materials – week of April 8Test Dates – April 22 – May 10Return tests – Initial administration May 3, 6, 7Return tests – Make-up administration May 10Return tests – Nonscorable materials May 13Pre-processing Change – April 15 – May 17Pre-reporting Change and Invalidation window – May 29- 30 Score results electronically available – June 15Printed reports – June 28
6. OAA Administration DatesReceive test materials – week of April 8Additional Order window in TIDE – April 8 – May 8Test Dates – April 22 – May 10Week 1 and 2 is the initial test administration: April 22 – May 3Week 3 is the makeup test administration: May 6-10
7. Questions on the OAA Dates
8. OAA Administration Roles
9. OAA Administration RolesDistrict Test CoordinatorBuilding Test CoordinatorTest AdministratorDepending on the size of the provider facilities, one person may be assigned all 3 roles and will be responsible for all duties listed.
10. District Test Coordinator (DTC) Responsibilities: Receive the monthly OAA newsletter sent by email – share information with all staff who are involved with OAA – must call AIR to sign up for newsletter.Train Building Test Coordinator (BTC) on proper security procedures.Receive and inventory test materials, special versions and overage from vendor and distribute to BTC using the packing lists.DO NOT open the shrink-wrapped packages prior to first day of testing.
11. District Test Coordinator (DTC) Responsibilities: Contact for TIDE – online system used to order materials and preID file layout; change demographic data; request invalidations, rescores and verifications.Contact for OOARS – online system where student results are receives.Ensure that state and district test security procedures are followed at all times: before, during and after test administration and during the return of test materials.Ensure the return of all test booklets and special versions.
12. District Test Coordinator (DTC) Responsibilities: Complete Secure Material Resolution Form. Retain documentation for returning materials after testing.Notify vendor of any discrepancy.Receive electronic test results (requires password) and distribute test results.Receive and distribute printed test reportsAct as district liaison during anomalous situationsInvalidations and Breach FormsRescore and Verification Requests12
13. 13Building Test Coordinator (BTC)Train Test Administrators (TA) on proper security procedures.Receive and inventory test materials and special versions from the DTC and distribute to the Test Administrator using the packing lists.DO NOT open the school boxes or shrink wrapped packages prior to the first day of testing.Notify vendor of any discrepancy by completing the Secure Material Resolution Form.Report discrepancies to the DTC that same day
14. 14Building Test Coordinator (BTC)Maintain test security by using the serial numbers to account for all secure test materials before, during and after test administrationProcess non-receipt of any materials listed on packing listdamaged or defective test booklets or answer documentsmissing or duplicate sequence numbers on booklets or answer documents.Keep materials in locked storage until day of testingKeep all boxes in which test materials were delivered to return scorable materials to the DTC after testing
15. 15Building Test Coordinator (BTC)Collect all test booklets or answer documents from TAs, confirming receipt of all materials distributed.Compare student name on front of book to name on Pre-ID label (or as gridded on demographic page) to avoid incorrect reporting.Separate scorable and nonscorable materials after testing completed. Ensure that all completed answer documents are promptly returned to DTC for scoring.
16. Employed by the provider (may be the provider)Holds a current license/certificate/permit issued by ODECannot be a student teacherCannot be related to a studentTest administrator must remain in testing room at all times (also monitor or proctor if student number over 30)Test Administrator (TA)
17. Test Administrator (TA)Account for all secure test booklets, answer documents & special versionsEnsure all electronic devices are securedAssure no coaching or test alterations take placeProvide no accommodations unless checked student record
18. Resources for DTC, BTC and TADistrict Test Coordinators’ monthly newsletter – main communication to supply details on OAA administration; DTC is required to share information with all staff involved with OAA administrationODE Website: education.ohio.govOhio Help Desk for OAA: 888.944.5001Ohio Help Desk E-mail: OhioHelpDesk@air.orgE-mail Blasts from OAA contractorPlan __________________________________________________________________________________________ Script/Notes: Foreign exchange students should not automatically receive extended time or use of a dictionary just because they are considered a foreign exchange student. Districts will need to go through the formal process of determining if the foreign exchange student meets the criteria to be considered a limited English proficient student prior to offering accommodations to the student on the OAA. More information on the process can be found on the ODE Web site by typing “LEP” into the search box.
19. Resources for DTC, BTC and TAOhio Statewide Assessment Rules BookDistrict Test Coordinator’s ManualBuilding Test Coordinator’s ManualDirections for Administration ManualOhio Documents posted on web: www.ohiodocs.orgODE Office of Curriculum and Assessment: 877-644-6338 / 614-466-0223
20. Questions on the Administration Roles
21. OAA Administration
22. One test per student per day (includes makeup)Allow up to 2.5 hours to completeMake room secure.Have policy to address all electronic devices.Ratio one test administrator to 30 students; monitor/proctor must be used when student number over 30, an additional TA is not required.Observe all security precautionsBefore, during, after administration.OAA Administration
23. OAA Administration DatesInitial test administration: April 22 – May 3Districts may choose to begin the initial administration on any date within the first two weeks of the test window April 22 through May 3 – it is not required to begin tests on Monday April 22Initial testing involves the entire grade levelThe starting date for each grade-level test administration must be the same district-wideAll schools within a district must test the same grade level content area on the same day
24. OAA Administration DatesInitial test administration: April 22 – May 3Tests may be administered on non-consecutive days or back-to-back daysThe testing sequence must be reading, mathematics and science
25. OAA Administration DatesMakeup test administration: May 6-10Make-up testing involves only individual students who were absent at the time of the initial testing Make-up tests may be administered after the tests have been initially administered to the entire grade level – not required to wait until the make-up test weekMake-up tests may be given on “in between” days if tests are administered on non-consecutive days during initial testing
26. OAA Administration DatesGeneral return informationAll completed tests returned to one designated district office/location to be picked up by the test vendorCompleted tests will not be picked up at individual buildings
27. OAA Administration DatesReturn materials after initial test administrationScorable materials must be returned no later than Friday, May 3, Monday, May 6 or Tuesday, May 7 Auto-pickup, no need for district/school to schedule pickup after initial test administrationDo not schedule testing on day of auto-pickupAll materials are returned to the DTC (materials will not be collected at the school buildings)
28. OAA Administration Dates“Rolling pickup”, excluding make-up testing, is based on K–12 school enrollment as follows: Fewer than 2,500 students: Friday, May 3; Between 2,500 and 7,000 students: Monday, May 6; More than 7,000 students: Tuesday, May 7Most JPS providers will have the auto pickup on Friday, May 3 as their enrollment is below 2,500
29. OAA Administration DatesReturn materials after make-up test administrationMake-up tests given during initial test administration may be returned during “rolling pickup”Make-up tests given during the make-up test week must be returned no later than Friday, May 10District/school must call to set up pickup after make-up test administration
30. OAA Administration DatesReturn of nonscorable test materialsAll nonscorable test materials must be returned no later than Monday, May 13Districts/schools must arrange for the pickup of nonscorable materials – information is given in the district test coordinator manual
31. OAA Administration DatesOAA Materials DefinedScorableTest booklets (grades 3 and 4) with test questions, student information and student responsesAnswer documents (grades 5–8) with student information and student responses
32. OAA Administration DatesOAA Materials DefinedNonscorableUnused grade 3 and 4 test bookletsUsed and unused grade 5–8 test booklets Used grade 3 and 4 test booklets and grade 5–8 answer documents that contain student responses that should not be scored (e.g., a soiled answer document)Blank unused answer documents do not have to be returned.
33. OAA Administration DatesOAA Materials DefinedNonscorableBraille test booklets – used and unusedLarge-Print test booklet (with or without student responses)English Audio CD – used and unused
34. OAA Administration DatesOAA Materials DefinedNonscorableRead-Aloud ScriptsGrade 8 Mathematics Reference Sheets containing student-written calculations – if blank, not required to return
35. OAA Administration DatesScore results electronically available through Ohio Online Assessment Reporting System (OOARS) – June 15Email address: https://reports.success-ode-state-oh-us.info/Login.aspxPrinted reports – June 28
36. OAA Administration Labels – PreID or GenericSuggest affixing labels after the test administration to avoid student doodlingDo not place labels over the security number preprinted on the front of the document – place label on back cover in designated spaceTesting time should not be used to apply the PreID labels or to complete demographic informationNo matter which label is used, the student name must be written on the front coverl
37. 37OAA Administration SSIDStatewide Student IDs (SSIDs) must be used for public school students.The SSID is secure data; districts/ schools need to have a policy in place to access the SSID and associated data.District/School EMIS coordinators should refer to the EMIS Manual for instructions to obtain SSIDs.
38. OAA Administration OAA Demographic PageGrade 3-4 – test booklet; Grade 5-8 answer documentBack cover and inside back cover to be completedTesting Group Number based on location – not TATest Booklet Form must be completed – if student used Form SV, mark SV
39. 39OAA Administration PreID LabelIf Pre-ID label used, no need to fill out inside front cover.Testing time should not be used to apply the Pre-ID labels or to complete demographic information.Suggest affixing Pre-ID labels after the test administration; labels must be aligned carefully for machine scoring.Do not place Pre-ID labels over the security number preprinted on the front of the document.Check name on cover with name on PreID label
40. 40OAA Administration Generic LabelIf a Pre-ID label is not available for the student and a generic label is being used, the inside front cover of the answer document must be filled out completelyThe inside front cover contains information that would be contained on a Pre-ID label.Contains district and school names and IRNs but does not contain student data
41. 41OAA Administration Pre-processing Record ChangesApril 15 – May 17 Allows updates to student data prior to test documents being processed Allows Do Not Score (DNS) and Invalidation (INV) codes to be entered Pre-reporting Record ChangesMay 29 – 30 Allows final changes to student data prior to test documents being processed
42. 42OAA Administration Returning Scorable MaterialsEnsure secured test materials are returned in accordance with timelinesOAA answer documents with student responses are secure and must be returned; blank answer documents are not required to be returned.Return all scorable materials to the DTC.All special versions are secure and must be returned – Braille, Large Print, English Audio CD, Read-Aloud Script.
43. 43OAA Administration Rescores and VerificationsVerify score data as soon as possible after receipt of test resultsRescore and Verification results will be reported via on-line memos (including e-mail notification when results are posted for district review)RescoreRequest if student score is thought to have an error; student score not expected based on classroom performance$25 charge for rescore – if score changes, no charge; PO must be submitted
44. 44OAA Administration Rescores and VerificationsVerifications$25 charge for verificationCategories for submission of verificationsIncorrect score assignment: Student score exchanged with another student’s scoreInvalid test score assignment: Student received a DNA on a test that he/she took or student received a score on a test that he/she did not take Missing student: Student tested but test results were not received
45. OAA Administration ReportsDistrictBuildingFamily – student scoreTeacher – classroom, available only if data entered into TIDE
46. OAA Administration Teacher ReportClassroom data can only be reported if submitted through TIDEData may be submitted for each subject area and may be different for each subject area per studentSample for reading shown below:District IRNSchool IRNStudent NameSSIDReading Class NameReading Class Section NumberReading Teacher Name000001000002John DoeXX1234567ReadingPeriod 2Janet Baker
47. Questions on the OAA Administration
48. OAA Special Versions and Accommodations
49. Accommodations for the Student with Disabilities (SWD)OAC 3301-13- 03(H)(1-4) specifies these four criteria for allowable accommodations: 1. The accommodation must be specified in a student with disabilities’ IEP and be provided to the student in the classroom for classroom- and district-wide tests. In addition, the accommodation must be documented in writing on the testing page of the IEP or 504 Plan.
50. Accommodations for the Student with Disabilities (SWD)2. The accommodation cannot change the content or structure of the test. 3. The accommodation cannot change what type of knowledge or skill that a test is intended to measure. 4. The accommodation cannot change or enhance the student’s response as to what type of knowledge or skill is intended to be assessed.
51. 51OAA Special Versions Students with disabilities (SWD) may be provided these special versions:Large-Print BookletBraille Booklet English Audio CDStudent must use Form SV.Each special version has specific test administration guidelines/instructions that must be followed.These instructions are included in the BTC Manual.
52. 52OAAAccommodationsOne of the most frequently assigned accommodations is the read-aloud accommodation.A human reader An English Audio CDUnder no circumstances should the reading passages be read to students. To do so would change what the test is measuring and will result in an invalidation.Human reader and student must use Form SV.
53. Another accommodation that is frequently provided is extended time (limited to one school day)Comprehensive list of accommodations for the SWDwww.education.ohio.govKey word search: “Testing Accommodations”53OAAAccommodations
54. Questions on the OAA Special Versions and Accommodations
55. Contact Information for theAccommodationsAndrew Hinkleandrew.hinkle@education.ohio.gov614.644.7304Amy Parkeramy.parker@education.ohio.gov614.387.0948
56. Contact Information for theOhio Achievement AssessmentsOAAPaula Mahaleypaula.mahaley@education.ohio.gov614 466-0217Ohio Dept. of EducationOffice of Curriculum and Assessment
57. Thank you for your time and attention.