Kansas Assessment Program Training Course For New District Test Coordinators 20192020 DTC Completion and Verification of Training All District Test Coordinators DTCs in Kansas must participate in one online ID: 779403
Download The PPT/PDF document "Kansas Test Security and Ethics" is the property of its rightful owner. Permission is granted to download and print the materials on this web site for personal, non-commercial use only, and to display it on your personal computer provided you do not modify the materials and that you retain all copyright notices contained in the materials. By downloading content from our website, you accept the terms of this agreement.
Slide1
KansasTest Security and Ethics
Kansas Assessment ProgramTraining CourseFor New District Test Coordinators
2019-2020
Slide2DTC Completion and Verification of TrainingAll District Test Coordinators (DTCs) in Kansas must
participate in one online Test Security and Ethics training module yearly.All DTCs must provide Verification of Training and Agreement to adhering to policies and practices outlined in the training using a secure website to obtain sign-off verification link.
All DTCs must complete the training module and sign off on or before
November 8, 2019
.
Slide3Online Training OptionsVeteran DTCs – “refresher” version – this training is designed for those who have been a DTC for at least 3 years.
New DTC – complete training – this training is designed for DTCs who have 0 – 3 years experience as a DTC.NOTE: An Optional Training Module Designed for DTCs to use with Educators
is
provided.
This training can be adapted by the DTC for training in their district, but it does not fulfill the requirement for DTCs which are listed above.
The slides for this training are provided at the end of this module.
Slide4New Test Coordinator Training ModuleYou have selected the: New DTC – complete training – this training is designed for DTCs who have 0 – 3 years experience as a DTC.
If this training module description does not describe you, stop and download the training module for Veteran test coordinators.If you are an educator, training will be provided by your DTC or BTC in your district.
Slide5Materials Needed Prior to beginning the training you will need to download or have access to the following materials from the KSDE and or KAP website
:2019-2020 Test Security and Ethics Fact Sheet2019-2020 Appropriate Testing Practices Fact SheetKansas State Test Security Guidelines
Slide6Materials Needed Prior to beginning the training you will need to download or have access to the following materials from the Kansas Assessment Program website www.ksassessments.org
2019 – 2020 Kansas Assessment Program Overview (Testing Window Calendar)Kansas Assessment Examiner’s Manual (KAEM) – Available January 3, 2020
Slide7Kansas State Test Security GuidelinesPlease take time now to read the
Test Security Guidelines.
Slide8KSDE Fact SheetsPlease take time now to read the:
2019-2020 Test Security and Ethics Fact Sheetprovides an overview of the KSDE test security plan
indicates where to access the roles and responsibilities for the DTC, BTC, and test administrators in test
security
tells how to report Testing Discrepancies and Potential Security Violations to KSDE
2019-2020 Appropriate Testing Practices Fact
Sheet
Acceptable practices for
testing
Unacceptable
practices for
testing
Slide9Kansas Assessment Examiner’s ManualThe Kansas Assessment Examiner’s Manual (KAEM) will be available the first week of January on the
www.ksassessments.org Any staff member who administers or supports the administration of the state assessment must read the KAEM prior to administering the assessment. Since this document is not available until January you will need to build this into your training plans and do a careful review of the manual.
Slide10PurposeTest security is essential to obtain reliable and valid scores for accountability purposes. Accordingly, the Department of Education must take every step to assure the security and confidentiality of the state test materials.
Slide11PurposeEveryone who is involved in student testing, communicates results, and/or receives testing information is responsible for test security.
Slide12Purpose All Kansas assessment programs must abide by test security and ethical testing practices. These programs include:Kansas assessment summative tests in ELA, math and science
Kansas assessment predictive interim assessments in ELA and mathKansas English Language Proficiency Assessment (KELPA) cPassDLM note: additional training modules provided for staff administering DLM assessments
Slide13District Test Coordinator ResponsibilitiesOversee test security for the entire district.
Establish and implement test security and ethics procedures for the district. Train district and building-level personnel before testing begins, which includes training regarding test security procedures, ethics of testing, and reporting/documentation of accommodations.
Refer
to the KSDE
Test Security Guidelines document for
a complete list of
responsibilities.
Slide14Security/Ethics Yearly TrainingAll district and/or building staff who administer or assist with administration of a state assessment must be trained yearly!
Must be an employee of the school system.No volunteers, parents, etc. may administer a state assessment.
Slide15Documentation of AgreementAny staff member who administers a state assessment must sign an agreement to adhere to Test Security and Ethical Testing Practices.
Written verification is needed for the protection of each teacher/proctor and the district.
Districts may use “The Agreement to Abide by Guidelines” found in the KAEM, or a district may customize a form to meet their own needs.
Slide16Trained PersonnelDistrict and Building-level personnel include any staff member who administers a state assessment, including administrators, educators, para educators,
etc. Parent volunteers may not administer a state assessment.
Slide17DTC Responsibilities: TrainingYou are responsible for training staff in your district.
You must document:which individuals have received training, when the training was provided,
and
the way in which the training was
provided.
D
ocumentation
must be kept at the district and the building level.
Slide18Required Training Topics The following topics must be included in the training provided by the DTC to BTCs and educators in your district:
KSDE Test Security PlanDistrict test security proceduresRoles and Responsibilities for DTC, BTC and or Educator/Test Proctor
Reporting Testing Discrepancies and Potential Violations (share both district and state responsibilities)
Reporting Item Issues (and PII)
Appropriate and Inappropriate Testing Practices
Monitor visits
Test Security Agreement to Abide by Guidelines and Sign off
Refer to the KSDE Test Security Guidelines document
Appendix
for
list
of Required Topics
Slide19DTC Responsibilities: Kite Educator Portal Establish procedures that determine who has access to information in Educator Portal and determine role assignments within the district
.Remove/inactivate users in Educator Portal for staff who have left the district and/or changed roles with the district; this task should be completed by the end of September.
Slide20DTC Responsibilities: Kite Educator Portal Establish and describe processes that confirm that usernames and passwords in Educator Portal are exclusive to the user and rights permitted for that user. Usernames and passwords should not be shared or exchanged
.Confirm the individual Educator Portal role and sign a Security Agreement when logging into the Educator Portal site.
Slide21What is PII?Personally identifiable information (PII) is any data that could potentially identify a specific individual. Any information that can be used to distinguish one person from another and can be used for de-anonymizing anonymous data can be considered PII.
Slide22Personally Identifiable Information (PII)
As the DTC, inform
staff that personally identifiable information (PII) must not be conveyed when testing issues are reported.
The
documentation for Kansas regarding allowable identifiers in an email specify that
only the Student State ID number
and no other identifying details should be provided in an email.
Slide23When Contacting the Service Desk:Do not send any Personally Identifiable Information (PII) for a student via email. This
is a federal violation of the Family Education Rights and Privacy Act (FERPA). PII includes such information as a student’s name, building name, or district name. Do send the student ID number, the test the students are taking (ELA, math, science, predictive interim, mini-test) and the error or concern you are reporting regarding the test taker.
Slide24Reporting Testing Discrepancies and Potential Security Violations to KSDEIt is the responsibility of the superintendent or their designee, on behalf of any and all school principals, to report in writing, all discrepancies in test material delivery and collection, as well as issues and concerns regarding potential violations of the Kansas State Department of Education’s test security procedures, to Lee Jones, Assessment Coordinator, Kansas State Department of Education, 785.296.4349
.
Slide25Reporting Testing Discrepancies and Potential Security Violations to KSDEIn
consultation with staff from KSDE upon breach of security, appropriate consequences will be put in place at the district level. Because each case is unique in nature a variety of steps could take place, but are not limited to the following suggestions:No action taken, discussion with KSDE indicated the breach was not severe in nature to warrant any actionKSDE Action: Written letter and/or phone call to Superintendent, District Test Coordinator stating concerns and processing of action steps
Retesting of students
Removal of test proctors from testing rooms
KSDE Monitor Visit follow-up the next testing year to check for validation that changes to inappropriate practices have been made
Slide26The Assessment Achievement Institute (AAI) provides data to KSDE that examines potential areas of test irregularities throughout testing. DTC training log (spreadsheet) – this validates that training was completed by the DTC in each district in Kansas
and who participated in the training.Test Reactivations – frequency of reactivationsClick History for responses and ending testsTests taken “after” school hours (i.e. with students who attend a virtual school test after the end of typical school day is allowed)
Sample Data Used to Examine
Potential Irregularities
Slide27DTC Responsibilities:Daily Access Code
During summative testing, students must use a daily access code to enter the Kite Student Portal. This code is provided in the Educator Portal and is not directly available to teachers and test proctors. As the DTC your must:
Establish
and describe the system used for sharing Daily Access Codes with staff. This plan should include the secure transmission of the information each day.
Slide28DTC Responsibilities:Reactivating TestsWhen reactivating
tests, you will not be able to view any student answers. Instead, you will be able to see which students have started the test and whether or not they have completed various sections of the test.
You must first end the test session and then click reactivate.
DTCs must keep records of reactivations and “why”
Slide29DTC Responsibilities: ReactivationsBest practice is to have two people present when reactivating a test.
Slide30Monitoring Tests and District TestingWhen monitoring tests, you will not be able to view any student answers. Instead, you will be able to see which students have started the test and whether or not they have completed various sections of the test.
Slide31DashboardsThe Dashboard provides key metrics that are critical to state and district stakeholders during testing.
Daily monitoring of the dashboard by DTCs and BTCs is essential. Each tab on the Dashboard allows you download an extract for your school and/or district. Testing SummaryScoring Summary
Reactivations
Testing Outside School Hours
Kite Error Messages
DTCs should review the Dashboard on a daily basis to assist with internal monitoring of testing.
Slide32State Monitor Visit: PurposeKSDE staff and the members of the Kansas Assessment Advisory Council visit about 10% of Kansas schools during test administration yearly for the purpose of monitoring test security.
Slide33State Monitor VisitsDistrict and School Selection
a representative sample of districts across Kansas, across all state BOE regions including both large and small districts are selected for monitor visits every year in Kansas
Slide34State Monitor ChecklistPosted on the KSDE website – assessment page, also included in the Test Security Guidelines Appendix.
Completed by visiting team member(s) and shared with the school upon completion of the visitKSDE reviews information provided and looks at the good things that are happening and for ways to enhance test security and ethics in the future.
Slide35Projected Testing Dates (EP)The Projected Testing
and scoring tab within Manage Tests is available. Information can be entered or uploaded by DTC and/or BTC.This helps
ATS understand
projected system testing loads by day.
It helps KSDE see testing schedules in the field for assistance with monitor visits.
It is also an easy way for DTCs to see when buildings are testing in case you have a monitor visit
!
Pages 42- 49
Not required, but is an extremely helpful and easy way to manage testing schedules
!
However, if you are selected for a monitor visit you must be able to provide an up-to-date schedule.
Slide36Reporting/Documentation of Accommodations
Slide37DTC Responsibilities:Personal Needs Profile (PNP)Students may have accommodations during testing. These accommodations must be done routinely and are typically part of an IEP or 504 student plan. Accommodations must be entered into the Kite
Educator Portal. As the DTC your must:Establish procedures for entering student accommodation information into the Personal Needs Profile (PNP) in Educator
Portal.
Keep
records of documentation for text-to-speech accommodations and any other accommodation that requires a deviation from the general assessment; documentation must be kept at the district and the building level.
Slide38Personal Needs Profile (PNP)Tools and Accommodations for the KS Assessment ProgramSome tools are only available when selected in the PNP found in the Kite Student Portal.
Slide39Accommodations by ProgramSome accommodations are available by testing program and not available for all testing programs!
Slide40PNPs and TTSAs the DTC, you need to be aware of policies and procedures for all accommodations and Text to Speech (TTS).NEW this year – TTS approval by KSDE for reading passages and items (nonvisual) – the following slides provide a reminder about TTS and this approval.Any questions – please contact KSDE for clarification
Slide41TTS of reading passages and items (nonvisual)***Text to Speech (TTS) of reading items and passages.Please contact Cary Rogers at KSDE, 785-296-0916 FOR APPROVAL; this accommodation is intended for a very limited number of students
.This accommodation is ONLY for students with an IEP, 504 or student intervention plan.This accommodation is appropriate for students who receive daily instruction and assessments orally and through computerized text to speech. This accommodation should only be used by students who:Have a reading-based disability (at least two grade levels below) that affects the student’s decoding, fluency or comprehension skills.
Can’t access print text due to blindness or low vision and do not have adequate Braille skills.
Slide42TTS of reading passages and items (nonvisual)***Text to Speech (TTS) of reading items and passages.Please contact Cary Rogers at KSDE, 785-296-0916 FOR APPROVAL; this accommodation is intended for a very limited number of students
.This accommodation is ONLY for students with an IEP, 504 or student intervention plan.This accommodation is appropriate for students who receive daily instruction and assessments orally and through computerized text to speech. This accommodation should only be used by students who:Have a reading-based disability (at least two grade levels below) that affects the student’s decoding, fluency or comprehension skills.
Can’t access print text due to blindness or low vision and do not have adequate Braille skills.
Slide43TTS for directions, question text, test itemsThis requires a PNP.A synthetic voice will read directions, text (related to the question) and the test items.
Slide44Human ReaderA HUMAN reader is NOT allowed on KS assessments! Students must utilize the synthetic voice in Kite!
An occasional word may be pronounced for students in questions and stems but not in passages.
Slide45Ethical Practices
Slide46Appropriate Testing Practices As the DTC, you must cover each item as part of your training.2019-2020
Test Security and Ethics Fact Sheetprovides an overview of the KSDE test security planindicates where to access the roles and responsibilities for the DTC, BTC, and test administrators in test security
tells how to report Testing Discrepancies and Potential Security Violations to KSDE
2019-2020 Appropriate Testing Practices Fact Sheet
Acceptable practices for testing
Unacceptable practices for testing
Slide47Appropriate Testing PracticesAcceptable Practices Fact SheetProvide students with the opportunity to learn the content and vocabulary prior to testing by basing instruction on state standards and an aligned local curriculum
.Integrate teaching of test-taking skills with regular classroom instruction and assessment.
Slide48Appropriate Testing PracticesAcceptable Practices Fact Sheet
Ensure that students have had prior experience with the testing format. Use Kite Technology Practice tests. These are for the intended purpose of practicing technology and not content. Use formative assessments to inform instruction prior to testing. Formative tools are available in the Kite Interim system.
Slide49Appropriate Testing PracticesAcceptable Practices Fact Sheet
Ensure that accommodations made on the state assessment are completed on all instructional assignments, as well as classroom, district, and standardized assessments.Attend training and sign an agreement to abide by KSDE Test Security, Ethics of Testing, and regulations before local testing begins.
Slide50Follow test procedures outlined in the Examiner’s Manual and in the training received regarding security and ethical practices for testing.Follow established district/building procedures for collecting and destroying testing materials, student notes, scratch paper, and drawings, etc., upon completion of each test session and the entire test.
Appropriate Testing Practices
Acceptable Practices Fact Sheet
Slide51Remove or cover (with opaque material) bulletin board displays, charts and diagrams, and other instructional material that could give assistance or advantage during testing.Monitor the testing environment actively by moving around the room; moving around the room encourages students to focus on their own work
.Verify the End Review Screen upon completion of the test to ensure that all test items have been answered before a student exits the test. Appropriate Testing Practices
Acceptable Practices
Fact Sheet
Slide52Do not store or save on computers or personal storage devices any test items; test items may not be shared via email or other file sharing systems; or reproduced by any means.Do not review tests or analyze test items before, during, or after the assessment has been administered.
Appropriate Testing PracticesAcceptable Practices Fact Sheet
Slide53Do not discuss any specific test items on the test with students or colleagues before, during, or after the administration of the assessment.Do not construct answer keys so that an assessment could be scored locally
.Do not use actual or altered test items (clone, parallel) for practice or instruction.Appropriate Testing PracticesAcceptable Practices
Fact Sheet
Slide54Do not conduct comprehensive reviews or drills the day of the test or between testing sessions. Once testing has begun, all reviewing should cease. Curriculum may be taught but not for review for the specific purposes of the test. Do not
require students to show work or use scratch paper; scratch paper may not be graded and must be destroyed at the end of the test session. Do not respond to questions during testing that would help the students understand the item, aid them in responding to an item, or advise/encourage them to edit or change a response.
Appropriate Testing Practices
Acceptable Practices
Fact Sheet
Slide55Do not say or do anything that would let a student know whether an answer is correct or incorrect.Do not coach or cue students in any way during test administration, including using gestures or facial expressions for guidance.
Do not ask students the way in which they arrived at an answer.Appropriate Testing PracticesAcceptable Practices Fact Sheet
Slide56Do not tell students to redo a specific item or to review any specific part of the test once testing has begun.Do not go back and review each item individually with the student, simply direct students to answer items that did not have a check mark to indicate that the item was answered.
Appropriate Testing PracticesAcceptable Practices Fact Sheet
Slide57Questions If you have specific questions please contact:Lee Jones, KSDE ljones@ksde.orgMary Matthew, AAI
mmatthew@ku.edu
Slide58DTC Validation of Training
Once you have completed this training please go the HELP tab inside the EP.
Open the document that titled:
Test Security Validation
This document will provide you access to the link for completion of training and agreement to abide by.
You must complete this by November 8, 2019.
Slide59Kansas State Test Security and EthicsQuick Check
True or False
Read each statement and decide
if it is true or false.
1.
When you complete the training module you must sign a verification of training and agreement to abide by ethics and test security policies and practices.
2.
District test coordinators are
responsible for training district and building personnel.
3.
District test coordinators will provide the State Assessment Office with accurate testing schedules through the KITE Educator Portal. If schedules change, it is required that online schedules be updated and information is accurate for potential monitor visits.
Slide60Kansas State Test Security and EthicsQuick Check
True or False
Read each statement and decide
if it is true or false.
4.
A
monitor visit allows KSDE to see the good things that schools are doing to ensure test security and ethical practices are maintained.
5.
When
reporting an item issue on the test it is okay to take a picture of the item and send to KSDE.
6.
During
administration of the math assessment students may use handheld calculators. If handheld calculators are used teachers must actively monitor this use. Before and after the test session calculators must be cleared.
Slide61Kansas State Test Security and EthicsQuick Check
True or FalseRead each statement and decide
if it is true or false.
7.
Actively
monitoring the testing sessions by test proctors is critical to maintaining security.
8.
Parents may help
administer the state assessment.
9.
Accommodations
on the state assessment must be part of regular classroom practice.
10.
The monitor team observed a test
proctor reading the assessment from the screen to a student. This is an acceptable practice.
Slide62Kansas State Test Security and EthicsQuick Check - KEYTrue
TrueTrueTrueFalse – Report only the student id, test being taken, session number and item number and the issue with the item.
True
True
False – Parents may not administer the assessment.
True
False – you may not read questions or passages from the screen.
Slide63Test Security
and Ethics
Kansas Assessment Program
Training Course
For Educators
This
section of the PowerPoint
is designed for use by DTC to modify and/or adapt to meet the needs of their district.
Slide64AgendaKSDE Test Security Plan
District test security proceduresRoles and Responsibilities for DTC, BTC and or Educator/Test ProctorReporting Testing Discrepancies and Potential Violations (share both district and state responsibilities)
Reporting Item Issues
Appropriate and Inappropriate Testing Practices
Monitor visits
Test Security Agreement to Abide by Guidelines and Sign off
Slide65Verification of TrainingAll District staff who administer a state assessment must provide Verification of Training by signing an agreement to abide by form and sign off on training.
District and Building-level personnel include any staff member who administers a state assessment, including administrators, educators, para educators, etc. Parent volunteers may not administer a state assessment.
Slide66VerificationAny staff member who administers a state assessment must sign an agreement to
adhere to Test Security and Ethical Testing Practices.Written verification is needed for the protection of each teacher/proctor and the district.
Slide67Materials Needed Prior to beginning the training you will need to download or have access to the following materials from the KSDE and or KAP website:
2019-2020 Test Security and Ethics Fact Sheet2019-2020 Appropriate Testing Practices Fact SheetKansas State Test Security Guidelines
Slide68Testing WindowShare your district testing datesPrior to beginning the training you will need to
download or have access to the following materials from the Kansas Assessment Program website www.ksassessments.orgTesting Window CalendarKansas Assessment Examiner’s Manual (KAEM) – Available January 3, 2020
Slide69Kansas Assessment Examiner’s ManualThe Kansas Assessment Examiner’s Manual (KAEM) will be available the first week of January on the
www.ksassessments.org Any staff member who administers or supports the administration of the state assessment must read the KAEM prior to administering the assessment.
Highlight
text that is important
to you when administering a state assessment.
Slide70Kansas State Test Security GuidelinesPlease take time now to read the Test Security Guidelines.
This training will reference key points in the document that are critical for staff who administer a state assessment to understand.Highlight text that is important to the role you serve when administering a state assessment.
Slide71Fact SheetsPlease take time now to read the: 2019-2020 Test Security and Ethics Fact Sheet
provides an overview of the KSDE test security planindicates where to access the roles and responsibilities for the DTC, BTC, and test administrators in test security
tells how to report Testing Discrepancies and Potential Security Violations to KSDE
2019-2020 Appropriate Testing Practices Fact Sheet
Acceptable practices for testing
Unacceptable practices for testing
Slide72PurposeTest security is essential to obtain reliable and valid scores for accountability purposes. Accordingly, the Department of Education must take every step to assure the security and confidentiality of the state test materials.
Slide73PurposeEveryone who is involved in student testing, communicates results, and/or receives testing information is responsible for test security.
Slide74Purpose All Kansas assessment programs must abide by test security and ethical testing practices. These programs include:Kansas assessment summative tests in ELA, math and science
Kansas assessment predictive interim assessments in ELA and mathKansas English Language Proficiency Assessment (KELPA) cPassDLM note: additional training modules provided for staff administering DLM assessments
Slide75District Test Coordinators ResponsibilitiesOversee
test security for the entire district. Establish and implement test security and ethics procedures for the district. Train district and building-level personnel before testing begins, which includes training regarding test security procedures, ethics of testing, and reporting/documentation of accommodations.
KSDE Test Security Guidelines document.
Slide76DTC Responsibilities:As the DTC I must maintain a training log that verifies who was trained and when the training was completed.
The training log is required for a monitor visit and for validation that staff have received training in your district.At the end of our training we will sign the appropriate forms to document training and agreement to abide by ethical practices and procedures.
Slide77Kite Educator Portal Include District procedures for: Establish
procedures that determine who has access to information in Educator Portal and determine role assignments within the district.
Slide78Kite Educator Portal Share the district process for:
Establish and describe processes that confirm that usernames and passwords in Educator Portal are exclusive to the user and rights permitted for that user. Usernames and passwords should not be shared or exchanged.When you log into Educator Portal you will sign a Security Agreement.
Slide79Daily Access CodeDuring testing, students must use a daily access code to enter the Kite Student Portal. This code is provided in the Educator Portal and is not directly available to teachers and test proctors.
In our district you will receive the DAC:Share your district procedure.Establish and describe the system used for sharing Daily Access Codes with staff. This plan should include the secure transmission of the information each day.
Slide80Personal Needs Profile (PNP)Students may have accommodations during testing. These accommodations must be done routinely and are typically part of an IEP or 504 student plan. Accommodations must be entered into the Kite
Educator Portal. Share your district plan for:Establish procedures for entering student accommodation information into the Personal Needs Profile (PNP) in Educator Portal.
Keep records of documentation for text-to-speech accommodations and any other accommodation that requires a deviation from the general assessment; documentation must be kept at the district and the building level.
Slide81Kansas Accommodations by Program 2019-2020An additional resource found on www.ksassessments.org
and on the KSDE assessment pageIndicates the tools available for students in Kite Let’s take a look at these tools so we are familiar with these options for students.
Slide82PII, Reporting Personally Identifiable Information (PII)
Reporting Testing Issues to Kite Service DeskReporting Testing Discrepancies and Potential Security Violations to KSDEData Used to Examine Potential Irregularities
Slide83What is PII?Personally identifiable information (PII) is any data that could potentially identify a specific individual. Any information that can be used to distinguish one person from another and can be used for de-anonymizing anonymous data can be considered PII.
Slide84Personally Identifiable Information (PII)
P
ersonally
identifiable information (PII) must not be conveyed when testing issues are reported.
The
documentation for Kansas regarding allowable identifiers in an email specify that
only the Student State ID number
and no other identifying details should be provided in an email.
Slide85Reporting Testing Issues to KITE Service DeskPlease do not report any PII (personally identifiable information)
The documentation for Kansas regarding allowable identifiers in an email specify that only the Student State ID number and no other identifying detail is to be used in email.
Do
NOT
include the student name, district or school
Slide86When Contacting the Service Desk:Do not send any Personally Identifiable Information (PII) for a student via email.
This is a federal violation of the Family Education Rights and Privacy Act (FERPA). PII includes such information as a student’s name, building name, or district name. Do send the student ID number, the test the students are taking (ELA, math, science, predictive interim, mini-test) and the error or concern you are reporting regarding the test taker.
Slide87Reporting Testing Discrepancies and Potential Security Violations to KSDEIt
is the responsibility of the superintendent or their designee, on behalf of any and all school principals, to report in writing, all discrepancies in test material delivery and collection, as well as issues and concerns regarding potential violations of the Kansas State Department of Education’s test security procedures, to Lee Jones, Assessment Coordinator, Kansas State Department of Education, 785.296.4349.
Slide88Reporting Testing Discrepancies and Potential Security Violations to KSDEIn consultation with staff from KSDE upon breach of security, appropriate consequences will be put in place at the district level.
Because each case is unique in nature a variety of steps could take place, but are not limited to the following suggestions:No action taken, discussion with KSDE indicated the breach was not severe in nature to warrant any actionKSDE Action: Written letter and/or phone call to Superintendent, District Test Coordinator stating concerns and processing of action steps
Retesting of students
Removal of test proctors from testing rooms
KSDE Monitor Visit follow-up the next testing year to check for validation that changes to inappropriate practices have been made
Slide89District Procedures for ReportingInsert district procedures for reporting.
Slide90ReactivationsIn rare instances, some students may not be able to complete a test session.
When this happens you may reactivate the student test.Share your district procedures for reactivation.
Slide91Appropriate Testing PracticesAcceptable Practices (Fact Sheet)
Provide students with the opportunity to learn the content and vocabulary prior to testing by basing instruction on state standards and an aligned local curriculum.Integrate teaching of test-taking skills with regular classroom instruction and assessment.
Slide92Appropriate Testing PracticesAcceptable Practices (Fact Sheet)
Ensure that students have had prior experience with the testing format. Use Kite Technology Practice tests. These are for the intended purpose of practicing technology and not content. Use formative assessments to inform instruction prior to testing. Formative tools are available in the Kite Interim system.
Slide93Appropriate Testing PracticesAcceptable Practices (Fact Sheet)
Ensure that accommodations made on the state assessment are completed on all instructional assignments, as well as classroom, district, and standardized assessments.Attend training and sign an agreement to abide by KSDE Test Security, Ethics of Testing, and regulations before local testing begins.
Slide94Appropriate Testing PracticesAcceptable Practices (Fact Sheet)
Follow test procedures outlined in the Examiner’s Manual and in the training received regarding security and ethical practices for testing.Follow established district/building procedures for collecting and destroying testing materials, student notes, scratch paper, and drawings, etc., upon completion of each test session and the entire test.
Slide95Appropriate Testing PracticesAcceptable Practices (Fact Sheet)
Remove or cover (with opaque material) bulletin board displays, charts and diagrams, and other instructional material that could give assistance or advantage during testing.Monitor the testing environment actively by moving around the room; moving around the room encourages students to focus on their own work.
Verify the End Review Screen upon completion of the test to ensure that all test items have been answered before a student exits the test.
Slide96Appropriate Testing PracticesUnacceptable Practices (Fact Sheet)
Do not store or save on computers or personal storage devices any test items; test items may not be shared via email or other file sharing systems; or reproduced by any means.Do not review tests or analyze test items before, during, or after the assessment has been administered.
Slide97Appropriate Testing PracticesUnacceptable Practices (Fact Sheet)
Do not discuss any specific test items on the test with students or colleagues before, during, or after the administration of the assessment.Do not construct answer keys so that an assessment could be scored locally
.
Do not use actual or altered test items (clone, parallel) for practice or instruction.
Slide98Appropriate Testing PracticesUnacceptable Practices (Fact Sheet)
Do not conduct comprehensive reviews or drills the day of the test or between testing sessions. Once testing has begun, all reviewing should cease. Curriculum may be taught but not for review for the specific purposes of the test.
Do not
require
students to show work or use scratch paper; scratch paper may not be graded and must be destroyed at the end of the test session.
Do not respond to questions during testing that would help the students understand the item, aid them in responding to an item, or advise/encourage them to edit or change a response.
Slide99Appropriate Testing PracticesUnacceptable Practices (Fact Sheet)
Do not say or do anything that would let a student know whether an answer is correct or incorrect.Do not coach or cue students in any way during test administration, including using gestures or facial expressions for guidance.
Do not ask students the way in which they arrived at an answer.
Slide100Appropriate Testing PracticesUnacceptable Practices (Fact Sheet)
Do not tell students to redo a specific item or to review any specific part of the test once testing has begun.Do not go back and review each item individually with the student, simply direct students to answer items that did not have a check mark to indicate that the item was answered.
Slide101Monitor Visit: PurposeKSDE staff and the members of the Kansas Assessment Advisory Council
visit about 10% of Kansas schools during test administration yearly for the purpose of monitoring test security.
Slide102Monitor VisitDistrict and School Selection
a representative sample of districts across Kansas, across all state BOE regions including both large and small districts
Slide103Monitor VisitsTwo methods will be used to conduct Monitor visits: Schools/districts can
volunteer to receive a monitor visit. A monitor team will be assigned to that district. The team will select the date they will conduct the visit based on the testing schedule provided by the school. The district will not be informed of the specific date selected since they have volunteered for the visit. Unannounced visits for a random sample of schools: schools will be chosen from the list of districts/schools who did not volunteer. The district test coordinator will be alerted to potential visits and will share test schedules for the purpose of monitor visits.
Random sample collection includes consideration of Board Member districts, district size, rural/urban, previous violations, previous monitor visits
Slide104Monitor ChecklistLet’s take a look and discuss the monitor checklist that I provided.
Completed by visiting team member(s)The visiting team will leave a copy of the report with the school and submit a copy to KSDE.
Slide105Test Security
and Ethics
Kansas Assessment Program
Training Course
For Educators
This
section of the PowerPoint
is designed for use by DTC to modify and/or adapt to meet the needs of their district.
Slide106AgendaKSDE Test Security Plan
District test security proceduresRoles and Responsibilities for DTC, BTC and or Educator/Test ProctorReporting Testing Discrepancies and Potential Violations (share both district and state responsibilities)
Reporting Item Issues
Appropriate and Inappropriate Testing Practices
Monitor visits
Test Security Agreement to Abide by Guidelines and Sign off
Slide107Verification of TrainingAll District staff who administer a state assessment must provide Verification of Training by signing an agreement to abide by form and sign off on training.
District and Building-level personnel include any staff member who administers a state assessment, including administrators, educators, para educators, etc. Parent volunteers may not administer a state assessment.
Slide108VerificationAny staff member who administers a state assessment must sign an agreement to
adhere to Test Security and Ethical Testing Practices.Written verification is needed for the protection of each teacher/proctor and the district.
Slide109Materials Needed Prior to beginning the training you will need to download or have access to the following materials from the KSDE and or KAP website:
2019-2020 Test Security and Ethics Fact Sheet2019-2020 Appropriate Testing Practices Fact SheetKansas State Test Security Guidelines
Slide110Testing WindowShare your district testing datesPrior to beginning the training you will need to
download or have access to the following materials from the Kansas Assessment Program website www.ksassessments.orgTesting Window CalendarKansas Assessment Examiner’s Manual (KAEM) – Available January 3, 2020
Slide111Kansas Assessment Examiner’s ManualThe Kansas Assessment Examiner’s Manual (KAEM) will be available the first week of January on the
www.ksassessments.org Any staff member who administers or supports the administration of the state assessment must read the KAEM prior to administering the assessment.
Highlight
text that is important
to you when administering a state assessment.
Slide112Kansas State Test Security GuidelinesPlease take time now to read the Test Security Guidelines.
This training will reference key points in the document that are critical for staff who administer a state assessment to understand.Highlight text that is important to the role you serve when administering a state assessment.
Slide113Fact SheetsPlease take time now to read the: 2019-2020 Test Security and Ethics Fact Sheet
provides an overview of the KSDE test security planindicates where to access the roles and responsibilities for the DTC, BTC, and test administrators in test security
tells how to report Testing Discrepancies and Potential Security Violations to KSDE
2019-2020 Appropriate Testing Practices Fact Sheet
Acceptable practices for testing
Unacceptable practices for testing
Slide114PurposeTest security is essential to obtain reliable and valid scores for accountability purposes. Accordingly, the Department of Education must take every step to assure the security and confidentiality of the state test materials.
Slide115PurposeEveryone who is involved in student testing, communicates results, and/or receives testing information is responsible for test security.
Slide116Purpose All Kansas assessment programs must abide by test security and ethical testing practices. These programs include:Kansas assessment summative tests in ELA, math and science
Kansas assessment predictive interim assessments in ELA and mathKansas English Language Proficiency Assessment (KELPA) cPassDLM note: additional training modules provided for staff administering DLM assessments
Slide117District Test Coordinators ResponsibilitiesOversee
test security for the entire district. Establish and implement test security and ethics procedures for the district. Train district and building-level personnel before testing begins, which includes training regarding test security procedures, ethics of testing, and reporting/documentation of accommodations.
KSDE Test Security Guidelines document.
Slide118DTC Responsibilities:As the DTC I must maintain a training log that verifies who was trained and when the training was completed.
The training log is required for a monitor visit and for validation that staff have received training in your district.At the end of our training we will sign the appropriate forms to document training and agreement to abide by ethical practices and procedures.
Slide119Kite Educator Portal Include District procedures for: Establish
procedures that determine who has access to information in Educator Portal and determine role assignments within the district.
Slide120Kite Educator Portal Share the district process for:
Establish and describe processes that confirm that usernames and passwords in Educator Portal are exclusive to the user and rights permitted for that user. Usernames and passwords should not be shared or exchanged.When you log into Educator Portal you will sign a Security Agreement.
Slide121Daily Access CodeDuring testing, students must use a daily access code to enter the Kite Student Portal. This code is provided in the Educator Portal and is not directly available to teachers and test proctors.
In our district you will receive the DAC:Share your district procedure.Establish and describe the system used for sharing Daily Access Codes with staff. This plan should include the secure transmission of the information each day.
Slide122Personal Needs Profile (PNP)Students may have accommodations during testing. These accommodations must be done routinely and are typically part of an IEP or 504 student plan. Accommodations must be entered into the Kite
Educator Portal. Share your district plan for:Establish procedures for entering student accommodation information into the Personal Needs Profile (PNP) in Educator Portal.
Keep records of documentation for text-to-speech accommodations and any other accommodation that requires a deviation from the general assessment; documentation must be kept at the district and the building level.
Slide123Kansas Accommodations by Program 2019-2020An additional resource found on www.ksassessments.org
and on the KSDE assessment pageIndicates the tools available for students in Kite Let’s take a look at these tools so we are familiar with these options for students.
Slide124PII, Reporting Personally Identifiable Information (PII)
Reporting Testing Issues to Kite Service DeskReporting Testing Discrepancies and Potential Security Violations to KSDEData Used to Examine Potential Irregularities
Slide125What is PII?Personally identifiable information (PII) is any data that could potentially identify a specific individual. Any information that can be used to distinguish one person from another and can be used for de-anonymizing anonymous data can be considered PII.
Slide126Personally Identifiable Information (PII)
P
ersonally
identifiable information (PII) must not be conveyed when testing issues are reported.
The
documentation for Kansas regarding allowable identifiers in an email specify that
only the Student State ID number
and no other identifying details should be provided in an email.
Slide127Reporting Testing Issues to KITE Service DeskPlease do not report any PII (personally identifiable information)
The documentation for Kansas regarding allowable identifiers in an email specify that only the Student State ID number and no other identifying detail is to be used in email.
Do
NOT
include the student name, district or school
Slide128When Contacting the Service Desk:Do not send any Personally Identifiable Information (PII) for a student via email.
This is a federal violation of the Family Education Rights and Privacy Act (FERPA). PII includes such information as a student’s name, building name, or district name. Do send the student ID number, the test the students are taking (ELA, math, science, predictive interim, mini-test) and the error or concern you are reporting regarding the test taker.
Slide129Reporting Testing Discrepancies and Potential Security Violations to KSDEIt
is the responsibility of the superintendent or their designee, on behalf of any and all school principals, to report in writing, all discrepancies in test material delivery and collection, as well as issues and concerns regarding potential violations of the Kansas State Department of Education’s test security procedures, to Lee Jones, Assessment Coordinator, Kansas State Department of Education, 785.296.4349.
Slide130Reporting Testing Discrepancies and Potential Security Violations to KSDEIn consultation with staff from KSDE upon breach of security, appropriate consequences will be put in place at the district level.
Because each case is unique in nature a variety of steps could take place, but are not limited to the following suggestions:No action taken, discussion with KSDE indicated the breach was not severe in nature to warrant any actionKSDE Action: Written letter and/or phone call to Superintendent, District Test Coordinator stating concerns and processing of action steps
Retesting of students
Removal of test proctors from testing rooms
KSDE Monitor Visit follow-up the next testing year to check for validation that changes to inappropriate practices have been made
Slide131District Procedures for ReportingInsert district procedures for reporting.
Slide132ReactivationsIn rare instances, some students may not be able to complete a test session.
When this happens you may reactivate the student test.Share your district procedures for reactivation.
Slide133Appropriate Testing PracticesAcceptable Practices (Fact Sheet)
Provide students with the opportunity to learn the content and vocabulary prior to testing by basing instruction on state standards and an aligned local curriculum.Integrate teaching of test-taking skills with regular classroom instruction and assessment.
Slide134Appropriate Testing PracticesAcceptable Practices (Fact Sheet)
Ensure that students have had prior experience with the testing format. Use Kite Technology Practice tests. These are for the intended purpose of practicing technology and not content. Use formative assessments to inform instruction prior to testing. Formative tools are available in the Kite Interim system.
Slide135Appropriate Testing PracticesAcceptable Practices (Fact Sheet)
Ensure that accommodations made on the state assessment are completed on all instructional assignments, as well as classroom, district, and standardized assessments.Attend training and sign an agreement to abide by KSDE Test Security, Ethics of Testing, and regulations before local testing begins.
Slide136Appropriate Testing PracticesAcceptable Practices (Fact Sheet)
Follow test procedures outlined in the Examiner’s Manual and in the training received regarding security and ethical practices for testing.Follow established district/building procedures for collecting and destroying testing materials, student notes, scratch paper, and drawings, etc., upon completion of each test session and the entire test.
Slide137Appropriate Testing PracticesAcceptable Practices (Fact Sheet)
Remove or cover (with opaque material) bulletin board displays, charts and diagrams, and other instructional material that could give assistance or advantage during testing.Monitor the testing environment actively by moving around the room; moving around the room encourages students to focus on their own work.
Verify the End Review Screen upon completion of the test to ensure that all test items have been answered before a student exits the test.
Slide138Appropriate Testing PracticesUnacceptable Practices (Fact Sheet)
Do not store or save on computers or personal storage devices any test items; test items may not be shared via email or other file sharing systems; or reproduced by any means.Do not review tests or analyze test items before, during, or after the assessment has been administered.
Slide139Appropriate Testing PracticesUnacceptable Practices (Fact Sheet)
Do not discuss any specific test items on the test with students or colleagues before, during, or after the administration of the assessment.Do not construct answer keys so that an assessment could be scored locally
.
Do not use actual or altered test items (clone, parallel) for practice or instruction.
Slide140Appropriate Testing PracticesUnacceptable Practices (Fact Sheet)
Do not conduct comprehensive reviews or drills the day of the test or between testing sessions. Once testing has begun, all reviewing should cease. Curriculum may be taught but not for review for the specific purposes of the test.
Do not
require
students to show work or use scratch paper; scratch paper may not be graded and must be destroyed at the end of the test session.
Do not respond to questions during testing that would help the students understand the item, aid them in responding to an item, or advise/encourage them to edit or change a response.
Slide141Appropriate Testing PracticesUnacceptable Practices (Fact Sheet)
Do not say or do anything that would let a student know whether an answer is correct or incorrect.Do not coach or cue students in any way during test administration, including using gestures or facial expressions for guidance.
Do not ask students the way in which they arrived at an answer.
Slide142Appropriate Testing PracticesUnacceptable Practices (Fact Sheet)
Do not tell students to redo a specific item or to review any specific part of the test once testing has begun.Do not go back and review each item individually with the student, simply direct students to answer items that did not have a check mark to indicate that the item was answered.
Slide143Monitor Visit: PurposeKSDE staff and the members of the Kansas Assessment Advisory Council
visit about 10% of Kansas schools during test administration yearly for the purpose of monitoring test security.
Slide144Monitor VisitDistrict and School Selection
a representative sample of districts across Kansas, across all state BOE regions including both large and small districts
Slide145Monitor VisitsTwo methods will be used to conduct Monitor visits: Schools/districts can
volunteer to receive a monitor visit. A monitor team will be assigned to that district. The team will select the date they will conduct the visit based on the testing schedule provided by the school. The district will not be informed of the specific date selected since they have volunteered for the visit. Unannounced visits for a random sample of schools: schools will be chosen from the list of districts/schools who did not volunteer. The district test coordinator will be alerted to potential visits and will share test schedules for the purpose of monitor visits.
Random sample collection includes consideration of Board Member districts, district size, rural/urban, previous violations, previous monitor visits
Slide146Monitor ChecklistLet’s take a look and discuss the monitor checklist that I provided.
Completed by visiting team member(s)The visiting team will leave a copy of the report with the school and submit a copy to KSDE.
Slide147Kansas State Test Security and EthicsQuick Check
True or
False
Read each statement and decide
if it is true or false.
1.
When you complete the training module you must sign a verification of training and agreement to abide by ethics and test security policies and practices.
2.
If you notice a student didn’t answer a question correctly it is okay to tell them to check their work.
3.
As
a test proctor students should raise their hand and indicate they are finished before exiting the test. It is okay to review the end review screen to make sure students have answered all items on the test.
Slide148Kansas State Test Security and EthicsQuick Check
True or False
Read each statement and decide
if it is true or false.
4.
A
monitor visit allows KSDE to see the good things that schools are doing to ensure test security and ethical practices are maintained.
5.
When
reporting an item issue on the test it is okay to take a picture of the item and send to KSDE.
6.
During
administration of the math assessment students may use handheld calculators. If handheld calculators are used teachers must actively monitor this use. Before and after the test session calculators must be cleared.
Slide149Kansas State Test Security and EthicsQuick Check
True or FalseRead each statement and decide
if it is true or false.
7.
Actively
monitoring the testing sessions by test proctors is critical to maintaining security.
8.
Parents may help
administer the state assessment.
9.
Accommodations
on the state assessment must be part of regular classroom practice.
10.
The monitor team observed a test
proctor reading the assessment from the screen to a student. This is an acceptable practice.
Slide150Kansas State Test Security and EthicsQuick Check - KEY
TrueFalse – you may not tell students to redo or review a specific item.TrueTrue
False – Report only the student id, test being taken, session number and item number and the issue with the item.
True
True
False – Parents may not administer the assessment.
True
False – you may not read questions or passages from the screen.
Slide151Questions and Sign off