2019 Self-Study Workshop . Session VI Characteristics of - PowerPoint Presentation

2019 Self-Study Workshop . Session VI Characteristics of Good Self-Study Reports . Tom Tanner ATS Commission Staff

Before we begin, a caution… ATS Commission on Accrediting: Self-Study Workshop—Session VI If you’re going to work that hard, do the right car… [humorous 30-second clip about removing snow from a car] https://www.youtube.com/watch?v=dcNrh8FL3vE

Characteristics of Good Self-Study Reports Five things to remember to do the “right” report: The 4 purposes of the report The 3 qualities of the report The 5 features of good/weak reports The 4 parts of the report The 3 last things to remember 1 2 3 4 5 ATS Commission on Accrediting: Self-Study Workshop—Session VI

Characteristics of Good Self-Study Reports ATS Commission on Accrediting: Self-Study Workshop—Session VI [advance alert] Table Talk: Where does our school most need to improve? or What is our biggest challenge over the next few years?

Characteristics of Good Self-Study Reports NOTE: This presentation is on our website (www.ats.edu) ATS Commission on Accrediting: Self-Study Workshop—Session VI

Characteristics of Good Self-Study Reports NOTE: This presentation is on our website (www.ats.edu) ATS Commission on Accrediting: Self-Study Workshop—Session VI

Characteristics of Good Self-Study Reports One more thing: see guidelines in Handbook ATS Commission on Accrediting: Self-Study Workshop—Session VI Tab 5 (page 7)

Characteristics of Good Self-Study Reports ATS Commission on Accrediting: Self-Study Workshop—Session VI Hang on! We’re going for a ride.

Characteristics of Good Self-Study Reports Five things to remember to do the “right” report: The 4 purposes of the report The 3 qualities of the report The 5 features of good/weak reports The 4 parts of the report The 3 last things to remember ATS Commission on Accrediting: Self-Study Workshop—Session VI 1

Characteristics of Good Self-Study Reports The 4 purposes of the report Demonstrate ability to analyze institution’s own effectiveness Develop plans for improvementProvide evidence of meeting standards Form basis for external review ATS Commission on Accrediting: Self-Study Workshop—Session VI

Characteristics of Good Self-Study Reports The 4 purposes of the report Demonstrate ability to analyze institution’s own effectiveness Good long look in the mirrorThe mirror has two faces: School’s own mission ATS Commission standards ATS Commission on Accrediting: Self-Study Workshop—Session VI

Characteristics of Good Self-Study Reports The 4 purposes of the report Develop plans for improvement Report must not only “look around” but “look ahead” Assessment (self-study) should show ATS Commission on Accrediting: Self-Study Workshop—Session VI Table Talk: Where do we need most to improve? (or) What is our biggest challenge next few years?

Characteristics of Good Self-Study Reports The 4 purposes of the report Provide evidence of meeting standards Weak report: “Our seminary complies with this standard.” Good report: “ Evidence of how our seminary meets this standard may be summarized in these three ways. First,…” ATS Commission on Accrediting: Self-Study Workshop—Session VI

Characteristics of Good Self-Study Reports The 4 purposes of the report Form basis for external review The self-study report is your story… but told to strangers (so don’t assume) who are sympathetic (but objective) so you must present (and persuade)ATS Commission on Accrediting: Self-Study Workshop—Session VI Peer review (ATS just doesn’t understand us  ATS is us) Committee composition is critical

Characteristics of Good Self-Study Reports Five things to remember to do the “right” report: The 4 purposes of the report The 3 qualities of the report The 5 features of good/weak reportsThe 4 parts of the report The 3 last things to remember ATS Commission on Accrediting: Self-Study Workshop—Session VI 2

Characteristics of Good Self-Study Reports The 3 qualities of the report* Provide sufficient description Document appropriate evaluationIdentify strategic recommendations * Page 11 of Chapter Two of the Handbook ATS Commission on Accrediting: Self-Study Workshop—Session VI

Characteristics of Good Self-Study Reports The 3 qualities of the report Provide sufficient description Weak report: “We have sufficient faculty, and they are all sufficiently qualified.” Good report: “We have seven full-time faculty; six have PhD degrees and one has a DMin (see Faculty Credentials for detailed list).” ATS Commission on Accrediting: Self-Study Workshop—Session VI

Characteristics of Good Self-Study Reports The 3 qualities of the report Provide sufficient description Weak report: “Our SLAP efforts have produced significant improvements.” Good report: “Our Student Learning Assessment Program (affectionately called SLAP by students) has produced these three improvements in student learning this past year. First,...” ATS Commission on Accrediting: Self-Study Workshop—Session VI

Characteristics of Good Self-Study Reports The 3 qualities of the report Provide sufficient description Document appropriate evaluation Identify strategic recommendations ATS Commission on Accrediting: Self-Study Workshop—Session VI

Characteristics of Good Self-Study Reports The 3 qualities of the report Document appropriate evaluation Weak report: “We try hard not to spend more than we take in.” Good report: “The seminary has balanced its budget four of the last five years, as Table 8.6 below demonstrates. The deficit of $74,892 in FY15 represented only a 2.5% overage due to an unexpected need to replace a furnace. We have since established a ‘contingency fund’ for such emergencies, with a line-item budget of $50,000 per year.” ATS Commission on Accrediting: Self-Study Workshop—Session VI

Characteristics of Good Self-Study Reports The 3 qualities of the report Provide sufficient description Document appropriate evaluation Identify strategic recommendations ATS Commission on Accrediting: Self-Study Workshop—Session VI

Characteristics of Good Self-Study Reports The 3 qualities of the report Identify strategic recommendations Weak report: “We know more should be done to address our lack of board diversity, and we are working on that.” Good report: “Given our global mission and given that one fourth of our students and staff are minorities, while no one on the board is, our trustees have set a goal of recruiting one new minority trustee each year for the next five years until our board more fairly represents our constituency and our mission. Our first African American trustee will begin her term this fall.” ATS Commission on Accrediting: Self-Study Workshop—Session VI

Characteristics of Good Self-Study Reports Five things to remember to do the “right” report: The 4 purposes of the report The 3 qualities of the report The 5 features of good/weak reports The 4 parts of the report The 3 last things to remember ATS Commission on Accrediting: Self-Study Workshop—Session VI 3

Characteristics of Good Self-Study Reports The 5 features of good [vs. weak] reportsAre organized coherently Describe the self-study process Present the data crucial to understanding Comprehensive as necessary; brief as possibleDemonstrate objectivity and honesty ATS Commission on Accrediting: Self-Study Workshop—Session VI

Characteristics of Good Self-Study Reports The 5 features of good/weak reports Are organized coherentlyMust be organized by the standards If joint visit, must have permission and detailed “cross walk” [Joint visits only with NECHE; concurrent, possible with any]Must also have Introduction and Conclusion Will discuss later under “The 4 parts of the report”ATS Commission on Accrediting: Self-Study Workshop—Session VI

Characteristics of Good Self-Study Reports The 5 features of good/weak reports Describe the self-study processIntroduction describes process Process engages the community Reflected in report and interviewsCaution: Summarize process in 1-2 pagesIf use people’s names, use titles tooATS Commission on Accrediting: Self-Study Workshop—Session VI

Characteristics of Good Self-Study Reports The 5 features of good/weak reports Present the data crucial to understandingBe clear and concise with data Use qualitative and quantitative data Use tables and charts to support narrative Caution: Put extensive data in Documents Room/links But include summary data in text When using links, make easy to useATS Commission on Accrediting: Self-Study Workshop—Session VI Clearly label each item

Characteristics of Good Self-Study Reports The 5 features of good/weak reports Present the data crucial to understanding ATS Commission on Accrediting: Self-Study Workshop—Session VI How many years to cover?

Characteristics of Good Self-Study Reports The 5 features of good/weak reports Present the data crucial to understandingWeak report: “Most of our MDiv students are placed.”Good report: “Over the last five years our MDiv graduates have averaged a 90% placement rate, with a steady increase each year, as the table below shows.” ATS Commission on Accrediting: Self-Study Workshop—Session VI Benchmarks

Characteristics of Good Self-Study Reports The 5 features of good/weak reports Comprehensive as necessary; brief as possibleWeak reports: Missing standards (e.g., Degree Program Standards) Too few pages: 50 pages won’t cover the standardsToo many pages: 200+ pages overwhelm reviewersPrinted incorrectly: Single-sided/double-spaced reports double the length and the weight (remember your traveling readers) ATS Commission on Accrediting: Self-Study Workshop—Session VI

Characteristics of Good Self-Study Reports The 5 features of good/weak reports Comprehensive as necessary; brief as possibleGood reports: 100-150 pages is “ideal range” 5-10 page Introduction75ish pages for General Institutional Standards (1-8)15-50 pages for Educational and Degree Program Standards 5-10 page ConclusionDon’t overwhelm text with supplemental informationPut lengthy information in appendices or links ATS Commission on Accrediting: Self-Study Workshop—Session VI

Characteristics of Good Self-Study Reports The 5 features of good/weak reports Demonstrate objectivity and honestyWeak report: “Morale on campus is much better.”Good report: “Three years ago faculty morale hit a low point when a doctrinal controversy led to the dismissal of a popular professor. The seminary followed its procedures (documented in our personnel files), but it was a very difficult time. Since then, the board and administration have worked hard to rebuild unity, with significant success—as noted in the recent faculty survey (see 2018 Faculty Survey, item #8).” ATS Commission on Accrediting: Self-Study Workshop—Session VI

Characteristics of Good Self-Study Reports Five things to remember to do the “right” report: The 4 purposes of the report The 3 qualities of the report The 5 features of good/weak reportsThe 4 parts of the report The 3 last things to remember ATS Commission on Accrediting: Self-Study Workshop—Session VI 4

Characteristics of Good Self-Study Reports The 4 parts of the report* Introduction Main Narrative ConclusionAppendices (do not print; on flash drive only) * Pages 13-14 of Chapter Two of the Handbook ATS Commission on Accrediting: Self-Study Workshop—Session VI Print and PDF on flash drive

Characteristics of Good Self-Study Reports The 4 parts of the report Introduction Main Narrative Conclusion Appendices ATS Commission on Accrediting: Self-Study Workshop—Session VI

Characteristics of Good Self-Study Reports The 4 parts of the report Introduction (5-10 pages)Introduce the school (mission/history) Review accreditation history (since last visit) Give overview of the self-study processIdentify any special features of the report Summarize any major changes (since last visit)Orient readers to any unique school issues ATS Commission on Accrediting: Self-Study Workshop—Session VI Merging? Moving? New curriculum? No students on campus during visit

Characteristics of Good Self-Study Reports The 4 parts of the report Main Narrative (90-115 pages)Part 1: General Institutional Standards (75 pp.) Standards 1-8—must cover each one Part 2: Educational and Degree Program Standards ( 15-40 pp.) Educational Standard—cover only applicable sections Degree Programs Standards—cover only applicable standardsNOTE: Can cover assessment under ES.6 or under section 1 of each DPS ATS Commission on Accrediting: Self-Study Workshop—Session VI

Characteristics of Good Self-Study Reports The 4 parts of the report Main Narrative (90-115 pages)One suggested structure per chapter (per earlier slide): brief description of school’s resources for that standard critical evaluation of school’s alignment with standardlist of strengths of the school in terms of that standard strategic recommendations to improve in that standardNOTE: If not meeting standard, must describe plans to do so. * Do not need to cover every subsection in every standard: group things. ATS Commission on Accrediting: Self-Study Workshop—Session VI

Characteristics of Good Self-Study Reports ATS Commission on Accrediting: Self-Study Workshop—Session VI Weak Report: Discuss each of 10 subsections Good Report:Discuss each of 3 sections Standard 4 Library (as example)

Characteristics of Good Self-Study Reports The 4 parts of the report Conclusion (5-10 pages)Summarize overall findings of self-study Organize and prioritize strengths Organize and prioritize concernsOrganize and prioritize recommendations Conclude with desired action (optional)ATS Commission on Accrediting: Self-Study Workshop—Session VI

Characteristics of Good Self-Study Reports The 4 parts of the report 4) Appendix (pp. 16-17 of Chapter Three; bookmarked PDF)Current organizational chart, showing names and titles Current strategic plan Current assessment plan (summarize results in report) Current budget (if embedded, just unit) + 3/5-year budget planMost recent fiscal year audit and management letter Handbooks: Board, faculty, staff, and student Academic catalog (include as bookmarked PDF)Targeted Issues Checklist (see next slide) ATS Commission on Accrediting: Self-Study Workshop—Session VI

Characteristics of Good Self-Study Reports The 4 parts of the report 4) Appendix: Targeted Issues ChecklistOur version of “federal compliance issues” Part 1 for all schools Part 2 only for Title IV participants www.ats.edu/accrediting/self-study-and-assessment ATS Commission on Accrediting: Self-Study Workshop—Session VI

Characteristics of Good Self-Study Reports The 4 parts of the report 4) Appendix vs. Documents Room See list (pp. 17-18 of Chapter Three) of other supporting materials not put in Appendix, but in Documents Room—either physical or virtual (i.e., hot links in narrative of report and/or flash drive) List includes, e.g., syllabi, minutes, faculty CVs, etc. ATS Commission on Accrediting: Self-Study Workshop—Session VI

Characteristics of Good Self-Study Reports Five things to remember to do the “right” report: The 4 purposes of the report The 3 qualities of the report The 5 features of good/weak reportsThe 4 parts of the report The 3 last things to remember ATS Commission on Accrediting: Self-Study Workshop—Session VI 5

Characteristics of Good Self-Study Reports 5. The 3 last things to remember Tell your story in light of the standards to improve your students and school ATS Commission on Accrediting: Self-Study Workshop—Session VI Where will this journey take you?