NASCSP ROMA Next Generation NASCSP Moving Forward with the Performance Management Framework 1 Presenters Katy Kujawski Research Director NASCSP Jeannie Chaffin Consultant NASCSP NASCSP ROMA Next Generation ID: 815754
Download The PPT/PDF document "NATIONAL ASSOCIATION FOR STATE COMMUNITY..." is the property of its rightful owner. Permission is granted to download and print the materials on this web site for personal, non-commercial use only, and to display it on your personal computer provided you do not modify the materials and that you retain all copyright notices contained in the materials. By downloading content from our website, you accept the terms of this agreement.
Slide1
NATIONAL ASSOCIATION FOR STATE COMMUNITY SERVICES PROGRAMS
NASCSP
ROMA Next Generation
NASCSP | Moving Forward with the Performance Management Framework
1
Slide2Presenters
Katy Kujawski,
Research Director, NASCSPJeannie Chaffin, Consultant, NASCSP
NASCSP | ROMA Next Generation
2
Slide3Agenda
Review the Performance Management Framework:
State and Federal Accountability Measures Organizational StandardsCSBG State Plan and Annual ReportExplore ROMA Next Generation:What is ROMA NG?Theory of Change (TOC)
CSBG Annual Report and the change from the CSBG IS SurveyCommunity Level Indicators
NASCSP | ROMA Next Generation3
Slide4NASCSP members are state administrators of the U.S. Department of Health and Human Services Community Services Block Grant (CSBG) and the U.S. Department of Energy's Weatherization Assistance Program (DOE/WAP). NASCSP provides research, analysis, training and technical assistance to State CSBG and WAP offices, Community Action Agencies, and State Associations in order to increase their capacity to prevent and reduce poverty and build economic and energy security.
NASCSP | ROMA Next Generation
4
ABOUT NASCSP |
What we do
Slide5NASCSP | ROMA Next Generation
5
ABOUT NASCSP |
CORE STRENGTHS
Training &
Technical Assistance
Communications & Resources
Advocacy & Leadership
Building Collaborative Relationships
Slide6NASCSP | ROMA Next Generation
6
ABOUT NASCSP | OUR PARTNERS
Slide7We provide information.
Each year NASCSP documents the sources of funding, services provided, clients and communities assisted, and the results achieved. This information is shared with the network and other research organizations in the form of national reports, articles, and a promising practices database.
NASCSP | ROMA Next Generation
7
ABOUT NASCSP | RESEARCH
Slide8Performance Management Framework
8
NASCSP | ROMA Next Generation
Slide9Performance Management Framework
A “complete package” of
Local, State, and Federal Accountability.Includes an a greater emphasis on the ROMA cycle.
Allows for progress on data modernization, infrastructure, and capacity for data analysis to improve outcomes.
Positions CSBG and Community Action as a model for credible national performance management.
NASCSP | ROMA Next Generation
9
Slide10STATE ACCOUNTABILITY MEASURES
NASCSP | ROMA Next Generation
10
Slide11State Accountability Measures
State accountability measures are actualized using three mechanisms:
NASCSP | ROMA Next Generation11
Slide12CSBG State Plan and Annual Report
NASCSP | ROMA Next Generation
12
Slide13ACSI
Use feedback to improve communication:
Monitoring and Corrective ActionDevelopment of the State PlanLinkagesDistribution of FundsUse of Discretionary FundsTraining and Technical Assistance
NASCSP | ROMA Next Generation
13
Slide14ORGANIZATIONAL
standards
NASCSP | ROMA Next Generation14
Slide15Organizational Standards
Developed for local CEEs.
Designed to reflect many of the requirements of the CSBG Act, applicable Federal laws and regulations, good management practices, and the values of Community Action.Ensures that all eligible entities have appropriate organizational capacity, not only in the critical financial and administrative, but also in areas of unique importance for CSBG funded eligible entities.State Offices provide consistent and high-quality oversight and technical assistance.
NASCSP | ROMA Next Generation15
Slide16Organizational Standards
Agencies will be assessed annually.
Agency progress will be reported to OCS by the state in the CSBG Annual Report. While agencies are expected to meet 100% of the standards, it is understood that implementation is a progression. Many standards are related to ROMA and standards 4.3 and 7.9 specifically require the services of a ROMA trainer (or equivalent) or the availability of a ROMA training. NASCSP | ROMA Next Generation
16
Slide17ROMA NEXT GENERATION
Building on the ROMA Foundation
17
NASCSP | ROMA Next Generation
Slide18ROMA Next Generation
ROMA is a system for
continuous quality improvement to enable the network to measure, analyze, and communicate performance.ROMA NG moves Community Action at all three levels to a culture of continuous learning
rather than a compliance and reporting culture. Ultimately, ROMA NG will help the CSBG Network generate more robust results
for individuals with low-incomes and the communities served.18
NASCSP | ROMA Next Generation
Slide19ROMA Next Generation
OCS, States and CAAs
use performance data to achieve greater stability and economic security for families and communities.
Each level of the CSBG Networkexecutes the
full ROMA cycle.uses data on people, services, and outcomes for decision making. The foundation of ROMA NG is the National Community Action Theory of Change.
19
14
NASCSP | ROMA Next Generation
Slide20What’s new in ROMA Next Generation?
The adoption of a
National Community Action Theory of Change.Renewal of the CSBG network understanding of the necessity of working toward community change as well as individual and family outcomes. Focus on improved collection and analysis of data.Increased use of data at every point of the full ROMA Cycle.
Integration of the phases of the ROMA Cycle.
NASCSP | ROMA Next Generation20
Slide21Community Action
Theory of Change
The foundation of ROMA NG is the National Community Action Theory of Change.NASCSP | ROMA Next Generation
21
Slide22What is the Community Action
Theory of Change?
The National Community Action TOC is the articulation of the underlying beliefs and assumptions that guide a service delivery strategy. It identifies the “why” and the “how” of the activities undertaken and it identifies the “what” of change and improvement produced. This national statement can be adapted for specific local needs and approaches by local CAAs.
NASCSP | ROMA Next Generation
22
Slide23Why We Need It
Make a complicated system easier to understand.
Unify the network.Articulate core principles.Identify national goals. NASCSP | ROMA Next Generation23
Slide2424
NASCSP | ROMA Next Generation
Slide25Slide26Questions?
What do you think about the new draft TOC?
NASCSP | ROMA Next Generation26
Slide27ROMA NG: The CSBG Annual Report and the CSBG IS Report
NASCSP | ROMA Next Generation
27
Slide28Where are we now?
CSBG Annual report received a
3-year clearance from the Office of Management and Budget (OMB) on January 12, 2017.This starts the phase-in
of the CSBG Annual Report and the phase-out of the CSBG IS Survey.
NASCSP | ROMA Next Generation
28
Slide2929
NASCSP | ROMA Next Generation
Where are we going?
CSBG Annual Report Implementation: Two Phases
Slide3030
NASCSP | The State of CSBG Data Collection and Submission
Reporting Timelines: October 1 – September 30
Federal Fiscal Year (FFY)
State Reporting Period
October 1 – September 30
Data Submission for States:
Data Submission for local CSBG Eligible Entities:
FFY 2016:
October 1, 2015-September 30, 2016
State Reporting Period:
October 1, 2015-
September 30, 2016
Due March 31, 2017:
CSBG IS Survey
is submitted to NASCSP.
Module 1
is completed based on the 2016 Federal Fiscal Year and submitted through the On-Line Data Collection system (OLDC).
CSBG IS Survey
FFY 2017:
October 1, 2016-September 30, 2017
State Reporting Period:
October 1, 2016-
September 30, 2017
Due March 31, 2018:
CSBG IS Survey
is submitted to NASCSP.
Module 1
is completed based on the 2017 Federal Fiscal Year and submitted through OLDC.
CSBG IS Survey
FFY 2018:
October 1, 2017-September 30, 2018
State Reporting Period:
October 1, 2017-
September 30, 2018
Due March 31, 2019:
CSBG Annual Report (Modules 1-4)
is submitted through OLDC.
CSBG Annual Report
(replaces CSBG IS Survey)
(In Progress)
Slide31How do we get there?
31
NASCSP | ROMA Next Generation
Slide3232
NASCSP | ROMA Next Generation
Assessment and Planning
Slide3333
NASCSP | ROMA Next Generation
Preparing to Report on Modules 2-4
Slide3434
NASCSP | ROMA Next Generation
Slide35CSBG DATA (Data, Analysis, and Technical Assistance) Task Force
Convened by NASCSP to assist OCS and NASCSP in understanding and addressing the CSBG Network’s
Data needs, including collection and storage; Use of data for analysis; andContinual improvement of results. DATA Task Force is a consultative body focused on:
The transition from the CSBG IS Survey to the CSBG Annual Report; andOngoing assistance in the implementation of the CSBG Annual Report.
Create a data oriented culture.NASCSP | ROMA Next Generation
35
Slide36ROMA NG: The CSBG Annual Report and the CSBG IS Report
NASCSP | ROMA Next Generation
36
Slide37New Annual Report: Modules 2 - 4
Question:
How do I know what data I need to collect for Modules 2 – 4?
37
NASCSP | ROMA Next Generation
Slide3838
NASCSP | The State of CSBG Data Collection and Submission
Annotated CSBG Annual Report
Slide3939
NASCSP | The State of CSBG Data Collection and Submission
What is in the new Annual Report?
Slide4040
NASCSP | ROMA Next Generation
What is in the new Annual Report?
Slide4141
NASCSP | The State of CSBG Data Collection and Submission
What is in the new Annual Report?
Slide42New Annual Report: Modules 2 - 4
Question:
Some of this looks very similar to what I currently report, what is different in Modules 2 – 4 than the IS Survey?
42
NASCSP | ROMA Next Generation
Slide43New Annual Report: Modules 2 - 4
Answer:
Module 3 has some new elements. We understand it may take time to phase in. Let’s talk about Module 3.
43
NASCSP | ROMA Next Generation
Slide44Module 3
Community Level NPIs
Community StrategiesNASCSP | ROMA Next Generation44
Slide45Community Needs
When we hear agencies talk about needs that were assessed, they are often community level needs:
Our community lacks living wage jobsThere is a need for more affordable housingWe have a high unemployment rateWe have a low high school graduation rate in the school district that serves our customers with low income
NASCSP | ROMA Next Generation
45
Slide46Community Responses – Identifying Outcomes
ROMA Next Generation asks the entire CSBG network to consider how we will respond to these needs.
What will change in communities?Increase in living wage jobs, affordable housing units? Reduced unemployment rate?Increased high school graduation rate?
NASCSP | ROMA Next Generation
46
Slide47Community Responses – Identifying Strategies
ROMA Next Generation asks the entire CSBG network to consider how we will respond to these needs.
What will agencies do to help make these kinds of changes in their communities? Who will we partner with (as these efforts usually involve multiple organizations.)NASCSP | ROMA Next Generation
47
Slide48Reporting on Community Work
Counts of Change
These are basic measures that provide the number of units being measured. e.g. jobs, houses, resources, etc. that have been added (created) and in some cases maintained, or undesirable conditions subtracted (eliminated), in the community the CSBG Eligible Entity has targeted. NASCSP | ROMA Next Generation
48
Slide49Reporting on Community Work
Rates of Change
These measures call for reporting the “percent change”—the increase or decrease of some rate from one year to the next. Require more data and information than countsThese indicate the magnitude of the impact a community initiative has had in a community. NASCSP | ROMA Next Generation
49
Slide50Rates of Change Examples
NASCSP | ROMA Next Generation
50
Slide51Rates of Change Examples
NASCSP | ROMA Next Generation
51
Slide52New Annual Report: Modules 2 - 4
Question:
Who is entering data into OLDC for Modules 2 – 4? States or CAAs?
52
NASCSP | ROMA Next Generation
Slide53New Annual Report: Modules 2 - 4
Question:
At this point in the planning phase, States will be entering data (collected from local agencies) for Modules 2 – 4 in OLDC in March 2019.
53
NASCSP | ROMA Next Generation
Slide54New Annual Report: Modules 2 - 4
Question:
Will there be a new numbering system for Modules 2 - 4?
54
NASCSP | ROMA Next Generation
Slide55New Annual Report: Modules 2 - 4
55
NASCSP | ROMA Next Generation
Slide56Improved Data Analysis and Use
Integration of the ROMA Cycle
Focus on improved collection and analysis of data – and use of data at every point of the full ROMA CycleNASCSP | ROMA Next Generation
56
Slide57NASCSP | ROMA Next Generation
57
Slide58Questions to Consider
ROMA Next Generation recognizes the importance of analysis to identify:
Trends that are happening over time across an agency which may impact services or strategies. Efforts that are making a
positive change in the lives of individuals and families with low income; and the conditions in communities where they live.
Resources that can be combined to produce greater and more comprehensive change.
Common barriers that go beyond the influence of a single local agency, which should be addressed at state, regional or federal level.
NASCSP | ROMA Next Generation
58
Slide59DATA Analysis
ROMA NEXT GENERATION
59
NASCSP | ROMA Next Generation
Slide6060
Does the CNA provide data on who is being served? Do the services match the needs of the people served?
Does the data in the community needs assessment contain qualitative and quantitative data? What conclusions are made?
Does the strategic plan address the needs identified in the needs assessment? What about the CAP Plan?
DATA ANALYSIS/
EVALUATION
NASCSP | ROMA Next Generation
Slide6161
What outcomes (NPIs) were achieved?
Is the data reported accurately? Is it reliable?
What types of services were provided? What outcomes did the services produce?
Can you report on a an unduplicated count served?
Can you connect the people served to outcomes obtained?
DATA ANALYSIS/
EVALUATION
NASCSP | ROMA Next Generation
What community strategies were reported?
Slide62putting it all together
NASCSP | ROMA Next Generation
62
Slide63ROMA NG
Community Needs Assessment
Standard 3.1 – completed at least once every three years.Strategic Plan
Standard 6.1 - approved within the past 5 years.Community Action Plan
Standards 4.2 – 4.4 – outcome based, documents ROMA cycle, annual update to board.CSBG Annual ReportStandard 9.4 – completes the annual report that contains outcomes and demographics.
NASCSP | ROMA Next Generation
63
Slide641.2 State ROMA Support Activities
NASCSP | ROMA Next Generation
64
Slide651.3 State Review of Data
NASCSP | ROMA Next Generation
65
Slide66I.4 State
Feedback to CEEson Meeting ROMA Goals
NASCSP | ROMA Next Generation
66
Slide67Questions?
67
NASCSP | ROMA Next Generation
What have you already done to get ready for implementation of modules 2-4?
How have you considered changing current planning or reporting processes?What do you need from NASCSP and other partners?
Slide68RESOURCES
National Theory of Change
How does ROMA NG fit into ROMA CSBG – ROMA – ROMA Next GenerationNASCSP | ROMA Next Generation
68