NASCSP ROMA Next Generation NASCSP Moving Forward with the Performance Management Framework 1 Presenters Katy Kujawski Research Director NASCSP Jeannie Chaffin Consultant NASCSP NASCSP ROMA Next Generation ID: 713624
Download Presentation The PPT/PDF document "NATIONAL ASSOCIATION FOR STATE COMMUNITY..." is the property of its rightful owner. Permission is granted to download and print the materials on this web site for personal, non-commercial use only, and to display it on your personal computer provided you do not modify the materials and that you retain all copyright notices contained in the materials. By downloading content from our website, you accept the terms of this agreement.
Slide1
NATIONAL ASSOCIATION FOR STATE COMMUNITY SERVICES PROGRAMS
NASCSP
ROMA Next Generation
NASCSP | Moving Forward with the Performance Management Framework
1Slide2
Presenters
Katy Kujawski,
Research Director, NASCSPJeannie Chaffin, Consultant, NASCSP
NASCSP | ROMA Next Generation
2Slide3
Agenda
Review the Performance Management Framework:
State and Federal Accountability Measures Organizational StandardsCSBG State Plan and Annual ReportExplore ROMA Next Generation:What is ROMA NG?Theory of Change (TOC)
CSBG Annual Report and the change from the CSBG IS SurveyCommunity Level Indicators
NASCSP | ROMA Next Generation3Slide4
NASCSP members are state administrators of the U.S. Department of Health and Human Services Community Services Block Grant (CSBG) and the U.S. Department of Energy's Weatherization Assistance Program (DOE/WAP). NASCSP provides research, analysis, training and technical assistance to State CSBG and WAP offices, Community Action Agencies, and State Associations in order to increase their capacity to prevent and reduce poverty and build economic and energy security.
NASCSP | ROMA Next Generation
4
ABOUT NASCSP |
What we doSlide5
NASCSP | ROMA Next Generation
5
ABOUT NASCSP |
CORE STRENGTHS
Training &
Technical Assistance
Communications & Resources
Advocacy & Leadership
Building Collaborative RelationshipsSlide6
NASCSP | ROMA Next Generation
6
ABOUT NASCSP | OUR PARTNERSSlide7
We provide information.
Each year NASCSP documents the sources of funding, services provided, clients and communities assisted, and the results achieved. This information is shared with the network and other research organizations in the form of national reports, articles, and a promising practices database.
NASCSP | ROMA Next Generation
7
ABOUT NASCSP | RESEARCHSlide8
Performance Management Framework
8
NASCSP | ROMA Next GenerationSlide9
Performance Management Framework
A “complete package” of
Local, State, and Federal Accountability.Includes an a greater emphasis on the ROMA cycle.
Allows for progress on data modernization, infrastructure, and capacity for data analysis to improve outcomes.
Positions CSBG and Community Action as a model for credible national performance management.
NASCSP | ROMA Next Generation
9Slide10
STATE ACCOUNTABILITY MEASURES
NASCSP | ROMA Next Generation
10Slide11
State Accountability Measures
State accountability measures are actualized using three mechanisms:
NASCSP | ROMA Next Generation11Slide12
CSBG State Plan and Annual Report
NASCSP | ROMA Next Generation
12Slide13
ACSI
Use feedback to improve communication:
Monitoring and Corrective ActionDevelopment of the State PlanLinkagesDistribution of FundsUse of Discretionary FundsTraining and Technical Assistance
NASCSP | ROMA Next Generation
13Slide14
ORGANIZATIONAL
standards
NASCSP | ROMA Next Generation14Slide15
Organizational Standards
Developed for local CEEs.
Designed to reflect many of the requirements of the CSBG Act, applicable Federal laws and regulations, good management practices, and the values of Community Action.Ensures that all eligible entities have appropriate organizational capacity, not only in the critical financial and administrative, but also in areas of unique importance for CSBG funded eligible entities.State Offices provide consistent and high-quality oversight and technical assistance.
NASCSP | ROMA Next Generation15Slide16
Organizational Standards
Agencies will be assessed annually.
Agency progress will be reported to OCS by the state in the CSBG Annual Report. While agencies are expected to meet 100% of the standards, it is understood that implementation is a progression. Many standards are related to ROMA and standards 4.3 and 7.9 specifically require the services of a ROMA trainer (or equivalent) or the availability of a ROMA training. NASCSP | ROMA Next Generation
16Slide17
ROMA NEXT GENERATION
Building on the ROMA Foundation
17
NASCSP | ROMA Next GenerationSlide18
ROMA Next Generation
ROMA is a system for
continuous quality improvement to enable the network to measure, analyze, and communicate performance.ROMA NG moves Community Action at all three levels to a culture of continuous learning
rather than a compliance and reporting culture. Ultimately, ROMA NG will help the CSBG Network generate more robust results
for individuals with low-incomes and the communities served.18
NASCSP | ROMA Next GenerationSlide19
ROMA Next Generation
OCS, States and CAAs
use performance data to achieve greater stability and economic security for families and communities.
Each level of the CSBG Networkexecutes the
full ROMA cycle.uses data on people, services, and outcomes for decision making. The foundation of ROMA NG is the National Community Action Theory of Change.
19
14
NASCSP | ROMA Next GenerationSlide20
What’s new in ROMA Next Generation?
The adoption of a
National Community Action Theory of Change.Renewal of the CSBG network understanding of the necessity of working toward community change as well as individual and family outcomes. Focus on improved collection and analysis of data.
Increased use of data at every point of the full ROMA Cycle.Integration of the phases of the ROMA Cycle.
NASCSP | ROMA Next Generation20Slide21
Community Action
Theory of Change
The foundation of ROMA NG is the National Community Action Theory of Change.NASCSP | ROMA Next Generation
21Slide22
What is the Community Action
Theory of Change?
The National Community Action TOC is the articulation of the underlying beliefs and assumptions that guide a service delivery strategy. It identifies the “why” and the “how” of the activities undertaken and it identifies the “what” of change and improvement produced. This national statement can be adapted for specific local needs and approaches by local CAAs.
NASCSP | ROMA Next Generation
22Slide23
Why We Need It
Make a complicated system easier to understand.
Unify the network.Articulate core principles.Identify national goals. NASCSP | ROMA Next Generation
23Slide24
24
NASCSP | ROMA Next GenerationSlide25Slide26
Questions?
What do you think about the new draft TOC?
NASCSP | ROMA Next Generation26Slide27
ROMA NG: The CSBG Annual Report and the CSBG IS Report
NASCSP | ROMA Next Generation
27Slide28
Where are we now?
CSBG Annual report received a
3-year clearance from the Office of Management and Budget (OMB) on January 12, 2017.This starts the phase-in
of the CSBG Annual Report and the phase-out of the CSBG IS Survey.
NASCSP | ROMA Next Generation
28Slide29
29
NASCSP | ROMA Next Generation
Where are we going?
CSBG Annual Report Implementation: Two Phases Slide30
30
NASCSP | The State of CSBG Data Collection and Submission
Reporting Timelines: October 1 – September 30
Federal Fiscal Year (FFY)
State Reporting Period
October 1 – September 30
Data Submission for States:
Data Submission for local CSBG Eligible Entities:
FFY 2016:
October 1, 2015-September 30, 2016
State Reporting Period:
October 1, 2015-
September 30, 2016
Due March 31, 2017:
CSBG IS Survey
is submitted to NASCSP.
Module 1
is completed based on the 2016 Federal Fiscal Year and submitted through the On-Line Data Collection system (OLDC).
CSBG IS Survey
FFY 2017:
October 1, 2016-September 30, 2017
State Reporting Period:
October 1, 2016-
September 30, 2017
Due March 31, 2018:
CSBG IS Survey
is submitted to NASCSP.
Module 1
is completed based on the 2017 Federal Fiscal Year and submitted through OLDC.
CSBG IS Survey
FFY 2018:
October 1, 2017-September 30, 2018
State Reporting Period:
October 1, 2017-
September 30, 2018
Due March 31, 2019:
CSBG Annual Report (Modules 1-4)
is submitted through OLDC.
CSBG Annual Report
(replaces CSBG IS Survey)
(In Progress)Slide31
How do we get there?
31
NASCSP | ROMA Next GenerationSlide32
32
NASCSP | ROMA Next Generation
Assessment and PlanningSlide33
33
NASCSP | ROMA Next Generation
Preparing to Report on Modules 2-4Slide34
34
NASCSP | ROMA Next GenerationSlide35
CSBG DATA (Data, Analysis, and Technical Assistance) Task Force
Convened by NASCSP to assist OCS and NASCSP in understanding and addressing the CSBG Network’s
Data needs, including collection and storage; Use of data for analysis; andContinual improvement of results. DATA Task Force is a consultative body focused on:
The transition from the CSBG IS Survey to the CSBG Annual Report; andOngoing assistance in the implementation of the CSBG Annual Report.
Create a data oriented culture.NASCSP | ROMA Next Generation
35Slide36
ROMA NG: The CSBG Annual Report and the CSBG IS Report
NASCSP | ROMA Next Generation
36Slide37
New Annual Report: Modules 2 - 4
Question:
How do I know what data I need to collect for Modules 2 – 4?
37
NASCSP | ROMA Next GenerationSlide38
38
NASCSP | The State of CSBG Data Collection and Submission
Annotated CSBG Annual ReportSlide39
39
NASCSP | The State of CSBG Data Collection and Submission
What is in the new Annual Report?Slide40
40
NASCSP | ROMA Next Generation
What is in the new Annual Report?Slide41
41
NASCSP | The State of CSBG Data Collection and Submission
What is in the new Annual Report?Slide42
New Annual Report: Modules 2 - 4
Question:
Some of this looks very similar to what I currently report, what is different in Modules 2 – 4 than the IS Survey?
42
NASCSP | ROMA Next GenerationSlide43
New Annual Report: Modules 2 - 4
Answer:
Module 3 has some new elements. We understand it may take time to phase in. Let’s talk about Module 3.
43
NASCSP | ROMA Next GenerationSlide44
Module 3
Community Level NPIs
Community StrategiesNASCSP | ROMA Next Generation44Slide45
Community Needs
When we hear agencies talk about needs that were assessed, they are often community level needs:
Our community lacks living wage jobsThere is a need for more affordable housingWe have a high unemployment rateWe have a low high school graduation rate in the school district that serves our customers with low income
NASCSP | ROMA Next Generation
45Slide46
Community Responses – Identifying Outcomes
ROMA Next Generation asks the entire CSBG network to consider how we will respond to these needs.
What will change in communities?Increase in living wage jobs, affordable housing units? Reduced unemployment rate?Increased high school graduation rate?
NASCSP | ROMA Next Generation
46Slide47
Community Responses – Identifying Strategies
ROMA Next Generation asks the entire CSBG network to consider how we will respond to these needs.
What will agencies do to help make these kinds of changes in their communities? Who will we partner with (as these efforts usually involve multiple organizations.)NASCSP | ROMA Next Generation
47Slide48
Reporting on Community Work
Counts of Change
These are basic measures that provide the number of units being measured. e.g. jobs, houses, resources, etc. that have been added (created) and in some cases maintained, or undesirable conditions subtracted (eliminated), in the community the CSBG Eligible Entity has targeted. NASCSP | ROMA Next Generation
48Slide49
Reporting on Community Work
Rates of Change
These measures call for reporting the “percent change”—the increase or decrease of some rate from one year to the next. Require more data and information than countsThese indicate the magnitude of the impact a community initiative has had in a community. NASCSP | ROMA Next Generation
49Slide50
Rates of Change Examples
NASCSP | ROMA Next Generation
50Slide51
Rates of Change Examples
NASCSP | ROMA Next Generation
51Slide52
New Annual Report: Modules 2 - 4
Question:
Who is entering data into OLDC for Modules 2 – 4? States or CAAs?
52
NASCSP | ROMA Next GenerationSlide53
New Annual Report: Modules 2 - 4
Question:
At this point in the planning phase, States will be entering data (collected from local agencies) for Modules 2 – 4 in OLDC in March 2019.
53
NASCSP | ROMA Next GenerationSlide54
New Annual Report: Modules 2 - 4
Question:
Will there be a new numbering system for Modules 2 - 4?
54
NASCSP | ROMA Next GenerationSlide55
New Annual Report: Modules 2 - 4
55
NASCSP | ROMA Next GenerationSlide56
Improved Data Analysis and Use
Integration of the ROMA Cycle
Focus on improved collection and analysis of data – and use of data at every point of the full ROMA CycleNASCSP | ROMA Next Generation
56Slide57
NASCSP | ROMA Next Generation
57Slide58
Questions to Consider
ROMA Next Generation recognizes the importance of analysis to identify:
Trends that are happening over time across an agency which may impact services or strategies.
Efforts that are making a positive change in the lives of individuals and families with low income; and the conditions in communities where they live.
Resources that can be combined to produce greater and more comprehensive change.
Common barriers that go beyond the influence of a single local agency, which should be addressed at state, regional or federal level.
NASCSP | ROMA Next Generation
58Slide59
DATA Analysis
ROMA NEXT GENERATION
59
NASCSP | ROMA Next GenerationSlide60
60
Does the CNA provide data on who is being served? Do the services match the needs of the people served?
Does the data in the community needs assessment contain qualitative and quantitative data? What conclusions are made?
Does the strategic plan address the needs identified in the needs assessment? What about the CAP Plan?
DATA ANALYSIS/
EVALUATION
NASCSP | ROMA Next GenerationSlide61
61
What outcomes (NPIs) were achieved?
Is the data reported accurately? Is it reliable?
What types of services were provided? What outcomes did the services produce?
Can you report on a an unduplicated count served?
Can you connect the people served to outcomes obtained?
DATA ANALYSIS/
EVALUATION
NASCSP | ROMA Next Generation
What community strategies were reported? Slide62
putting it all together
NASCSP | ROMA Next Generation
62Slide63
ROMA NG
Community Needs Assessment
Standard 3.1 – completed at least once every three years.Strategic Plan
Standard 6.1 - approved within the past 5 years.Community Action Plan
Standards 4.2 – 4.4 – outcome based, documents ROMA cycle, annual update to board.CSBG Annual ReportStandard 9.4 – completes the annual report that contains outcomes and demographics.
NASCSP | ROMA Next Generation
63Slide64
1.2 State ROMA Support Activities
NASCSP | ROMA Next Generation
64Slide65
1.3 State Review of Data
NASCSP | ROMA Next Generation
65Slide66
I.4 State
Feedback to CEEson Meeting ROMA Goals
NASCSP | ROMA Next Generation
66Slide67
Questions?
67
NASCSP | ROMA Next Generation
What have you already done to get ready for implementation of modules 2-4?
How have you considered changing current planning or reporting processes?What do you need from NASCSP and other partners?Slide68
RESOURCES
National Theory of Change
How does ROMA NG fit into ROMA CSBG – ROMA – ROMA Next GenerationNASCSP | ROMA Next Generation
68