National Peer to Peer (NPtP) - PowerPoint Presentation

Slide1

National Peer to Peer (NPtP)ROMA Training and Certification Project

Study Circle 2

Competencies

Demonstrates knowledge of basic Introduction to ROMA curriculum key principles and practices

Content Knowledge includes key points related to the full ROMA Cycle

Also is able to:

construct or analyze a scale or matrix

construct logic model with all elements matching

analyze

logic models

Demonstrates experience in working in a CAA or other level of the CAA network with implementation of ROMA a part of the job duties

Demonstrates ability to fulfill job duties related to ROMA implementation effectively 

Key findings

The portfolios that were strongest included analysis and suggestions for changes as they reviewed their agencies and their programs

In a few cases,  documents were submitted without much explanation or connection to the ROMA principles they may represent.  There was limited reflection by the candidate to point out or identify specific examples of the principles. 

In the cases where candidate provided a summary or  “overall” comment document, we found a lot of reflection and analysis in those documents.

Another area of strength was when candidates provided specific examples from a particular program to show outcomes, targeting, etc.  This showed real understanding of the concepts.

Revised Prompts

We revised the prompts:

Put them all into a single document.

If you want to summit separately, that is ok.

Be sure to have your name on every document, and to save the document with both your name and the activity number in the title.

Revised Prompts – Give Examples

We included this direction: “give examples” throughout the activities.

For example:

it is NOT helpful to the reviewer for the candidate to say “the CNA included identification of family and community level needs.”

It IS helpful to say “the family level needs identified in the CNA include inability to secure affordable housing, lack of health care coverage for the adults in the family and adult’s who lack high school diploma.” Or to say “our CNA identified the lack of living wage employment opportunity as a top need” and to clearly indicate the level of need is community.

Revised Prompts – Examples

What happens if there are NO examples in the documents you are reviewing?

For instance, your CNA identifies “housing” and “employment opportunities” as the top two needs. You know these are not stated with the level of needs explicit. Therefore you do not have an example to share.

In this case, please suggest a need statement that clarifies the level of need (as on the prior slide)

You will see this direction throughout “what is or could be” so if you do not find something, you can suggest what it could be.

In this way you demonstrate your understanding and skill even if you do not find it in the documents.

Revised Prompts - Reflection

We included a section to prompt reflection in each of the activities.

Also included is an “Overall Summary” to allow one more opportunity for the candidate to reflect, but this time about the whole agency and the entire ROMA Cycle.

Reviewers want to see some specific ideas from candidates. Not just “we need to improve our data system” but “we need to improve our system of observing and tracking the multiple services given to an individual or family. I think this could be done by ….”

Revised Prompts – Strategic Plan

Many of the Strategic Plans that were reviewed included only agency level outcomes and activities

They were not connected to the CNA findings

Candidates indicated that the Community Action Plan is where responses to the CNA are found

If you find this situation, consider how the Strategic Plan could set the broad outcome areas, as identified by the Board, without being too detailed.

Consider how the Strategic Plan might actually identify what other document would contain action steps to connect with the CNA finding.

CATEGORY SIX: Strategic Planning

This is important to discuss as the Org Standards specifically identify the role of the board approved agency wide Strategic Plan.

Standard 6.2

The approved strategic plan addresses reduction of poverty, revitalization of low-income communities, and/or empowerment of people with low incomes to become more self-sufficient.

Standard 6.3

The approved strategic plan contains family, agency, and/or community goals.

Revised Prompts -- Context

We worded some of the prompts to be clearer about what competency we were looking for.

Some prompts are what we are thinking of as “context” for the actual demonstration of competencies.

EX: The first questions in Assessment – about when the CNA was done and who was involved.

EX: Several prompts are about the Board involvement in the phase of the ROMA Cycle being addressed.

EX: There are several places where the “tracking” system is mentioned: who does it, how often is information reviewed and shared, with whom is it shared.

Revised Prompts -- Implementation

Implementation is about quality of service, but there is not much in the Introduction to ROMA that is specifically about assessing this. You will see some context questions here.

What IS included is the Carter Questions (ROMA Questions) about how many are being served, who they are, what services they are being given and what is expected to happen to them. You will have to consider where that information is kept. Give examples in each of these areas.

What seems to be most successful is when the candidate selects a single program or service to follow as a way to focus on these concepts.

If you do this, remember that you will also have to think beyond the single program to discuss how/if your agency tracks multiple services for single outcome or for multiple outcomes.

Revised Prompts -- Indicators

The issue of identifying performance calculations was addressed differently by candidates, so we need clarification going forward.

There are important ROMA concepts here.

Identifying targets for service and outcome achievement will allow analysis of the data once the actuals are collected and compared.

These numbers are found in the indicator statements

There are two primary performance calculations that are included: relationship between those served and those achieving, and relationship between targets and actuals.

Directions are included in the prompts to use the formulas on pages 58 (to identify the indicator), 66 (to calculate percent) and 72 (to compare targets and actuals) – using real numbers as examples.

Revised Prompts – Measurement Tools

It appears to be difficult to find measurement tools and processes (the last 3 columns in the ROMA Logic Model) identified.

They are not mentioned in plan documents or report documents.

They may be found in some grant applications where specific tools are required by the funding source or where an “evaluation” section of the grant application asks for the “how will you know” information.

Again for this, it appears to be most reasonable to use the same program that is considered for the Carter questions and identify what measurement tools and processes are (or could be) used.

Logic Model, Scales, Matrices

The competencies related to construction and analysis of logic models is addressed in the exam

Scales and Matrices are also included in the exam

Reference is encouraged related to use of these tools for measuring progress, collecting and analysis of data.

interaction within/between agencies

Sharing documents

Reviewing as a team

Establish timeline for VA portfolios and exam

Do you want to submit in sections or all at once?

Portfolio submission –

July 22

nd

New date:

Exam (two weeks following portfolio submission)

Average time for exam is ranging between 1.5 hours to 3.5 hours.

An exam review guide will be sent to you once you submit your portfolio.

Information gathering

Following the call,

If you have completed any of the assignments, please provide an estimate of the time it has taken you.

please send email to

ncri.ancrt@gmail.com

Evaluation Questions

We want to have a sense, following this project, of what has changed in your agency because of your involvement in securing this certification.

Consider some areas of agency operation that might be impacted.

Send me your ideas, as we are creating questions to send to you to get a “baseline” which will be a snapshot of your agency pre and then we will follow up in 6 months for a post snapshot.

You can send to

barbaramooney@windstream.net

or to

ncri.ancrt@gmail.com