of Supportive Housing Key ProjectLevel Outcome Measures MHSA Promising Practices Call 41311 What is Outcome Measurement Answers the question are we doing the right program activities to bring about the outcomes ID: 562292
Download Presentation The PPT/PDF document "Demonstrating the Quality and Impact" is the property of its rightful owner. Permission is granted to download and print the materials on this web site for personal, non-commercial use only, and to display it on your personal computer provided you do not modify the materials and that you retain all copyright notices contained in the materials. By downloading content from our website, you accept the terms of this agreement.
Slide1
Demonstrating the Quality and Impact of Supportive Housing: Key Project-Level Outcome Measures
MHSA Promising Practices Call 4/13/11Slide2
What is Outcome Measurement?
Answers the question: are we
doing the right program activities to bring about the outcomes
needed by clients Outcomes are benefits to clients from participation in the program. Outcomes are usually measured in terms of enhanced learning (knowledge, perceptions/attitudes or skills) or conditions, e.g., increased literacy, self-reliance, etc.
2Slide3
Why Outcome Measurement?Focuses on short-term, intermediate, or
long-term outcomes
Determine
whether or not program goals/outcome objectives were metTo justify the need for further fundingTo ensure that only effective programs are continued
3Slide4
Logic Models
Provide a visual depiction of how a program is supposed
to work
Describe the inputs, activities and outcomes of a programVisually connect program inputs with short-term and long-term outcomesSpecify how the program activities relate to the ultimate outcomes of the programProvide causal links between the operations of the
program to
short-term and long-term outcomes
Clarify
the relationship between the program and
the problem
(and its determinants)
4Slide5
5
Generic Program Logic Model
Inputs
People
Money
Clients
Case-load
Processes
Activities
Initiatives
Procedures
Outputs
Services
Products
Outcomes
Impacts
Effects
Results
Intervening (Contextual) VariablesSlide6
6
6
Where to start:
Answer Three Key Questions
What did you do?
How well did you do it?
What difference did it make?
Slide7
7
7
Evaluating Outcomes:
Common Types of Change
New knowledge
Increased skills
Changed attitudes, opinions, or values
Changed motivation or aspirations
Modified behavior
Changed decisions
Changed policies
Changed conditionsSlide8
Outcome Measurement: Some Basic Definitions
Inputs
Indicate the amount of resources applied; for example, the amount of funds or number
of employees. When related to output or outcome information, the combined information
will provide
indicators of efficiency/productivity
.
8Slide9
Outcome Measurement: Some Basic Definitions
Outputs
Show the quantity of work activity completed. Outputs are expected to lead to
desired outcomes, but by themselves do not tell anything about the outcomes.9Slide10
Outcome Measurement: Some Basic Definitions
Intermediate Outcomes
Events or results that are expected to lead to the end outcomes, but are not
themselves “ends.” Also include characteristics relating to the quality of the service provided to clients, such
as accessibility, response time, and overall satisfaction.
10Slide11
Outcome Measurement: Some Basic Definitions
End Outcomes
The consequences/results of what the program did, not what the program itself did.
These are likely to be aspects of the client’s condition or behavior that the program seeks to affect
.
11Slide12
Outcome Measurement: Some Basic Definitions
Benchmarks
Data that can be used as targets for outcomes or as a comparison with observed outcomes
12Slide13
13
Essential Outcome Measures for
Supportive
Housing Programs Clearly-defined, measurable project-level outcomes are an important tool for evaluating the quality and impact of supportive housing projects Slide14
14
Essential Outcome Measures for
Supportive
Housing Programs Number and Characteristics of Tenants
Served
Providers can
track their progress along the following indicators:
Eligible tenants are quickly identified and enrolled into supportive housing (e.g. vacant units are quickly filled); and
Tenant characteristics match the eligibility criteria of the supportive housing project or initiative (e.g. length of homelessness, sleeping on the streets, severe mental illness, and/or any other key eligibility criteria.) Slide15
15
Essential Outcome Measures for
Supportive
Housing Programs Housing Outcomes
All
providers of supportive housing should track:
The number/percentage of tenants who remain in supportive housing after one year; and
Of those who exit supportive housing, how many or what proportion leave for another stable housing situation Slide16
16
Essential Outcome Measures for
Supportive
Housing Programs Service Utilization
All
providers of supportive housing should track:
The number/percentage of tenants receiving services in supportive housing; and
The type of services they receive Slide17
17
Essential Outcome Measures for
Supportive
Housing Programs Tenant Satisfaction
Providers
can administer focus groups or a short survey in order to measure tenants’ satisfaction with the following:
Safety and cleanliness of housing;
Policies, rules, and procedures within the housing
Quality and appropriateness of services; and
Staffing patterns, staff communication skills, and responsiveness to tenant needs. Slide18
18
Essential Outcome Measures for
Supportive
Housing Programs Additional Project-Level Outcomes: There are many other important outcomes that providers may want to track depending on the goals of the supportive housing project, the target populations, the services being provided, and the capacity to collect data. Slide19
19
Essential Outcome Measures for
Supportive
Housing Programs Income and Employment
Providers
may want to track changes in the following outcomes after tenants are housed:
Number/percentage of tenants who are employed;
Amount of earned income;
Number/percentage of tenants with SSI and/or other income supports; and
Amount of total income Slide20
20
Essential Outcome Measures for
Supportive
Housing Programs Service Utilization and Cost Effectiveness
Research shows that supportive housing reduces tenant incarceration and use of emergency health care, mental health services, and shelter. Tracking these patterns both before and after entry into supportive housing – along with the associated cost savings – can be a powerful tool to increase investment in supportive housing. Slide21
21
Essential Outcome Measures for
Supportive
Housing Programs Service Utilization and Cost Effectiveness Agencies/providers should track utilization of other health services and institutions before and after entry into supportive housing, including:
Shelters
Emergency rooms
Hospitals
Outpatient health and mental health services
Jails and prisons
Per diem costs for each of these systems Slide22
22
Essential Outcome Measures for
Supportive
Housing Programs How will you use the data you collect?Identify where improvements
are.
This is likely to be the single most important
use.
Determine how effectively program modifications improved services.
This will
help identify whether further changes are needed.
Motivate staff to continually strive for service improvements.
Encourage
innovation.
Improve fundraising and community relations by including outcome
information in
communications.Slide23
Reported Benefits of Outcome Measurement
A clear definition of the program's intended outcomes, in itself, provides focus for the program's work.
Understanding
the current level of outcome achievement provides a barometer to assess progress and direct future activities. Outcome measurement provides invaluable information to improve programs and then see if the improvements make the intended difference. Outcome information is a powerful motivator of staff, who now can observe the progress they are making with participants in a consistent, tangible manner.
23Slide24
Resources and Tools: Point K
Organizational Assessment Tool
: A self-assessment survey and reporting tool that provides
a snapshot of organizational strengths and areas for improvement. Logic Model Builder: A step-by-step guide for articulating and connecting organizational or program goals, resources, activities, outputs, and outcomes. Evaluation Plan Builder: Transfers key data from the Logic Model Builder and moves from goal-setting to identification of evaluation questions, indicators, and data collection strategies for evaluating program outcomes and implementation. www.innonet.org
24Slide25
Resources and Tools: Free Management LibraryBasic Guide to Program Evaluation (Including Outcomes Evaluation
) in Free Management Library
http://
www.managementhelp.org/evaluatn/fnl_eval.htm25Slide26
Resources and Tools: Urban Institute
The Urban Institute Series on
Outcome Management for Nonprofit
OrganizationsKey Steps in Outcome ManagementFinding Out What Happened to Former Clients Surveying Clients about Outcomes
Analyzing Outcome
Information
Developing Community-wide Outcome Indicators for Specific Services
Using Outcome
Information
26Slide27
Resources and Tools:American Evaluation Association
Website includes materials, links to blogs, extensive information
http://
comm.eval.org/EVAL/EVAL/Home/Default.aspx27Slide28
For more information contact CSH