Katherine Sela WP Research and Evaluation Manager Introduction Benefits of using logic models in evaluation Developing outcomes Evaluating programmes Challenges faced and solutions universityofsurrey ID: 798413
Download The PPT/PDF document "Using an outcomes based logic model to e..." is the property of its rightful owner. Permission is granted to download and print the materials on this web site for personal, non-commercial use only, and to display it on your personal computer provided you do not modify the materials and that you retain all copyright notices contained in the materials. By downloading content from our website, you accept the terms of this agreement.
Slide1
Using an outcomes based logic model to evaluate Access, Success and Progression initiatives
Katherine Sela
WP Research and Evaluation Manager
Slide2Introduction
Benefits of using logic models in evaluationDeveloping outcomes Evaluating programmesChallenges faced and solutions#universityofsurrey
2
Slide3#universityofsurrey
3“A logic model is a graphic display or ‘map’ of the relationship between a programme’s resources, activities, and intended results, which also identifies the programme’s underlying theory and assumptions.”
(
Kaplan and Garrett, 2005)
Slide4Why use logic modelsContinual improvement
Helps with planningHelps visualise the strategy Unpacks processes that lead to outcomesIntegrated with formative evaluationLends itself to qualitative methods
#universityofsurrey
4
Slide55
Students from KS2 to 5 (including mature
learners)
Inputs & Activities
Knowledge
Outcomes
Attitudinal
Outcomes
Impact
Increased
progression to HE by students
from underrepresented
groups
Increased success and progression of WP students within and beyond higher education
Outcomes
Situation
Remit to ensure
that
under-represented
students are supported to access, succeed in and progress beyond higher education
Short term
Medium term
Long term
Behavioural Outcomes
Parents and carers
Teachers and support staff
WP UG students at the
UoS
Increased aspiration and attainment of students from underrepresented
groups
Increase engagement with outreach
activities and educational opportunities
Increase engagement with outreach
activities and Higher Education
Increased retention, success and progression indicators
Outcomes based
logic model
Knowledge
Outcomes
Medium term
Inputs & Activities
Situation
Short term
Medium term
Slide6Setting outcomes
An outcome is a clear statement of the change in behaviour, attitude, knowledge or skills you are trying to achieve Behavioural Attitude Knowledge
(
long term
) (
medium term
)
(
short term)
Outcomes need to be:
Realistic
Meaningful
Agreed on
Evaluable
#universityofsurrey
6
Slide7Outcomes – Pre-entry and Mature students
Knowledge of
the different pathways to HE
Understanding
of the financial implications of going to
HE
Knowledge of academic and pastoral support available within
HE
7
Knowledge
Outcomes
Attitudinal Outcomes
Increased confidence in their ability to make informed and independent
decisions
Increased confidence to make the transition to HE
Increased commitment to learning
Slide811-week programme on Saturday mornings (Tasters; study skills; university exchanges) 3 sessions include parents and teachers
Aims to increase GCSE attainment
Year 10 programme
#universityofsurrey
8
80% agreed or strongly agreed that they better understood the different pathways to HE
Students, Year 10 Programme
‘It has boosted his confidence and given him a great insight to what university can offer’
Parent, Year 10 Programme
Slide9Success and Progression initiatives
Academic Skills Development (SPLASH)
Sprint Development programme for female students
Additional Learning Support
Early Induction Programme for Autistic students
Academic Skills Development (SPLASH)
Maths and Statistics Hub
Additional Learning Support
Mental health workshops
Faculty For Arts and Social Sciences
Foundation Year
Careers & Employability
Employability Award
Global Engagement
Summer School Travel Bursary
Centre for Wellbeing
Vet School Peer Support Scheme
Slide10Outcomes –
undergraduate students
Knowledge of personal and professional development skills and how to apply
these (
eg
communication, team work)
Knowledge of key academic skills and how to apply
these (
eg
research, critical thinking)
Knowledge of key support services and how to access them
10
Knowledge
Outcomes
Attitudinal Outcomes
Increased confidence in applying professional development
skills
Confidence to engage in extra-curricular activities
Increased confidence to seek support from support
services
Increased sense of belonging
Slide11Sprint evaluation#universityofsurrey
11
‘I feel more confident to apply for opportunities which come my way’
‘I have
grown in confidence during the course of the programme’
81% of students felt confident in getting involved with extra-curricular activities
95% of students said they felt confident to network with others
Slide12Challenges and possible solutions
ChallengesInstitutional ‘buy in’
Identifying
WP Students within the
university
Limited uptake and success of programmes
Compliance with data protection legislation
Staff resources
Some solutions
Access
and Participation Advisory
Group
Consent to contact at Registration
programmes targeted directly at students in most need
WP success and progression
dashboard
Evaluation and Data Officer (Success and Progression)
Slide1313
Email: k.sela@surrey.ac.uk
Any Questions?