Experience at MMU Clearing a path amp interpreting digital footprints Professor Mark Stubbs Head of Learning amp Research Technologies http twittercomthestubbs httpslidesharenetmarkstubbs ID: 623016
Download Presentation The PPT/PDF document "Enhancing the First Year Student" is the property of its rightful owner. Permission is granted to download and print the materials on this web site for personal, non-commercial use only, and to display it on your personal computer provided you do not modify the materials and that you retain all copyright notices contained in the materials. By downloading content from our website, you accept the terms of this agreement.
Slide1
Enhancing the First Year Student Experience at MMU: Clearing a path & interpreting digital footprints
Professor Mark StubbsHead of Learning & Research Technologieshttp://twitter.com/thestubbshttp://slideshare.net/markstubbs
Nottingham | Jun 2014
#EFYE2014Slide2
Context | An interesting place to work!Large, popular, multi-campus university36,000+ students | 1,000+ courses | consolidating from 7 sites
Pursuing an ambitious transformation initiativeNew Buildings, New Curriculum, New Admin Processes & Systems, New Learning & Mobile Tech, New Quality Processes…
80
%+
of 8,125 11/12 UG
intake
young from state schools /
collegesSlide3
Context | Strategic improvement imperative
Student RetentionSuccess & Satisfaction
Student Intake
(Aspirations, Attitude
& Abilities)
Learning, Teaching, Assessment
& Personal Development
Processes, Facilities
& Resources
Reputation
Marketing &
Recruitment
Processes
All Year Numbers
Resource allocation
League table
rankings
A
A
Recruit to target
B
B
Improve satisfaction, retention & success
C
C
Inform decision-makers
2010 NSS Where to intervene?Slide4
CSI | Student ExperienceCareful diagnosis of (diverse) learning experiencesRecurrent messages
NSS analysis: course organisation determines Q22Mobile surveys: deadlines, timetables… (m-admin)Focus groups: consistent, easy to find infoGreat (and not-so great) expectations“engaging, well-organised courses”“inspirational tutors who know me”
‘Hygiene factors’
Stimulating pedagogiesSlide5
CSI | Student Retention & SuccessReflect on…
+ Assumptions+ InterventionsExamine data…+ Focus Groups+ Surveys
+ Journey journals+ Observations+ National dataReview literature…
+ Multi-dimensional+ Belonging
+ Habitus+ Polishing+ …
B
Improve satisfaction, retention & success
Literature
Journeys
Wed 9, N31
Assumptions
1
st
years have requisite motivation, academic ability, adaptive capacity and resilience
to
a) Sort
/
£
/
/
/
/
so they can focus
b) Adapt
study methods to new academic
requirementsc) Perform to required standardd) Establish supportive social / working relationships
Interventions
R&A / pre-entry, personalised info, early formative feedbackSlide6
Coordinating our response
B
Improve satisfaction, retention & success
Great
Online Experience
(Seamless, personalised)
Great
Learning Spaces
Great
Teaching
Simplify
Unwieldy
Curriculum
EQAL
£350MSlide7
A coordinated strike for step-change improvementEQAL
New Curriculum
designing new units, …
New Admin Systems & Processes
personal timetabling, …
New Virtual Learning Environment
Moodle &
myMMU
web/mobile,
Talis
Aspire…
New QA & QE Processes
facilitating curriculum transformation
In the current climate
Diminishing unit of resource
Everything depends on everything else
We are large and risk averse
but
but
but
but
but
Programme Board chaired by DVC Student ExperienceSlide8
MISSION:
2010 Q1
:
Plan Programme & Projects
2010 Q2: Approve UG curriculum rules
2010 Q3: Develop smart curriculum capture forms
2010 Q4: Enter 800+ new L3 + L4 module
2011 Q1: Approve new modules
2011 Q2: Set up SRS, TT & VLE
2011 Q3
: L4 curriculum & systems go live
2011 Q4: Enter new L5 modules…
2012 Q3: L5 goes live
2013 Q3
:
Entire new UG curriculum liveSlide9
Smart forms
868
L3+L4
modules
Minimise
‘big ask’
Jul 2010Slide10
Feb 2011
Core+ VLE blueprint
timetable
d
eadlines, marks
enrolments
m
resource lists
past exams,
digitizations
s
so
linksSlide11
More familiarSlide12
12
Wrapping the institution around the learner
Student ID
Timetable
This work is licensed under a Attribution-NonCommercial-ShareAlike 2.0 licence
Sync to personal deviceSlide13
Pre-entry access to timetables
Less early access than expectedSlide14
Wrapping the institution around the learner
Student ID (+ Unit code)
Deadlines / extensions /
feedback return dates / provisional marks
Personalised
submission sheet
This work is licensed under a Attribution-NonCommercial-ShareAlike 2.0 licenceSlide15
Wrapping the institution around the learner
Unit code
Resource list
Relevant resource
This work is licensed under a Attribution-NonCommercial-ShareAlike 2.0 licenceSlide16
Wrapping the institution around the learner
Unit code
Past exam papers
Past exam paper
This work is licensed under a Attribution-NonCommercial-ShareAlike 2.0 licence
11,000+ past exams uploadedSlide17
MyMMU
App
m-adminSlide18
Summary | we cleared a path to the information our learners needed…Slide19
Are we in a better place now?
10,000+ students post 40,000+ comments in our biannual student surveys
Submission tracking, Personal timetables, …
Quartile improvements in course org & learning resources in 2012 NSS
EQAL wins inaugural Guardian Student Experience Award!
30,000 regular users, 52m+ hits on Moodle, 26,000+ App registrations!Slide20
… we can now begin to interpret some digital footprintsSlide21
Using the data
Refining understanding of a problem spaceSlide22
Understanding student satisfaction
Refining understanding of student satisfaction
Student demographicsEntry profilesInternal survey responses
Join on student ID
Random Forests analysis
Satisfaction predictors
↗
Confidence
↘ Organisation
→Teaching
Sum entry points &
qual
type
Handle missing values, collapse categories… Slide23
Understanding student success
Refining understanding of student continuation
HESA PILeague Tables
Join on UK PRN
Random Forests Regression Tree
Predictors
YNG NSSEC4-7
Entry Tariff
NSS
Add UKPRN
Handle missing values, collapse categories… Slide24
Conditional Inference Trees
Party LibrarySlide25
LimitationsConfirmation biasMeaningful comparison
Quantitative V QualitativeData qualityCorrelation ≠ causation“Everything that can be counted does not necessarily count; everything that counts cannot necessarily be
counted”Einstein
Reality of our current data warehouse build: careful thought about error handling + painstaking checking of joins!Slide26
Continuous monitoring & improvement
MDL
SRS
TT
Data Warehouse
Analysis Cubes
CMI dashboard for all programme leaders for Sep 2014
CSlide27
Change management lessonsUnderstand important dynamicsBe clear what needs to be doneSet high-level goals
Understand where change is requiredBe bold and plan holisticallyEnsure you’ve got the right team to driveMake ‘big asks’ as small as possibleMake it stick with reinforcing changehttp://tinyurl.com/jiscmmusrc
Curriculum Design
Assessment & Feedback
http://tinyurl.com/jiscmmutraffic
Find out more!