Eric Stroshane NDSL Spring Workshop April 11 2016 estroshanendgov ericstroshane Acknowledgements This presentation is adapted from several different sessions presented at the 2015 Research Institute for Public Libraries RIPL conference in Colorado Springs ID: 598064
Download Presentation The PPT/PDF document "Charting Your Course" is the property of its rightful owner. Permission is granted to download and print the materials on this web site for personal, non-commercial use only, and to display it on your personal computer provided you do not modify the materials and that you retain all copyright notices contained in the materials. By downloading content from our website, you accept the terms of this agreement.
Slide1
Charting Your Course
Eric Stroshane
NDSL Spring Workshop
April 11, 2016
estroshane@nd.gov
@
ericstroshaneSlide2
Acknowledgements
This presentation is adapted from several different sessions presented at the 2015 Research Institute for Public Libraries (RIPL) conference in Colorado Springs.
It is particularly indebted to: “Creating A Data Roadmap,” prepared and presented by Nicolle Steffen, Keith Curry Lance, Rochelle Logan, and
Zeth
Lietzau
and to
Linda
Hofschire’s
presentation “Data Visualization for the Rest of Us: A Beginner’s Guide.”Slide3
Welcome…
…to ninety (90!) breathtaking minutes listening to a nincompoop
b
lather
a
bout statistics.
Know in your heart of hearts that it is not too late to run away. Slide4
http://www.pewinternet.org/2015/09/15/libraries-at-the-crossroads
/
Slide5
Data-Driven Decision Making
What is it?
Making operational determinations based on reasonable interpretations of usage, trends, and ROI
Why should we bother?
To ensure what you do is an appropriate use of resources
To communicate decisions in a defensible, comprehensible, and repeatable manner
How do we go about it?
Baking assessment into operations
Reviewing and assembling pertinent dataSlide6
Defining Our Metrics
Input
– Costs, material, time, labor, space, marketing, etc.
Inputs also include grant money, donations, and volunteer workSlide7
Defining Our Metrics
Output
– Immediately measurable quantitative data
Program registration/attendance, circulation, database usage
What we talk about when we talk about statisticsSlide8
Defining Our Metrics
Outcome
– Qualitative or quantitative measures of a service’s true impact
Generally not immediately available
Often has an anecdotal componentSlide9
The Arrow of Assessment
9Slide10
Telling the Whole Story
Why are each of these data elements important?
How do they relate?
What comes to light when you consider them together?Slide11
Library A
Library C
Library B
Slide12
Library A
100% of participating children increased or maintained reading skills
8
5% of participating
children
increased or maintained
reading
skills
8
5% of participating
children
increased or maintained
reading
skills
Library C
Library BSlide13
100% of participating children increased or maintained reading skills
8
5% of participating
children
increased or maintained
reading
skills
8
5% of participating
children
increased or maintained
reading
skills
25 children participated
100
children participated
50
children participated
Library A
Library C
Library BSlide14
100% of participating children increased or maintained reading skills
8
5% of participating
children
increased or maintained
reading
skills
8
5% of participating
children
increased or maintained
reading
skills
25 children participated
100
children participated
50
children participated
$
5,000
$
10,000
$2,500
Library A
Library C
Library BSlide15
100% of participating children increased or maintained reading skills
8
5% of participating
children
increased or maintained
reading
skills
8
5% of participating
children
increased or maintained
reading
skills
25 children participated
100
children
participated
50
children
participated
$5,000
$
10,000
$2,500
$200/child
$
1
00/child
$
5
0/child
Library A
Library C
Library BSlide16
A Fresh Look at Old Stats
Circulation
Circulation per item
Return on investment (material cost x circs)
Turnaround time/checkout percentageSlide17
Example: NDSL Kit CirculationSlide18
Assessment Milestone 1: Define Success Measures
Inputs:
Outputs:
Outcomes:Slide19
Assessment Milestone 2:Identify Data Needs
Planning
Managing
Reporting
CommunicatingSlide20
Assessment Milestone 3:Data Crosswalk
Inventory existing data
Identify
overlaps & gaps
Identify new data needed
Assess needs vs. wantsSlide21
3.5 Existing Data
Your Public Library Annual Report (if a P.L.)
Your Automation System (if automated)
Census Demographics and the Census Business Builder: Small
Business Edition:
https://cbb.census.gov/sbe
/
Expanding Minds
and Opportunities:
http://www.expandinglearning.org/expandingminds
/
Others?Slide22
3.5 Data Needs
Needed data…
…and how to acquire itSlide23
Assessment Milestone 4:Talk About Data
Stakeholders
Share external requirements
Listen to needs & concernsSlide24
Handling Data in Excel/Google Sheets
Data is great!
But numbers often need some TLC
2 + 2 =
LOVESlide25
Practicing the Mathemagical Arts
A Brief Demonstration of the Most Useful Things I’ve Learned About Spreadsheets Over the Years
(and
those
I’m most often asked how to do)Slide26
Numbers Are Not Enough
We can no longer rely on outputs alone
Find the story you need to tell
Q
ualitative outcome assessment
Data synthesis
Support your story with data, but don’t bog it down
Now tell it! We’re librarians—we get stories!Slide27
Stories
are how numbers talk to people.
-Thomas Davenport
Numbers have an
important story
to tell. They rely on you to give them a
clear and convincing voice
.
―Stephen FewSlide28
Data Visualization
Why even bother?Slide29
By visualizing information, we turn it into a landscape that you can explore with your eyes, a sort of information map. And when you’re lost in information,
an information map is kind of useful
.
―David
McCandlessSlide30
From @factbot1,April 9, 2016, 4:03 p.m.:
https://twitter.com/factbot1/status/718937291750842368
Slide31
Reasons to Visualize
When done well, visualizations make data more…
Digestible
Memorable
ConvincingSlide32
But It Can Go Pants Up
However, it is possible to visually arrange data such that it is…
Incomprehensible
Confusing
Offensively hideousSlide33
Rule 1: Avoid Silly ChartsSlide34
Rule 2: Choose Charts that Suit Your StorySlide35
Rule 3: Put Numbers in ContextSlide36
Rule 4: Establish a Focal Point
From the great
Junk Charts
,
http://junkcharts.typepad.com/
Slide37
Rule 5: Don’t Make People Work Too Hard To Find InformationSlide38
Rule 6: Tell Me Something I Don’t Know
From @
ChappellTracker
:
https
://
twitter.com/ChappellTracker/status/719314783858765824
Slide39
Data Visualization ContinuumSlide40
To Recap
Assess everything you do
Get the data you need
Tell your story well
Use pretty picturesSlide41
Any Questions?