Key Issues and Trends Marshall Breeding Independent Consult Author Founder and Publisher Library Technology Guides httpwwwlibrarytechnologyorg httptwittercommbreeding July 25 2012 ID: 800161
Download The PPT/PDF document "The Next Generation of Library Automatio..." is the property of its rightful owner. Permission is granted to download and print the materials on this web site for personal, non-commercial use only, and to display it on your personal computer provided you do not modify the materials and that you retain all copyright notices contained in the materials. By downloading content from our website, you accept the terms of this agreement.
Slide1
The Next Generation of Library Automation and Discovery: Key Issues and Trends
Marshall BreedingIndependent Consult, Author, Founder and Publisher, Library Technology Guideshttp://www.librarytechnology.org/http://twitter.com/mbreeding
July 25, 2012
WiLSWorld
Conference
Slide2SummaryLibraries today face incredible challenges as they face challenges brought on by shifts in their collections to include ever increasing of electronic content, never-ending budget pressures, and rising expectations by their customers for instant access to information. In response to these challenges, libraries demand more effective and efficient automation solutions with requirements for additional features and functionality aligned with these new realities that may not have been present in previous automation products. In the past, libraries could gain adequate automation by choosing the best integrated library system that fit their technical requirements and budget. Now, for better or worse, many choices now exist that represent quite different paths, including decisions regarding open source versus proprietary products, evolutionary ILS versus new-generation library services platforms, online catalogs versus discovery services, locally implemented versus cloud-based deployment. Marshall Breeding will present an overview of the current library automation landscape, highlighting the advantages and concerns presented by this new slate of alternatives.
Slide3Library Technology Guides
www.librarytechnology.org
Slide4ILS Turnover Report
Slide5ILS Turnover Report -- Reverse
Slide6Mergers and Acquisitions
http://www.librarytechnology.org/automationhistory.pl
Slide7Key Context: Libraries in TransitionAcademic Shift from Print > ElectronicE-journal transition largely completeCirculation of print collections slowingE-books now in play (consultation > reading)
Public: Emphasis on Patron EngagementIncreased pressure on physical facilities Increased circulation of print collectionsDramatic increase in interest in e-booksAll libraries:Need better tools for access to complex multi-format collections
Strong emphasis on digitizing local collectionsDemands for enterprise integration and interoperability
Slide8Key Context: Technologies in transitionClient / Server > Web-based computingBeyond Web 2.0Integration of social computing into core infrastructure
Local computing shifting to cloud platformsApplication Service Provider offerings standardNew expectations for multi-tenant software-as-a-serviceFull spectrum of devices full-scale / net book / tablet / mobileMobile the current focus, but is only one example of device and interface cycles
Slide9Key Text: Changed expectations in metadata managementMoving away from individual record-by-record creation Life cycle of metadata Metadata follows the supply chain, improved and enhanced
along the way as neededManage metadata in bulk when possibleE-book collectionsHighly shared metadata E-journal knowledge bases, e.g.Great interest in moving toward semantic web and open linked dataVery little progress in linked data for operational systemsAACR2 > RDA
MARC > RDF (Library of Congress bibliographic framework transition)
http://www.loc.gov/marc/transition/
Slide10Each Library Type DistinctiveAcademic – Public – School – SpecialAcademic: Emphasis on subscribed electronic resourcesPublic: Engaged in the management of print collectionsDramatic increase in interest in E-books
School: Age-appropriate resources (print and Web), textbook and media managementSpecial: Enterprise knowledge management (Corporate, Law, Medical, etc)
Slide11Cooperation and Resource sharingEfforts on many fronts to cooperate and consolidateMany regional consortia merging (Example: suburban Chicago systems)State-wide or national implementationsSoftware-as-a-service or “cloud” based implementationsMany
libraries share computing infrastructure and data resources
Slide12Each Library Type DistinctiveAcademic – Public – School – SpecialAcademic: Emphasis on subscribed electronic resourcesPublic: Engaged in the management of print collectionsDramatic increase in interest in E-books
School: Age-appropriate resources (print and Web), textbook and media managementSpecial: Enterprise knowledge management (Corporate, Law, Medical, etc)
Slide13Cooperation and Resource sharingEfforts on many fronts to cooperate and consolidateMany regional consortia merging (Example: suburban Chicago systems)State-wide or national implementationsSoftware-as-a-service or “cloud” based implementationsMany
libraries share computing infrastructure and data resources
Slide14Status Quo Sustainable?ILS for management of (mostly) printDuplicative financial systems between library and campusElectronic Resource Management (non-integrated with ILS)OpenURL Link Resolver w/ knowledge base for access to full-text electronic articlesDigital Collections Management platforms (CONTENTdm, DigiTool, etc.)
Institutional Repositories (DSpace, Fedora, etc.)Discovery-layer services for broader access to library collectionsNo effective integration services / interoperability among disconnected systems, non-aligned metadata schemes
Slide15Academic Library IssuesGreater concern with electronic resourcesManagement: Need for consolidated approach that balances print, digital, and electronic workflowsAccess: discovery interfaces that maximize the value of investments in electronic content
Slide16Cloud ComputingMajor trend in Information TechnologyFew organizations have core competence in large-scale computer infrastructure managementEssentially outsourcing of server housing and managementUsually based on a consumption-based business model
Most new automation products delivered through some flavor of cloud computingMany flavors to suit business needs: public, private, hybrid
Slide17Software as a ServiceMulti Tennant SaaS is the modern approachOne copy of the code base serves multiple sitesSoftware functionality delivered entirely through Web interfacesNo workstation clients
Upgrades and fixes deployed universallyUsually in small increments
Slide18Data as a serviceSaaS provides opportunity for highly shared data modelsWorldCat: one globally shared copy that serves all librariesPrimo Central: central index of articles maintained by Ex Libris shared by all libraries implementing Primo / Primo CentralKnowledgeWorks database of
of e-journal holdings shared among all customers of Serials Solutions productsGeneral opportunity to move away from library-by-library metadata management to globally shared workflows
Slide19Open SystemsAchieving openness has risen as the key driver behind library technology strategiesLibraries need to do more with their data
Ability to improve customer experience and operational efficiencies
Demand for InteroperabilityOpen source
– full access to internal program of the application
Open API’s
– expose programmatic interfaces to data and functionality
Slide20Mobile Computing
Slide21Challenge: Disjointed approach to information and service deliveryLibrary Web sites offer a menu of unconnected silos:Books: Library OPAC (ILS online catalog module)Articles: Aggregated content products, e-journal collectionsOpenURL linking services
E-journal finding aids (Often managed by link resolver)Subject guides (e.g. Springshare LibGuides)Local digital collectionsETDs, photos, rich media collectionsMetasearch engines
Discovery Services – often just another choice among manyAll searched separately
Slide22Online CatalogBooks, Journals, and Media at the Title LevelNot in scope:ArticlesBook ChaptersDigital objectsWeb site content
Etc.Scope of Search
Search:
Search Results
ILS Data
Slide23Next-gen Catalogs or Discovery Interface (2002-2009)Single search boxQuery toolsDid you meanType-aheadRelevance ranked results (for some content sources)
Faceted navigationEnhanced visual displaysCover artSummaries, reviews,Recommendation services
Slide24Discovery Interface search model
Search:
Digital Collections
ProQuest
EBSCOhost
…
MLA
Bibliography
ABC-CLIO
Search Results
Real-time query and responses
ILS Data
Local Index
MetaSearch
Engine
Slide25Discovery Products
http://www.librarytechnology.org/discovery.pl
Slide26Differentiation in DiscoveryProducts increasingly specialized between public and academic librariesPublic libraries: emphasis on engagement with physical collectionAcademic libraries: concern for discovery of heterogeneous material types, especially books + articles + digital objects
Slide27Discovery from Local to Web-scaleInitial products focused on technologyAquaBrowser, Endeca, Primo, Encore, VuFind,
LIBERO Uno, Civica Sorcer, Axiell ArenaMostly locally-installed softwareCurrent phase is focused on pre-populated indexes that aim to deliver Web-scale discoveryPrimo Central (Ex Libris)Summon (Serials Solutions)WorldCat Local (OCLC)
EBSCO Discovery Service (EBSCO)Encore with Article Integration (no index, though)
Slide28Web-scale Index-based Discovery
Search:
Digital Collections
Web Site Content
Institutional Repositories
…
E-Journals
Reference Sources
Search Results
Pre-built harvesting and indexing
Consolidated Index
ILS Data
Aggregated Content packages
(2009- present)
Slide29Web-scale Search Problem
Search:
Search Results
Pre-built harvesting and indexing
Consolidated Index
???
Non Participating
Content Sources
Problem in how to deal with resources not provided to ingest into consolidated index
Digital Collections
Web Site Content
Institutional Repositories
…
E-Journals
ILS Data
Aggregated Content packages
Slide30Encore Synergy
Search:
Digital Collections
ProQuest
…
Local Index
ILS Data
Web Services
Local Index Results
Local Index Results
Remote Search Results
EBSCOhost
…
MLA
Bibliography
ABC-CLIO
Slide31Consolidated index
Search
Engine
Unified Presentation Layer
Search:
Digital
Coll
ProQuest
EBSCO
…
JSTOR
Other Resources
New Library Management Model
`
API Layer
Library Services Platform
Learning
Management
Enterprise Resource
Planning
Stock
Management
Self-Check /
Automated Return
Authentication
Service
Smart Cad /
Payment systems
Discovery Service
Slide32Adoption of Discovery ServicesNext-gen catalogs or discovery services have been around since 2002Many mature productsContinuing to evolve and expandOnline catalog components of ILS products have taken on many of the characteristics of discovery layersExamples: LS2 PAC, Polaris PowerPAC
Slide33Discovery Service Installations
Discovery Product2007
2008
2009
2010
2011
Installed
Primo
12
37
53
506
111
914
AquaBrowser
55
339
64
69
74
254
Encore
72
72
109
56
72
326
LS2 PAC
46
77
58
88
236
Summon
50
164
214
407
Enterprise
16
75
100
251
Civica Sorcer
7
12
22
39
Axiell Arena
61
57
33
76
Chamo
10
34
7
51
Slide34EBSCO Discovery Service
Slide35Global Primo Installations
Slide36Summon Global Adoption
Slide37Expanding the Depth of Discovery
Slide38Citations / Metadata > Full TextCitations or structured metadata provide key data to power search & retrieval and faceted navigationIndexing Full-text of content amplifies access Important to understand depth indexingCurrency, dates covered, full-text
or citationMany other factors
Slide39Full-text Book indexingHathiTrust: 11 million volumes, 5.3 million titles, 263,000 serial titles, 3.5 billion pagesHathiTrust in Discovery IndexesPrimo
Central (Jan 20, 2012) [previously indexed only metadata]EBSCO Discovery Service (Sept 8 2011)WorldCat Local (Sept 7, 2011)Summon (Mar 28, 2011)
Slide40Challenge for RelevancyTechnically feasible to index hundreds of millions or billions of records through Lucene or SOLRDifficult to order records in ways that make senseMany fairly equivalent candidates returned for any given queryMust rely on use-based and social factors to improve relevancy rankings
Slide41Quest for Improved RelevancyExample: Ex Libris Primo ScholarRank Relevancy tuned for scholarly contentUses bX data to assign score that reflects scholarly importanceAble to weight by disciplines and filter by other factors for signed-in users
Now available in Primo Version 4
Slide42Challenges for Collection CoverageTo work effectively, discovery services need to cover comprehensively the body of content represented in library collectionsWhat about publishers that do not participate?Is content indexed at the citation or full-text level?What are the restrictions for non-authenticated users?
How can libraries understand the differences in coverage among competing services?
Slide43Evaluating the Coverage of Index-based Discovery ServicesIntense competition: how well the index covers the body of scholarly content stands as a key differentiatorDifficult to evaluate based on numbers of items indexed alone. Important to ascertain now your library’s content packages are represented by the discovery service.
Important to know what items are indexed by citation and which are full textImportant to know whether the discovery service favors the content of any given publisher
Slide44Open Discovery InitiativeNISO Work Group to Develop Standards and Recommended Practices for Library Discovery Services Based on Indexed SearchInformal meeting called at ALA Annual 2011Co-Chaired by Marshall Breeding and Jenny WalkerTerm: Dec 2011 – May 2013
Slide45Balance of Constituents
45Marshall Breeding, Vanderbilt UniversityJamene Brooks-Kieffer
, Kansas State University Laura Morse, Harvard University
Ken Varnum, University of Michigan
Anya Arnold, Orbis Cascade Alliance
Sara Brownmiller, University of
Oregon
Lucy Harrison, College Center for Library Automation (D2D liaison/observer)
Lettie
Conrad, SAGE Publications
Beth
LaPensee
, ITHAKA/JSTOR/Portico
Jeff Lang, Thomson Reuters
Linda Beebe, American Psychological
Assoc
Aaron Wood, Alexander Street Press
Jenny Walker, Ex
Libris
Group
John Law, Serials Solutions
Michael
Gorrell
, EBSCO Information Services
David
Lindahl
, University of Rochester (XC
)
Jeff
Penka
, OCLC (D2D liaison/observer)
Slide46TimelineMilestone
Target DateStatus
Appointment of working group
December 2011
Approval of charge and initial work plan
March 2012
Agreement on process and tools
June 2012
Completion of information gathering
October 2012
Completion of initial draft
January 2013
Completion of final draft
May 2013
46
Slide47ODI Project Goals:Identify … needs and requirements of the three stakeholder groups in this area of work. Create recommendations and tools to streamline the process by which information providers, discovery service providers, and librarians work together to better serve libraries and their users.
Provide effective means for librarians to assess the level of participation by information providers in discovery services, to evaluate the breadth and depth of content indexed and the degree to which this content is made available to the user.
Slide48The rise of e-booksAcademic libraries: e-books included in aggregated content packagesE-books used primarily for research and consultation, not long readingPublic Libraries: Subscriptions to e-book services that provide an outsourced collection of loanable e-books
K-12 Schools, Colleges, Universities: interest in electronic textbooks
Slide49Integrating e-Books into Library Automation InfrastructureCurrent approach involves mostly outsourced arrangementsCollections licensed wholesale from single providerHand-off to DRM and delivery systems of providersLoading of MARC records into local catalog with linking mechanisms
No ability to see availability status of e-books from the library’s online catalog or discovery interface
Slide50Technology IssuesAccess to materials controlled through Digital Rights Management Closed ecosystems that control content through identity management and rights policiesImposes significant overhead on the user experience:Download an install DRM components
Establish user credentials in site trusted by DRMWorks only with devices that comply with DRM restrictions
Slide51Next-Gen Library Catalogs
Marshall BreedingNeal-Schuman PublishersMarch 2010
Volume 1 of The Tech Set
Slide52New Generation Management
Slide53Appropriate Automation InfrastructureCurrent automation products out of step with current realitiesMajority of library collection funds spent on electronic contentMajority of automation efforts support print activities
Management of e-content continues with inadequate supporting infrastructureNew discovery solutions help with access to e-contentLibrary users expect more engaging socially aware interfaces for Web and mobile
Slide54Fundamental technology shiftMainframe computingClient/ServerCloud Computing
http://www.flickr.com/photos/carrick/61952845/
http://soacloudcomputing.blogspot.com/2008/10/cloud-computing.html
http://www.javaworld.com/javaworld/jw-10-2001/jw-1019-jxta.html
Slide55Library Automation in the CloudAlmost all library automation vendors offer some form of “cloud-based” servicesServer management moves from library to VendorSubscription-based business modelComprehensive annual subscription paymentOffsets local server purchase and maintenance
Offsets some local technology support
Slide56Leveraging the CloudMoving legacy systems to hosted services provides some savings to individual institutions but does not result in dramatic transformationGlobally shared data and metadata models have the potential to achieve new levels of operational efficiencies and more powerful discovery and automation scenarios that improve the position of libraries overall.
Slide57Is the status quo sustainable?ILS for management of (mostly) printDuplicative financial systems between library and campusElectronic Resource Management (non-integrated with ILS)
OpenURL Link Resolver w/ knowledge base for access to full-text electronic articlesDigital Collections Management platforms (CONTENTdm, DigiTool, etc.)Institutional Repositories (DSpace, Fedora, etc.)Discovery-layer services for broader access to library collectionsNo effective integration services / interoperability among disconnected systems, non-aligned metadata schemes
Slide58Integrated (for print) Library System
Circulation
BIB
Staff Interfaces:
Holding
/ Items
Circ
Transact
User
Vendor
Policies
$$$
Funds
Cataloging
Acquisitions
Serials
Online
Catalog
Public Interfaces
:
Interfaces
Business
Logic
Data
Stores
Slide59LMS / ERM: Fragmented Model
Circulation
BIB
Staff Interfaces:
Holding
/ Items
Circ
Transact
User
Vendor
Policies
$$$
Funds
Cataloging
Acquisitions
Serials
Online
Catalog
Public Interfaces
:
Application Programming Interfaces
`
License
Management
License
Terms
E-resource
Procurement
Vendors
E-Journal
Titles
Protocols:
CORE
Slide60Common approach for ERM
Circulation
BIB
Staff Interfaces:
Holding
/ Items
Circ
Transact
User
Vendor
Policies
$$$
Funds
Cataloging
Acquisitions
Serials
Online
Catalog
Public Interfaces
:
Application Programming Interfaces
Budget
License Terms
Titles / Holdings
Vendors
Access Details
Slide61Comprehensive Resource ManagementNo longer sensible to use different software platforms for managing different types of library materialsILS + ERM + OpenURL Resolver + Digital Asset management, etc. very inefficient modelFlexible platform capable of managing multiple type of library materials, multiple metadata formats, with appropriate workflows
Slide62Libraries need a new model of library automationNot an Integrated Library System or Library Management SystemThe ILS/LMS was designed to help libraries manage print collections
Generally did not evolve to manage electronic collectionsOther library automation products evolved:Electronic Resource Management Systems – OpenURL Link Resolvers – Digital Library Management Systems -- Institutional Repositories
Slide63Library Services PlatformLibrary-specific software. Designed to help libraries automate their internal operations, manage collections, fulfillment requests, and deliver servicesServicesService oriented architecture
Exposes Web services and other API’sFacilitates the services libraries offer to their usersPlatformGeneral infrastructure for library automationConsistent with the concept of Platform as a Service Library programmers address the APIs of the platform to extend functionality, create connections with other systems, dynamically interact with data
Slide64Library Services Platform CharacteristicsHighly Shared data modelsKnowledgebase architectureSome may take hybrid approach to accommodate local data stores
Delivered through software as a serviceMulti-tenantUnified workflows across formats and mediaFlexible metadata managementMARC – Dublin Core – VRA – MODS – ONIXNew structures not yet inventedOpen APIs for extensibility and interoperability
Slide65Beyond the legacy Library Management SystemFind a new term for the successor to the LMSLibrary Management System now viewed as print-centricNeed to designate a name for the new genre of automation products
Slide66Open SystemsAchieving openness has risen as the key driver behind library technology strategiesLibraries need to do more with their data
Ability to improve customer experience and operational efficiencies
Demand for InteroperabilityOpen source
– full access to internal program of the application
Open API’s
– expose programmatic interfaces to data and functionality
Slide67Consolidated index
Unified Presentation Layer
Search:
Digital
Coll
ProQuest
EBSCO
…
JSTOR
Other Resources
New Library Management Model
`
API Layer
Library Services Platform
Learning
Management
Enterprise Resource
Planning
Stock
Management
Self-Check /
Automated Return
Authentication
Service
Smart Cad /
Payment systems
Discovery Service
Slide68Library Services Platforms
Category
WorldShare Management Services
Alma
Intota
Sierra Services Platform
Kuali OLE
Responsible Organization
OCLC
.
Ex
Libris
Serials Solutions
Innovative Interfaces, Inc
Kuali Foundation
Key precepts
Global network-level approach to management and discovery.
Consolidate workflows, unified management: print, electronic,
digital;
Hybrid data model
Knowledge-base
driven.
Pure multi-tenant SaaS
Service-oriented architecture
Technology uplift for Millennium ILS. More open source components, consolidated modules and workflows
Manage library resources in a format agnostic approach. Integration into the broader academic enterprise infrastructure
Software model
Proprietary
Proprietary
Proprietary
Proprietary
Open Source
Slide69Development Schedule
WorldShare Management Services
Alma
Intota
Sierra Services Platform
Kuali OLE
General Release in July 2011
38
now in production
5 incremental
development partner releases complete.
Boston College first in production July 2, 2012
Phase
I:
Late in 2012;
Libraries
in production by 2014
Phase 1: Mid-2012
with full Millennium functionality; subsequent phases that expand
model,
~ 10 libraries in production by Jul 2012
Version 1.0 expected Dec 2012
Partners begin migration
in 2013
Slide70Development Resources
CompanyDev
Sup
Sales
Admin
Other
Total
Ex Libris
170
231
54
44
13
512
Follett Software Company
87
143
86
49
0
365
Innovative Interfaces, Inc.
83
158
43
24
3
311
SirsiDynix Corporation
84
166
51
23
56
380
Serials Solutions
80
50
46
4
57
237
Axiell
57
66
34
35
34
226
The Library Corporation
39
91
28
13
28
199
Polaris Library Systems
27
42
15
2
86
VTLS Inc.
24
48
12
8
18
110
Koha
ByWater Solutions
3
12
3
3
1
13
Catalyst IT
3
BibLibre
4
3
Koha Total (estimated)
15
PTFS
5
16
8
8
155
Evergreen
Equinox Software
6
5
2
3
5
21
Slide71Development / Deployment perspectiveBeginning of a new cycle of transitionOver the course of the next decade, academic libraries will replace their current legacy products with new platformsNot just a change of technology but a substantial change in the ways that libraries manage their resources and deliver their services
Slide72The ILS is not deadTraditional ILS model continues to basically work for public librariesPossible to evolve to accommodate e-book management and accessE-book integration also implemented in discovery layers
Slide73Recent ILS Industry Contracts
CompanyProduct
2009
2010
2011
OCLC
WorldShare Management Services
184
Innovative Interfaces
Sierra
206
Ex Libris
Alma
8
24
SirsiDynix
Symphony
-
126
122
Innovative Interfaces, Inc.
Millennium
45
39
32
The Library Corporation
Library.Solution
30
43
48
Ex Libris
Aleph
47
39
25
VTLS Inc.
Virtua
18
22
13
Polaris Library Systems
Polaris ILS
33
23
53
Biblionix
Apollo
55
87
79
ByWater Solutions
Koha
7
44
54
PTFS
LibLime
LibLime Academic Koha
7
PTFS
LibLime
LibLime Koha
44
27
Equinox Software
Evergreen
18
15
21
Equinox Software
Koha
6
Slide74Traditional Proprietary Commercial ILSAleph, Voyager, Millennium, Symphony, Polaris,
BOOK-IT, DDELibra, Libra.seLIBERO, Amlib, Spydus, TOTALS II, Talis Alto, OpenGalaxyTraditional Open Source ILS
Evergreen, KohaNew generation Library Services PlatformsEx Libris Alma
Kuali OLE (Enterprise, not cloud)
OCLC WorldShare Management
Services
Serials Solutions
Intota (In development
Innovative Interfaces
Sierra Services Platform
Competing Models of Library Automation
Slide75Convergence Discovery and Management solutions will increasingly be implemented as matched setsEx Libris: Primo / AlmaSerials Solutions: Summon / IntotaOCLC: WorldCat Local / WorldShare PlatformExcept: Kuali OLE, EBSCO Discovery Service
Both depend on an ecosystem of interrelated knowledge basesAPI’s exposed to mix and match, but efficiencies and synergies are lost
Slide76Questions and discussion