developments Darrell J Siebert NHM Collections Database Manager EMu Object oriented data model Convenient for collections management purposes Some relational functionality Can link between some modules in manyto1 relationship ID: 274218
Download Presentation The PPT/PDF document "EMu enhancements and" is the property of its rightful owner. Permission is granted to download and print the materials on this web site for personal, non-commercial use only, and to display it on your personal computer provided you do not modify the materials and that you retain all copyright notices contained in the materials. By downloading content from our website, you accept the terms of this agreement.
Slide1
EMu enhancements and developments
Darrell J. Siebert
NHM Collections Database ManagerSlide2
EMuObject oriented data modelConvenient for collections management purposes
Some relational functionality
Can link between some modules in many-to-1 relationship
Client-Server architectureEMu user community-wide aspects server sideNHM bespoke aspects client side Indexing methods to support data model‘joins’ not supportedSlide3
EMu enhancements and developments to support digitisation programmeExport of data for NHM data portal (Informatics Initiative)
Server side image loading
Batch Operations
IMu Barcodes Slide4
Data export for data portalEMu data model and indexing methods not suitable for our needs for fast web display‘Table dump’ -- core product functionality
Initial dump of data from relevant tables
Only records with appropriate security setting are exported!
Automatic weekly change listInformatics Initiative team structures and indexes data to suit needs of data portalSlide5
Server side image loadingImages typically processed client side (on desktop PC)Can be ‘slow’: > 10 min for 220MB Mellon Project botanical image
100,000 Mellon images:
1.9 years to load
Bulk server side image loading (images processed by server)220MB Mellon Project image processed in 1 min100,000 Mellon images: 69 days to loadEffectively 24/7 background processCurrently using 1 core; can increase this but need to understand impact on server performanceSlide6
EMu Batch Operations module: dataset cleanupCollections digitisation programme: high quality, end-to-end outcomesCollections information in digital form associated with appropriate image(s)
High quality collections information – our biggest challenge
Duplicates
Identical recordsNear identical records for same informationEMu Batch Operations moduleStandard, client side ‘Merge’ operation addresses duplicate recordsBulk ‘Merge’ operations moved to server sideFrees client for other usesEffectively 24/7 background processSlide7
IMu APIIMu – api delivered as standard with EMuStandard functionality: query; insert; update; and delete
IMu is ‘EMu data model aware’
IMu is ‘EMu security model aware’
Informatics Initiative team exploring delivering data to a scratch pad for the SCORE project using IMu apiWith appropriate developer expertise IMU can enable development of mobile (tablet) applicationsSlide8
BarcodesLabels too small to fit much information onPalaeo labels 42x42mm
Slide labels 25x25mm (or smaller)
Barcode
Machine readable objectEncodes registration numberCan be linear or 2D -- these are 2D - 5x5mmCan be ‘read’ with mobile phoneLink to richer informationWireless infrastructure
Mobile devices and applicationsSlide9
Questions