SDMX Global Conference 25 October Addis Ababa SDMX Technical Working Group SDMXTWG Prepared by Juan Muñoz López VTL Validation and Transformation Language VTL lets incorporate the exchange of validation and transformation rules to the exchange of data and metadata so you can assure d ID: 712729
Download Presentation The PPT/PDF document "Upcoming changes to the DMX technical st..." is the property of its rightful owner. Permission is granted to download and print the materials on this web site for personal, non-commercial use only, and to display it on your personal computer provided you do not modify the materials and that you retain all copyright notices contained in the materials. By downloading content from our website, you accept the terms of this agreement.
Slide1
Upcoming changes to the DMX technical standard
SDMX Global Conference2-5 October Addis Ababa
SDMX Technical Working Group (SDMX-TWG)
Prepared by: Juan Muñoz LópezSlide2
VTL (Validation and Transformation Language)
VTL lets incorporate the exchange of validation and transformation rules to the exchange of data and metadata, so you can assure data accuracy and correctness and calculate derived data.
VTL 1.0 was published in 2015
A new improved version will be published by the end of 2017
After publishing this version the task team will continue making improvements and adding new operations
Implementations of the language are planned to be developedCurrent Technical Specification documents can be found in: https://sdmx.org/?page_id=5096 Slide3
Code List Extensions
A Data Structure Definition (DSD) contains the Code Lists that describe possible values for the Dimensions.
If you modify a code-list contained in a DSD you will need to define a new one. Some code lists are very dynamic, so managing DSD versions could be quite complicated.
A task team composed by members from the TWG and from the SWG is working on implementing a way to let manage most common changes to code lists without needing to define a new DSD.
This work will derive in some adjustments to the SDMX Information Model, but the task team is taking care to keep compatibility with current versionSlide4
SDMX-JSON Format
JSON which stands for JavaScript Object Notation, is a standard language (RFC 4627) based on JavaScript which is supported by the main Web Browsers (Chrome, Edge, Fire Fox, Internet Explorer, Opera, etc.)
A SDMX-JSON format makes easier to create appealing visualizations of
d
ataflows
, improving the dissemination processThe format specification has been publicly reviewed and it is in a final adjustments period to be deliveredA draft version of the format can be found in: https://sdmx.org/wp-content/uploads/sdmx-json-data-message.pdf Slide5
SDMX-CSV Format
Comma Separated Values (CSV) is
a standard format
(IETF RFC 4180) widely supported by almost all commercial tools used in the statistical community.
An SDMX-CSV format will improve interoperability and make easier using the information for different purposes.
As CSV is a light weight format it is easier to exchange large amounts of information, one required step for the exchange of microdata.
SDMX Information Model addresses weakness of the CSV format. DSD provides the tools to maintain a well defined (and interpretable) dataflow.
On September 15
th
2017 the public review of the specification ended, and now the task team is working on improving it by applying received feedback.
Current proposal can be
accessed in:
https://
github.com/sdmx-twg/sdmx-csv
Slide6
SDMX RESTful web services API specification (version 1.2.0
)
Web Services are essential for Machine to Machine (M2M) communication, they provide a way to directly connect applications and exchange information in an automated way
SDMX supports two kinds of Web Services:
SOAP which are based on XML messages
RESTful which are based on HTTP requestsThe new version lets retrieve a single hierarchy within an hierarchical codelist, and several improvements to the documentation.Documentation, tutorial and list of changes can be obtained from: https://
github.com/sdmx-twg/sdmx-restSlide7
Technical priorities
Attention to the SDMX 2020 roadmap actions
Providing solutions to technical issues impeding SDMX implementation
Extending
usefulness of SDMX
for different sceneries (new and emergent)Maintaining SDMX relevant in the context of new technologies and user needs: OpenData, Big Data, IoT, geo-referencing, etc.Fitting the standard into the statistical modernization projects and making it suitable to be inside the statistical standards ecosystemImproving technical documentation Maintaining a close relation with the conceptual development of the standard to ensure adequate support
Maintaining technical integrity and compatibility of the technical standardsSlide8
Contact
: contact@sdmx.org