sdmx transmission method

advertisement
OECD, Paris, May 2014
How to report BOP (QBOP & AITS) data to the OECD using SDMX
The aim of this document is to provide guidance on how to report Quarterly Balance of Payments and Annual
Trade in Services data to the OECD, using SDMX.
TABLE OF CONTENTS
INTRODUCTION ...................................................................................................................................................... 1
SDMX MESSAGE FORMAT ...................................................................................................................................... 2
SDMX TRANSMISSION METHOD ............................................................................................................................. 2
SDMX-REFERENCE INFRASTRUCTURE (SDMX-RI) ............................................................................................... 2
SDMX CONTACTS .................................................................................................................................................... 3
TECHNICAL .......................................................................................................................................................... 3
SUBJECT-MATTER ............................................................................................................................................... 3
DATA FLOWS AND ASSOCIATED INFORMATION .................................................................................................... 3
INTRODUCTION
The SDMX (Statistical Data and Metadata Exchange) Data Structure Definition (and related documentation1)
for Balance of Payments (BOP-DSD), released on 1st October 2013 in its version 1.0_20130930, and updated to
V1.2_20140407 in April 2014, is the standard for the transmission of BOP statistics according to IMF-Balance of
Payment manual 6th Edition. It was prepared in close cooperation between Eurostat, ECB, IMF and OECD,
under the auspices of the SDMX technical Group on BOP-DSD.
The BOP-DSD is one of the key elements in the implementation of the SDMX standard in IT systems for the
compilation and the transmission of data to and between International Organisations (IOs).
BOP-DSD is now available on the SDMX global registry currently available on the IMF-Sandbox Registry
(https://registry.sdmx.org/content.html) which is where artefacts for global use are maintained The BOP Data
Structure Definition is structured as showed in Annex 1. It is composed of 16 dimensions and 13 attributes. A
detailed description of each dimension and attribute is included in the BOP-DSD Excel file and in the Guidelines
for Using BOP-DSD Concepts in Time Series Keys available on the SDMX website
http://sdmx.org/?page_id=1747. An Excel file including all BOP data requests of Eurostat, IMF and OECD
(BPM6_DATA_CODIFICATION.xls) can also be downloaded from this website. For more specific information on
the
OECD
BOP
dataflow,
please
refer
to
http://www.oecd.org/statistics/datacollection/internationaltrade.htm under “Target indicators”.
1
Guidelines for using BOP-DSD v1.1 and an Excel file including BOP data requests of Eurostat/ECB, IMF and
OECD (BPM6_DATA_CODIFICATION_V1.1.xls)
OECD, Paris, May 2014
D V1.1
SDMX MESSAGE FORMAT
The preferred SDMX format for data messages is SDMX-ML 2.0 Compact format. If this is not possible, SDMXML 2.1 Compact format is preferred. Less preferable are the other SDMX-ML 2.0/2.1 formats (Generic, Crossreference).
The OECD will accept other SDMX formats (EDI, V1.0), but data will take longer to process and OECD cannot
offer technical assistance.
SDMX TRANSMISSION METHOD
SDMX supports these methods of data transmission:



Pull method: The collector gets the data via a query
Push method: The publisher sends the data to the collector in files
Data hub: The Data-hub method acts as a central data repository. Publishers send data to the hub using
push or pull technologies. Collectors later retrieve the data from the hub repository.
The OECD’s preferred method for BOP data is :
 Pull from an SDMX web service conforming to the SDMX web service API standards at
http://sdmx.org/wp-content/uploads/2013/09/SDMX_2_1-SECTION_07_WebServicesGuidelines_201304.pdf
 Push: see the DATA FLOWS AND ASSOCIATED INFORMATION section for the mailbox where to send the
data
If implementing the pull method, the SDMX web service standards should be strongly adhered to. The SDMXReference Infrastructure software (SDMX-RI) is a practical way to implement the pull method while following
the standards with little or no development required. See the SDMX-REFERENCE INFRASTRUCTURE (SDMX-RI)
section below.
SDMX-REFERENCE INFRASTRUCTURE (SDMX-RI)
* The SDMX Reference Infrastructure (SDMX-RI) provides a free, open-source SDMX technical implementation.
It is a free-standing implementation that requires no development. The source code is also freely available and
the application may be customised if needed. It includes:


a SDMX web service used to query and disseminate data
a Mapping Assistant tool used to create mappings to transform data structures. It may be used to map
existing local data structures to SDMX Data Structure Definitions without having to change the local
structures
 Data connectors that link your existing Oracle or SQL Server database to the mappings and SDMX web
service
A typical implementation connects the SDMX-RI to the local dissemination data-warehouse, therefore as soon
as data is published through to the dissemination data-warehouse it is also available via the SDMX web service.
More details can be found here:
https://webgate.ec.europa.eu/fpfis/mwikis/sdmx/index.php/SDMX_Reference_Infrastructure_SDMX-RI
OECD, Paris, May 2014
The OECD promotes and provides technical assistance for implementation of the SDMX Reference
Infrastructure (SDMX-RI) for its member countries.
SDMX CONTACTS
TECHNICAL
David Barraclough – David.barraclough@oecd.org
Marco Oksman – Marco.Oksman@oecd.org
SUBJECT-MATTER (BALANCE OF PAYMENTS)
Quarterly Balance of Payments (QBOP) Isaac Lagnado – Isaac.Lagnado@oecd.org
Annual International Trade in Services (AITS) Laura Thomson – Laura.thomson@oecd.org
OECD BOP DATA FLOWS AND ASSOCIATED INFORMATION
Countries willing to report BOP data to the OECD using SDMX should use the following dataflows:
Domain
DSD
Data flow ID
Data flow description
Push data
mailbox
Quarterly
Balance of
Payments
BOP-DSD
OECD_BPM6_BOP_Q
This dataflow includes
quarterly balance of
payments (including
seasonally adjusted
series) statistics to be
reported to the OECD
account.meid
oc@oecd.org
Annual
Trade in
Services
BOP-DSD
BPM6_ITS_A
This dataflow includes
annual international
trade in services by
partner country and
remittances statistics to
be reported to the
OECD.
STD.Servstat
@oecd.org
https://registry.sdmx.org
/content.html#
https://registry.sdmx.org
/content.html#
A detailed composition of the Annual Trade in Services request (the BPM6_ITS_A dataflow) including the
codification
of
series
according
to
the
BOP
DSD
is
available
at:
http://www.oecd.org/std/its/tradeinservicesquestionnaires.htm. (see very bottom of the page).
The detailed composition of the OECD quarterly BOP data flow is available here (see target indicators):
http://www.oecd.org/statistics/data-collection/internationaltrade.htm
OECD, Paris, May 2014
Annex 1: Structure of the BOP DSD
BOP Data Structure Definition - V1.2 - 7 April 2014
Dimensions
7
1.1
8
1.2
9
1.2
Concept
Mnemonic/Identifier
FREQ
ADJUSTMENT
REF_AREA
COUNTERPART_AR
EA
REF_SECTOR
COUNTERPART_SE
CTOR
FLOW_STOCK_ENT
RY
ACCOUNTING_ENT
RY
INT_ACC_ITEM
10
1.0
FUNCTIONAL_CAT Functional category
11
1.2
INSTR_ASSET
Position
1
2
3
Version
2.0
1.1
1.2
4
5
1.2
6
Concept Name
Frequency
Adjustment indicator
Reference country or area
Description
Frequency
Adjustment indicator
Reference country or area
Code List Mnemonic
CL_FREQ
CL_ADJUSTMENT
CL_AREA
Code List Name
Frequency code list
Adjustment code list
Area code list
Code Length
Fixed Length - A1
Variable Length - AN..2
Variable Length - AN..4
Maintenance Org (2)
SDMX
Eurostat
IMF
Counterpart Area
Counterpart Area
CL_AREA
Area code list
Variable Length - AN..4
IMF
Reference sector
Institutional sector in the Reference country or area
Counterpart institutional sector in the reporting
country or area
CL_SECTOR
Institutional sector code list
Variable Length - AN..7
Eurostat
CL_SECTOR
Institutional sector code list
Variable Length - AN..7
Eurostat
Flows and stocks indicator
CL_FSENTRY
Flow or stock entry code list
Variable Length - AN..3
IMF
CL_ACCOUNT_ENTRY
Accounting entry code list
Variable Length - AN..2
IMF
CL_ACCOUNTS_ITEM
Item classification code list
Variable Length - AN..8
IMF
Classification by functional of the financial investment CL_FUNCTIONAL_CAT
Functional category code list
Variable Length - AN..4
IMF
Breakdown by financial instruments and assets
CL_INSTR_ASSET
Financial instruments and assets
classification list
Variable Length - AN..7
Eurostat
CL_MATURITY
Maturity code list
Variable Length - AN..6
Eurostat
CL_UNIT
Variable Length - AN..3
IMF
Variable Length - AN..3
IMF
CL_VALUATION
Unit of measure code list
Currency of issuance or invoicing
code list
Valuation code list
Variable Length - AN..2
Eurostat
CL_COMP_METHOD
Compilation methodology code list
Fixed Length - A1
IMF
Counterpart sector
Flows and stocks indicator
Accounting entries
International accounts item
Instrument and assets
classification
12
1.2
MATURITY
13
1.1
14
1.1
15
1.0
UNIT_MEASURE
Unit of measure
CURRENCY_DENO
Currency of denomination
M
VALUATION
Valuation
Maturity
16
1.2
COMP_METHOD
Compiliation methodology
Types of accounting entries (i.e. credit, debit,
balance)
Item classification for international accounts statistics
Original maturity of financial instrument, combined
with remaining maturity
Unit of measure for reporting the time-series
Currency of issuance for financial items or invoicing
for goods and services
Price valuation
Identify the compilation methodology of otherwise
identical concepts
CL_CURRENCY
Attributes
Attachment Level
C/M (1)
Concept Mnemonic/Identifier Concept Name
Code List Mnemonic
Presentation Type
(Code list/Free Text)
Code Length
Maint. Org. (2)
Series
Observation
C
M
TIME_FORMAT
OBS_STATUS
Time format
Observation status
CL_TIME_FORMAT
CL_OBS_STATUS
Time Format code list
Observation status code list
Variable Length - AN..4
Fixed Length - A1
SDMX
SDMX
Observation
Observation
M
C
CONF_STATUS
PRE_BREAK_VALUE
Confidentiality status
Pre-break value
CL_CONF_STATUS
Uncoded
Confidentiality status code list
Free Text (up to 15 characters)
Fixed Length - A1
Free Text
SDMX
IMF
Observation
C
COMMENT_OBS
Comments to the observation value
Uncoded
Free Text (up to 4000 characters)
Free Text AN..4000
IMF
Series
C
COMMENT_TS
Title complement: Detailed description of the series
Uncoded
Free Text (up to 1050 characters)
Free Text - AN..1050
IMF
Series
C
TITLE
Short title
Uncoded
Free Text (up to 200 characters)
Free Text - AN..200
IMF
Series
M
UNIT_MULT
Unit multiplier
CL_UNIT_MULT
Unit multiplier code list
Variable Length - N..2
SDMX
Series
M
DECIMALS
Decimals
CL_DECIMALS
Decimals code list
Variable Length - N..2
SDMX
Series
M
TIME_PER_COLLECT
Time period collection
CL_TIME_COLLECT
Time period collection code list
Fixed Length - A1
IMF
Series
C
REF_PERIOD_DETAIL
Reference period detail
CL_REF_PERIOD_DTL
Reference period code list
Variable Length - AN..3
Eurostat
Series
C
COMPILING_ORG
Compiling organisation
CL_ORGANISATION
Compiling organisation code list
Variable Length - AN..4
IMF
Series
C
DATA_COMP
Underlying compilation
Uncoded
Free Text (up to 4000 characters)
Free Text - AN..4000
IMF
Download