TURKISH STATISTICAL INSTITUTE
How the standards based modernization
of statistical production serves
dissemination?
Nilgün DORSAN
Turkish Statistical Institute
International Seminar on Modernizing Official Statistics: Meeting
Productivity and New Data Challenges, 24-25 October 2013
Metadata and Standards Department
TURKISH STATISTICAL INSTITUTE
What makes a statistical
organisation efficient? 1
• Use of administrative records
• Optimization of data collection
• Standardization of business processes
• Management of human resources
• Decisions at each stage of statistical
processing cycle
1 From
the presentation made by Lidia Bratanova, UNECE
Metadata and Standards Department
2
TURKISH STATISTICAL INSTITUTE
Turkish Statistical
Institute
 Main data provider in Turkish Statistical System
 Coordination role in Official Statistical Programme
(63 organization, 287 subjects)
 Central and 26 regional offices, 1672 permanent
and 1920 temporary: total 3592 staff
 The vision for 2012-2016 is “to establish a user
focused and sustainable statistical system based on
international standards”
Metadata and Standards Department
Principles of official statistics and
Turkish Statistical Law
User needs
Institutional
Environment
Statistical
Processes
Statistical Outputs
•
•
•
•
•
•
Professional independence (m.17, m.22, m.23)
Mandate for data collection (m.7)
Adequacy of resources
Quality commitment (m.41)
Statistical confidentiality (m.4, m.12, m.13)
İmpartiality and objectivity (m.4)
•
•
•
•
•
•
•
•
•
Trust in
statistical
organizations
Sound methodology (m.5, m.11)
Appropriate statistical processes (m. 18)
Non excessive burden on respondents (m.3)
Cost effectiveness (m.3)
Relevance
Accuracy and reliability (m.4)
Timeliness and punctuality (m.12)
Coherence and comparability (m.4)
Accessibility and Clarity (m.12, m.4)
Trust in
statistics
TURKISH STATISTICAL INSTITUTE
Why standardization is important?
 To define the production line
 To establish comparable, harmonized and integrated
systems
 To portray the statistical studies
 To define which outputs of the surveys are inputs of which
surveys
 To consolidate the concepts within the institution
 Transfer of institutional culture to future generations
 Effective organizational structure
 Base for the statistical metadata system
 Benchmark or peer review processes with other
organizations within the statististical system
Metadata and Standards Department
TURKISH STATISTICAL INSTITUTE
Some of the objectives and strategies on
standardization
TurkStat 2012-2016 Strategic Plan:
•Development of strategic management
approach and management of the knowledge
•Creation and development of process
management
•Establishing metadata system
•Use of international standards (NACE, ISCED,
PRODCOM, etc.)
Metadata and Standards Department
Statistics Production Process
TURKISH STATISTICAL INSTITUTE
TurkStat Draft Model for GSBPM (Level 1 and 2)
1
Specify needs
2
3
4
Design
Build
Collect
5
Process
6
7
Anaylse
Dissemination
7.1
Update
dissemination
systems
Design statistcal
Products and
outputs
3.1
Build and enhance
production
system components
4.1
Establish frame
and registers, select
sample
5.1
Classify and code
6.1
Evaluate
the information for
İts effect
2.2
Design frame, register
and sample methodology
3.2
Integrate production
System with other
systems
4.2
Set up collection
5.2
Micro-edit
6.2
Produce statistics
7.2
Produce
dissemination
product
1.3
Establish output
objectives
2.3
Design data collection
methodology
3.3
Test production system
4.3
Run collection
5.3
Macro-control
6.3
Quality assure
statistics
7.3
Manage publishing
for dissemination
product
1.4
Check data
availability
2.4
Design process and
analysis methodology
3.4
Finalise production
system
4.4
Finalise collection
6.4
Examine and
evaluate
statistics
7.4
Manage user
demands
Determine business
plan
2.5
Design production
system and work flows
1.1
Determine need
for information
1.2
Consult and confirm
need
5.4
Imputation
5.5
Calculate weights
and derive
variables
6.5
Prepare statistics
for
dissemination
6.6
Finalise
content
Metadata and Standards Department
Data Collection
Methodology and
Information Systems
Thematic Units
Dissemination
TURKISH STATISTICAL INSTITUTE
Actions for streamlining the statistical
production
• Process modeling and standardization studies launched in
2010
• TurkStat Draft Statistical Businesss Process Model in 2011
• Bilateral negotiations with the technical units
• Processes for 273 products and services
• Standardization plan for metadata and processes in 2011
Under 7 main processes,33 processes in 2nd level, 106 sub
processes in 3rd level and thousands of activities under
these levels.
Metadata and Standards Department
TURKISH STATISTICAL INSTITUTE
Reference and Structural Metadata
• Metada template prepared in DDI format
• Training of technical units
• Code lists used in the surveys were standardized
across all business surveys and all household
surveys, wherever possible.
 125 projects in DDI format
 103 standard code lists
 143 codes in global repository
Metadata and Standards Department
TURKISH STATISTICAL INSTITUTE
Where dissemination begins?
Main statistical processes and systems
Collect
Process
Input
Raw
data
Micro
data
Statistical
data
Raw
data
Micro
data
Statistical data
(Macro data)
Output
Production
Database
Production
Database
Metadata and Standards Department
Analyse
Institutional
Database
Disseminate
Dissemination
Database
TURKISH STATISTICAL INSTITUTE
Outputs
•
•
•
•
•
News bulletins
Dissemination databases
Statistical tables
Anonymized micro data
Printed / electronic publications
Disseminated through web page, teletext,
micro data research center, paper, CD,
Social media
Metadata and Standards Department
TURKISH STATISTICAL INSTITUTE
Main dissemination channel :
www.tuik.gov.tr
• In 2012, 267 news bulletin in 80 subjects
• Dissemination databases in 58 subjects including
detailed time series data
• 1 336 statistical tables
• Metadata
Metadata and Standards Department
12
TURKISH STATISTICAL INSTITUTE
Challenge facing statistical producers
Metadata and Standards Department
TURKISH STATISTICAL INSTITUTE
Challenges of the data
• New data needs in statistical domains
• Abundance of data sources and data flows from
different registers
• Management of the data and data sources
• Non standardised codes
• Data integration
• Micro data exchange and transperancy
• Data confidentiality
• Effective use of the data and its quality
Metadata and Standards Department
TURKISH STATISTICAL INSTITUTE
Without a good description of the
needs and effective design of the
processes, you can not get quality
outputs.
Metadata and Standards Department
Statistics Production Process
TURKISH STATISTICAL INSTITUTE
TurkStat Draft Model for GSBPM (Level 1 and 2)
1
Specify needs
2
3
4
Design
Build
Collect
5
Process
6
7
Anaylse
Dissemination
7.1
Update
dissemination
systems
Design statistcal
Products and
outputs
3.1
Build and enhance
production
system components
4.1
Establish frame
and registers, select
sample
5.1
Classify and code
6.1
Evaluate
the information for
İts effect
2.2
Design frame, register
and sample methodology
3.2
Integrate production
System with other
systems
4.2
Set up collection
5.2
Micro-edit
6.2
Produce statistics
7.2
Produce
dissemination
product
1.3
Establish output
objectives
2.3
Design data collection
methodology
3.3
Test production system
4.3
Run collection
5.3
Macro-control
6.3
Quality assure
statistics
7.3
Manage publishing
for dissemination
product
1.4
Check data
availability
2.4
Design process and
analysis methodology
3.4
Finalise production
system
4.4
Finalise collection
6.4
Examine and
evaluate
statistics
7.4
Manage user
demands
Determine business
plan
2.5
Design production
system and work flows
1.1
Determine need
for information
1.2
Consult and confirm
need
5.4
Imputation
5.5
Calculate weights
and derive
variables
6.5
Prepare statistics
for
dissemination
6.6
Finalise
content
Metadata and Standards Department
Data Collection
Methodology and
Information Systems
Thematic Units
Dissemination
TURKISH STATISTICAL INSTITUTE
Specify needs
For an efficient data production and meeting the
user needs some questions arise…
• What users wants?
• What is our sources?
• Do we need extra data source?
• Which data source best meets the needs?
• How we manage the big data?
Metadata and Standards Department
TURKISH STATISTICAL INSTITUTE
Design
• Data integration from multiple sources
• Data structure
• Management of metadata and meta information
• Statistical outputs
• Variables
• Concepts and definitions
• Classifications, code lists
• Questionnaire design
• Design of architecture
Metadata and Standards Department
TURKISH STATISTICAL INSTITUTE
Structural Metadata Components
Data sources (surveys,
admin. records, GIS data)
Metadata Editor
Questionnaires
Metadata
Repository
Code lists, classifications
Concepts and definitions
Production
database
Institutional
Database
Metadata and Standards Department
Disseminatio
n databases
Variables
TURKISH STATISTICAL INSTITUTE
Build
Necessary for an efficient production system.
Without this process you can not manage and
integrate the data.
Metadata and Standards Department
TURKISH STATISTICAL INSTITUTE
Analyse
•
•
•
•
•
•
•
•
•
Production of statistics / indexes
Evaluation of data quality
Seasonal adjustments
Evaluation of response rates
Benchmarks for other periods and data sources
Application of data confidentiality rules
Decision of the dissemination of data level
Metadata preparation for outputs
Preparation of the data for the dissemination
Metadata and Standards Department
TURKISH STATISTICAL INSTITUTE
Disseminate
• Feedback of the users and update of the
specifying needs
• Update dissemination system for relevant,
timely and accesible data
• Development of the dissemination channels
Metadata and Standards Department
TURKISH STATISTICAL INSTITUTE
TurkStat’s main principles for
dissemination
• Maximum data:open and free access
• Transperancy, clarity
• Timeliness and punctuality
• Comparability
Metadata and Standards Department
TURKISH STATISTICAL INSTITUTE
Data Confidentiality
 Confidentiality rules determined in Law
No.5429 (Articles 4, 12, 13 and 14) and related
regulation
 Data Confidentiality Board
 Decisions on conflicts
 Confidentiality Commitment Document is
signed by every staff
Metadata and Standards Department
TURKISH STATISTICAL INSTITUTE
Production process: Continuous improvement,
monitoring, evaluation (quality management)
I have to
rotate this
wheel
Act
Plan
Do
Check
Metadata and Standards Department
25
TURKISH STATISTICAL INSTITUTE
Future plans for streamlining
• Finalize the statistical business process model
integrated with a strong statistical metadata
system.
• Provide a strong infrastructure for quality
management system.
• A leading model for other producers of official
statistics.
• Develop metadata infrastructure
Metadata and Standards Department
TURKISH STATISTICAL INSTITUTE
Thank you for your attention.
Any question?
Metadata and Standards Department