8 th Oslo Group meeting in Azerbaijan, 24-27 September 2013 Quality management and metadata for crude oil statistics in the SSC of the Republic of Azerbaijan Yusif Yusifov Deputy chairman of the State Statistical Committee of the Republic of Azerbaijan yusify@azstat.org 1 Outline 1.Quality management and metadata in the SSC of the Republic of Azerbaijan 2.GSBPM for energy statistics 3.GSBPM for crude oil statistics: phases 4.Sub-processes and activities for oil statistics 5.Challenges 2 Quality management and metadata in the SSC of the Republic of Azerbaijan. Metadata as new challenges for world statistics Quality management and metadata system is one of the recommendations of Global Assessment of the official statistics of Azerbaijan which organized by Eurostat,The European Free Trade Association(EFTA) and United Nations Economic Commission (UNECE) for Europe in 2010. 3 Activities of Azerbaijan on Quality Management 2010 Decision about creation of “Quality Management system” Ratification of policy and aim about Quality Management Creation of new sector for implementation “Quality Management”system 2011 Quality management system has been applied to the Industry ,Transport and communication and Price statistics sectors of Community as pilot project. 2012 Creation of “Quality Management and Information Technology “ department for effective coordination activities on SSC. Ratification of “Activity plan 2012-2013”about implementation of Quality Management and Metada system. Starting implementation Quality management to all sections of the Committee. 2013 Starting implementation QM system to local statistics organizations of SSC. Realization of internal audit to find out condition on divisions of SSC. 4 Forming of external audit by certification organization Original external audit Period of audit Area of audit Direction of audit • Contact with Quality Management system (25 June 2013) • 04-09 July 2013 • Departments of SSC • Condition of implementation of ISO 9001:2008 in SSC 5 İSO 9001: 2008 Bureau Veritas Certification certify that the Management System of the organisation has been audited and found to be in accordance with the requirements of the management system standard İSO 9001: 2008 Original certification date: 6 What is GSBPM? GSBPM is a speedy tool which gives an opportunity to standardize ,operation, organize single mechanism of production and minimize the mistakes of the management. This model enables coordinate the process with human resource and realize the system with the qualified technological route. The structure of the model GSBPM consist of 4 levels : 1. Statistics-business process 2. 9 Steps of statistics-business process 3. Sub-process of each step 4. Description of the sub-processes 7 Why GSBPM for energy statistics Associated with forming ISO 9001:2008 Quality Management in the State Statistical Committee of the Republic of Azerbaijan Recommendation of Global Assessment to the State Statistical Committee Common way for describing process steps Appreciation of the accumulation, usage, evaluation process of the energy statistics indexes Challenges Achievement of the Committee 8 Advantages of GSBPM on energy statistics GSBPM facilitate management of processes Emend the mistakes in time Systematic approach to the problems Increase belief of users Increase quality of statistics information 9 Our strategy Improve the base of the energy statistics process taking into consideration the national version of GSBPM. Our aim The aim of the GSBPM is provision of the base of metadata system with the standard nomenclature. 10 “Generalized Model of Statistical Business Processes” (GSBPM) “Methodological Conception of Existing Process on Management System on Energy Statistics” Standards and map of management of statistical processes on industry and construction statistics” 11 Model GSBPM for energy statistics Specify needs Process Design Analysis Build Disseminate Collect Archive Evaluate 12 Model GSBPM for oil statistics Specify needs Analysis Design Disseminate Build Collect Archive Process Evaluate GSBPM model for oil statistics is identical to the model of GSBPM on energy statistics. 13 Continue of phase 1 Phases and sub-processes for energy statistics 1.Specify needs 1.1 Determine need for information 1.2 Consult and confirm needs 1.5 Check data and metadata availability 1.3 Establish output objectives 1.4 Identify concepts 1.6 Prepare business case 14 Continue of phase 1 1. Specify needs Determine the need on crude oil statistics Input Output International methodology, questionnaire, presentation, users request, orders, decrees Improved official statistical questionnaires 15 Input 1.1 Determine need for information International requirements and recommendations orders, decrees, reports, presentations Identification of need on crude oil statistics 1.2 Consult and confirm need Input Offers from SOCAR and MIE Implementation of discussion with SOCAR and MIE on improvement of crude oil indicators and its coordination and confirmation Continue of phase 1 Output Study needs of data users Output Minutes of meetings, works and written agreement 16 Continue of phase 1 Input 1.3 Establish output objectives Decrees and orders of the SSC Create viable definitions of the variables Output Conceptual definitions of variable, table outlines 1.4 Identify concepts Input Standards, control checking concepts Output Identify concepts Improved concepts 17 Input 1.5 Check data and metadata availability Output Issues with SOCAR and MIE the project approved by Methodological Council, decrees and orders of the SSC Input Projects, estimations Determine internal and external sources Agreements, strategy, analysis 1.6 Prepare business case Make a project work plan, determine the budget Results Phase 1. Approved projects and plans Output Work plan, budget 18 Continue of phase 2 2. Design 2.1 Design outputs 2.2 Design variable descriptions 2.5 Design statistical processing methodology 2.3 Design data collection methodology 2.4 Design frame and sample methodology 2.6 Design production systems and workflow 19 Continue of phase 2 2.Design Discussion of the program on processing of the instructions on filling in of the report forms (6extraction (oil, gas) 1-TİG (oil), 1-balance (oil)) in PC Input Questionnaires, output tables, set of indicators Output Layout of the output tables 20 2.1 Design outputs Input Questionnaires, output tables, set of indicators Input Design outputs 2.2 Design variable descriptions Letters of agreement, resolution, register Design variable descriptions, surveys, registers Continue of phase 2 Output Layout of the out put tables Output Harmonization of clarification 21 Input 2.3 Design data collection methodology Metadata Definition report coverage Continue of phase 2 Draft metadata 2.4 Design frame and sample methodology Output Input Survey plan Determination of frame of survey and plan to conduct survey Actual register 22 Input 2.5 Design statistical processing methodology Letters of agreement , Methodological Council s resolution Input Design statistical processing methodology Output Statistical processing methodology 2.6 Design production systems and workflow Output Division of work on Department of Industry and Construction Statistics Including of report forms reflecting crude oil data in statistical work Preparation of work plan program Results Phase 2. All designs approved 23 Continue of phase 3 3. Build 3.1 Construct components of data collection issues 3.2 Build or enhance process components 3.5 Test statistical business process 3.3 Configure workflow 3.4 Test production system 3.6 Finalize production system 24 Continue of phase 3 3. Build Create process components Input Instruments Output Production system 25 Input 3.1 Construct components of data collection issues Issues, instruments Build system Continue of phase 3 Output Production system 3.2 Build or enhance process components Input Output Instruments Build process components Created components 26 Input Raise the issue 3.3 Configure workflow Preparation of reports Continue of phase 3 Output Reports 3.4 Test production system Input Raise the issue Test production system Output Take over 27 3.5 Test statistical business process Input Output Raise the issue Test statistical business process Take over 3.6 Finalize production system Input Output Staffs, production system Finalize production system Skills, production system Results Phase 3. System in production 28 Continue of phase 4 4. Collect 4.1 Select sample 4.3 Run collection 4.2 Set up collection 4.4 Finalize collection 29 Continue of phase 4 4. Collect Data collection Input Output Data Data 30 4.1 Select sample Input Set of observation Including all economic subjects engaged in crude oil extraction, consumption, import and export in reporting register Continue of phase 4 Output List of statistical units presenting reports 6-extraction (oil, gas) 1-TİG (oil), 1-balance (oil) 4.2 Set up collection Input Questionnaires data Output Set up collection Data Data 31 4.3 Run collection Input Raise the issue Output Online collection of the reports Data 4.4 Input Finalize collection Output Finalize collection Data Results Phase 4. Data ready for processing Data 32 Continue of phase 5 5. Process 5.1 Integrate data 5.2 Classify &coding 5.5 Derive new variables & statistical units 5.6 Calculate weights 5.3 Review, validate & edit 5.7 Calculate aggregates 5.4 Impute 5.8 Finalize data files 33 Continue of phase 5 5.Process Classify and mode, micro edit, control, imputation, calculate weights Input Output Data Statistical data 34 5.1 Integrate data Input Data and registers Input Units data Continue of phase 5 Output Link data sources and statistical registers 5.2 Classify & coding Classification and coding Integration of data Output Data 35 Input Data 5.3 Review, validate & edit Review, validity check and editing Continue of phase 5 Output Validated data 5.4 Impute Input Data Identification of potential errors and missing Output Estimated data 36 Continue of phase 5 5.5 Derive new variables & statistical units Input Output Results of monitoring Derive new variables& statistical units Variable 5.6 Calculate weights Input Approved notes by MCC Output Calculate weights Data 37 5.7 Calculate aggregates Input Output Approved notes by MCC Input Data Calculate aggregates 5.8 Finalize data files Finalize data files Data Output Store micro-data Results Phase 5. Data ready for analysis 38 Continue of phase 6 6. Analysis 6.1 Prepare draft outputs 6.2 Validate outputs 6.3 Scrutinize & explain 6.4 Apply disclosure control 6.5 Finalize outputs 39 6. Analysis Input Data Produce statistics, quality of data, preparation of data, finalize Continue of phase 6 Output Ready data 6.1 Prepare draft outputs Input Primary output Preparation of initial results based on 6extraction (oil, gas) 1TİG (oil), 1-balance (oil) reports Output Output 40 Input Primary output 6.2 Validate outputs Validate outputs Input 6.3 Scrutinize & explain Summarized data based on reports Explanation of results based on output data Continue of phase 6 Output Validated outputs Output Data 41 6.4 Apply disclosure control Input Summarized data based on reports Preserve confidentially of primary data Output Control of preserve confidentially of primary data 6.5 Finalize outputs Output Input Summarized data based on reports Prepare final result Final outputs for user Results Phase 6. Analysis ready to dissemination 42 Continue of phase 7 7. Disseminate 7.1 Update output system 7.4 Promote dissemination products 7.2 Produce dissemination products 7.3 Manage release of dissemination products 7.5 Manage users' inquires 43 Continue of phase 7 7. Disseminate Input Output Analysis and data Input Dissemination of oil data Analysis and data 7.1 Update output system Register on dissemination of the issues Update of oil data Analysis and data 44 Continue of phase 7 Input 7.2 Produce dissemination products Register on dissemination of the issues Input Oil data production Output Analysis and data 7.3 Manage release of dissemination products Working plan on statistical analysis, catalogue of statistical publications Manage oil release products Output Notify users of release 45 Input 7.4 Promote dissemination products Dissemination products Promote dissemination products 7.5 Manage users' inquires Input The assignment of chairman or deputy chairman of the Committee Manage questionnaires on oil, filling of questionnaire Output Manage of products Output Meet requirements of users Results Phase 7. Statistics disseminated 46 Continue of phase 8 8.Archive 8.1Determine the rules of archive 8.2Management of archive 8.3Support of information and metadata 8.4Extermination of metadata and information 8.1.1. Reference to standard legal acts 8.2.1. Creating of archive catalogue 8.3.1. Identification of metadata and information 8.4.1. Make actual the information 8.1.2 Preparation of theory about archive 8.2.2. Check out archive and expulsion process 8.3.2 . Overcharge and renewal of information 8.4.2. Extermination of metadata and information 8.1.3 Solution of planning and forming tasks of archive operations 8.2.3. Determination the completeness of metadata and information 8.3.3. Catalogue of metadata and information 8.4.3. Document the extermination 8.2.4 Format of archive 8.3.4. Verify of archive 47 Continue of phase 8 8.Archive Archive Input Procedural nomenclature, data and metadata Output Archive 48 Input Procedural nomenclature Input Procedural nomenclature 8.1 Determine the rules of archive Determine archiving rules 8.2 Management of archive Determine archiving rules Continue of phase 8 Output Documents Output Documents 49 8.3 Support of information and metadata Input Preserve data and associated metadata Data and metadata Input 8.4 Extermination of metadata and information Data and metadata Dispose of data & associated metadata Results Phase 8. Statistics archived Output Archive Output Archive 50 9.Evaluate Continue of phase 9 9.1. Gather evaluation inputs 9.2 Conduct evaluation 9.3 Agree action plan 9.1.1Creating of team 9.2.1. Analysis and include on a report 9.3.1. Forming action plan 9.2.2. Reference 9.3.2 Determine monitoring mechanism 9.1.2 Gather the materials of precedent evaluation 9.1.3Present materials to the team 9.3.3 Confirm action plan 51 9.Evaluate Input Evaluation materials Input Gather evaluation inputs Continue of phase 9 Output Evaluate of processes 9.1 Gather evaluation inputs Gather evaluation inputs Evaluation Output Evaluation 52 9.2 Conduct evaluation Input Conduct evaluation Output Conduct evaluation Evaluation 9.3 Agree action plan Output Input Agree action plan Agree action plan Results Phase 9. Evaluate Evaluation 53 Challenges Operate the processes of energy statistics on the basis of GSBPM in detail. Provide possible relations of the processes . To form the metadata op detailed processes. Organize trainings and development programs about GSBPM. Explore the methodology, recommendations and innovative plans accepted by the international organizations and determine expediency of application standards. 54 55