Country Paper on: Access Policy and Dissemination of Micro-Data: ’s Experience

advertisement
Country Paper on:
Access Policy and
Dissemination of Micro-Data:
Egypt’s Experience
Prepared by
Khaled Hamed El-Deib
Director of decision support systems
Introduction.
Explain the components of electronic Archive
table.
International Household Survey Network (IHSN)
Micro-data Management Toolkit in CAPMAS.
Micro-data Access.
Data Dissemination.
Future of Micro-data Access by the Public.
Future of Dissemination.
Key Challenges.
Statistical main objective of the implementation of the
census is the process of access the product meets
the needs of data users at the suitable time and high
accuracy .
From this point the cooperation Each of the statistics
sector and the IT sector to achieve this goal,
according to prior planning.
Was conducted the last census the population in
Egypt in 2006, a thirteenth.
Begin preparations for the census before the date of
its inception three years .
The use of electronic archive during the
census: it consists of three tables :
In first table each row represents a specific
record data.
In the second table each row represents data
for a particular image and the content of the
barcode.
In the third table each row represents the data
and form number and record number and the
number of the smallest administrative unit.
A- Data storage of the image such as the type and number
form the smallest administrative unit and the record
number and number of the form and inquire about any
of them
B-Know the status of each record (Is the work of quality control
of the record or not)
C - Know the status of each form (it was the work of ICR
or not)
D - Does each form a face and back, No. scanner was
scanning through
E - Type barcode on each form
 We collect information for statistical
purposes and it is never used to identify
individuals .
-Information released from the site should
not be sold to others . Violating this rule is a
crime with severe penalties
-We recognize the value of your trust and we
believe that when you answer our survey we
must serve as caretakers of your
information
-On information dissemination users should
indicate that the source of information is
CAPMAS
International Household
Survey Network (IHSN)
Micro-data Management Toolkit in
CAPMAS
Application of international standards in the use of DDI
,DCMI in Egypt
The beginning of December 2009 started CAPMAS in
cooperation with Paris on the 21 training criteria mentioned by
6 surveys .
Training was done "On Job Training" by the staff of CAPMAS
five other projects .
Been the work of the session included the other nine projects,
and thus the total projects to 20 projects .
Is a monthly follow-up action by the President of the CAPMAS
on the progress made in the documentation process, and this
work offers a monthly position
The next step
 The use of SDMX in support of the
program to facilitate the exchange
of data.
 Documentation of surveys carried
out by CAPMAS to third-party.
 Training of other government data
producers on the documentation
See everything that is new to
the development of
Micro Data Access
Researcher access
Availability has improved over
the past 20 years.
Household micro-data are
more accessible than
establishment data.
Data Dissemination
Methods of data dissemination are
evolving.
Newspapers are becoming less important
for data dissemination.
Newspaper employment down in case of
data dissemination.
Web has revolutionized data
dissemination and analysis.
Data Dissemination
Statistical agencies increasingly interact with
customers directly through their websites.
Users have access to more data than ever
before.
However, data are dispersed across
agencies ,Can be hard to locate proper data
set Explanations of methodologies
underlying the data are hard to find.
Future of Micro-data
Access by the Public
 Match
confidential and public use data
files within and across agencies.
 Will advances in firewall and security
technologies allow increased
researcher access to confidential data?
Future of Micro-data
Access by the Public
 Access
to the sampling frames of other
agencies may improve sampling
efficiency.
 Access to administrative records from
other agencies may reduce duplication.
Future of Dissemination
Need to recognize broad range of data
users (not just policy-makers).
Each group has distinct needs.
Varying technical abilities.
Realign focus from outputs to
“outcomes”.
Future of Dissemination
Data Delivery.
 Internet – websites are now the “faces” of
statistical agencies.
Web-based data releases
 Social media and other mobile electronic
devices.
 Private sector helping to fill in the gap –
Google Public Data Explorer
Future of Dissemination
Harmonize measurement concepts
across programs
 Example: industry classifications are
standardized, but products and services
classifications are not
 Example: concept of earnings and how it is
measured across different surveys can be
very confusing
Future of Dissemination
Centralize data warehousing?
 Data by concept: One place to find all
government data on housing, education,
retirement, health, etc.
Customizing data
 Allow the customer to customized the data they
need with options for delivery of update notices
Future of Dissemination
Transparency
 Clear, easy to understand, explanations of
concepts underlying data
 Up-to-date technical documentation
The Accelerated Data Program ( ADP )
International Household
Survey Network (IHSN)
Micro-data Management Toolkit
IHSN Activities
Coordinating survey programs
 Web based information on planned surveys
Harmonizing concepts & methods
 Planning, sampling, questionnaire design,
processing, data disclosure & confidentiality, etc.
Maintaining a survey catalog
 Web based central catalog
Developing data dissemination tools
 Micro-data Management Toolkit
Improving survey quality
and data harmonization
Documenting helps harmonizing.
Documenting helps identifying data gaps.
ADP : assessing and improving quality of
survey data.
Mid term proposed solution: international /
national question banks (XML repository of
re-usable survey metadata).
ADP implementation: pilot Countries
 Africa
Burkina Faso, Cameroon, Ethiopia, The Gambia, Ghana, Guinea
*, Kenya, Liberia, Mali, Mauritania *, Mozambique, Niger,
Nigeria, Senegal, Tanzania, Tunisia, Uganda (+ Botswana,
Lesotho, Namibia and Swaziland [TFSCB])
 Asia
Bangladesh, Fiji, Indonesia, Lao PDR, Mongolia, Philippines,
Sri Lanka, Thailand, Vietnam
 Central and South America
Argentina, Bolivia, Costa Rica, Dominica, Guatemala, Haiti*,
Honduras, Mexico, Peru, Uruguay
 Middle East
Yemen
Looking Forward:
Tools and guidelines
 Micro-data Management Toolkit: Building on success
 Dissemination Policy Guidelines:
 Anonymization tools: Preserving Confidentiality
 Comprehensive protocol in metadata preservation
 Guidelines on improving:
Data Processing
Data Analysis
Data Quality
Survey Methodology
 Release of the Survey Quality Assessment
Framework
Micro-data Management Toolkit
 Software + guidelines + training materials
 For data documentation: DDI Metadata Editor
Dissemination Policy Guidelines
Dissemination
of micro-data
files
 Access policies and procedures
are crucial to protect data.
 IHSN “Policy Guidelines &
Recommendations”.
 Why / how / when / to whom
should micro-data be
disseminated?.
 Practical guidelines with
suggested access agreement
forms, etc.
 To be adapted to country
specificities.
Micro-data Management Toolkit
For data dissemination: open-source tools
CDROM
Web cataloguing system
and Web-Builder
Anonymization Tools
 By a Task Force; building on
existing work
 Not an integrated software.
 Using power of statistical
packages for processing complex
algorithms
 A collection of specialized tools
for:
Measuring the risk
Reducing the risk
Assessing the information loss
Intelligent system
To generate anonymized subsets
on-demand
Key Challenges
 Overlap between the individuals
responsible for various stages of census
data and the individuals responsible for
the archiving of census data.
 Do not specify a time for archiving.
 The presence of more than one source
has the census data, which impedes the
archiving of census data.
 Metadata collection and delivery
 Ensuring solution integrated with data
dissemination
 Access to Egypt-wide outputs
 Micro-data provision
 Product definition and delivery
Mechanisms
E-mail:
pres_capmas@capmas.gov.eg
E-mail:
khaled_man@live.com
Download