April 2013
Ki-bong Park
광업제조업 동향지수 빅데이터 활용 Pilot Project
MSIS2013(2013.4.23~25, Bangkok)
Contents
1. Establishment of a Big Data Roadmap of the Korean Government
2. Beginning of Big Data Use
3. KOSTAT Countermeasures against Big Data Use
4. KOSTAT Pilot Project for Big Data Use in Official Statistics
5. Future Plans
광업제조업 동향지수 빅데이터 활용 Pilot Project
MSIS2013(2013.4.23~25, Bangkok)
U.S.A.: ‘Big Data Research & Development Initiatives’ , investment in big data research & development (March 2012)
England: ‘Open Data Strategy’, Strengthen data access (March 2012)
Japan: Published ‘Strategy for Big Data Use’, Selected as a major goal for ‘Active Japan’(May 2012)
Cope with big data issues
- March 15, 2012: Big data national strategy forum (Participation by industries, universities, research institutes and
governmental agencies)
- Sep. 16, 2012: Big data forum (Participation by the public and private sectors)
Establish a ‘Big Data Master Plan’ (National Science & Technology Commission, Nov. 28, 2012)
- Step-by-step big data use by considering benefits and utilities
- Establishment of infrastructure for big data sharing, provision of technical support and expert training
광업제조업 동향지수 빅데이터 활용 Pilot Project
1 / 12
MSIS2013(2013.4.23~25, Bangkok)
Big data use when analyzing welfare and complaints from the general public
Beginning of big data use in terms of policy support and customized services
- (Policy support) Link and share data that is located in several ministries, and support policymaking via data analysis
- (Customized services) Provide user-focused services via an integrated analysis (e.g. qualification
and history)
Holding World-class ‘IT infrastructure’ and ‘data production and dissemination’
- World-best infrastructure including high-speed Internet, 3G smart phones and LTE phones
- Sharp increase in mobile data due to the popularity of smart phones and SNS
Poor data use by businesses when considering the production and dissemination of a
huge amount of data
- Just a few enterprises properly understand and use big data.
- Mobile and portal service providers started to use big data based on their own data.
광업제조업 동향지수 빅데이터 활용 Pilot Project
2 / 12
MSIS2013(2013.4.23~25, Bangkok)
Collect, classify, analyze and forecast online complaints of the public to facilitate communication between
the government and the public
Produce a complaints calendar by month and region after analyzing past complaints and produce a
complaints map showing social issues
형태로 제공
Strengthen policies
Unemployment benefits,
use of public transportation
Apartment sales
광업제조업 동향지수 빅데이터 활용 Pilot Project
3 / 12
MSIS2013(2013.4.23~25, Bangkok)
Policies for adolescents are too passive to prevent their extreme behaviors.
Help to make policies to prevent suicides of adolescents by analyzing buzz patterns related to suicides in social data and
reflecting their situations and psychology
e.g.) Suicide context pool
e.g.) Online spread of harmful contents
e.g.) Ripple effect of big mouths in a
network
(Source) Pilot Project of the National Information Society Agency (July ~ Sep. 2012)
광업제조업 동향지수 빅데이터 활용 Pilot Project
4 / 12
MSIS2013(2013.4.23~25, Bangkok)
Research on big data use in official statistics and pilot production of statistics
Establish a task force responsible for big data use and train human resources
“Earlier dissemination of the Mining and Manufacturing Production Index by using media data”
Support rapid and accurate production of the Mining and Manufacturing
Production Index
Collection
and analysis
of Internet
data
Provision of
visualized
analysis
function
광업제조업 동향지수 빅데이터 활용 Pilot Project
Media data is automatically collected and used for objective editing (checking changes in
establishments and items, finding outliers) before finalizing the Index.
Easier understanding of time-series data (index and volume) by providing visualized analysis function
5 / 12
MSIS2013(2013.4.23~25, Bangkok)
Workflow
Visualized analysis of survey data
Volume
tablefocused
edit
Volume information
by establishment and
item
Index information by
industry and item
Inquiry
over the
phone
Analysis of media non-typical data
Individual
verification
of Internet
data
광업제조업 동향지수 빅데이터 활용 Pilot Project
Integrated Internet
information on items
and establishments
9 / 12
MSIS2013(2013.4.23~25, Bangkok)
(Media data) Notices on the related websites and Internet news articles
Industry
Source
Contents
Korea Pharmaceutical Manufacturers Association
C21
(Pharmaceutical products)
C24
(Basic metal products)
Chong Kun Dan Pharm.
Related articles
Korea Metal Journal
new.kmj.co.kr / New by product
Korea Iron & Steel Association
Ministry of Knowledge Economy
C28
(Electrical equipment)
Major production and commodities
Internet newspapers
Internet newspapers
C26
(Electronic components, computer,
radio, television and
communication equipment and
apparatuses)
www.kpma.or.kr / Pharmaceutical news
Korea Customs Service
Korea Semiconductor Industry Association
Semiconductor Network
Korea Display Industry Association
www.kosa.or.kr / Iron & steel information / Survey
report, Iron & Steel Journal
Related articles
Website / Press releases, notices, policy
Website / Policy, press releases
Real-time news on semiconductor
News
News on display industry
Internet newspapers
Related articles
Internet newspapers
Related articles
※ 4 industry groups (C21, C24, C26, C28, 162 items, 1438 establishments) that are surveyed in the Monthly Survey of Mining and Manufacturing
(Survey data) Time-series index and volume data by industry, item and establishment from
2005 to the current month for the Monthly Survey of Mining and Manufacturing
광업제조업 동향지수 빅데이터 활용 Pilot Project
6 / 12
MSIS2013(2013.4.23~25, Bangkok)
Scrolling of articles and documents on the Internet
from the previous month to the current month
- Collect Internet data that contains words such as increase and
decrease for survey items and establishments
- Scroll Internet news on a real-time basis
- Analyze attached documents in the PDF or MS word format on
the websites and load data into the analysis server
Analysis of non-typical data
Integrated analysis of attached documents from the
websites and Internet news articles
- Improve retrieval accuracy by registering search words (e.g. items)
in advance
- Provide website and Internet news according to the order of
광업제조업 동향지수 빅데이터 활용 Pilot Project
7 / 12
accuracy
MSIS2013(2013.4.23~25, Bangkok)
Online link to the DB for the Mining and
Manufacturing Survey System
Visualization of time-series index and volume data
by industry, establishment and item (e.g. in graphs)
Visualization of
typical data
- Volume graph by item and establishment
(Volume/month-on-month/year-on-year)
- Index graph by industry and item
Index by
industry
Index by
item
광업제조업 동향지수 빅데이터 활용 Pilot Project
Volume by
establishment
Volume
by item
(Volume/month-on-month/year-on-year)
8 / 12
MSIS2013(2013.4.23~25, Bangkok)
광업제조업 동향지수 빅데이터 활용 Pilot Project
10 / 12
MSIS2013(2013.4.23~25, Bangkok)
Define business processes and responsibilities
Examine applicability and efficiency in statistical production/ accumulate big data use
techniques
Expand the system (e.g. expand analysis range)
Expand to all industries in Monthly Survey of Mining and Manufacturing
Expand to the Monthly Service Industry Survey
광업제조업 동향지수 빅데이터 활용 Pilot Project
11 / 12
MSIS2013(2013.4.23~25, Bangkok)
Thank you for watching
광업제조업 동향지수 빅데이터 활용 Pilot Project
MSIS2013(2013.4.23~25, Bangkok)