Earth System
Supercomputer Center/ KMA
2004. 8. 28
Dongil Lee
contents
• What the earth system is
• How we can understand the earth
system – observation, analysis, and
prediction
• Examples of Grid Project for Earth
System
• opportunity
contents
• What the earth system is
• How we can understand the earth
system – observation, analysis, and
prediction
• Examples of Grid Project for Earth
System
• opportunity
Source:isc2003 Walter Zwieflhofer ECMWF
Source:isc2003 Walter Zwieflhofer ECMWF
Source:isc2003 Walter Zwieflhofer ECMWF
Source:isc2003 Walter Zwieflhofer ECMWF
Source:isc2003 Walter Zwieflhofer ECMWF
contents
• What the earth system is
• How we can understand the earth
system – observation, analysis, and
prediction
• Examples of Grid Project for Earth
System
• opportunity
Technology for the weather forecasting
observation
collection
Anal.& WF
Diss.
World Meteorological Organization(187members)
DATA
PRODUCERS
DATA
CONVEYORS
Global
Observing
System
Global
Telecommunication
System
GOS
GTS
DATA
USERS
Global Data
Processing
System
GDPS
GOS
Observation
to understand
the current
weather
Surface
Buoy
Radiosonde
Weather
Observation
Aircraft
Sat.(wind)
Sat.(temp)
GOS(Global Observing System)
 to understand the current weather
 satellite, aircraft, wind profiler, buoy, etc…
 international data exchange
National Space Program in Korea
2006
2008
Communication, Ocean
& Meteorological Satellite-1
2001
1999 KOMPSAT 1
2005
Scientific Satellite 2
2004 KOMPSAT 2
2008 KOMPSAT 3
2003
Scientific Satellite 1
2005
KOREASAT 5
2008 Scientific Satellite 3
1999 KITSAT 3
2009 KOMPSAT4
1999 KOREASAT 3
2014
Communication, Ocean
& Meteorological Satellite 2
2011
2012
KOMPSAT 6
2015
Scientific
Satellite 6
2015
KOMPSAT 8
2014
KOMPSAT 7
2015
KOREASAT 6
2013
Scientific Satellite 5
2010
KOMPSAT5
2011
Scientific Satellite4
COMS System Architecture
Ka-band RF Signals
HRIT/LRIT
Communication
System Monitoring
Facility
Meteorological
Information Supply
Command,
Telemetry
Raw Data,
HRIT/LRIT
Foreign
Meteorological Data
Receiving Station
HRIT/LRIT
Raw Data
Various Site
Satellite Operation Control Center
/ Back-up Data Processing Center
Internet
Internet
Exclusive Line
Meteo/Ocean Data
Application Center
(Primary Data Processing Center)
Foreign Meteorological Organization
/ Foreign User
Internet
Specialized Organization
/ Domestic User
Telecommunication with
187 countries
Nature
Model
Numerical Model
 Initial Data
 예보모델
 Data Assimilation to improve the initial data quality
 Ensemble Forecast to reduce the uncertainty of N.M.
연구배경
Some Characteristics of Earth Science
• Global Scale Study => climatology with Atmos., Ocean, land surface, etc
Global Observation and sharing information
• Co-work with international society is important
•
global science with huge observation data and high performance computing
• Dynamic Equation Set
• Super Computing
• Numerical Representation
GDPS
Pre Processing
Encoding
Decoding
Data Ass.
Numerical
Model
Q.C.
Objective Ana.
Analysis Chart
NWP
Global
Regional
Post Processing
Graphics
Prog. Index
Statistical Model
charts
Indexs
Forecast Guidance
Cloud Forecast
KMA Supercomputer - Cray X1E-8/960L; final stage(18Tflops)
KMA 2nd Supercomputer Baram
0.5
Applications of Meteorology
0.4
0.3
0.2
0.1
0
93년 94년 95년 96년 97년 98년 99년 00년 01년
Mapping
Energy- Defence
Marine Grid OceanAquaculture
Grid
Grid
Water use
HydroEnvironGHG inventory
Grid
Grid
Food security
TransAgroTransSiberia
Grid
Grid
ImpactAssessment
Grid
SpaceSattelite
Grid
APCN WMOCAgM
Grid Grid GridWAMIS
Network Hub
언
론
기
관
강수유무
강수유무
1mm 이상
1mm 이상
5mm 이상
5mm 이상
To improve the accuracy of weather forecast
 improve the initial data using satellite, radar, etc..
 reduce the uncertainty of numerical model
To achieve this goals, we need
more observation data and model results
Source : FSU, U.S.A.
Data is increasing…. Example of one center
4000
3500
GB/Day
3000
2500
2000
1500
1000
500
0
2001 2002 2003 2004 2005 2006 2007
NWP
Messages
NEXRAD Prod
NEXRAD Base
Turning Observations into Knowledge
Products
Source: Dr.Ghassem Asrar, GEO
contents
• What the earth system is
• How we can understand the earth
system – observation, analysis, and
prediction
• Examples of Grid Projects for Earth
System
• opportunity
The Grid and Meteorology:
Opportunities
• Inter-personal collaboration
– E.g., Access Grid, CHEF
• On-demand access to simulation models
– E.g., Espresso
• Access to, and integration of, data sources
– E.g., Earth System Grid
• Dynamic, virtual computing resources
– “Metacomputing”
• Integration of all of the above
– Collaborative, computationally intensive analysis of large
quantities of online data
Source: APAN16 Ian Foster
Expresso Modeling Interface
(Michael Dvorak, John Taylor)
• “Meteorology on demand”
Source: APAN16 Ian Foster
Earth System Grid (ESG)
Goal: address
technical
obstacles to the
sharing &
analysis of
high-volume
data from
advanced earth
system models
Source: APAN16 Ian Foster
Collaborations & Relationships
• CCSM Data Management Group
• OPeNDAP/DODS (multi-agency)
• NSF National Science Digital Libraries
Program (UCAR & Unidata THREDDS Project)
• U.K. e-Science and British Atmospheric Data
Center
• NOAA NOMADS and CEOS-grid
• Earth Science Portal group (multi-agency,
international)
Source: APAN16 Ian Foster
Linked Environments for
Atmospheric Discovery (LEAD)
A Cyberinfrastucture for Mesoscale Meteorology
Research and Education
Kelvin K. Droegemeier
School of Meteorology and
Center for Analysis and Prediction of Storms
University of Oklahoma
Source : Kelvin Droegemeier
LEAD Data Cloud
Source : Kelvin Droegemeier
Geosciences CI Activities
Source : Kelvin Droegemeier
contents
• What the earth system is
• How we can understand the earth
system – observation, analysis, and
prediction
• Examples of Grid Project for Earth
System
• Opportunity –
CPU-intensive and data-intensive
Example : Proposal for RA-VI
(Offer supported by DWD, Met Office and Météo France)
“Virtual” GISC
DWD, Met Office,
Météo France
(RTH and RSMC)
DCPC’s
ECMWF,
EUMETSAT
“Virtual” GISC
The Earth Observation Summit II was held on Sunday, April 25th, 2004 at Hotel Okura in
Tokyo, Japan. 43 countries (including Japan) from G8, Asia, Europe, Africa, Latin
America, etc and the European Commission participated in the Summit. Among the
participants were the Honorable Michael O. Leavitt, Administrator of the US.
Environmental Protection Agency, Dr. John M. Marburger, Science Advisor to the
President and Director of the Office of Science and Technology Policy from United States
and Minister Guanhua Xu from the Ministry of Science and Technology of China, Ministers
from Gabon, Guatemala and Israel. To name the few of the participating 25 organizations
were IBRD (The World Bank Group), U.N. Educational, Scientific and Cultural
Organization (UNESCO) and World Meteorological Organization (WMO), which made the
grand total of the participants to approximately 350 people.
Feedback mechanism
between Earth Observation and Societal Benefits
GEOSS
Korean Meteorological Administration
Approved at GEO-2:
Idealized System Components
Observation
Component
Data Processing
Component
• Observation:
• Data processing:
acquire
process data into
observations
useful information
based on
existing national, re
gional and
global
contributions
29 November, 2003
GEO-2
Data Exchange and
Dissemination Component
• Data Exchange
and Dissemination:
exchange and
disseminate observatio
nal data and informatio
n
Baveno, Italy
42
Korean Meteorological Administration
기타 참고 자료
Thank you …
Super Computer Center/KMA
Lee, Dongil ldi@kma.go.kr
KMA 2nd Supercomputer Boram
The first proposal
Items
Initial system
(2004)
Final system
(2005)
Model name
X1-3/192-L
X1E-8/960-L
3
7.5
System
1
4
Computing
47
236
System
4
16
Computing
188
944
Single CPU performance
12.8Gflops
19.2Gflops
1 CPU Sustained performance
3.38 Gflops
4.63Gflops
Total Sustained Gflops
635.44 Gflops
4,370.72 Gflops
Total memory size
760 Gbytes
3776 Gbytes
I/O Cabinets
1
2
I/O Drawers
4
8
SPC channels
16
32
PC-20 Cabinets
6
8
The number of cabinets
Nodes
Main
System
Disk &
I/O
CPUs
SAN Disk
Direct Attached Disk
12 Tbytes
44 Tbytes
63 Tbytes
The second proposal
Items
Initial system
(2004)
Final system
(2005)
Model name
X1-3/192-L
X1E-8/960-L
CPES
Login Server
(cross compiler)
Servers
Network
Remote
Display
System
Tape Library
CNS
1
2
CPES +Dual 3 Dell 1750 cluster
2
4
Pre-post processing servers
2* Fujitsu RX800(8-way)
File system server
2
CWS
1
Cisco 76xx routers
2
Cisco 45xx routers
2
Video Display System
1
Access Grid System
Fixed 2, mobile type 1
3D Hologram System
3D Rear Projection System
ADIC Scalar 10K
1 (1 Pbytes capacity)
Chiller (60RT)
4
Cooling Tower(80RT)
4
Chiller