The Development of the Grid in China Guangwen Yang Department of Computer Science

advertisement
The Development of the
Grid in China
Guangwen Yang
Department of Computer Science
Tsinghua University
ygw@tsinghua.edu.cn
Jun. 11,2007
Grid Computing in China
4 Major Grid Projects:
CNGrid (China National Grid, MOST)
ChinaGrid(MOE)
NSFC Grid (NSF)
ShanghaiGrid (Shanghai Province)
“Grid Computing in China”
Journal of Grid Computing (2004)2:193-206
Overview of CNGrid



Key project supported by the National
High-Tech R&D Program (the 863
program)
Earliest and largest Grid project in China
4-year effort



May 2002 to Dec. 2005
100 million RMB government funding from
the MOST
More than 2Χ associated funds from local
government, application organizations, and
industry
CNGrid infrastructure

Major nodes:



Standard nodes:







CNIC, CAS, Beijing
Shanghai Supercomputer Center, Shanghai
Tsinghua University, Beijing
Institute of Applied Physics and computational
Mathematics, Beijing
University of Science and Technology of China, Hefei
Xi’an Jiaotong University, Xi’an
NUDT, Changsha
Hong Kong University, Hongkong
CNGrid Operation Center

The CNGrid Operation Center, CNIC, CAS
CNGrid nodes locations (1)
Beijing
Xi’an
Shanghai
Hefei
Changsha
Hong Kong
CNGrid resources

Computing resource:


18 TFlops
Disk storage:

>200TB
Application software
 Databases

SCCAS



Equipped with
Lenovo DeepComp
6800, 5.324TFlops
Average utilization
86%
Applications


155 registered
users
Supporting more
than 120 important
projects
SSC

Equipped with Dawning 4000A,
10.2 TFlops

Utilization >80%

About 150 users
CNGrid GOS architecture
Application Logic by Web Pages
Grid Apps
Grid
Portal
Build-in Utility Collection
User Customized
Applications
Extended Utilities
Servlet Based Scalable Grid Portal Engine
User APIs
System and Application Libraries(Core Based Functional APIs and Exception Handling)
App Level
Services
Batch Service
System
Level
Services
GIS Service
Information(MetaX) Services
MetaFile Service
MetaDB
Meta Info
Service
Naming
Replica
Mgmt.
Mgmt.
Quota
Mgmt.
MetaSys
Service
File AC Mgmt.
Core APIs
Core
Level
Services
etc.
etc.
Base Services
System
Monitoring
Service
Logging&
Auditing
Service
CA&
Certificates
Mgmt. Service
File
Database
Messaging
Service
Service
Service
Dymaic Deploy Service
Extended
System
Services
Core Libraries(Grip, Agora, Router, AC Handling, Core Exception Handling)
Agora Service
User Mgmt. Engine
Resource Mgmt. Engine
Profile
Service Addr. Service
Acct.
and PortType
Info
Proxy
Authentication
Cert.
Mapping
Mgmt.
Role Based
Acct. Mgmt.
Tomcat
(Apache)
Grip Service
Grip Container
Agora
AA
Multi-Grained
Resource AC Policy Mgmt.
Authorization Engine
Service Info. Mgmt. (Local)
OMII
GT4
(Globus)
WebSphere
(IBM)
Result
Caching
User
Interaction
Grip State Mgmt.
Grip Ctrl. Structure
Acct.
Approve
Router Service
GOS
Hosting
Env.
Workflow Service
Addr. Core Exceptions
Trans. Service Invocation
Service Locating(Global)
WebLogic
(BEA)
Java J2SE, J2EE/Microsoft Windows
.NET
(Microsoft)
Grid Software: CNGrid GOS



CNGrid GOS 2.0
deployed on 8
nodes
Support
heterogeneous
HPCs: Dawning
4000A, DeepComp
6800, Galaxy, etc.
Support multiple
platforms:
Unix, Linux,
Windows, Apache,
WebSphere, etc.
Support application Grids
Bioinfor
matics
Geosurvey
Manufacture
& Simulation
Weather
forecast
CNGrid Applications

Applications from selected areas

Resource and Environment


Research


SDG, BAGrid, DDG
Services


NGG, DFG, SeisGrid
CMAG, TIG
Manufacturing

AviGrid, SimGrid
National Geological survey
Grid: NGG

Undertaken by China National Geological
Survey Bureau





Nation-wide productive grid
Data exchange and sharing by services
Grid-enabled resource evaluation
Shorten the evaluation time from 3 years to 3
months
Achievements


North China ground water resources evaluation
Mineral resources evaluation
NGG environment
Drug discovery grid: DDG


Undertaken by Shanghai Institute of
Materia Medica CAS
Chemical Compound screening for new
drug discovery




Speed up the process by computer simulation
Higher accuracy
Using HPC in P2P mode
New drug for diabetes is under
development and will enter clinic testing
DDG Portal
Task allocation in DDG
Aviation Grid: AviGrid
Undertaken by AVIC II of China
 Supporting distributed design,
simulation, and manufacturing

CAD software sharing
 Data exchange and sharing
 Computing resource sharing

AviGrid
Aviation grid platform
composed of three
clusters in different
locations
哈飞
北京628
洪都
AviGrid
Windows
Windows
Automatically
locating resource
when submitting
jobs
Linux
Windows
AIX
Linux
Linux
Windows
Windows
AviGrid
MultiCluster
WAN
GLB
run
Licence pool
Acquire Token
submit
Software sharing
AviGrid: Topological optimization
before optimization
Added skin
After optimization
Reduced skin
The new 863 key project



Period: 2006-2010, launched in Oct. 2006
640 million (RMB) from the MOST and at least
equal amount of matching funding from different
organizations
Major efforts:
 High productivity Computer development
 CNGrid development
 CNGrid GOS continuous development
 12-15 Grid applications
Objectives





Capabilities in HPC design and
manufacturing
Innovation on key Grid technologies
Mature and robust Grid software
Service oriented Grid infrastructure
Productive Grid applications
High productivity
Computer development

Two phase development
Two 100TFlops machines in the first
phase (By the end of 2008)
 One 1000Tflops in the second phase
(TBD)



Installation in CNGrid Major sites
Promoting HPC and grid applications
Grid software development

Major tasks
Robust grid system software
 Data grid software
 Grid workflow
 Grid user interface
 Grid security
 Grid management



Deployment over CNGrid
Supporting various grid applications
Developing Grid service
environment




Upgrading of CNGrid resources
 increased to 12 nodes
 Aggregated computing power of 300TF
 1PB storage
Grid monitoring and management
 Strengthen CNGrid operation center
Management regulation
CNGrid will become infrastructure for various
applications
Grid applications



Choose important domains, support key
business
Demonstrate grid technologies
Achieve productive operations
Challenges










Robust and reliable grid infrastructure
Mature and robust grid software
Grid economical and Business model
Data Grid technologies
Grid management
Grid programming model & languages
Grid application development environment
Grid user interface
“Gridization” of traditional applications
Grid standards
CNGrid (2006-2010)

HPC Systems



Grid Software: CNGrid GOS



Merge with international efforts
Emphasize matureness
CNGrid Environment


100 Tflop/s by 2008,
Pflop/s by 2010?
Nodes, Centers, mgt
Applications




Research
Resource & Environment
Manufacturing
Services
CNGrid nodes locations (2)
Beijing
Xi’an
Jinan
Shenzhen
Hefei
Hong Kong
Shanghai
Present Progress



10 nodes
8 applications
Meteorological, Science Data,
High Speed Railway, Drug discovery,
Computational chemistry, astronomy,
Chinese medicine
CNGrid Software
Cooperation with UK and
EU FP6


OMII UK & OMII China, Data Grid
EUChinaGrid




EchoGrid



Interoperability between CNGrid GOS and GRIA
Grid applications: Aerospace, Phama, Meteo
XtreemOS


Grid roadmap
BRIDGE


Interoperability between CNGrid GOS and gLite
IPv6 support
Application in HEPH, Biology and bioinformatics
Network centric OS
OMII-Europe

Grid middleware
Thank you!
Download