The Development of the Grid in China Guangwen Yang Department of Computer Science Tsinghua University ygw@tsinghua.edu.cn Jun. 11,2007 Grid Computing in China 4 Major Grid Projects: CNGrid (China National Grid, MOST) ChinaGrid(MOE) NSFC Grid (NSF) ShanghaiGrid (Shanghai Province) “Grid Computing in China” Journal of Grid Computing (2004)2:193-206 Overview of CNGrid Key project supported by the National High-Tech R&D Program (the 863 program) Earliest and largest Grid project in China 4-year effort May 2002 to Dec. 2005 100 million RMB government funding from the MOST More than 2Χ associated funds from local government, application organizations, and industry CNGrid infrastructure Major nodes: Standard nodes: CNIC, CAS, Beijing Shanghai Supercomputer Center, Shanghai Tsinghua University, Beijing Institute of Applied Physics and computational Mathematics, Beijing University of Science and Technology of China, Hefei Xi’an Jiaotong University, Xi’an NUDT, Changsha Hong Kong University, Hongkong CNGrid Operation Center The CNGrid Operation Center, CNIC, CAS CNGrid nodes locations (1) Beijing Xi’an Shanghai Hefei Changsha Hong Kong CNGrid resources Computing resource: 18 TFlops Disk storage: >200TB Application software Databases SCCAS Equipped with Lenovo DeepComp 6800, 5.324TFlops Average utilization 86% Applications 155 registered users Supporting more than 120 important projects SSC Equipped with Dawning 4000A, 10.2 TFlops Utilization >80% About 150 users CNGrid GOS architecture Application Logic by Web Pages Grid Apps Grid Portal Build-in Utility Collection User Customized Applications Extended Utilities Servlet Based Scalable Grid Portal Engine User APIs System and Application Libraries(Core Based Functional APIs and Exception Handling) App Level Services Batch Service System Level Services GIS Service Information(MetaX) Services MetaFile Service MetaDB Meta Info Service Naming Replica Mgmt. Mgmt. Quota Mgmt. MetaSys Service File AC Mgmt. Core APIs Core Level Services etc. etc. Base Services System Monitoring Service Logging& Auditing Service CA& Certificates Mgmt. Service File Database Messaging Service Service Service Dymaic Deploy Service Extended System Services Core Libraries(Grip, Agora, Router, AC Handling, Core Exception Handling) Agora Service User Mgmt. Engine Resource Mgmt. Engine Profile Service Addr. Service Acct. and PortType Info Proxy Authentication Cert. Mapping Mgmt. Role Based Acct. Mgmt. Tomcat (Apache) Grip Service Grip Container Agora AA Multi-Grained Resource AC Policy Mgmt. Authorization Engine Service Info. Mgmt. (Local) OMII GT4 (Globus) WebSphere (IBM) Result Caching User Interaction Grip State Mgmt. Grip Ctrl. Structure Acct. Approve Router Service GOS Hosting Env. Workflow Service Addr. Core Exceptions Trans. Service Invocation Service Locating(Global) WebLogic (BEA) Java J2SE, J2EE/Microsoft Windows .NET (Microsoft) Grid Software: CNGrid GOS CNGrid GOS 2.0 deployed on 8 nodes Support heterogeneous HPCs: Dawning 4000A, DeepComp 6800, Galaxy, etc. Support multiple platforms: Unix, Linux, Windows, Apache, WebSphere, etc. Support application Grids Bioinfor matics Geosurvey Manufacture & Simulation Weather forecast CNGrid Applications Applications from selected areas Resource and Environment Research SDG, BAGrid, DDG Services NGG, DFG, SeisGrid CMAG, TIG Manufacturing AviGrid, SimGrid National Geological survey Grid: NGG Undertaken by China National Geological Survey Bureau Nation-wide productive grid Data exchange and sharing by services Grid-enabled resource evaluation Shorten the evaluation time from 3 years to 3 months Achievements North China ground water resources evaluation Mineral resources evaluation NGG environment Drug discovery grid: DDG Undertaken by Shanghai Institute of Materia Medica CAS Chemical Compound screening for new drug discovery Speed up the process by computer simulation Higher accuracy Using HPC in P2P mode New drug for diabetes is under development and will enter clinic testing DDG Portal Task allocation in DDG Aviation Grid: AviGrid Undertaken by AVIC II of China Supporting distributed design, simulation, and manufacturing CAD software sharing Data exchange and sharing Computing resource sharing AviGrid Aviation grid platform composed of three clusters in different locations 哈飞 北京628 洪都 AviGrid Windows Windows Automatically locating resource when submitting jobs Linux Windows AIX Linux Linux Windows Windows AviGrid MultiCluster WAN GLB run Licence pool Acquire Token submit Software sharing AviGrid: Topological optimization before optimization Added skin After optimization Reduced skin The new 863 key project Period: 2006-2010, launched in Oct. 2006 640 million (RMB) from the MOST and at least equal amount of matching funding from different organizations Major efforts: High productivity Computer development CNGrid development CNGrid GOS continuous development 12-15 Grid applications Objectives Capabilities in HPC design and manufacturing Innovation on key Grid technologies Mature and robust Grid software Service oriented Grid infrastructure Productive Grid applications High productivity Computer development Two phase development Two 100TFlops machines in the first phase (By the end of 2008) One 1000Tflops in the second phase (TBD) Installation in CNGrid Major sites Promoting HPC and grid applications Grid software development Major tasks Robust grid system software Data grid software Grid workflow Grid user interface Grid security Grid management Deployment over CNGrid Supporting various grid applications Developing Grid service environment Upgrading of CNGrid resources increased to 12 nodes Aggregated computing power of 300TF 1PB storage Grid monitoring and management Strengthen CNGrid operation center Management regulation CNGrid will become infrastructure for various applications Grid applications Choose important domains, support key business Demonstrate grid technologies Achieve productive operations Challenges Robust and reliable grid infrastructure Mature and robust grid software Grid economical and Business model Data Grid technologies Grid management Grid programming model & languages Grid application development environment Grid user interface “Gridization” of traditional applications Grid standards CNGrid (2006-2010) HPC Systems Grid Software: CNGrid GOS Merge with international efforts Emphasize matureness CNGrid Environment 100 Tflop/s by 2008, Pflop/s by 2010? Nodes, Centers, mgt Applications Research Resource & Environment Manufacturing Services CNGrid nodes locations (2) Beijing Xi’an Jinan Shenzhen Hefei Hong Kong Shanghai Present Progress 10 nodes 8 applications Meteorological, Science Data, High Speed Railway, Drug discovery, Computational chemistry, astronomy, Chinese medicine CNGrid Software Cooperation with UK and EU FP6 OMII UK & OMII China, Data Grid EUChinaGrid EchoGrid Interoperability between CNGrid GOS and GRIA Grid applications: Aerospace, Phama, Meteo XtreemOS Grid roadmap BRIDGE Interoperability between CNGrid GOS and gLite IPv6 support Application in HEPH, Biology and bioinformatics Network centric OS OMII-Europe Grid middleware Thank you!