Investment for the Future of PRAGMA
Progress Since PRAGMA 10:
PRAGMA 11
Osaka University
15 – 17 October 2006
PRAGMA Excitement
Cyclone Larry
Tropical cyclone Larry is seen striking
the coast of Australia in this
satellite image.
Magnitude 5.8 - OFF THE EAST
COAST OF HONSHU, JAPAN
2006 October 10 23:58:07 UTC
NSF Renews PRAGMA for Five Year
Thanks to the work of all of us
And what is expected of
PRAGMA?
Validate the investments in
cyberinfrastructure
One (not to be lost in) translation:
Have scientist use the grid to do
science!
Savannah Burn:
How tightly linked are burning, vegetation, and rainfall?
• PRAGMA Testbed ran CSIRO
climate model called CCAM in
combination with Nimrod/G tool set.
• Executed on a maximum of 90
processors (out of a maximum 159)
across 7 PRAGMA grid resources
located in Australia, Japan, Korea,
Taiwan, Thailand and the U.S.
• David Abramson, Amanda Lynch
Validation of Cyberinfrastructure Investments
by the Savannah Burn experiment
•
Science Resulted: The hypothesis that burning the
Savanna can affect the strength and timing of the
monsoon was confirmed.
Testbed Exercised: The testbed operated for 170 days,
and delivered over 1.25 million processor hours!
Importantly, we were able to do a live upgrade of a
number of the cyberinfrastructure components during the
period.
Middleware Improved: Improved Nimrod's ability to
schedule computations by incorporating both data location
and transport delays.
•
•
–
–
•
Allowing it to make a better choice of resources, improving the
performance of the system as well as its fault tolerance.
We also enhanced Nimrod's ability to handle faults in the Grid
testbed.
Policy Impacted: The experiment shipped some 1.6TB of
data across national and international networks. This
exposed some interesting features of Australia’s network
charging policy, and will lead to lasting improvements.
PRAGMA Overview and Approach
Process to Promote Routine Use Team Science
Workshops and
Organization
Application-Driven Collaborations
Applications
Middleware
Information Exchange
Planning and Review
Routine Use Lab/Testbed
Testing Applications
Building Grid and GOC
New Collaborations
New Members
Expand Users
Expand Impact
Multiway Dissemination
Key Middleware
Outcomes
Improved middleware
Broader Use
New Collaborations
Transfer Tech.
Standards
Publications
New Knowledge
Data Access
Education
PRAGMA Continues to Experiment
• Expand our impact to new application areas
– GEO and Geosciences*; Metagenomics*
• Increase emphasis on data in our routine use laboratory
– Establish data grid testbed* (AIST, SDSC, Tsukuba, NCHC)
– GEO and Geosciences and others
• Harness the potential of lambda grids
– Telescience and Tile Display Walls* with demo at SC06
• Work with productions grids to achieve interoperations
– Grid Interoperations Now (GIN)*
• Broaden involvement of middleware developments from
outside the Pacific Rim
– U Amsterdam; UK National e-science Center, U Zurich
• Build the community
– Develop federated approach to training and to establishing research
directions*
– Understand organizational aspects of how virtual organizations work*
* We’ll
already be seeing results of some of these activities
PRAGMA Grid Testbed
UZurich
Switzerland
CNIC
GUCAS
China
JLU
China
KU
NECTEC
Thailand
UoHyd
India
MIMOS
USM
Malaysia
BII
IHPC
NGO
Singapore
BU
USA
KISTI
Korea
AIST
OSAKAU
TITECH
Japan
ASCC
NCHC
Taiwan
SDSC
USA
NCSA
USA
CICESE
Mexico
IOIT-HCM
Vietnam
UNAM
Mexico
QUT
Australia
MU
Australia
30 Clusters from 27 institutions in 14 countries
Source Cindy Zheng
UMC
USA
UChile
Chile
Applications
http://goc.pragma-grid.net
•
Achieved long run and scientific results
– Savannah/Nimrod, MU, Australia
– FMO/Ninf-G, AIST, Japan
•
Successful run
– MM5/Mpich-Gx, CICESE/KISTI,
Mexico/KISTI
•
11 applications continue run in testbed
– Savannah: climate model, MU, Australia
– MM5: climate model, CICESE, Mexico
– QM-MD, FMO: quantum-mechanics, AIST,
Japan
– iGAP: genomics, UCSD, USA
– HPM: genomics, IOIT-HCM, Vietnam
– mpiBlast: genomics, ASCC, Taiwan
– Gamess-APBS: organic chemistry,
UZurich, Switzerland
– Siesta: molecular simulation, UZurich,
Switzerland
– Amber: molecular simulation, USM,
Malaysia
•
Coupling of applications with middleware
Source Cindy Zheng
Grid Security
• APGrid PMA Meeting (yesterday)
– See Yoshio Tanaka
• IGTF (OGF) http://www.gridpma.org/
– APGrid PMA, http://www.apgridpma.org/
• 5 site-CAs are IGTF accredited
– AIST, ASGC, CNIC, NCSA, NECTEC
• PRAGMA CA
– Naregi-CA, https://www.naregi.org/ca/
• APGrid, UChile, …
– Experimental CA in use for users/hosts
– Working on production CA under APGRID PMA
• GAMA and Naregi-CA integration
– GAMA, http://grid-devel.sdsc.edu/gridsphere/gridsphere?cid=gama
– User private key issue
Grid Interoperation Now (GIN)
http://forge.gridforum.org/sf/wiki/do/viewPage/projects.gin/wiki/GinOps
• GIN testbed (started Feb. 2006)
– PRAGMA, TeraGrid, EGEE, OSG, NorduGrid
• Applications
– TDDFT/Ninf-G
• Lead: Yoshio Tanaka, Yusuke Tanimura (AIST, Japan)
• Deployed and run
–
–
–
–
PRAGMA - AIST, NCSA, SDSC
TeraGrid – ANL
OSG – UCSD
NordiGrid
• Working on deployment to EGEE
– Savanah Study (data intensive)
• Lead: Colin Enticott (MU, Australia)
• In preparation
• Presentation at SC06
Grid Interoperation Now (GIN) [2]
http://forge.gridforum.org/sf/wiki/do/viewPage/projects.gin/wiki/GinOps
•
•
Somsak Sriprayoonsakul, Sugree Phatanapherom, (KU, ThaiGrid)
Infrastructure testing matrix
– Test 7 clusters from 5 grids
http://goc.pragma-grid.net/cgi-bin/scmsweb/probe.cgi
– New version to handle various grid service configurations/tests
•
GIN map
– implemented a XML-> LDIF translator for GIN map
http://maps.google.com/maps?q=http://lfield.home.cern.ch/lfield/gin.kml
•
Cross-grid monitoring
– Common schema
http://wiki.pragma-grid.net/index.php?title=GIN_%28Grid_Interoperation_Now%29_Monitoring
Telescience
Osaka has deployed software and tested with UCSD and NCHC
Transferred dv and hdv bidirectionally using pixer movie
Hope to have Osaka University President Miyahara tomorrow from Thailand!
Developed by PRIUS Students
Global Engagement Examples and Programs
SCIENCE
• GLEON
– Global Ecological Observatory Network
– Grassroots effort to understand lake dynamics
EDUCATION
• PRIME
– Pacific Rim Undergraduate Experiences
– Prepares globally-enabled workforce
• PRIUS
– Pacific Rim International UniverSity at Osaka University
– Prepares global workforce in context of curriculum
GRID
• PRAGMA
– Pacific Rim Application and Grid Middleware Assembly
– Catalyzes collaborations
SOFTWARE
• OptIPuter:
– Optical networking, Internet Protocol, computer storage,
processing and visualization technologies
– Develops technologies for data intensive computing and
collaborations
Source: Philip Papadopoulos – Talk to NSF about Global Engagement
3rd GLEON and CREON Joint Workshop
3-4 October 2006 Hsinchu
• Science:
– Qualitative explanation of
diel oxygen
– Understanding biological
and physical influences on
metabolism by modeling
– Publications
• Data Infrastructure:
– Metadata about lakes;
controlled vocabulary
• Students:
– Find funding
• Next Meeting: GLEON
– Finland, March 2-5 2007
PRIME: A Pilot Project for Global Engagement
PRIME Class 2006
• Built on top of PRAGMA people network and
activities for Undergraduate Research:
–
–
–
–
Summer Internship in a host country laboratory
Mentors in US and Abroad
Pre-/Post experience research opportunities
Cultural pre-/during-/post-activity awareness
component (use www.pacific.edu/culture)
– Professional development seminars
PRIME 2006 and Beyond
With President Miyahara Osaka U
Monash U in Melbourne
Melissa DiCiero-Monash
NCHC’s New Facility Taichung
Lao She Tea House
Challenges
for our
renewal
• Sustainability
• Enhancement of research, cultural
component, extended sites
• Transfer, assess, and disseminate
PRIUS Students 2006
Queensland University of Technology:
Raj Chhabra, Yohei Sawai, Junya Seo
Bioscience Portal
Nanyang Technological University (NTU),
Singapore: Francis Lee, Shingo Takeda,
Junwei Zhang Grid Security
National Center for High-performance
Computing: Seiki Kuwabara, Fang-Pang Lin,
Sun-In Lin, Yi-Haur Shiau, Jer-Huang Shiau
and Shi-Wei Lo Tile Display Walls
The PRAGMA Steering Committee
http://www.pragma-grid.net/steering_committee.htm
Working Groups:
Organize PRAGMA Efforts
• Resources and Data
– Mason Katz, SDSC
– Yoshio Tanaka, AIST
– Cindy Zheng, SDSC (testbed)
• Biological Sciences
– Karpjoo Jeong, Konkuk
U/KISTI
– Habibah Wahab, USM
– Raj Chhabra, QUT
– Wilfred Li, UCSD
• Telescience
– Shinji Shimojo, Osaka
– Fang-Pang Lin, NCHC
• GeoGrid, GEON (tentative)
– Ryosuke Nakamura, AIST
Some Members and Participants
Warning: Be wary of people with cameras
http://pragma-goc.rocksclusters.org/pragma-doc/org.html;
Resource Group Album: Total 85 Pictures – and another album
Annual Reports
•Prepare for SCxy
•Highlight Accomplishments
•Promote PRIME and PRIUS
•Describe Working Group Progress
•Summarize Individual Institution Contributions
•Give Additional Information, e.g. Publications, Sponsors
Highlights of 2006 - 2007
• Simulating the Australian Monsoon and the
Effect of Wildfires
• PRAGMA Biosciences Portal
• PRAGMA Leads Grid Interoperation
Experiments in GIN Testbed
• PRAGMA Establishes Certificate Authority (CA)
Using Naregi-CA Software
• Expanding the Collaboration Grid
• Building Communities, Catalyzing Collaborations
• PRIME and PRIUS
• More accomplishments in the Working Group
sections
Steering Committee Agenda
• Business Issues
– New Membership Applications: Thai National Grid
Center
– Workshop Applications: Proposal to host PRAGMA 15
(Fall 2008) in Penang Malaysia, by Universiti Sains
Malaysia
– PRAGMA Annual Report: Review and Approve
– SC’06 Schedule: Coordinate and Promote Activities
• Governance
– Steering Committee Composition
• Other
– PRAGMA Training / Research Institute
– HPDC and PRAGMA collaboration (Satoshi Matsuoka,
Carl Kesselman)
Investing in the Future of PRAGMA
Challenges and Opportunities
• Build the community
– Grow shared resources; Set research directions; Engage new
applications; Create new generation of researchers and
developers;
• Grow future leadership
– What leadership opportunities or challenges can we create?
• Focus on science we can enable
– Make routine use of testbed a reality
• Specific Challenges and Opportunities
– Working Groups
• What other activities should be highlighted in the Annual Report?
• What science accomplishment will you enable?
• What type of “PRAGMA Institute” would benefit your members?
– HPDC – an opportunity to focus on a topic and engage others –
similar to CCGrid activities
– How do we engage more students and postdocs?
Potential New Participants
to help address these challenges
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
Chinese University Hong Kong, Sammy Tang
Academic State University Research Center, Costa Rica, Jose Castro
University of Auckland, New Zealand, Paul Bonnington
BeSTGRID New Zealand, Neil Gemmell
National Institute of Information and Communications Technology, Asako
Toyoda, Akiyoshi Nishiura, Masayuki Shimada, Yamaguchi Megumi
Kyoto University, Yasuo Okabe
Senri International Information Institute, Ryuichi Shimizu, Keishi Kimura
Kyushu University, Koji Okamura
Hyogo College of Medicine, Seiichi Kato
High Energy Accelerator Research Organization (KEK), Go Iwai
National Applied Research Laboratory, Taiwan, Joe Juang, Guey-Shin
Chang, Cheyenne Chen
Disaster Prevention & Research Center, National Cheng-Kung
University,Taiwan, Min-Lang Huang
National Chung Hsing University, Ye-Nu Wan
Institute of High-Energy Physics - Beijing, Huaxiang Fan
University of Utah, representing Vietnam’s Grid Effort, Thanh Truong
Florida International University, Julio Ibarra and Kuldeep Kumar
The Enablers of the Workshop
•
•
•
•
NEC Corporation
SGI Japan Ltd.
Sun Microsystems
Nippon Telegraph and Telephone West
Corporation
• KDDI Corporation
• KDDI R&D Laboratories
• Foundry Networks, Inc.
Thanks to the Local Organizing
Committee
•
•
•
•
•
•
Shinji Shimojo
Susumu Date
Kazunori Nozaki
Tomomi Takeo
Kae Nakagawa
Many others
Welcome
Looking Forward to an
Exciting Meeting
And see the second floor