MCNC Grid Computing and
Networking Services (GCNS)
Western Carolina University
North Carolina Statewide Grid
John Killebrew
Director - NCREN
GCNS UNIVERSE
Universities UNC-OP
RENCI
Internet2
DukeNet
SURA
Services and Relationships
NLR
General
Assembly
MCNC
GCNS
ERCWC
SERNet
e-NC
RTI RDI
ITS
WinstonNet
Industry
NCREN Video Services
MCNC GCNS
• Broadcast quality interactive video conferencing
• 20 sites continuous presence audio and video
• Full bridging interoperability among
Broadcast Quality video sites
H.320 private line sites
H.320 dial (ISDN) sites
H.323 Video-over-IP sites
MPEG2 Video-over-IP sites
• Live monitoring of all scheduled
Conferences
• Satellite Links
•Downlinks for any/all campuses
•Uplinks via Microspace from any/all
campuses
MCNC Network Access and Services
•
Direct Access to
NCREN
– Internet2 (Abilene)
– Research networks (NLR, NCNI)
– National Labs
– NC Grid, MCNC Enterprise Grid
–
•
Grid and Data Center Offerings
Co-location hosting services
– Managed hosting services
– Managed WAN hosting
– Use of Grid Compute & Data resources
– NEW! Grid Technology Evaluation Cntr
• benchmarking, interoperability,
integration, and training
–
What is a Grid ?
I don’t know, but…
“Context, Not Products, Defines Grid
Computing”
Gartner, 2004
“Resource sharing & coordinated problem solving in
dynamic, multi-institutional virtual organizations”
Ian Foster & Carl Kesselman, 2002
This is a Grid !
An IT Utility
A Grid Middleware (the glue)
And Networked Distributed
Resources
The North Carolina Economy Challenge
Employment by North American Industry Classification System (NAICS)
850000
800000
750000
700000
650000
600000
Manufacturing
550000
Information, Financial
Activities, Professional
and Business Services
500000
450000
400000
1991
1992
1993
1994
1995
1996
1997
1998
1999
2000
Source: The Employment Security Commission of NC, Labor Market Information
2001
2002
Grid Benefits
Department, Enterprise, and Global Grids
•
•
•
•
•
•
•
•
•
Access: transparent, remote, secure, wireless
Sharing: enable collaboration over the network
Failover:
migrate/restart applications automatically
On Demand: get resources, when you need them
Productivity: more work done in shorter time
Virtualization: access compute services, not servers
Heterogeneity: platforms, OSs, devices, software
Resource Utilization: increase from 20% to 80+%
Virtual Organizations: build & dismantle on the fly
Grid Computing: Competitive Advantage for N.C.
•
Education, Research,
Government, Industry
•
•
•
•
•
•
•
•
•
Reduce IT costs
Access disparate data across multiple domains
Enhance Education, R&D and Business processes
Create innovative products and services
Reduce design time and time to market
Increase quality (reduce defects)
Accelerate product development (e.g. drugs)
Rapidly process and solve problems
beyond an individual organization's capacity
Leverage very powerful but inexpensive
networked resources
Connect and share computing resources
seamlessly - regardless of system type or
physical location
Technology
However, There is Still a Long Way to Go !
 Grids are over-hyped: currently, they promise much more
than they can really offer.
 Grid technology is far from mature and complete.
 Grid standards are (mostly) still missing.
 Grids are very complex IT infrastructures.
 Grids bring new challenges: sharing resources, loosing
direct control, security, intellectual property, legal, social,
political issues . . .
Therefore, MCNC - GCNS !
Our Foundation for Grid: NCREN
Internet
Internet 4-7 MCNC-owned Clusters
2
distributed throughout the state
NLR Locations still under evaluation
Cisco
Interne
t
Existing: Blend of owned and leased fiber and circuits moving
toward resilient rings powered by Cisco routers
Planned: Strong focus on owned and leased fiber, Lambda, and
few circuits, in resilient rings powered by Cisco routers and Wave
Division Multiplexers
EPA
The Grid
The next IT Infrastructure of North Carolina
• Proving ground for Grid
• Successful prototype apps
• Catalyst for collaboration
• International recognition
NC BioGrid
2002
2003
2004
2005
The Grid
The next IT Infrastructure of North Carolina
• Cluster and SMP resources
• Research platform for GTEC
• Core component in NCGrid
• Revenue generation
MCNC Enterprise Grid
NC BioGrid
2002
2003
2004
2005
The Grid
The next IT Infrastructure of North Carolina
• State-wide partnership
• Leverage lessons learned
• Grid education & training resource
• Enable first mover applications
NC Grid Initiative
MCNC Enterprise Grid
NC BioGrid
2002
2003
2004
2005
MCNC &
The Grid Infrastructure
for North Carolina
NC Statewide Grid Initiative
MCNC Enterprise Grid
MCNC
NC BioGrid
NCREN
North Carolina Research & Education Network
Microelectronics Center of North Carolina
- Founded in 1980
- Independent, private, non-profit organization
- Operates NCREN since 1984
- Past: Supercomputer Center for universities
- Now: Grid Service Provider, offering Video,
Network, Grid, and Datacenter Services
- 50+ employees
MCNC-GCNS Roadmap
Grid Service Provider
Easy Access
Awareness Creation
Our Vision :
The Three Waves of Grid Computing
The Research Wave
Technology, Prototypes
Virtual Organizations
Standards
GGF, IETF, OASIS
GCNS: “Awareness Creation”
The Industry Wave
Grid-Enabled Products
Enterprise Solutions
Interoperability
GGF, EGA, IETF, OASIS
GCNS: “Easy Access”
Commodity
IT Utility
Integration
Legal, Ethical, Political Orgs
GCNS: “Grid Service Provider”
The Consumer Wave
GCNS Mission
Advance education, innovation and economic development
throughout North Carolina
by delivering next generation information technology
that enables the academic, research, government and
business communities
to discover, create, share and apply knowledge.
Higher Education Grid Constituencies
•
Chancellors/Presidents: University Outreach
•
CIO’s: Providing and running IT infrastructure
•
CRO’s, Deans, Key faculty: Education and Research
•
Students
Chancellors/Presidents
•
Play key important role in NC further education and
economic development
•
Improve global competitive position of NC universities
•
Offer the best infrastructure for research and education
•
Become early part and active participant in the next-gen
Advanced Internet
CIO’s
•
Offer service-oriented IT architecture (hide complexity)
•
Enable much more efficient resource management
•
Balance resource utilization within and across Campuses
CRO’s, Deans, Key Faculty
•
Offer and use larger and richer set of resources
•
Develop, provide, and use more powerful tools for joint
research collaborations
•
Enable researchers to concentrate on research (and not on
the resources)
Core Strategy Components
•
•
•
•
•
•
•
•
Briefing key constituencies about Grid Computing
Train key IT and research staff
Develop joint Graduate/PhD program
Build and use NC Grid as foundation (think globally, start
locally)
Grid-enable existing resources and join the NC Grid
Offer training to users to grid-enable applications
Work with users to port applications to the NC Grid
Start QuadA project with partners
Grid Technology Evaluation Center
The Epicenter for Accelerating Grid Adoption
Influential Network
of Key-Players
From Innovation
to Deployment
Socio-Economical
Mission
Joint BizDev, PR
& Marketing
Independent Lab:
Eval & Testing
Grid Training
& Education
Customer Briefing
Center
So, are there really any working Grids out there?
• Yes!….
In North Carolina even…
+ Wachovia
+ NC BioGrid
+ SCOOP
+ EPA
NC BioGrid
One of the nation’s first grid test beds for computing, data
storage and networking resources for life sciences research
Established to research and implement new grid computing technologies
that will enable researchers and educators throughout North Carolina
to take full advantage of the genomic revolution
•
Installed
in Summer 2002, heterogeneous
.
hardware and OS platforms
•
More than 80 organizations
•
Dedicated systems for testing grid
middleware and developing grid
applications for bioinformatics
•
Spans multiple administrative domains
with systems located at MCNC, NC State,
UNC-CH & Duke
•
Established a Certificate Authority
SURA SCOOP South-eastern
Coastal Ocean Observing Program
The Challenge:
- More than half of the nation's tidal shores home to 80 million people
- coastal zone is undergoing environmental and ecological changes
- threaten the sustainability of the region's economies and marine resources
The Solution:
- develop a Grid of sensors and linked computers
- fully integrating several observing systems in the southern region
- provide data, in real-time and at high speed, for more reliable, accurate and timely information
To help guide effective coastal stewardship, plan for extreme events,
facilitate safe maritime operations, and support coastal military security.
•
And, how about other states?
•
Grid Development efforts announced in
• Colorado
• West Virginia
• Louisiana
• Texas
• Virginia
Plus….the following are also working….
Access Grid
for Education and Training
•
Builds on our proven and advanced video
infrastructure
•
Utilizes Multicast Backbone
•
Real time, continuous presence audio, video,
data
•
Purpose-built sites encourage natural, seamless
interaction
–
•
Desktop implementation available
H.323
Multi-Platform: including Win X, Linux/Unix
–
Mac OS X support coming soon
H.320
Voice & Video Over IP (V2oIP), Ubiquitous
352 x 288 @ 128 kbps - 2 Mbps, Multipoint
capable
Multipoint via third-party
MPEG-2
720 x 480 @ 5.5 Mbps NCREN Video Network
supports multipoint
Earth System Grid
Goal: address
technical
obstacles to the
sharing &
analysis of
high-volume
data from
advanced earth
system models
Network for Earthquake Eng. Simulation
Remote Users
(Faculty,
Students,
Practitioners)
Instrumented
Structures
and Sites
Simulation
Tools
Repository
Laboratory
Equipment
Field Equipment
Curated Data
Repository
Leading Edge
Computation
Global
Connections
Remote Users:
www.neesgrid.org
Laboratory Equipment
(K-12 Faculty and
Students)
Butterfly.net:
Enterprise Optimization
•
•
•
•
•
•
A scalable, resilient infrastructure for
creating & running massive
multiplayer games
Developers avoid upfront costs
Improved end-user experience
Demonstrated 8x increase in
profitability over centralized model
Dynamic provisioning & on demand
capacity
Uses Globus Toolkit & runs on IBM
Global Services hosting environment
•
Metropolitan Grid across the Universities
•
Stable, well-managed HPC resources
•
Supporting multi-disiplinary research
• And
local industries (e.g. Rolls Royce)
Slides: Courtesy James Coomer
Grid Collaboration MCNC - Universities
1+1=3
Common
Interests
Grid Computing
Higher Education
Economic Development
Thought Leadership
Universities
Top Research
Education
Vertical Applications
Middleware
MCNC
Deployment
Infrastructure
Horizontal
Complementary Focus
Time Machines
The Innovation Engine
Thank You !
jtk@mcnc.org
http://www.mcnc.org
GCNS Enterprise Grid
Avaki
Data
Grid
Global Grid
Resource DB
(GIIS)
Users
Campus Grids
Data Grid Access Servers
(8 total, i.e. 1 per 8 nodes)
Grid Gatekeeper / Interactive Nodes
LSF Master Job Scheduler
32-CPU SGI Altix
Linux SMP Server
128-CPU IBM Linux
Cluster (64 nodes)
8-TB Storage
Network, Grid and Data Center Services
GTEC, NLR, ANR and other Innovation Initiatives
DEPLOYMENT
Self-serve
Data Center
Services
Value-add
Information
Systems
Services
Hosting & Infrastructure
Enterprise
Grid
Services
State-wide
Grid
Services
Grid Computing
DATA CENTER
NCREN
Data
Archival
Services
Information
Security
Services
Information Assurance
Co-location Services
•
GCNS supplies server cabinets
–
–
–
–
–
•
19” EIA, 42-RU, 4-post APC-brand enclosures
Perforated, lockable doors
84” high x 24” wide x 40” deep
Additional APC cabinet accessories available
$1,200 per cabinet one-time setup fee
Base monthly rate of $500* per cabinet
–
–
–
–
–
Includes two 20-Amp, 110-VAC power circuits
One 100-Mbps network uplink
Four public IP addresses
30-day average network utilization of up to 0.5-Mbps
• Additional network utilization options are available
*20% discount available for educational customers
Data Mirroring and Archival
Virtual Filers
Customer 1
Grid
Users
Data
Grid
Interface
Customer 2
Linux
Servers
NetApp
SnapVault
NCREN
Customer 3
NetApp
Servers
NetApp
SnapMirror
Customer 4
NetApp
Servers
NetApp
SnapMirror
Network Appliance
R200 Nearstore Filer
8-TB initially
(scales up to 96-TB)
Duke (GbE)
NCREN
NCSU (GbE)
NCCU
RTP
Raleigh
7609
7609
Level3 (GbE)
Qwest Internet (Oc12 PoS)
Abilene (Internet2 OC48 PoS)
Greenville
Greensboro
UNC-CH (GbE)
ECU
ECSU
CMST
UNC-G
NCAT
ASU
Winston-Salem
OC48 SRP Ring
counter-rotating ring
<=50ms reroute
Fully active redundancy
WFU
WSSU
NCSA
Fayetteville
FSU
UNCP
OC12 SRP Ring
Hickory
counter-rotating ring
<=50ms reroute
Fully active redundancy
UNC-C
Charlotte
Wilmington
UNCW
Asheville
UNCA
WCU
ERC
OC12 SRP Ring
counter-rotating ring
<=50ms reroute
Fully active redundancy
Qwest (OC12 PoS)
Level3 (GbE)
Greenville
GTEC Projects Driving Grid Adoption
MCNC Grid SP
Grid ColLab
Kids Grids
Gaming Grid
School Grids
Grid-Info Grid
Download-The-Grid
AAAA Project
Grid Training Courses
Startup Grid
Grid Appliance
Grid Portal
GGF & EGA
NC Statewide Grid
MCNC Enterprise Grid
NC BioGrid
MCNC Supercomputing
2000
20004
2008
MCNC: 3-Year GCNS Grid Roadmap
Grid Service Provider:
Awareness Creation:
Network, Computing, Data, Video
Partner with SC Sites
Build GTEC Service Portfolio
Start Grid Consulting
Easy Access:
Annual GSP Workshop
Training, Web Courses
Access Grid Node
Grid Appliance
QuadA
Conferences, Workshops, PR
MCNC Enterprise Grid
NC BioGrid
NC Statewide Grid
CY03
CY04
CY05
CY06