CrossGrid Testbed Node at
ACC CYFRONET AGH
Andrzej Ozieblo, Krzysztof Gawel, Marek Pogoda
5 Nov 2001
5 Nov 2001
CGW'01
Summary
•
•
•
•
•
What is ACC CYFRONET AGH?
Present and future of ACC
Why ACC Cyfronet for CrossGrid Testbed?
First installations
Next steps
5 Nov 2001
CGW'01
5 Nov 2001
CGW'01
What is ACC CYFRONET AGH?
• Established in 1973 as an independent, non-profit organization
• Since 1999 became a separate unit of the University of Mining
and Metallurgy in Krakow
• About 60 employees in several divisions
• Main goals are to provide to universities and research institutes
in Krakow:
– computer power combined with wide range of software
– communication infrastructure and network services
5 Nov 2001
CGW'01
LAN in ACC CYFRONET
MAN of Krakow
5 Nov 2001
CGW'01
Present and future of ACC Cyfronet AGH
Computers (parallel):
• SGI 2800 - 128 processors R10000 and R12000, 73.6 Gflops of
peak performance, 40 GB of operating memory, 190 GB of disk
storage
• HP S2000 - 16 processors PA 8000, 11.5 Gflops of peak
performance, 4 GB of operating memory, 45 GB od disk storage
• SPP1600/XA - 32 processors HP PA-RISC 7200, 7.68 Gflops of
peak performance, 2.5 GB of operating memory, 40 GB of disk
storage
• ???
5 Nov 2001
CGW'01
SGI 2800
5 Nov 2001
CGW'01
Hierarchical data storage system
HP K400 Server, with
UCFM 2.3 (UniTree)
software
Disk cache
Cyfronet LAN
Local access via
FTP and/or NFS
Data
migration
SCSI
Remote access via
FTP
Magnetooptical disks
library(HP)
Tape
libraries
(ATL)
Hierarchical data storage system - features
•
•
•
•
Automatic data migration to magneto-optical disks and tapes
Each file stored in two copies
trashcan - protection against accidental removal
capacities:
– disk cache: 110 GB
– M-O library: 660 GB
– tape libraries: 17 TB
• average file access time:
– M-O library: 12 s + 30s/100MB
– tape libraries: 3 min + 30s/100MB
5 Nov 2001
CGW'01
Present and future of ACC
Network:
• ACC Cyfronet is the leading unit for the Krakow’s MAN:
– main network node in soutern Poland
– designer and owner of the fiber-optic infrastructure within the city
(links several dozen institutions; approximately 70 km long; ATM
and/or FDDI standard)
• Provides access to interurban and international connections over
three WANs (wide area networks): Ebone (3 Mb/s), POLPAK-T (5
Mb/s) and POL-34 (155 Mb/s)
• POL-34 (ATM standard) 155 Mb/s --> 622 Mb/s soon
5 Nov 2001
CGW'01
5 Nov 2001
CGW'01
Present and future of ACC
Network:
• Future is PIONIER (Polish Optical Internet) - high-speed
academic network in Poland with its own fiber-optic structure;
should be ready in two years
• Supercomputing center PSNC in Poznan has already access to
GEANT - Gigabit (2.4 Gb/s) Europeen Academic NeTwork
5 Nov 2001
CGW'01
Why ACC Cyfronet for CrossGrid Testbed?
• Good infrastructure: computer and network resources
• High-speed connection with other testbed centers in Europe
5 Nov 2001
CGW'01
First installations
• PC Linux cluster (8 processors + switch at the beginning) with a
simple disk storage system
• Switch: at least 8 FastEthernet ports + 1 GigabitEthernet
– e.g. BATM 48 FastEthernet + 2 GigabitEthernet, price: ~7500$
– e.g. BATM 24 FastEthernet + 1 GigabitEthernet, price: ~4000$
• Software installation (Globus, middle-ware, etc.)
5 Nov 2001
CGW'01
Further plans
• Real-time calculations for HEP experiments (future LHC
accelerator in CERN)
– data transfer speed of 1.5 Gb/s is needed.
– GigabitEthernet port for our Cisco Catalyst 8540 (connection with
POL-34 network); price: ~17000$;
not necessary at the first stage
• Heterogeneous CrossGrid node:
– including small number (e.g. 8) processors of SGI2800 by using
miser or mpset programs offered by IRIX 6.5
– incorporating our hierarchical storage system UniTree + ATL
5 Nov 2001
CGW'01