SHARCNET TASP Report 2005-2006 C3 TASP Meeting/HPCS 2006 Memorial University, St John’s Newfoundland, 2006.05.14 TASP Meeting 20th Int’l Symposium on High Performance Computer and Systems St John’s, Newfoundland May 14, 2006 Outline About SHARCNET Resources and Usage Accessibility HPC Research Highlights Staffing HPC Activities Future Development Open Questions Copyright © 2006 Ge Baolai Ge Baolai David McCaughan Doug Roberts Jemmy Hu Sergey Mashchenko Thomas Hu C3 TASP Meeting/HPCS 2006 Memorial University, St John’s Newfoundland, 2006.05.14 SHARCNET Lakehead University Laurentian University Trent University York University University of Ontario Institute of Technology Ontario College of Art and Design Sheridan College McMaster University University of Guelph University of Waterloo Perimeter Institute Wilrid Laurier University Brock University University of Western Ontario Fanshawe College University of Windsor Copyright © 2006 Ge Baolai C3 TASP Meeting/HPCS 2006 Memorial University, St John’s Newfoundland, 2006.05.14 Resources Resources at A Glance Throughput Cluster ~3000c Utility Cluster ~1000c UOIT York UoG SMP Cluster ~500c SMP ~128c UW SC Capability Cluster ~1500c WLU GridLab UWO MAC FC Storage ~200TB UoW Copyright © 2006 Ge Baolai BU C3 TASP Meeting/HPCS 2006 Memorial University, St John’s Newfoundland, 2006.05.14 Resource… Resource Information Online Name bull cat coral goblin greatwhite idra narwhal requin silky tiger1 typhon whale wobbe Type cluster cluster cluster cluster cluster cluster cluster cluster SMP cluster SMP cluster cluster Total Copyright © 2006 Ge Baolai Make hp generic hp Sun Compaq Compaq hp hp SGI Compaq Compaq Compaq hp CPU Type Opteron Xeon, Opteron Itanium2 Opteron Alpha Alpha Opteron Opteron Itanium2 Alpha Alpha Opteron Opteron CPUs 384 162 64 56 388 128 1068 1536 128 8 16 3076 208 7218 Interconect Quadrics GigE Quadrics GigE Quadrics Quadrics Myrinet Quadrics NUMA GigE Compaq GigE Myrinet OS XC 3.0 Red Hat 8.0 XC 3.0 Fedora Core 4 Red Hat 7.2 Tru64 XC 3.0 XC 3.0 Linux 2.4 Red Hat 7.2 Tru64 XC 3.0 Fedora Core 3 C3 TASP Meeting/HPCS 2006 Memorial University, St John’s Newfoundland, 2006.05.14 Statistics User base Copyright © 2006 Ge Baolai C3 TASP Meeting/HPCS 2006 Memorial University, St John’s Newfoundland, 2006.05.14 Statistics… Users by Institutions Copyright © 2006 Ge Baolai C3 TASP Meeting/HPCS 2006 Memorial University, St John’s Newfoundland, 2006.05.14 Statistics… Cumulative CPU usage Copyright © 2006 Ge Baolai C3 TASP Meeting/HPCS 2006 Memorial University, St John’s Newfoundland, 2006.05.14 Statistics… Cumulative jobs Copyright © 2006 Ge Baolai C3 TASP Meeting/HPCS 2006 Memorial University, St John’s Newfoundland, 2006.05.14 Accessibility Same home accounts accessible from anywhere across all systems. Unified software environment across all systems. User info in sophisticated database: accounts, contact, projects, publications, problem tracking, etc. Web – a source for resources, usage, help info and events. Web portal – a gateway to internal information: user profile, system usage, job status, statistics and online problem tracking system. Copyright © 2006 Ge Baolai C3 TASP Meeting/HPCS 2006 Memorial University, St John’s Newfoundland, 2006.05.14 HPC Highlights Computational Chemistry Material Science Financial Modelling Social Science Catastrophic Event Prevention Simulation …… Copyright © 2006 Ge Baolai C3 TASP Meeting/HPCS 2006 Memorial University, St John’s Newfoundland, 2006.05.14 Staffing Now 11 + ½ people. 4 + ½ HPTC analysts, 5 + ½ system administrators. 1 technical manager. Everyone is truly multitasking: – – – – user research computing support. system tool development, database, web programming. giving lectures, workshops. organizing conferences and workshops, event, budget planning, inviting external speakers, seeking financial support from sponsors, handling online registration with e-commerce, etc. – public communication – …… Copyright © 2006 Ge Baolai C3 TASP Meeting/HPCS 2006 Memorial University, St John’s Newfoundland, 2006.05.14 HPC Activities Renovations, deployment and testing of new systems. Training courses and workshops. Organizational and inter-organizational symposiums. – – – – HPCS ’05 in Guelph. SHARCNET-HPCVL joint symposium in Toronto. SHARCNET annual fall workshop/symposium at York University. Various workshops, lectures… Consultations, long term research projects. Copyright © 2006 Ge Baolai C3 TASP Meeting/HPCS 2006 Memorial University, St John’s Newfoundland, 2006.05.14 Copyright © 2006 Ge Baolai C3 TASP Meeting/HPCS 2006 Memorial University, St John’s Newfoundland, 2006.05.14 Copyright © 2006 Ge Baolai C3 TASP Meeting/HPCS 2006 Memorial University, St John’s Newfoundland, 2006.05.14 Copyright © 2006 Ge Baolai C3 TASP Meeting/HPCS 2006 Memorial University, St John’s Newfoundland, 2006.05.14 Copyright © 2006 Ge Baolai C3 TASP Meeting/HPCS 2006 Memorial University, St John’s Newfoundland, 2006.05.14 Copyright © 2006 Ge Baolai C3 TASP Meeting/HPCS 2006 Memorial University, St John’s Newfoundland, 2006.05.14 Copyright © 2006 Ge Baolai C3 TASP Meeting/HPCS 2006 Memorial University, St John’s Newfoundland, 2006.05.14 Copyright © 2006 Ge Baolai C3 TASP Meeting/HPCS 2006 Memorial University, St John’s Newfoundland, 2006.05.14 Copyright © 2006 Ge Baolai C3 TASP Meeting/HPCS 2006 Memorial University, St John’s Newfoundland, 2006.05.14 Copyright © 2006 Ge Baolai C3 TASP Meeting/HPCS 2006 Memorial University, St John’s Newfoundland, 2006.05.14 Copyright © 2006 Ge Baolai C3 TASP Meeting/HPCS 2006 Memorial University, St John’s Newfoundland, 2006.05.14 Copyright © 2006 Ge Baolai C3 TASP Meeting/HPCS 2006 Memorial University, St John’s Newfoundland, 2006.05.14 Copyright © 2006 Ge Baolai C3 TASP Meeting/HPCS 2006 Memorial University, St John’s Newfoundland, 2006.05.14 Future Development AccessGrid. Multicluster scheduling. HPC support software development. Training and education: Certification Program Copyright © 2006 Ge Baolai C3 TASP Meeting/HPCS 2006 Memorial University, St John’s Newfoundland, 2006.05.14 Issues, Open Questions People money. Queuing policies, user job priority, frustrations. Copyright © 2006 Ge Baolai