outline

advertisement

Grid Computing

Fall 2004

Tuesday/Thursday 2:00 pm - 3:15 pm

Instructors

Dr. Barry Wilkinson

Western Carolina University and

Dr. Clayton Ferner

University of North Carolina at Wilmington

Grid Computing, B. Wilkinson, 2004 outline.1

Grid Computing, B. Wilkinson, 2004

Outline

outline.2

Grid Computing

• Using usually geographically distributed and interconnected computers together for high performance computing and/or for resource sharing.

Notice “usually”, “and/or” - many definitions of grid computing and applications.

Grid Computing, B. Wilkinson, 2004 outline.3

The interconnection now “usually” made through the Internet to multiple administrative domains.

Resource sharing - can involve a geographically distributed team ( virtual organization ) and resources in addition to computers (software, experimental equipment etc.)

Grid Computing, B. Wilkinson, 2004 outline.4

“The grid virtualizes heterogeneous geographically disperse resources”

From "Introduction to Grid Computing with Globus," IBM Redbooks

Grid Computing, B. Wilkinson, 2004 outline.5

Course credit

This course can be taken by students at any university connected to the NCREN for credit at their institution.

Listed as an undergraduate course but could be taken for graduate credit with my approval (and your institution).

Graduate students can expect more demanding work.

Grid Computing, B. Wilkinson, 2004 outline.6

Class schedule

Each university has its own class schedule.

Classes will start on August 26th, 2004 (WCU's start date).

Last class presentation will be on Thursday December 2nd,

2004.

No class on Thursday October 14th, 2004 (WCU Fall break).

It will be necessary for students at sites with breaks that do not coincide with WCU's breaks to watch recordings of classes later.

Final exams will be scheduled according to the local schedule.

Grid Computing, B. Wilkinson, 2004 outline.7

Prerequisites

• Preferably programming skills in Java on a Linux system.

• Some later work may also involve

C/C++ programming.

Grid Computing, B. Wilkinson, 2004 outline.8

Topics

• Introduction to grid computing

• Web services

• Grid services

• Security, Public Key Infrastructure

• Open Grid Services Architecture (OGSA)

• Globus 3.2

• Condor-G

• MPI and grid enabled MPI

• UNC-W GUI and grid computing applications

Grid Computing, B. Wilkinson, 2004 outline.9

Assignments and Grading

• 6 “simple” pre-written programming assignments (tasks)

– web services

– grid services

– Globus job

– Condor job

– MPI-G2 job

– Using UNC-W GUI

• Additional programming assignment/project

• Class tests (2)

• Final test

Small print: Subject to change. The instructor reserves the right to change the assignments and the grading to make it easier or harder.

Grid Computing, B. Wilkinson, 2004

45%

15%

25%

15% outline.10

“Simple” Prewritten Programming

Assignments

• Detailed instructions provided on achieving a task

(creating a web service, grid service, etc.,)

• Simply follow instructions.

• At end, asked to extend the work - e.g. add functionality to a service.

These assignments require specific distributed computing software available either locally, or through remote access to WCU.

Grid Computing, B. Wilkinson, 2004 outline.11

Grid computing

Weeks 1 - 3 (tentative)

Virtual organizations, computational grid projects, grid computing networks, TeraGrid, grid projects in the US and around the world, grid challenges

Internet Technologies IP addresses, HTTP, URL, HTTP, XML, Telnet,

FTP, SSL

Web Services I.

Service-Oriented Architecture (SOA), service registry, XML documents, XML schema, namespaces, SOAP, XML/SOAP examples,

Axis

Web Services II.

WSDL, portType, message definition, WSDL to/from code

Assignment 1

Grid Computing, B. Wilkinson, 2004

"Simple" Web service Java programming assignment. Tomcat environment, axis, JWS facility outline.12

Grid Service

Assignment 2

Weeks 3 - 4 (tentative)

Concepts, differences to Web services, stateful/stateless/transient/non-transient,

Open Grid Services Architecture (OGSA),

OGSI, grid service factory, Web Services

Resource Framework (WSRF)

"Simple" grid service Java programming assignment. Globus 3.2 environment.Tools: ant

Grid Computing, B. Wilkinson, 2004 outline.13

Security

Globus: Part 1

Globus: Part II

Assignment 3

Grid Computing, B. Wilkinson, 2004

Weeks 4 - 6 (tentative)

Secure connection, authorization requirements, symmetric and asymmetric

(public/private) key cryptography, nonrepudiation, digital signatures, certificates, certificate authorities, X509 certificate

Basic structure (version 3.2), grid service container, service browser, Globus Resource

Allocation Manager (GRAM), job submission with managed-job-globusrun, Grid Security

Infrastructure (GSI), Globus certificates, simpleCA, proxies, creating a proxy

Resource management, Master Managed Job

Factory Service (MMJFS), more on managedjob-globusrun. Resource Specification

Language (RSL and RSL-2), syntax and examples in RSL and RSl-2

Submitting a Job to the Grid, GT3 mangagedjob-globusrun, job specified in RSL-2 (XML file) outline.14

Globus: Part III

Schedulers and resource brokers

Assignment 4

Weeks 6 - 7 (tentative)

Information Directory Services, LDAP, resource discovery

Condor, submit description file,

DAGMan, Checkpointing, ClassAd, Condor-

G, other systems

Submitting a Condor-G Job

Grid Computing, B. Wilkinson, 2004 outline.15

High performance computing (HPF)

Weeks 7 - 8 (tentative)

Grand challenge problems, parallel computing, potential speed-up, types of parallel computers, shared memory multiprocessors, programming, messagepassing multicomputers

Parallel Programming Techniques suitable for a Grid, embarrassingly parallel computations, Monte

Carlo, parameter studies, sample "big" problems, gravitational N-body problem

Cluster Computing

Grid Computing, B. Wilkinson, 2004

Basic message passing techniques, History,

Beowulf clusters, system software, programming models (MPMD, SPMD), synchronous message passing, asynchronous message passing, message tags, collective routines outline.16

MPI

Grid-enabled MPI

Assignment 5

Weeks 8 - 9 (tentative)

Process creation, communicators, unsafe message passing, point-to-point messagepassing, blocking, non-blocking, communication modes, collective communication, running an MPI program on a cluster

MPI-G2 internals, mpirun command, RSL script

Running a simple MPI-G2 program

Grid Computing, B. Wilkinson, 2004 outline.17

Weeks 10 to 15

Grid portals

UNC-W GUI, Assignment 6

UNC-W applications Scientific, business

Guest Speaker

Grid Computing, B. Wilkinson, 2004 outline.18

Instructor details

Barry Wilkinson

Department of Mathematics and Computer Science

Western Carolina University

Home page: http://www.cs.wcu.edu/~abw

Email: wilkinson@email.wcu.edu

Tele: (828) 227 3944

Office Hours

Tuesday/Thursday 11:00 am - 12:00 pm, 3:30 pm - 5:00 pm

Grid Computing, B. Wilkinson, 2004 outline.19

Course Home Page

http://www.cs.wcu.edu/~abw/CS493F04 for announcements, slides, assignments, reading materials, tests dates, etc.

Visit regularly.

Grid Computing, B. Wilkinson, 2004 outline.20

Grid Computing, B. Wilkinson, 2004 outline.21

Grid Computing, B. Wilkinson, 2004 outline.22

Grid Computing, B. Wilkinson, 2004 outline.23

Grid Computing, B. Wilkinson, 2004 outline.24

Course Text

• There is no assigned course textbook

• Materials and links are provided on the home page.

Grid Computing, B. Wilkinson, 2004 outline.25

Class Expectations

• Understand Queen’s English (the language of instruction). Verbal skills not necessary.

• Print out slides before class, read them, and annotate them during class.

• Read key papers and other materials provided.

• Ask questions during class and participate in class discussion.

Grid Computing, B. Wilkinson, 2004 outline.26

Acknowledgements

This course is a team effort of:

M ountain

A rea

G rid

I nnovation

C ollaborative

(MAGIC)

Faculty: Barry Wilkinson, Mark Holliday, David Luginbuhl

Students (Wizards): Sam Daoud, Jeffrey House, Chris

Johnson http://www.cs.wcu.edu/~abw/MAGIC and:

University of North Carolina at Wilmington

Grid Computing, B. Wilkinson, 2004 outline.27

Grid Computing, B. Wilkinson, 2004 outline.28

Acknowledgements

Partial support for this work was provided by the National Science Foundation’s Course,

Curriculum, and Laboratory Improvement program under grant 0410667 and by

University of North Carolina, Office of the

President.

MAGIC gratefully acknowledges their support.

Grid Computing, B. Wilkinson, 2004 outline.29

Download