G-monitor: A Gridbus Web Portal for Monitoring and Steering Application Execution on Global Grids WW Grid Martin Placek and Rajkumar Buyya Grid Computing and Distributed Systems (GRIDS) Lab. Dept. of Computer Science and Software Engineering The University of Melbourne http://www.gridbus.org G-Monitor 2 Introduction Architecture Implementation Notes Gmonitor Snapshots Conclusion Introduction Functionality/Requirements Experiment Management and Control Broker QoS Experiment status 3 Job control Job status Resources status Run from anywhere Architecture - System Grid Nodes Web Browser (clients) Web Servers (G-monitor) Nimrod-G and Gridbus Servers Grid Nodes Grid Nodes Grid Broker 4 Grid Service Providers (GSP) Architecture - Gmonitor Web client Web Server Apache mod: CGI mod..... Perl scripts (G-monitor) Nimrod-G and Gridbus Server 5 Implementation Technologies Issues 6 Apache Web Server (CGI) Perl JavaScript Nimrod-G Protocol Timezones issue, as webclient, webserver and nimrod server can all be in different Timezones! (Fix:UTC) Scalability - Handles large scale experiments (1000’s of Jobs,100’s of Resources.) G-monitor Usage: HPC Challenge Demo @ SC 2002 Australia North America GMonitor MEG Visualisation Melbourne+Monash U: ANL: SGI/Sun/SP2 NCSA: Cluster Wisc: PC/cluster NRC, Canada Many others Gridbus+ Nimrod-G VPAC, Physics Solaris WS @ SC 2002/Baltimore Europe Grid Market Directory Asia AIST, Japan: Solaris Cluster Osaka University: Cluster Doshia: Linux cluster Korea: Linux cluster 7 WW Grid Internet ZIB: T3E/Onyx AEI: Onyx CNR: Cluster CUNI/CZ: Onyx Pozman: SGI/SP2 Vrije U: Cluster Cardiff: Sun E6500 Portsmouth: Linux PC Manchester: O3K Cambridge: SGI Many others G-monitor - Login 8 G-monitor - QoS 9 Deadline Budget Optimisation Algorithm Start/Stop Experiment G-monitor - QoS 10 G-monitor - Job Status & Resource Status 11 Job execution status Further Attributes Job Control Resource Availability Resource Cost (G$) G-monitor - Job Status 12 G-monitor - Resource Status 13 G-monitor - Experiment Status Deadline (Assigned/Spent/Remaining) Budget Job Status Summary Host Status Summary 14 Jobs Completed/Jobs Assigned G-monitor - Experiment Status 15 Conclusion G-Monitor Web based implementation Scalable and places low overhead on the network Try it and Download from http://www.gridbus.org/ Future Work 16 provides easy to use and ubiquitous interace to the Grid. Easy to setup. Integrate G-monitor into a HTML framework (Eg. WebGUI) Integrate further job/experiment statistics. Integrate further job/experiment control.