Intro Agent Grid Repast Simulator

advertisement
Intro Agent Grid Repast Simulator
-
Fills the gap on agent-based Grid simulators
-
-
very high-level Grid Model
but provides validated Network & Resource model
focus on Agents and not technical Grid issues
leverages Repast tools for visualization & analysis
Will focus on community (sourceforge project)
to enhance the tool
Isaac Chao Andrade, Politechnical University of Catalonia
Agents and Grids: towards the intelligent grid
Edinburgh, 19 February, 07
www.thinkingrid.com
Agent Grid simulator, why?

Think in Grid startup (Barcelona) targets



Pervasive Grid (…. + Smartphones, PSP, etc)
Social Communities around Grid
Requirement:



Adaptive, scalable, Grid coordination mechanisms
… then use MAS, but need extensive testing
… then need Agent Grid simulator
State of the Art Grid Simulators

Too low level, too much Grid technical detail




Gridify app in jobs, scheduling techniques
Model resources CPU (MFLOPs, etc)
Model Network packet routing….
Complex from a MAS point of view

Focus for most IA researchers might be instead



Decision making
Grid coordination
No support for easy MAS development & analysis
Two well known Grid Simulators

GridSim (GRIDS Lab,University of Melbourne )




too low level model : network packet routing
poor doc: no user manual, just code examples
no validation: need contrasting to a real system!
SimGrid (ID Laboratory, Grenoble,France)



High level & validated Network/Resource model
Too focused on Grid scheduling low level details
C/based (hard to combine with Java tools)
Agent Grid Repast Simulator (I)

Built on top of Repast:



Relies on a very well tested simulation engine
Leverages excellent Repast tools for visualization & analysis
Provides:




Grid Resource and Network model, inspired on SimGrid validated
high level models
submission of jobs and data transfers into the Grid and the operation of
the Grid itself
agents controlling the scheduling/load balancing
Graphical display of the Grid and related Grid statistics by leveraging
Repast facilities
Agent Grid Repast Simulator (II)

Goes to open-source, released GPL at
sourceforge:




Enhance the Resource and Network Models
Add features to the agent framework
Towards a tool for the specific community
meeting Agent and Grid systems
The Demo:
The gory details I: Resource Model

Grid Nodes (extending repast DefaultNodes)
modeling Job processing at Grid Resources

Model coming from SimGrid high-level models:



Each CPU is defined by a rate that can vary over time and
that is equally shared between tasks
“validated" this model by running instances of the same
program , doing a dgemm (matrix multiply routine)
We add

background load, availability
The gory details II: Network model

Grid Edges (extending repast DefaultEdge)
modelling the data Transfers over the links using an
underlying physical NetworkModel.

Proportional bandwidth sharing: OK for LAN



From paper: Network Modeling Issues for Grid Application
Scheduling H. Casanova, in the International Journal of
Foundations of Computer Science (IJFCS), 6(2), 145--162,
2005 ( SimGrid people)
+ background traffic and availability
Needs to be extended for TCP in WAN
The gory details III: Agent
Framework

Allows creation of agents to coordinate the job
submission, load balancing and resource management
on top of the Grid Model

Just need to extend Agent class and implement
methods from the learning Agent interface

So far we have tested:

Reinforcement Learning for scheduling/load balancing
Goes Open source

GPL license at sourceforge: Towards a tool for the
Agent Grid research community

Improvements required:



Extend Network model with high level model for shared
TCP flows over WANS ( follow SimGrid papers)
Extend Network & Resource Models with interference of
computation with communication - build on the paper:
“On the Interference of Communication on Computation in
B. Kreaseck, L. Carter, H. Casanova, J. Ferrante April
2004.
AgentFramework development: Interfaces /Routines for
Negotiation, ResourceManagenet, Mobile Agents,etc
Questions ?


Interest in joining at sourceforge?
Contact: ichao@thinkingrid.com
www.thinkingrid.com
Download