OSG Accounting Service
Requirements
Matteo Melani
(matteom@slac.stanford.edu)
SLAC
for the OSG Accounting Activity
1
Who are we?
The team
 Matteo Melani – SLAC
 Philippe Canal – Fermilab
 Sudhir Borra –Fermilab
2
And we are talking to




Ian Foster, Frank Siebenlist – Globus
Sebastien Goasguen –TeraGrid
David Kant – LCG
Andrea Guarise - EGEE
3
What are the Activity Goals?

To provide the OSG stakeholders with a reliable and
accurate set of views of the Grid resources usage.

The Grid Accounting Project will:




design (or choose) the accounting data model
ensure the necessary meters and collectors are in place at the
resource provider sites,
define and deploy repositories and access tools for the reporting
and analysis of the grid wide accounting information
ensure interoperability with other Grids (LCG, TeraGrid,...)
4
Project Charter
OSG Document 131:
http://osg-docdb.opensciencegrid.org/0001/000131/004/AccountingProjectDefinition1.pdf
5
What are we doing?

Just finish the Requirements document


Working at the Design


Architecture Overview Document (DRAFT in preparation)
Talking to the stakeholders



OSG Accounting Service Requirements v1.0 - Just released!
OSG stakeholders
Other Grids stakeholders: LCG, TeraGrid, EGEE, Globus…
Reviewing other Accounting Systems



DGAS, APEL, SGAS
GGF groups RUS/UR/GESA/OGSA-WGs,
IETF’s AAA, Telecommunications Network
6
Why a Requirements doc?




Verba volant, scripta manent
Define the Accounting System scope
Establish a common accounting model and terminology
so that we can understand each other and we can
communicate with OSG stakeholders and other Grids
stakeholders
Understand OSG needs so that:



do not build what we do not need and want
reuse what is out there
Accounting is a fairly new topic in distributed systems
and in IT
7
VO
Management
System
Subscribe to
VO
Admin
s.
VO
Manger
Grid
User
Accounting
System Scope
uses
uses
Gets VO info
uses
Grid wide
Accounting
System
Grid
Access
Service
manag
es
Accounting
Sys.
Admin,
uses
uses
Grid
Manager
Grid Wide
Monitoring System
Resourc
e
Manager
uses
OSG Accounting
Service
Site
administration
domain &
Computing
OSG Monitoring
Service Environment
OSG Grid
Grid Service
Services
Grid Service
OSG Auth. & Auth.
Infrastructure
Resources
Software
Network
Resources
Storage
Resources
Resources
Site
Monitoring
System
Site
Accounting
system
8
Main Functionalities (1)
•
•
•
•
The ability to collect resources and services usage
data at each resources and services provider site.
The ability to combine authentication, authorization
and resource usage data related to a Grid user request
to produce detailed accounting records.
The ability to store and manage accounting records
and accounting data.
The ability to present accounting records in tabular
format at the Grid wide and site level
9
Main Functionalities (2)
•
•
•
The ability to apply various (statistical) functions to
analysis accounting records and data to facilitate the
spotting of trends and patterns in the usage of
resources and services.
The ability to present the results of this analysis with
graphical views.
The ability to support auditing processes by storing the
raw usage data and maintaining links between the
accounting records and the raw usage data used to
generate them.
10
Main Functionalities (3)



No user charging system,
No resources or services pricing
No support for an economic model for resource
allocation
But we have to keep them in mind!
11
System Properties(1)

Interoperability


The Accounting System should leverage existing standards to
maximize interoperability with other Grids and Accounting
Services.
Fault Tolerance



The Accounting System must reduce as much as possible
usage data and accounting records loss.
The Accounting System must be resilient to temporary
communication failures over LAN and WAN.
The Accounting System must be resilient to the failure of one
of its component.
12
System Properties(2)

Security



Scalability and Performance


The Accounting System will guarantee integrity and non–
repudiation of the accounting records at the site level.
The Accounting System must protect accounting information
using secure communication channels (mutual authentication,
message integrity, confidentiality) and access control lists.
Not really an issue
Other

The Accounting System should leverage existing tools and
infrastructures to solve related problems.
13
Open Questions

How do we measure resource usage?



Specific metrics
What are the specific graphs and tabular views the
stakeholders want?
What (and how) Authentication & Authorization
information the OSG infrastructure can supply?


DN-UID mapping issue
Template account
14
What are your accounting needs?
OSG-ACCOUNTING@OPENSCIENCEGRID.ORG
15
Logging
Accounting &Monitoring
Monitoring
Auditing
Accounting
16