http://www.grid-support.ac.uk http://www.ngs.ac.uk Data services on the NGS http://www.nesc.ac.uk/ http://www.pparc.ac.uk/ http://www.eu-egee.org/ Acknowledgments • Matt Ford for OGSA-DAI and Oracle slides taken from his presentations for the NGS Induction Workshop (Dec. 2004, NeSC) • Peter Berrisford for SRB slides 2 Overview • OGSA-DAI: database access and integration – grid-enabled database access…. • GridFTP: a protocol for large file transfer • The Storage Resource Broker: – virtual file system for distributed file systems – Replica files in different locations, catalogue service to find them. • But first…. 3 Oracle and the NGS • The NGS core nodes, from the outset, have been partitioned into compute and data clusters. • As the NGS matures the requirement for data hosting will grow • Oracle database: for both users and services offered by the NGS. • The RAL and Manchester sites are designated as the data clusters with each site having the ability to dedicate up to eight nodes for use by Oracle. 4 Oracle and the NGS Support • Additional application needed after joining the NGS • All enquiries and production support for the Oracle service is via the Grid Operations Support Centre (GOSC) – 9-5 Operational support (monitoring, notification, maintenance) other times best endeavours basis. 5 Data services on NGS Simple data files • Middleware supporting – Replica files – Logical filenames – Catalogue: maps logical name to physical storage device/file – Virtual filesystems, POSIX-like I/O • Storage Resource Broker Structured data – RDBMS, XML databases • Require extendable middleware tools to support – Move computation near to data – easy access, controlled by AA – integration and federation • OGSA -DAI DAI: Data Access and Integration 6 OGSA-DAI 7 What is OGSA-DAI? • The Open Grid Services Architecture Data Access and Integration project is concerned with constructing middleware to assist with access and integration of data from separate data sources via the grid. • The project was conceived by the UK Database Task Force and is working closely with the Global Grid Forum DAIS-WG and the Globus team. 8 OGSA-DAI and the NGS • the OGSA-DAI deployment on the NGS is being actively developed • users should expect that procedures may change – it does not reflect the commitment NGS has to providing a service. • Initially the Manchester JISC data cluster has been charged with deploying the OGSA-DAI service 9 OGSA-DAI practical 10