Configuration and
Setup Changes for
connection to the L2G
Dr. David Wallom
Grid Support Centre
Aims
• Continues with more advanced configurations
– Common errors with Globus Setup
– Review installation of necessary extra packages from
MDS reporting
– Advanced Job manager setup
– Advanced GridFTP setup
– Configure MDS to run to a central server in the
classroom
– Change from MDS reporting to machine here to
actual machine on the L2G
31/05/2016
31/05/2016
Globus
2 Installation
Setup
Globus
2 Installation
andand
Setup
Dr. David Wallom
2
Grid Support Centre
The Most Common Errors
•
The most common errors when using Globus have the following root
causes and as such should be investigated first
(The number in brackets are the number of associated Errors with this
solution from the Globus Website page)
–
–
–
–
–
•
Services not correctly being started (1)
User proxies too old or not created (3)
Username and DN correctly added to grid-mapfile (5)
Date and time synchronisation (3)
User/host/service certificates validity problems due to CA certificates
not being loaded correctly into /etc/gridsecurity/certificates (3)
http://www.globus.org/about/faq/errors.html
31/05/2016
31/05/2016
Globus
2 Installation
Setup
Globus
2 Installation
andand
Setup
Dr. David Wallom
3
Grid Support Centre
Job Manager and Reporter
• These are available for download from the Globus
Alliance
• To install reporters the reporter setup is also needed
– Reporters available for the following
• LSF
• PBS
• Condor
– These packages are all installed using the
gcc32dbg flavour
31/05/2016
31/05/2016
Globus
2 Installation
Setup
Globus
2 Installation
andand
Setup
Dr. David Wallom
4
Grid Support Centre
Addition of Further Job Managers
•
There are 2 steps to this:
– Adding gram-reporter: this publishes jobmanager information into
MDS.
• To enable install;
– globus-gram-reporter package
– jobmanager-specific setup package
– edit the globus-job-manager.conf file to add the "-publish-jobs"
and "-job-reporting-dir" options
– Adding scheduler-setup-packages
• The first job manager scheduler package installed will be the default
job manager service (e.g. $GLOBUS_LOCATION/etc/gridservices/jobmanager).
• Additional job manager scheduler packages installed will be
installed using the convention "jobmanager-<scheduler-name>"
(e.g. $GLOBUS_LOCATION/grid-services/jobmanager-pbs).
31/05/2016
31/05/2016
Globus
2 Installation
Setup
Globus
2 Installation
andand
Setup
Dr. David Wallom
5
Grid Support Centre
Changing the Default Jobmanager
• The default job manager when installed is fork.
• To change the default job manager:
setup-globus-job-manager-xxx -service-name jobmanager
31/05/2016
31/05/2016
Globus
2 Installation
Setup
Globus
2 Installation
andand
Setup
Dr. David Wallom
6
Grid Support Centre
Advanced GridFTP setup
•
•
•
Advanced GridFTP setup consists of only one change
to allow third party transfers.
Involves editing
$GLOBUS_LOCATION/etc/ftpaccess file to add the
lines:
port-allow all 0.0.0.0/0
pasv-allow all 0.0.0.0/0
on both sides of the third-party connection.
31/05/2016
31/05/2016
Globus
2 Installation
Setup
Globus
2 Installation
andand
Setup
Dr. David Wallom
7
Grid Support Centre
Practical 4
• Install the reporter and job manager specific setup
packages.
– Perform additional configuration to allow publishing of
jobmanager information.
• Perform GridFTP advanced configuration.
• Check the behaviour of the job manager under MDS.
31/05/2016
31/05/2016
Globus
2 Installation
Setup
Globus
2 Installation
andand
Setup
Dr. David Wallom
8
Grid Support Centre
Configuration Files for MDS
• All files located in $GLOBUS_LOCATION/etc
– grid-info-resource-register.conf
• Lists the GIIS servers to which a GRIS will register directly.
– grid-info-site-giis.conf
• Initializes the data structure for a GRIS registering to a GIIS.
– grid-info-site-policy.conf
• Controls the acceptance of registration messages by a GIIS.
– grid-info-slapd.conf
• Designates the GIIS and GRIS provider components to
OpenLDAP.
– grid-info.conf
• Sets the default values for the arguments to the grid-infosearch command
31/05/2016
31/05/2016
Globus
2 Installation
Setup
Globus
2 Installation
andand
Setup
Dr. David Wallom
9
Grid Support Centre
MDS Configuration Changes
• The only changes to make the reporting to another MDs server are
needed in
– grid-info-resource-register.conf
• The changes are that you need to copy the existing block describing
‘local’ to the name of your own VO
• For our example:
– Machine=lab-10.nesc.ed.ac.uk
– Port=2135
– Mds-VO-name=site
• Now stop and restart you GRIS services and then test using:
• ‘grid-info-search –h lab-10.nesc.ed.ac.uk –p 2135 –b “Mds-VO-name=site,
o=Grid” –x’
31/05/2016
31/05/2016
Globus
2 Installation
Setup
Globus
2 Installation
andand
Setup
Dr. David Wallom
10
Grid Support Centre
MDS Changes for GIIS
• By default the GIIS will only accept registrations from
itself
• Need to change the file:
$GLOBUS_LOCATION/etc/grid-info-site-policy.conf
Adding “MDS-Service-hn=*” entry.
31/05/2016
31/05/2016
Globus
2 Installation
Setup
Globus
2 Installation
andand
Setup
Dr. David Wallom
11
Grid Support Centre
Practical 4
• Configure MDS to report to single server within the ‘grid
in a room’ setup.
• Adjust machine configurations to connect to L2G GIIS
server.
31/05/2016
31/05/2016
Globus
2 Installation
Setup
Globus
2 Installation
andand
Setup
Dr. David Wallom
12
Grid Support Centre
MDS Server
• Within the UK E-Science community the main GIIS
server is defined as:
– Machine=ginfo.grid-support.ac.uk
– Port=2135
– Mds-VO-name=UK e-Science
• In order to register ourselves though we must use an
intermediate VO-name.
– Machine=lab-10.nesc.ed.ac.uk
– Port=2135
– Mds-Vo-name=site
31/05/2016
31/05/2016
Globus
2 Installation
Setup
Globus
2 Installation
andand
Setup
Dr. David Wallom
13
Grid Support Centre
The Results of Connection to L2G MDS
• These results for the L2G are shown on the ‘infoportal’
http://esc.dl.ac.uk/InfoPortal/
• Automatically changes to include new nodes reporting to
the ‘ginfo.grid-support.ac.uk’ server.
• Coloured according to finding a correctly configured job
manager.
31/05/2016
31/05/2016
Globus
2 Installation
Setup
Globus
2 Installation
andand
Setup
Dr. David Wallom
14
Grid Support Centre
Conclusions
• Shown how to install the Globus Toolkit.
• Added Globus advisories to bring it up to date.
• Registered all the machines with the E-Science
Information Server.
• Shown how to configure further job managers both as
and not as defaults.
31/05/2016
31/05/2016
Globus
2 Installation
Setup
Globus
2 Installation
andand
Setup
Dr. David Wallom
15
Grid Support Centre
Useful Websites
•
•
•
•
http://www.globus.org
http://www.grid-support.ac.uk
http://esc.dl.ac.uk
http://www.edg.org
31/05/2016
31/05/2016
Globus
2 Installation
Setup
Globus
2 Installation
andand
Setup
Dr. David Wallom
16
Grid Support Centre