E-science grid facility for Europe and Latin America gLite UI Installation and config (EELA-2) Riccardo Bruno INFN-Catania (Italy) EELA-2 Tutorial Cuanca (Ecuador), 02-05.02.2010 www.eu-eela.eu Preliminaries • The instructions provided in this presentation assume that you are going to use a machine with Scientific Linux 4.6 installed. – Virtual Machine image (GILDA VM Base_SLC4.6_i386) available at: https://gilda.ct.infn.it/VirtualServices.html or – SL 4.6 distribution available at: https://www.scientificlinux.org/download www.eu-eela.eu Cuenca (Ecuador), EELA-2 User and Sys Admin Tutorial, 02-05.02.2010 2 Repository settings • Specify the mrepo host: export MREPO=http://www.cedia.org.ec/mrepo/ (Tutorial) export MREPO=http://grid018.ct.infn.it/mrepo (GILDA) • Configure the repository as follows: REPOS="ca ig jpackage glite-ui dag gilda" • Get repositories with: for name in $REPOS; do wget $MREPO/repos/$name.repo -O /etc/yum.repos.d/$name.repo; done • To get a full mirror of GILDA repository: wget -mp -nH -np http://grid018.ct.infn.it/mrepo/ Then replace baseurl filed in any .repo file inside repos/ directorty www.eu-eela.eu Cuenca (Ecuador), EELA-2 User and Sys Admin Tutorial, 02-05.02.2010 3 System requirements • Please check: – If you have a valid hostname – To verify, type: hostname -f – To edit the hostname: www.eu-eela.eu vim /etc/hosts vim /etc/hostname vim /etc/sysconfig/network hostname <nombre.de.la.maquina> Cuenca (Ecuador), EELA-2 User and Sys Admin Tutorial, 02-05.02.2010 4 YUM cache • With YUM it is possible to exploit its package caching mechanism to speed up the installation process – Download cached files: wget http://www.cedia.org.ec/generic/UI_yum_cache.tar.gz – Install cached packages: tar xvfz UI_yum_cache.tar.gz –C /var/cache/yum • The installed packages will avoid YUM to download files from the network before to install them www.eu-eela.eu Cuenca (Ecuador), EELA-2 User and Sys Admin Tutorial, 02-05.02.2010 5 g++ Compiler required • GILDA VM Base does not provide dev tools: yum install -y gcc-c++ (gcc-c++ includes the mandatory package libstdc++-devel) www.eu-eela.eu Cuenca (Ecuador), EELA-2 User and Sys Admin Tutorial, 02-05.02.2010 6 INFN Grid UI metapackage yum install -y ig_UI_noafs http://igrelease.forge.cnaf.infn.it/doku.php?id=doc:guides:install-3_1 www.eu-eela.eu Cuenca (Ecuador), EELA-2 User and Sys Admin Tutorial, 02-05.02.2010 7 System requirements Processing Dependency: libxerces-c.so.27 is needed by package glite-rgma-api-cpp • Missing dependency xerces 2.7 (2.8 requilred by RGMA) Download the 2.7 from the web: wget ftp://mirror.switch.ch/pool/1/mirror/epel/4/x86_64/xercesc-2.7.0-8.el4.i386.rpm wget http://temuco02.dis.ufro.cl/varios/xerces-c2.7.0-8.el4.i386.rpm In case the xercers 2.8 exsists; remove it: rpm -e --nodeps xerces-c-2.8.0-1.slc4 Install the 2.7: rpm -ivh xerces-c-2.7.0-8.el4.i386.rpm www.eu-eela.eu Cuenca (Ecuador), EELA-2 User and Sys Admin Tutorial, 02-05.02.2010 8 Got an error? Processing Dependency: jdk = 2000:1.5.0_14-fcs for package: java-1.5.0-sun-compat rpm -e --nodeps jdk-1.5.0_14-fcs • Try again the yum command: yum install -y ig_UI_noafs www.eu-eela.eu Cuenca (Ecuador), EELA-2 User and Sys Admin Tutorial, 02-05.02.2010 9 CAs & GILDA Utils • Recognition of Certification Authorities: yum install -y lcg-CA • Install GILDA’ voms server certificates (needed for proxy creation and validation): You may skip following statements since they depend on: gilda_utils wget http://grid018.ct.infn.it/mrepo/gilda_s l4-i386/RPMS.all/gilda-vomscert-1.02.noarch.rpm rpm –ivh gilda-vomscert-1.02.noarch.rpm • Install GILDA configurations: gilda_utils yum install -y gilda_utils www.eu-eela.eu Cuenca (Ecuador), EELA-2 User and Sys Admin Tutorial, 02-05.02.2010 10 site-info.def • Copy the ig-site-info.def script template cp /opt/glite/yaim/examples/siteinfo/ig-siteinfo.def $HOME/mysite-info.def • Open your own site-info.def and customize it: vi $HOME/mysite-info.def www.eu-eela.eu Cuenca (Ecuador), EELA-2 User and Sys Admin Tutorial, 02-05.02.2010 11 Setup site-info.def RB_HOST=glite-rb.ct.infn.it BDII_HOST=gilda-bdii.ct.infn.it WMS_HOST=gilda-wms-01.ct.infn.it LB_HOST="gilda-lb-01.ct.infn.it:9000" PX_HOST=myproxy.ct.infn.it LFC_HOST=lfc-gilda.ct.infn.it DPM_HOST=aliserv6.ct.infn.it JAVA_LOCATION=/usr/java/j2re-1.4.2_16 !(please verify if the JAVA_LOCATION is correct) www.eu-eela.eu Cuenca (Ecuador), EELA-2 User and Sys Admin Tutorial, 02-05.02.2010 12 Add GILDA Settings VOS="… gilda" Add gilda here [..] ######### # gilda # ######### VO_GILDA_VOMS_CA_DN="/C=IT/O=INFN/OU=Host/L=Catania/ CN=voms.ct.infn.it" VO_GILDA_SW_DIR=$VO_SW_DIR/gilda VO_GILDA_DEFAULT_SE=$DPM_HOST VO_GILDA_STORAGE_DIR=$CLASSIC_STORAGE_DIR/gilda VO_GILDA_VOMS_SERVERS="vomss://voms.ct.infn.it:8443/ voms/gilda?/gilda" VO_GILDA_VOMSES="gilda voms.ct.infn.it 15001 /C=IT/O=INFN/OU=Host/L=Catania/CN=voms.ct.infn.it gilda" www.eu-eela.eu Cuenca (Ecuador), EELA-2 User and Sys Admin Tutorial, 02-05.02.2010 13 Configuring the UI for GILDA • Configure the UI with YAIM /opt/glite/yaim/bin/yaim -c -s $HOME/mysite-info.def -n glite-UI • If everithing is ok, the UI is now READY for testing • NOTICE! YAIM does not configure the LFC_HOST variable; please add the following line into the file: /opt/glite/etc/profile.d/grid-env.sh gridenv_set www.eu-eela.eu "LFC_HOST" "lfc-gilda.ct.infn.it" Cuenca (Ecuador), EELA-2 User and Sys Admin Tutorial, 02-05.02.2010 14 Testing the UI • Add new user and copy user’ PEM certificates: adduser gildauser passwd gildauser su – gildauser scp –rp cuencaXX@glite-tutor.ct.infn.it:.globus . • Test: Create a proxy (voms-proxy-init) Use Information system commands (lcg-infosites) Use LFC/LCG commands Use Job submission/controll/output retrieval commands www.eu-eela.eu Cuenca (Ecuador), EELA-2 User and Sys Admin Tutorial, 02-05.02.2010 15 From GILDA to EELA • The installation steps above may be changed in order to install UI able to operate with other VOs (EELA-2) • Steps required: • Install VOMS certificates • Customize site-info.def values with new services • Renew the CRLs in case you added a CA • Reconfigure the UI with YAIM www.eu-eela.eu Cuenca (Ecuador), EELA-2 User and Sys Admin Tutorial, 02-05.02.2010 16 Configuring the UI for EELA-2 • Using the Latin American services: BDII_HOST=bdii.eela.ufrj.br WMS_HOST=wms.eela.ufrj.br LB_HOST="lb2.eela.ufrj.br:9000" PX_HOST=px.eela.ufrj.br LFC_HOST=lfc.eela.ufrj.br DPM_HOST=<choose any available SE> JAVA_LOCATION=/usr/java/j2re-1.4.2_16 (*) # please verify The site-info.def for LA Users can be downloaded from: http://eoc.eu-eela.eu/files/EELA-2VOs.tgz (*) lcg-infosites --vo prod.vo.eu-eela.eu se www.eu-eela.eu Cuenca (Ecuador), EELA-2 User and Sys Admin Tutorial, 02-05.02.2010 17 Configuring the UI to access EELA-2 • Using the European services: BDII_HOST=bdii-eela.ceta-ciemat.es WMS_HOST=wms-eela.ceta-ciemat.es LB_HOST="lb-eela.ceta-ciemat.es:9000" PX_HOST=px-eela.ceta-ciemat.es LFC_HOST=lfc-eela.ceta-ciemat.es DPM_HOST=<choose the closest SE> JAVA_LOCATION=/usr/java/jdk1.6.0_13 # please verify NOTICE! The list of available EELA-2 services is published by the address: http://eoc.eu-eela.eu/doku.php?id=central_services www.eu-eela.eu Cuenca (Ecuador), EELA-2 User and Sys Admin Tutorial, 02-05.02.2010 18 Adding EELA-2 VO settings VOS=”gilda alice atlas... " [...] Add prod.vo.eu-eela.eu oper.vo.eu-eela.eu ############################ # Specific Settings (PROD) # ############################ SW_DIR=$VO_SW_DIR/prod DEFAULT_SE=$DPM_HOST STORAGE_DIR=$CLASSIC_STORAGE_DIR/prod QUEUES="prod" VOMS_SERVERS="vomss://voms.eela.ufrj.br:8443/voms/prod.vo.eueela.eu?/prod.vo.eu-eela.eu" VO_PROD_VO_EU_EELA_EU_VOMSES="'prod.vo.eu-eela.eu voms.eela.ufrj.br 15003 /C=BR/O=ICPEDU/O=UFF BrGrid CA/O=UFRJ/OU=IF/CN=host/voms.eela.ufrj.br prod.vo.eu-eela.eu' 'prod.vo.eu-eela.eu voms-eela.ceta-ciemat.es 15003 /DC=es/DC=irisgrid/O=ceta-ciemat/CN=host/voms-eela.ceta-ciemat.es prod.vo.eu-eela.eu'" VOMS_CA_DN="'/C=BR/O=ICPEDU/O=UFF BrGrid CA/CN=UFF Brazilian Grid Certification Authority' '/DC=es/DC=irisgrid/CN=IRISGridCA'" VO_PROD_VO_EU_EELA_EU_VOMS_CA_DN="subject= /C=BR/O=ICPEDU/O=UFF BrGrid CA/O=UFRJ/OU=IF/CN=host/voms.eela.ufrj.br" Cuenca (Ecuador), EELA-2 User and Sys Admin Tutorial, 02-05.02.2010 19 www.eu-eela.eu Adding EELA-2 settings ############################ # Specific Settings (OPER) # ############################ SW_DIR=$VO_SW_DIR/oper DEFAULT_SE=$DPM_HOST STORAGE_DIR=$CLASSIC_STORAGE_DIR/oper QUEUES="oper" VOMS_SERVERS="vomss://voms.eela.ufrj.br:8443/voms/oper.vo.eueela.eu?/oper.vo.eu-eela.eu“ VO_OPER_VO_EU_EELA_EU_VOMSES="'oper.vo.eu-eela.eu voms.eela.ufrj.br 15004 /C=BR/O=ICPEDU/O=UFF BrGrid CA/O=UFRJ/OU=IF/CN=host/voms.eela.ufrj.br oper.vo.eu-eela.eu' 'oper.vo.eu-eela.eu voms-eela.ceta-ciemat.es 15004 /DC=es/DC=irisgrid/O=ceta-ciemat/CN=host/voms-eela.ceta-ciemat.es oper.vo.eu-eela.eu'" VOMS_CA_DN="'/C=BR/O=ICPEDU/O=UFF BrGrid CA/CN=UFF Brazilian Grid Certification Authority' '/DC=es/DC=irisgrid/CN=IRISGridCA'" VO_PROD_VO_EU_EELA_EU_VOMS_CA_DN=”<contact SA1: sa1@eu-eela.eu>" www.eu-eela.eu Cuenca (Ecuador), EELA-2 User and Sys Admin Tutorial, 02-05.02.2010 20 GILDA to EELA-2 • Recognition of Certification Authorities: yum install -y lcg-CA • Install EELA-2's voms server certificates (needed for proxy creation and validation): – wget http://gaia.eela.if.ufrj.br/mrepo/eela4xi386/RPMS.generic/eela-vomscerts-5.0.1-1.noarch.rpm – rpm –ivh eela-vomscerts-5.0.1-1.noarch.rpm • Get new CRLs (in case you added a CA) – cd /etc/grid-security/certificates – fetch-crl • Reconfigure UI – /opt/glite/yaim/bin/yaim -c –s $HOME/mysiteinfo.def -n glite-UI www.eu-eela.eu Cuenca (Ecuador), EELA-2 User and Sys Admin Tutorial, 02-05.02.2010 21 Configuring the LFC host • LFC_HOST is not configured by yaim – Open the file: /opt/glite/etc/profile.d/grid-env.sh – Insert the following entry inside the bash if block gridenv_set www.eu-eela.eu "LFC_HOST" "<LFC server>" EELA-2 (LA) EELA-2 (Europe) lfc.eela.ufrj.br lfc-eela.ceta-ciemat.es Cuenca (Ecuador), EELA-2 User and Sys Admin Tutorial, 02-05.02.2010 22 References INFNGrid installation http://igrelease.forge.cnaf.infn.it/doku.php?id=doc:guides:install-3_1 EELA-2 Operations Centre http://eoc.eu-eela.eu How to deploy your own User Interface http://eoc.eu-eela.eu/doku.php?id=deploy_your_own_eela-2_ui GILDA Site installation https://grid.ct.infn.it/twiki/bin/view/GILDA/GILDASiteInstall middleware-ports.txt http://glite.cvs.cern.ch/cgi-bin/glite.cgi/org.glite.site-info.ports/doc/middlewareports.txt?revision=1.15&view=markup www.eu-eela.eu Cuenca (Ecuador), EELA-2 User and Sys Admin Tutorial, 02-05.02.2010 23 Questions? www.eu-eela.eu www.eu-eela.eu Cuenca (Ecuador), EELA-2 User and Sys Admin Tutorial, 02-05.02.2010 24