Making Rocks Gfarm rolls

From PRAGMA wiki
Jump to: navigation, search

Gfarm install for making roll

Package installed files

Create 3 tar.gz files

  • gfarm.tar.gz

/opt/gfarm, but remove /opt/gfarm/etc/* (gfarm 2.5)

  • gfarm2fs.tar.gz


  • vdt.tar.gz

/opt/vdt (include VDT packages: Globus and Globus-Base-SDK)

Gfarm roll user guide

You can install gfarm roll at the initial build of a Rocks 5.4 x86_64 system, or to add it on a running Rocks 5.4 x86_64 system.

Gfarm roll overview

In order to install and setup GSI-enabled Gfarm system, this Gfarm roll does the following:

  • On a single node system or a cluster frontend
    • install VDT Globus and Globus-Base-SDK
    • setup certificate auto-update from PRAGMA certificates distribution point (including IGTF certificates distribution)
    • setup CRL auto-update
    • enable certificate files synchronization for compute nodes
  • On a cluster compute node
    • install VDT Globus and Globus-Base-SDK
    • setup certificate files synchronization with its frontend

Add gfarm roll to your frontend or single node system

  • download gfarm roll iso image file
  • install gfarm roll

For example:

# rocks add roll gfarm-1.0-0.x86_64.disk1.iso
# rocks enable roll gfarm
# cd /export/rocks/install
# rocks create distro
# rocks run roll gfarm | bash
# reboot

To install gfarm client on compute nodes, reinstall compute nodes

After install Gfarm roll

  • Obtain/install host certificate
  • If the system is a gfarm metaserver
# chkconfig gfarm-pgsql on
# chkconfig gfmd on
# /etc/init.d/gfarm-pgsql start
# /etc/init.d/gfmd start
  • If the system is not a gfarm metaserver
  • Get gfarm2.conf from gfarm metaserver, install in /opt/gfarm2.4.2/etc directory on all gfarm file system nodes and client nodes
    • If the system is a gfarm file system node
      • Obtain/install gfsd certificate
      • Ask gfarm metaserver admin to register your gfsd
      • Set gfsd start-up
# chkconfig --add gfsd
# /etc/init.d/gfsd start
  • gfarm metaserver administrator need to
    • Create users and groups
    • Register gfarm system nodes
    • Setup gfarm file system structures
    • Create users gfarm home directories


Issues resolved with a work-around

  • Missing libxslt.i386
+ config-gfarm -A gfarm -a gsi -X
/usr/bin/pg_config: error while loading shared libraries: cannot open shared object file: No such file or directory
WARNING: PostgreSQL version 7.4 or later required: unknown 
    • libxslt.x86_64 already installed.
    • Making sym link from lib64 did not help.
    • Install i386 rpm worked.
    • Solution should be to add "libsxlt.i386" package in nodes xml file.
      • Does not work when add gfarm roll on a running system. It's a bug in run roll script.
        • Work-around is to rpm install libxslt.i386 in post install script

Issues still need to be resolved

  • If globus is already installed
    • /opt/vdt already exists
    • globus installed elsewhere