Gridware / Open Cluster Scheduler

Here is a tutorial to setup EF Portal with Gridware Cluster Scheduler.

Overview

The Gridware Cluster Scheduler (GCS) is a robust job management and resource allocation system, built upon the open-source Open Cluster Scheduler (OCS) available on GitHub. OCS has its roots in the Univa Open Core Grid Engine, which was itself derived from the open-source Sun Grid Engine project. More details you can check clicking here.

Installing OCS

Here are the steps to setup Gridware in a localhost.

Important:

  • Check your /etc/hosts and ensure that your server HOSTNAME is not pointed to localhost IPs (127.0.0.1 or ::1). It needs to solve to another IPs (usually the ipv4 valid IP).
  • Customize the autoinstall.template before proceed
dnf -y install git tar binutils

sudo dnf -y install git tar make screen
git clone https://github.com/hpc-gridware/go-clusterscheduler.git
cd go-clusterscheduler

source autoinstall.template
sudo mkdir -p /opt/ocs/ /opt/cs/ $SGE_ROOT

wget -k --content-disposition 'https://www.hpc-gridware.com/download/10190/?tmstv=1744011426'
wget -k --content-disposition 'https://www.hpc-gridware.com/download/10200/?tmstv=1744011426'
wget -k --content-disposition 'https://www.hpc-gridware.com/download/10202/?tmstv=1744011426'

for file in ocs-*.tar.gz
do
    tar xf "$file" -C /opt/ocs/
done

sudo cp autoinstall.template ${SGE_ROOT}/
sudo cp  installer.sh ${SGE_ROOT}/


if [ ! -f /bin/sh ]
then
    if [ -f /bin/bash ]
    then
        ln -s /bin/bash /bin/sh
    else
        ln -s /usr/bin/bash /bin/sh
        ln -s /usr/bin/bash /bin/bash
    fi
fi

if [ ! /bin/echo]
then
    ln -s /usr/bin/echo /bin/echo
fi

cd ${SGE_ROOT}
sed -i 's/echo "echo root\\n"/echo "echo root"/' ./installer.sh

sudo bash installer.sh

Notes:

  • If you are getting error or the terminal is blank and the “echo $?” command return a number different than zero, do “ls -lhrt /tmp/” and open the last /tmp/install.12345 listed (the number will be variable) to check what happened.

Integrating EF Portal with OCS/gcs

When you have OCS or GCS installed, you can edit $EF_ROOT/conf/plugins/interactive/interactive.efconf and find the parameters:

  • INTERACTIVE_DEFAULT_LINUX_JOBMANAGER
  • INTERACTIVE_DEFAULT_WINDOWS_JOBMANAGER

Set “sge” parameter where you need the scheduler working.

You can override this behaviour on per-EnginFrame service basis by using –jobmanager option of interactive.submit session starter script.