This is a multi-container Slurm cluster using docker-compose. The compose file creates named volumes for persistent storage of MySQL data files as well as Slurm state and log directories.

This is a fork of https://github.com/giovtorres/slurm-docker-cluster, including the latest slurm as default, basic BATS https://github.com/bats-core/bats-core, testing which determines whether the correct version of Slurm is installed, two nodes are available, and a job can be submitted.

Typically,

make test

On OS X, you must install a newer version of GNU Make by running:

brew install remake

Then run remake test

The compose file will run the following containers:

• mysql
• slurmdbd
• slurmctld
• c1 (slurmd)
• c2 (slurmd)

The compose file will create the following named volumes:

• etc_munge ( -> /etc/munge )
• etc_slurm ( -> /etc/slurm )
• slurm_jobdir ( -> /data )
• var_lib_mysql ( -> /var/lib/mysql )
• var_log_slurm ( -> /var/log/slurm )

Build the image locally:

make build

Build a different version of Slurm using Docker build args and the Slurm Git tag. Slurm tags available on https://github.com/SchedMD/slurm/releases.

make build -s SLURM_TAG="slurm-19-05-2-1"

Run docker-compose to instantiate the cluster. SLURM_TAG is required. Latest supported SLURM_TAG is slurm-20-02-1-1.

env SLURM_TAG=slurm-20-02-1-1 docker-compose up -d

Use docker exec to run a bash shell on the controller container:

docker exec -it slurmctld bash

From the shell, execute slurm commands, for example:

[root@slurmctld /]# sinfo
PARTITION AVAIL  TIMELIMIT  NODES  STATE NODELIST
normal*      up 5-00:00:00      2   idle c[1-2]

The slurm_jobdir named volume is mounted on each Slurm container as /data. Therefore, in order to see job output files while on the controller, change to the /data directory when on the slurmctld container and then submit a job:

[root@slurmctld /]# cd /data/
[root@slurmctld data]# sbatch --wrap="uptime"
Submitted batch job 2
[root@slurmctld data]# ls
slurm-2.out

docker-compose stop
docker-compose start

To remove all containers and volumes, run:

docker-compose down -v

If you want to keep your configuration and metadata as docker volumes, just omit -v and run

docker-compose down