SDP Slurm Deployer

The SDP Slurm Deployer is a component of the SKA SDP System. Its main responsibility is to monitor the SDP Configuration Database for new deployments of type slurm and submit corresponding jobs to an external HPC Slurm Cluster.

It acts as a bridge between the Kubernetes-based SDP control system and external HPC environments, enabling the execution of SDP processing scripts via SLURM. The deployer interfaces with SLURM through its REST API, allowing it to submit, monitor, and manage jobs on the cluster.

The repository is hosted on gitlab.

It supports SLURM REST API versions: 0.0.39 and 0.0.40.

Contents

• Functionality and Usage
  • Environment Configuration
  • Key Components
  • Authentication
  • Job Configuration
  • Job Labelling
  • Job Monitoring
  • SDP Deployment
• Developer Guide
  • Cloning the repository
  • Installing package and dependencies
  • Git hooks
  • GPG signing the commits
  • Useful commands for developers
• Slurm Deployer API
  • Main
  • Slurm service
  • Deployment manager
  • SDP Configuration DB manager

Releases

• Changelog

Indices and tables

• Index

• Module Index