ska_sdp_batchlet.services.pipeline_service module

class ska_sdp_batchlet.services.pipeline_service.PipelineService[source]

Bases: object

Pipeline service.

static run_pipeline(command, dask_params=None, monitor=None, generate_reports_on_failure=True)[source]

Update pipeline into config.

Parameters:

  • command (list[str]) -- Command to be executed within the dask cluster

  • dask_params (dict) -- User provided dask parameters. Given to batchlet as json input, in the key "dask_params".

  • monitor (Optional(dict)) -- Monitor Configuration

  • generate_reports_on_failure (bool) -- Whether to generate reports even if some exception occurs during exit