Test Dask Script

The test-dask script is designed to test deploying two instances of a Dask execution engine and executing a simple function on each one.

The sequence of actions carried out by the script is:

  • Claims processing block

  • Sets processing block status to 'WAITING'

  • Waits for resources_available to be True

    • This is the signal from the processing controller that the script can start

  • Sets processing block status to 'RUNNING'

  • Deploys two Dask execution engines in parallel

  • Does some simple operations. Constructs a graph to add two numbers together and computes the result by calling the ‘compute’ method.

  • Sets processing block status to 'FINISHED'

Changelog

0.5.0

  • Update to scripting library 0.6.1

0.4.0

  • Update to latest scripting library (0.5.0). This required the update of how phase.wait_loop is used in the script.

0.3.0

  • Port to use SDP scripting library (formerly known as the workflow library).

0.2.6

  • Use dependencies from the central artefact repository and publish the workflow image there.

0.2.5

  • Ported to use the latest version of workflow library (0.2.4).

0.2.4

  • use python:3.9-slim as the base docker image

  • slimmed down the requirements file as well