System Flow Prerequisites

Before executing the System flow, ensure the following prerequisites are in place.

Dummy User Account

  • Tests are executed in the production environment; a dedicated dummy user is required for System testing.

  • The user must have a Cavern home directory set up on every node where the operator will run the tests.

  • The home directory is required to stage and manage test data during workflow execution.

  • A user account test_dummy_user has been created with a lifetime of 12 months.

  • If the account expires, contact #team-src-neon on Slack to request a renewal.

  • ⚠️ Note: Use this dummy user only for System testing, not for production workflows.

Required Groups

Add the dummy user to all of the following groups:

- data
- data/namespaces
- data/namespaces/chocolate
- data/namespaces/chocolate/owner
- monitoring
- monitoring/grafana
- prototyping-groups
- prototyping-groups/mini-src
- prototyping-groups/mini-src/platform-users
- services
- services/data-management-api
- services/data-management-api/roles
- services/data-management-api/roles/developer
- services/gateway-backend-api
- services/rucio
- services/rucio/roles
- services/rucio/roles/user
- services/site-capabilities-api
- services/site-capabilities-api/roles
- services/site-capabilities-api/roles/viewer

Test Dataset

  • The data file to be replicated between RSEs must be uploaded manually with a longer lifetime.

  • This file serves as the source dataset in the workflow and will be staged under /data/stage on the source node.

Steps to Upload Data to Rucio

  1. Run the Rucio client container:

docker run -it --rm \
  -e RUCIO_CFG_CLIENT_ACCOUNT=accountname \
  -e RUCIO_CFG_CLIENT_OIDC_SCOPE="openid profile offline_access wlcg.groups storage.create:/" \
  -v path_to_file/file.txt \
  registry.gitlab.com/ska-telescope/src/src-dm/ska-src-dm-da-rucio-client:release-35.6.0

  1. Upload the mounted file:

rucio upload --rse RSE_NAME --lifetime 3600 --scope testing --register-after-upload path_to_file/file.txt

Or generate and upload a random file:

export FILE=$(uuidgen)
echo "test" >> $FILE
rucio upload --rse CHSRC_XRD_PROD --lifetime 3600 --scope testing --register-after-upload $FILE