Change Log

All notable changes to this project will be documented in this file. This project adheres to Semantic Versioning.

[main]

(Latest changes not linked to a new release are here. Please include link to MR.)

[0.4.0] April 18, 2025

  • Expect DP3 version 6.4.0 and WSClean version 3.6. (MR266)

  • Remove EveryBeam / CasaCore library version checks. (MR270)

  • Add convert-oskar-skymodel script for converting OSKAR skymodel to LSMTool / makesourcedb format. (MR240)

  • Add --init_skymodel option, for specifying an alternate initial skymodel file. (MR244)

  • Support multiple input measurement sets. The pipeline concatenates them into one large MS, and then processes that MS. (MR228)

  • Remove --restore_args option. (MR260)

  • Support Spack environments in script for launching Dask and dool. (MR225)

  • Use LSMTool 1.6.2 (MR243)

  • Use different files for restored images (MR247)

  • Use different sector skymodel and vertices files per cycle. (MR269)

  • Make creating diagnostics images in filter_skymodel optional. Don’t create these images by default. (MR252)

  • Remove temporary measurement sets in the imaging step. (MR229)

  • Allow overriding channel settings in the YAML configuration file. (MR235)

  • Move hardcoded configuration settings for FOV scaling to a YAML configuration file. (MR237)

  • Allow skipping subtracting outlier sources completely. (MR242)

  • Add SKA-Low configuration file, based on how Rapthor processes AA1 simulated data. (MR234, MR258, MR263, MR264, MR265)

  • Decrease start times passed to DP3 by 0.1 second (MR261)

[0.3.1] February 3, 2025

  • Use DP3 6.3 and EveryBeam 0.7.0, which enables supporting simulated SKA-LOW data. (MR224)

  • Disable silencing HDF5 errors. Missing EveryBeam data files now show a clear error message. (MR221)

[0.3.0] January 16, 2025

  • Allow other steps besides solver steps during calibration. (MR191)

  • Validate solver settings in YAML config file. (MR198)

  • Update Python module dependencies to recent versions. (MR196)

  • Add (partial) support for the SKA-MID telescope.

  • Renamed the repository to ska-sdp-wflow-selfcal (removed ‘low’ from the name).

  • Remove solution files from individual DP3 runs. Only keep the merged solution file. (MR208)

  • Support a different data_fraction in each calibration cycle. Use a final cycle with 100% of the data in the example configurations. (MR185)

  • Support !if, !include and !ref custom tags in YAML config file. (MR199)

  • Use separate YAML configurations for full and averaged test data sets. (MR206)

  • Make filter_skymodel optional. Disable it in default configurations. (MR207)

  • Exploit DP3’s new beam_interval setting, improving performance. (MR194)

  • Make --input-ms and --config arguments mandatory (remove default values). (MR212)

  • Update installations instructions. (MR210, MR215, MR217)

  • Check main version of DP3 and WSClean, instead of git commit hash. Use DP3 6.2.1 and WSClean 3.5. (MR219)

[0.2.0] October 23, 2024

  • Move many hardcoded configuration settings to a YAML configuration file.

  • Read the number of self calibration cycles from the YAML file.

  • Make the predict operation optional. Allow outlier and/or bright source prediction in any cycle.

  • Remove --dp3_args option, since DP3 configuration is in YAML now. (MR128)

  • Remove --subtract-bright-sources argument. Predict configuration is in YAML now. (MR160)

  • Document example sbatch scripts. (MR100)

  • Add fourth self-calibration cycle. (MR108)

  • Remove --combine_dp3_calls option. Always combine DP3 calls now.(MR123)

  • Support starting dool along with dask. (MR136)

  • Support running without SLURM. (MR154)

  • Onboard changes from Rapthor. (MR137)

  • Use LSMTool 1.6.0 and EveryBeam 0.6.1. (MR142)

  • Clean up and/or merge several internal functions, including the main self calibration loop.

  • Improve names of intermediate output files.

[0.1.2] April 25, 2024

  • Extract all MPI commands from the pipeline and add as command line argument (MR82)

  • Start dask scheduler and workers outside the pipeline and pass as an argument (MR84)

  • Commit check: * DP3 should have version 6.0.1-46-g1b792f2 * WSClean should have version v3.3-86-gdfb984b

[0.1.1] February 7, 2024

  • First repository release following the procedure (MR71)

  • Add version check against specific DP3 and WSClean git commits: * DP3 should have version 6.0.1-76-g0386079d * WSClean should have version v3.3-116-g02993d7

  • Checks that only one everybeam library is found

  • Checks that only one casacore library is found

Added

  • Empty Python project directory structure