SKA Batch Preprocessing Pipeline

The Batch Preprocessing Pipeline prepares visibility data before they can be sent off for self-calibration and imaging. The typical processing steps performed are:

• Static flagging: flagging a set of user-provided channel frequency ranges.

• Dynamic flagging: smarter flagging of visibility data based on various heuristics.

• Removal of distant bright sources: subtract away predicted visibilities from well-known bright sources outside the field of view.

• Application of calibration solutions, derived from observing calibrator sources and provided by the instrumental calibration pipeline.

• Averaging of the data in both time and frequency.

Getting Started:

• Installation
• Quickstart
• Running on AWS

Pipeline:

• Introduction
• Overview
• Dask Scaling

Reference:

• Configuration Guide
• Pipeline Steps
• AOFlagger Strategy Presets
• Diagnostic Data Products

E2E Integration:

• SDM Mode Guide

Development:

• Developer Guide
• Changelog