Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

Recombining means converting legacy VCS data from one format to another. The two formats are both headerless binary formats, with each byte representing a (4+4)-bit complex signed sample. The only main difference between the formats is the ordering of the bytes and how they are distributed between multiple files. For the purposes of this document, the "from" format will be called the PFB or unrecombined format, and the "to" format will be called the VCS or recombined format. The format conversion is necessary because the beamformer only (currently) supports the VCS format as input.

...

Examples of using recombine to process both single-second and multiple-second jobs on Garrawarla is now provided as part of the documentation included in the recombine repository.

Other (wrapper) scripts

vcs_download.nf

vcs_download.nf is a Nextflow script provided by the mwa_search repo. Its use is described on the main Documentation page. As a quick reference, however, the following template can be followed on Garrawarla:

Code Block
languagebash
themeMidnight
module load vcstools/devel
module load mwa_search/devel
vcs_download.nf --obsid <obsid> --begin <begin gps> --end <end gps> --download_dir /astro/mwavcs/asvo/<ASVO ID> --vcstools_version devel -resume

Note that vcs_download.nf will remove the PFB files once they have been successfully recombined.

process_vcs.py (deprecated)

...