Recombining means converting legacy VCS data from one format to another. The two formats are both headerless binary formats, with each byte representing a (4+4)-bit complex signed sample. The only main difference between the formats is the ordering of the bytes and how they are distributed between multiple files. For the purposes of this document, the "from" format will be called the PFB or unrecombined format, and the "to" format will be called the VCS or recombined format. The format conversion is necessary because the beamformer only (currently) supports the VCS format as input.
...
Examples of using recombine
to process both single-second and multiple-second jobs on Garrawarla is now provided as part of the documentation included in the recombine repository.
Other (wrapper) scripts
vcs_download.nf
vcs_download.nf
is a Nextflow script provided by the mwa_search repo. Its use is described on the main Documentation page. As a quick reference, however, the following template can be followed on Garrawarla:
Code Block | ||||
---|---|---|---|---|
| ||||
module load vcstools/devel module load mwa_search/devel vcs_download.nf --obsid <obsid> --begin <begin gps> --end <end gps> --download_dir /astro/mwavcs/asvo/<ASVO ID> --vcstools_version devel -resume |
Note that vcs_download.nf
will remove the PFB files once they have been successfully recombined.
process_vcs.py (deprecated)
...