Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

The following is current as of 12 August 4 November 2021.

See help text:

Code Block
languagebash
themeMidnight
hyperdrive -h # -h could also be --help

...

Code Block
languagetext
themeMidnight
titleExample help output
collapsetrue
hyperdrive 0.2.0-alpha1
Compiled on git commit hash: f76c8f6499349bff83b1953abf2f923f5a46ff46
                head ref:    refs/heads/di
         at: Fri, 06 Aug 2021 07:43:20 +0000
         with compiler: rustc 1.54.0 (a178d0322 2021-07-26)
Christopher H. Jordan <christopherjordan87@gmail.com>


alpha4
https://github.com/MWATelescope/mwa_hyperdrive
Calibration software for the Murchison Widefield Array (MWA) radio telescope

USAGE:
    hyperdrive <SUBCOMMAND>

FLAGS:
    -h, --help       Prints help information
    -V, --version    Prints version information

SUBCOMMANDS:
    di-calibrate       Perform direction-independent calibration on the input MWA data
    simulate-vis       Simulate visibilities of a sky-model source list
    srclist-by-beam    Reduce a sky-model source list to the top N brightest sources, given pointing information
    srclist-convert    Convert a sky-model source list from one format to another
    srclist-shift      Shift the sources in a source list. Useful to correct for the ionosphere. The shifts must be
                       detailed in a .json file, with source names as keys associated with an "ra" and "dec" in
                       degrees. Only the sources specified in the .json are written to the output source list
    srclist-verify     Verify that sky-model source lists can be read by hyperdrive
    dipole-gains       Print information on the dipole gains listed by a metafits file
    help               Prints this message or the help of the given subcommand(s)

...

Code Block
languagetext
themeMidnight
titleExample help output for hyperdrive simulate-vis
collapsetrue
hyperdrive-simulate-vis 0.2.0-alpha1alpha4
Simulate visibilities of a sky-model source list

USAGE:
    hyperdrive simulate-vis [FLAGS] [OPTIONS] --metafits <metafits> --source-list <source-list>

FLAGS:
        --no-beam               Should we use a beam? Default is to use the FEE beam
        --unity-dipole-gains    Pretend that all MWA dipoles are alive and well, ignoring whatever is in the metafits
                                file
        --dont-convert-lists    Don't attempt to convert "list" flux densities to power law flux densities. See for more
                                info: https://github.com/MWATelescope/mwa_hyperdrive/wiki/Source-lists
        --filter-points         Don't include point components from the input sky model
        --filter-gaussians      Don't include Gaussian components from the input sky model
        --filter-shapelets      Don't include shapelet components from the input sky model
    -v, --verbosity             The verbosity of the program. The default is to print high-level information
        --dry-run               Don't actually do any work; just verify that the input arguments were correctly ingested and
                                and print out high-level information
     -c,   --cpu                   Use the CPU for visibility generation. This is deliberately made non-default because using a GPU
                                using a GPU is much faster
    -h, --help                  Prints help information
    -V, --version               Prints version information

OPTIONS:
    -s, --source-list <source-list>                Path to the sky-model source list used for simulation
    -m, --metafits <metafits>                      Path to the metafits file
        --o, --output-model-file <model<output-model-file>                  Path to the output visibilities file [default: model.uvfits]
    -r, --ra <ra>
            The phase centre right ascension \[degrees\]. If this is not specified, then the metafits phase/pointing
            centre is used
    -d, --dec <dec>
            The phase centre declination \[degrees\]. If this is not specified, then the metafits phase/pointing centre is
           is used
    -c,    --num-fine-channels <num-fine-channels>
            The total number of fine channels in the observation [default: 384]

    -f, --freq-res <freq-res>                      The fine-channel resolution \[kHz\] [default: 80]
        --middle-freq <middle-freq>
            The middle frequency of the simulation \[MHz\]. If this is not specified, then the middle frequency specified
           specified in the metafits is used
    -t, --timenum-stepstimesteps <time<num-steps>timesteps>
            The number of time steps used from the metafits epoch [default: 14]

        --time-res <time-res>                      The time resolution \[seconds\] [default: 8.0]
        --beam-file <beam-file>
            The path to the HDF5 MWA FEE beam file. If not specified, this must be provided by the MWA_BEAM_FILE
            environment variable
        --dipole-delays <dipole-delays>...
            Specify the MWA dipoles delays, ignoring whatever is in the metafits file


DI calibration

Available with hyperdrive di-calibrate

...

By default, hyperdrive will attempt to use all sources in the source list file.  If there are more than 1,000 sources in the file, then it may take a long time !if you're not using a GPU.  In order to keep the number of sources used low, one could use the -n/--num-sources and/or --veto-threshold flags, or use a source list with fewer sources in the first place (see hyperdrive srclist-by-beam).

Example slurm script for garrawarla:

Code Block
languagebash
themeMidnight
#SBATCH --job-name=hyp-$1
#SBATCH --output=hyperdrive.out
#SBATCH --nodes=1
#SBATCH --ntasks-per-node=40
#SBATCH --time=01:00:00
#SBATCH --clusters=garrawarla
#SBATCH --partition=gpuq
#SBATCH --account=mwaeor
#SBATCH --export=NONE
#SBATCH --gres=tmp:50g
#SBATCH --gres=gpu:1

module use /pawsey/mwa/software/python3/modulefiles
module load hyperdrive

set -eux
which hyperdrive

cd /astro/mwaeor/MWA/data/1090008640

if [[ ! -r srclist_1000.yaml ]]; then
   hyperdrive srclist-by-beam -n 1000 -m *.metafits /pawsey/mwa/software/python3/srclists/master/srclist_pumav3_EoR0aegean_fixedEoR1pietro+ForA_phase1+2.txt srclist_1000.yaml
fi

hyperdrive di-calibrate -s srclist_1000.yaml -d *.ms *.metafits


As hyperdrive is still in heavy development, not all features are currently available.  An indication of what is available is below.

...