Table of Contents

The recent upgrade to MWAX necessitates verification that the system is capable of observing high time resolution phenomena, such as pulsars. To this end, we put in a successful proposal for an MWA observing campaign to being in the end of 2021 and into the beginning of 2022. The requested observations fall into two categories:

Obsid	Duration (sec)	Files	Pulsar(s) / Calibrator(s)	RA/Dec	PC RA/Dec	Az/El	Goal	Processing	Download folder	VCSBeam version*	Beamforming time
1323690320	296	24	In-beam calibration (for 1323690616)	11.8 / -5.8	8.5 / -7.4	341.6 / 68.0	1, 5	Downloaded Calibrated	`/astro/mwavcs/asvo/253001`	v3.3.31_c279695
1323690616	1200	3600 VCS	B0031-07 J0036-1033 J0034-0534	8.0 / -5.2	8.5 / -7.4	326.3 / 64.7	1, 5	Downloaded Beamformed B0031-07 J0036-1033 J0034-0534 (FAIL!)	`/astro/mwavcs/asvo/253008`	v3.3.31_c279695	1 channel: 1600s 24 channels: 4200-5000s
1323708616	296	24	In-beam calibration (for 1323709032)	95.1 / -26.7	97.7 / -28.6	0.0 / 90.0	1, 4	Downloaded Calibrated	`/astro/mwavcs/asvo/253000`
1323708912	120	24	PicA (for 1323709032)	75.9 / -46.4	80.0 / -45.8	213.7 / 64.7	1, 4	Downloaded Calibrated	`/astro/mwavcs/asvo/252998`
1323709032	600	1800 VCS	B0628-28	97.5 / -26.7	97.7 / -28.6	0.0 / 90.0	1, 4	Downloaded Beamformed	`/astro/mwavcs/asvo/253009`
1323776720	120	24	PKS2356-61 (for 1323776840)	4.3 / -62.7	359.8 / -60.9	191.3 / 52.8	1, 2	Downloaded Calibrated	`/astro/mwavcs/asvo/252999`
1323776840	1200	3600 VCS	J2241-5236	346.9 / -51.9	340.4 / -52.6	216.9 / 53.6	1, 2	Downloaded Beamformed	`/astro/mwavcs/asvo/253010`

Processing details

...

VCSBeam: v3.3.30_edafd20

Create Hyperdrive batch script:

...

*VCSBeam version is the earliest version that was successfully used for the processing. For calibration observations, this means using mwa_plot_calibration, and for the VCS observations, make_mwa_tied_array_beam.

Processing details

Setting up Garrawarla environment

astromwavcsvcs1323690320/hyperdrive/hyperdrive.sbatch

Code Block

language	bash
theme	Midnight
title	Setting up Garrawarla environment

module use /

pawsey/

mwa/

software/

collapse

true

#!/bin/bash -l
#SBATCH --job-name=hyp-$1
#SBATCH --output=hyperdrive.out
#SBATCH --nodes=1
#SBATCH --ntasks-per-node=40
#SBATCH --time=01:00:00
#SBATCH --clusters=garrawarla
#SBATCH --partition=gpuq
#SBATCH --account=mwavcs
#SBATCH --export=NONE
#SBATCH --gres=tmp:50g
#SBATCH --gres=gpu:1

# Load the Hyperdrive module
module use /pawsey/mwapython3/modulefiles
module load singularity
module load vcsbeam
module load psrcat
module load hyperdrive

1323690320
Anchor
1323690320
1323690320

Run Hyperdrive

Create Hyperdrive batch script:

Code Block

language	bash
theme	Midnight
title	/astro/mwavcs/vcs/1323690320/hyperdrive/hyperdrive.sbatch
collapse	true

#!/bin/bash -l
#SBATCH --job-name=hyp-$1
#SBATCH --output=hyperdrive.out
#SBATCH --nodes=1
#SBATCH --ntasks-per-node=40
#SBATCH --time=01:00:00
#SBATCH --clusters=garrawarla
#SBATCH --partition=gpuq
#SBATCH --account=mwavcs
#SBATCH --export=NONE
#SBATCH --gres=tmp:50g
#SBATCH --gres=gpu:1

# Load the Hyperdrive module
module use /pawsey/mwa/software/python3/modulefiles
module load hyperdrive
module load vcsbeam

set -eux
which hyperdrive

# The location of the correlated visibility FITS files:
DATADIR=/astro/mwavcs/asvo/253001

# The path to the associated metafits filesfile
CAL_METAFITS=${DATADIR}/1323690320.metafits
OBS_METAFITS=/astro/mwavcs/asvo/253008/1323690616.metafits
# <-- This is the observation for which the calibration solution is needed

# The The base source list (you shouldn't need to change this)
SRCLIST=/pawsey/mwa/software/python3/srclists/master/srclist_pumav3_EoR0aegean_fixedEoR1pietro+ForA_phase1+2.txt

# If it hasn't been done already, run Hyperdrive in "srclist-by-beam" to get just the subset of sources in the beam
if [[ ! -r srclist_1000.yaml ]]; then
   hyperdrive srclist-by-beam \
       -n 1000 \
       -m ${CAL_METAFITS} \
       /pawsey/mwa/software/python3/srclists/master/srclist_pumav3_EoR0aegean_fixedEoR1pietro+ForA_phase1+2.txt \
       srclist_1000.yaml
fi

# Run Hyperdrive to generate a calibration solution
hyperdrive di-calibrate \
    -s srclist_1000.yaml \
    -d ${DATADIR}/*.fits \
    ${CAL_METAFITS}

# Use VCSBeam to plot the solutions
srun -N 1 -n 1 mwa_plot_calibration -m ${OBS_METAFITS} -c ${CAL_METAFITS} -C hyperdrive_solutions.bin -R NONE -U 0,0 -O -X -z nan > plot_data.txt

# The following will have to be done on your own computer (not on Garrawarla)
# Download
#    (1) plot_calibration.py (use "which plot_calibration.py" to find out where it is)
#    (2) plot_data.txt
# and then run the following
#plot_calibration.py  --phases_png phases.png  --amps_png amps.png  plot_data.txt

...

Run the Hyperdrive script (on Garrawarla):

Code Block

language	bash
theme	Midnight
title	Run Hyperdrive on Garrawarla

cd /astro/mwavcs/vcs/1323690320/hyperdrive
sbatch hyperdrive.sbatch

Run VCSBeam plotting

Create VCSBeam plotting script:

Code Block

language	bash
theme	Midnight
title	/astro/mwavcs/vcs/1323690320/hyperdrive/plot.sbatch
collapse	true

#!/bin/bash -l
#SBATCH --job-name=plot_calsol
#SBATCH --output=plot_calsol.out
#SBATCH --nodes=1
#SBATCH --ntasks-per-node=2
#SBATCH --time=01:00:00
#SBATCH --clusters=garrawarla
#SBATCH --partition=gpuq
#SBATCH --account=mwavcs
#SBATCH --export=NONE
#SBATCH --gres=tmp:50g
#SBATCH --gres=gpu:1

# Load the VCSBeam module
module use /pawsey/mwa/software/python3/modulefiles
module load vcsbeam

# The location of the correlated visibility FITS files:
DATADIR=/astro/mwavcs/asvo/253001

# The paths to the associated metafits files
CAL_METAFITS=${DATADIR}/1323690320.metafits
OBS_METAFITS=/astro/mwavcs/asvo/253008/1323690616.metafits # <-- This is the observation for which the calibration solution is needed

# Use VCSBeam to plot the solutions
srun -N 1 -n 1 mwa_plot_calibration -m ${OBS_METAFITS} -c ${CAL_METAFITS} -C hyperdrive_solutions.bin -R NONE -U 0,0 -O -X -z nan > plot_data.txt

# The following will have to be done on your own computer (not on Garrawarla)
# Download
#    (1) plot_calibration.py (use "which plot_calibration.py" to find out where it is)
#    (2) plot_data.txt
# and then run the following
#plot_calibration.py  --phases_png phases.png  --amps_png amps.png  plot_data.txt

Run plotting script:

Code Block

language	bash
theme	Midnight
title	Run VCSBeam plotting on Garrawarla

cd /astro/mwavcs/vcs/1323690320/hyperdrive
sbatch plot.sbatch

Plot the calibration solutions (on your local computer, after downloading a copy of plot_calibration.py and plot_data.txt:

Code Block

language	bash
theme	Midnight
title	Plot calibration solutions on local machine

plot_calibration.py  --phases_png phases.png  --amps_png amps.png  plot_data.txt

Image AddedImage Added

Iterative step

It looks like the solutions are probably fine for most, if not all the antennas (except possibly HexE23, since there's a lot of power in the off-diagonal terms, Dpq and Dqp), but the curviness of the phases makes it hard to tell. Therefore, I will choose a reference antenna to plot all the phases relative to that. Since there's a bunch of tiles whose phases are strongly sloped (near the middle of the plot), I'll choose a reference tile with a negative slope as well, but whose gradient is not as steep... HexE25 will do. To do this, I need to re-run the plotting script with the following change:

Code Block

theme	Midnight

-R NONE --> -R HexE25

If I want to keep the old plots, I just make sure I rename the various output files to something different. Remaking the plots gives:

Image AddedImage Added

These solutions look fine (the on-diagonal terms, Dpp and Dqq, look straight). At the moment, I'm not trying to do polarimetry, so I don't need to worry about either the reference antenna or the PQ phase. By default, I should probably get rid of the cross terms (taking guidance from the imaging team). Therefore, I should be able to simply apply this solution with the following options to make_mwa_tied_array_beam:

Code Block

theme	Midnight

-R NONE -U 0,0
# (and without -X)

1323690616
Anchor
1323690616
1323690616

Make sure you have a calibration solution ready. this example uses the solution derived from observation 1323690320.

B0031-07
Anchor
1323690616-B0031-07
1323690616-B0031-07

Create a VCSBeam beamforming script:

Code Block

language	bash
theme	Midnight
title	/astro/mwavcs/vcs/1323690616/vcsbeam/vcsbeam_0031.sbatch
collapse	true

#!/bin/bash -l

#SBATCH --job-name=1323690616-0031
#SBATCH --output=vcsbeam_0031.out
#SBATCH --nodes=24
#SBATCH --ntasks-per-node=1
#SBATCH --cpus-per-task=1
#SBATCH --mem=370gb
#SBATCH --partition=gpuq
#SBATCH --gres=gpu:1
#SBATCH --time=03:00:00
#SBATCH --account=mwavcs
#SBATCH --nice=0
#SBATCH --export=NONE

# Load the VCSBeam module 
module use /pawsey/mwa/software/python3/modulefiles
module load vcsbeam

# Define the directories where the data are
DATADIR=/astro/mwavcs/asvo/253008
CALSOL=/astro/mwavcs/vcs/1323690320/hyperdrive/hyperdrive_solutions.bin

OBS_METAFITS=${DATADIR}/1323690616.metafits
CAL_METAFITS=/astro/mwavcs/asvo/253001/1323690320.metafits

# Run VCSBeam for all 24 coarse channels
# Start 8 seconds in, just to avoid quacktime
# -p -v = Output both PSRFITS and VDIF
srun -N 24 -n 24 make_mwa_tied_array_beam \
    -m ${OBS_METAFITS} \
    -b 1323690624 \
    -T 1192 \
    -f 109 \
    -d ${DATADIR} \
    -P pointings_0031.txt \
    -c ${CAL_METAFITS} \
    -C ${CALSOL} \
    -O \
    -R NONE -U 0,0 \
    -p \
    -v

Prepare a pointings file (PSR B0031-07):

Code Block

language	bash
theme	Midnight
title	/astro/mwavcs/vcs/1323690616/vcsbeam/pointings_0031.txt
collapse	true

00:34:08.8703 -07:21:53.409

Run the VCSBeam beamforming script:

Code Block

language	bash
theme	Midnight
title	Run VCSBeam beamforming on Garrawarla

cd /astro/mwavcs/vcs/1323690616/vcsbeam
sbatch vcsbeam_0031.sbatch

Generate an ephemeris:

Code Block

language	bash
theme	Midnight
title	Run psrcat on Garrawarla

psrcat -e J0034-0534 > 0034.par

Use PRESTO's prepfold utility to fold on the pulsar's period from the FITS files:

Code Block

language	bash
theme	Midnight
title	Run PRESTO prepfold on Garrawarla

cd /astro/mwavcs/vcs/1323690616/vcsbeam
/pawsey/mwa/singularity/presto/presto.sif prepfold -psr J0034-0721 -nosearch -nodmsearch G0057_1323690616_00:34:08.87_-07:21:53.41_ch109-132_00*.fits

Image Added

Use DSPSR and PSRCHIVE to fold on the pulsar's period from the VDIF files:

Code Block

language	bash
theme	Midnight
title	Run PRESTO prepfold on Garrawarla

cd /astro/mwavcs/vcs/1323690616/vcsbeam
for freq in {109..132}; do /pawsey/mwa/singularity/dspsr/dspsr.sif dspsr -E 0031.par -b 512 -L 10 -A -O B0031-07_ch${freq}.ar G0057_1323690616_00:34:08.87_-07:21:53.41_ch${freq}.hdr; done
/pawsey/mwa/singularity/dspsr/dspsr.sif psradd -o B0031-07.ar -R B0031-07_ch1*
# (Did some pazi flagging: there was something weird in the first subint. This generated B0031-07.ar.pazi)
pav -g B0031-07.png/png -DFT B0031-07.ar.pazi

Image Added

J0036-1033
Anchor
1323690616-J0036-1033
1323690616-J0036-1033

Create a VCSBeam beamforming script:

Code Block

language	bash
theme	Midnight
title	/astro/mwavcs/vcs/1323690616/vcsbeam/vcsbeam_0036.sbatch
collapse	true

#!/bin/bash -l

#SBATCH --job-name=1323690616-0036
#SBATCH --output=vcsbeam_0036.out
#SBATCH --nodes=24
#SBATCH --ntasks-per-node=1
#SBATCH --cpus-per-task=1
#SBATCH --mem=370gb
#SBATCH --partition=gpuq
#SBATCH --gres=gpu:1
#SBATCH --time=03:00:00
#SBATCH --account=mwavcs
#SBATCH --nice=0
#SBATCH --export=NONE

# Load the VCSBeam module 
module use /pawsey/mwa/software/python3/modulefiles
module load vcsbeam

# Define the directories where the data are
DATADIR=/astro/mwavcs/asvo/253008
CALSOL=/astro/mwavcs/vcs/1323690320/hyperdrive/hyperdrive_solutions.bin

OBS_METAFITS=${DATADIR}/1323690616.metafits
CAL_METAFITS=/astro/mwavcs/asvo/253001/1323690320.metafits

# Run VCSBeam for all 24 coarse channels
# Start 8 seconds in, just to avoid quacktime
# -p -v = Output both PSRFITS and VDIF
srun -N 24 -n 24 make_mwa_tied_array_beam \
    -m ${OBS_METAFITS} \
    -b 1323690624 \
    -T 1192 \
    -f 109 \
    -d ${DATADIR} \
    -P pointings_0036.txt \
    -c ${CAL_METAFITS} \
    -C ${CALSOL} \
    -O \
    -R NONE -U 0,0 \
    -p \
    -v

Prepare a pointings file (PSR J0036-1033):

Code Block

language	bash
theme	Midnight
title	/astro/mwavcs/vcs/1323690616/vcsbeam/pointings_0036.txt
collapse	true

00:36:15.1 -10:33:14

Run the VCSBeam beamforming script:

Code Block

language	bash
theme	Midnight
title	Run VCSBeam beamforming on Garrawarla

cd /astro/mwavcs/vcs/1323690616/vcsbeam
sbatch vcsbeam_0036.sbatch

Get an ephemeris from Nick:

Code Block

language	bash
theme	Midnight
title	/astro/mwavcs/vcs/1323690616/vcsbeam/0036.par
collapse	true

PSRJ           J0036-1033
RAJ            00:36:14.70                 
DECJ           -10:33:37.18                
F0             1.1111412561028151282     1  0.00000000152553465775   
F1             -3.9179999999999999999e-14    2.264e-14                
PEPOCH         46635                       
POSEPOCH       46635                       
DMEPOCH        46635                       
DM             23.123                      
EPHEM          DE405

Use PRESTO's prepfold utility to fold on the pulsar's period from the FITS files:

Code Block

language	bash
theme	Midnight
title	Run PRESTO prepfold on Garrawarla

cd /astro/mwavcs/vcs/1323690616/vcsbeam
/pawsey/mwa/singularity/presto/presto.sif prepfold -par 0036.par -nosearch -nodmsearch G0057_1323690616_00:36:15.10_-10:33:14.00_ch109-132_00*.fits

Image Added

Use DSPSR and PSRCHIVE to fold on the pulsar's period from the VDIF files:

Code Block

language	bash
theme	Midnight
title	Run PRESTO prepfold on Garrawarla

cd /astro/mwavcs/vcs/1323690616/vcsbeam
for freq in {109..132}; do /pawsey/mwa/singularity/dspsr/dspsr.sif dspsr -E 0036.par -b 512 -L 10 -A -O J0036-1033_ch${freq}.ar G0057_1323690616_00:36:15.10_-10:33:14.00_ch${freq}.hdr; done

J0034-0534
Anchor
1323690616-J0034-0534
1323690616-J0034-0534

Create a VCSBeam beamforming script:

Code Block

language	bash
theme	Midnight
title	/astro/mwavcs/vcs/1323690616/vcsbeam/vcsbeam_0036.sbatch
collapse	true

#!/bin/bash -l

#SBATCH --job-name=1323690616-0034
#SBATCH --output=vcsbeam_0034.out
#SBATCH --nodes=24
#SBATCH --ntasks-per-node=1
#SBATCH --cpus-per-task=1
#SBATCH --mem=370gb
#SBATCH --partition=gpuq
#SBATCH --gres=gpu:1
#SBATCH --time=03:00:00
#SBATCH --account=mwavcs
#SBATCH --nice=0
#SBATCH --export=NONE

# Load the VCSBeam module 
module use /pawsey/mwa/software/python3/modulefiles
module load vcsbeam

# Define the directories where the data are
DATADIR=/astro/mwavcs/asvo/253008
CALSOL=/astro/mwavcs/vcs/1323690320/hyperdrive/hyperdrive_solutions.bin

OBS_METAFITS=${DATADIR}/1323690616.metafits
CAL_METAFITS=/astro/mwavcs/asvo/253001/1323690320.metafits

# Run VCSBeam for all 24 coarse channels
# Start 8 seconds in, just to avoid quacktime
# -p -v = Output both PSRFITS and VDIF
srun -N 24 -n 24 make_mwa_tied_array_beam \
    -m ${OBS_METAFITS} \
    -b 1323690624 \
    -T 1192 \
    -f 109 \
    -d ${DATADIR} \
    -P pointings_0034.txt \
    -c ${CAL_METAFITS} \
    -C ${CALSOL} \
    -O \
    -R NONE -U 0,0 \
    -p \
    -v

Prepare a pointings file (PSR J0034-0534):

Code Block

language	bash
theme	Midnight
title	/astro/mwavcs/vcs/1323690616/vcsbeam/pointings_0036.txt
collapse	true

00:34:21.83422 -05:34:36.722

Run the VCSBeam beamforming script:

Code Block

language	bash
theme	Midnight
title	Run VCSBeam beamforming on Garrawarla

cd /astro/mwavcs/vcs/1323690616/vcsbeam
sbatch vcsbeam_0034.sbatch

Use PRESTO's prepfold utility to fold on the pulsar's period from the FITS files:

Code Block

language	bash
theme	Midnight
title	Run PRESTO prepfold on Garrawarla

cd /astro/mwavcs/vcs/1323690616/vcsbeam
/pawsey/mwa/singularity/presto/presto.sif prepfold -psr J0034-0534 -nosearch -nodmsearch G0057_1323690616_00:34:21.83_-05:34:36.72_ch109-132_00*.fits

Image Added

FAIL!!

Generate an ephemeris:

Code Block

language	bash
theme	Midnight
title	Run psrcat on Garrawarla

psrcat -e J0034-0534 > 0034.par

Use DSPSR and PSRCHIVE to fold on the pulsar's period from the VDIF files:

Code Block

language	bash
theme	Midnight
title	Run Hyperdrive PRESTO prepfold on Garrawarla

cd /astro/mwavcs/vcs/1323690320/hyperdrive
sbatch hyperdrive.sbatch

Plot the calibration solutions (on your local computer, after downloading a copy of plot_calibration.py and plot_data.txt:

Code Block

language	bash
theme	Midnight
title	Plot calibration solutions on local machine

plot_calibration.py  --phases_png phases.png  --amps_png amps.png  plot_data.txt

...

1323690616/vcsbeam
psrcat -e J0034-0534 > 0034.par
for freq in {109..132}; do /pawsey/mwa/singularity/dspsr/dspsr.sif dspsr -E 0034.par -b 512 -L 10 -A -O J0034-0534_ch${freq}.ar G0057_1323690616_00:34:21.83_-05:34:36.72_ch${freq}.hdr; done

1323708616
Anchor
1323708616
1323708616

...

Versions Compared

Old Version 14

New Version Current

Key

Processing details

Processing details

Setting up Garrawarla environment

1323690320
Anchor
1323690320
1323690320

Run Hyperdrive

Run VCSBeam plotting

Iterative step

1323690616
Anchor
1323690616
1323690616

B0031-07
Anchor
1323690616-B0031-07
1323690616-B0031-07

J0036-1033
Anchor
1323690616-J0036-1033
1323690616-J0036-1033

J0034-0534
Anchor
1323690616-J0034-0534
1323690616-J0034-0534

1323708616
Anchor
1323708616
1323708616

Page Comparison

Versions Compared

Old Version 14

New Version Current

Key

Processing details

Processing details

Setting up Garrawarla environment

1323690320 Anchor13236903201323690320

Run Hyperdrive

Run VCSBeam plotting

Iterative step

1323690616 Anchor13236906161323690616

B0031-07 Anchor1323690616-B0031-071323690616-B0031-07

J0036-1033 Anchor1323690616-J0036-10331323690616-J0036-1033

J0034-0534 Anchor1323690616-J0034-05341323690616-J0034-0534

1323708616 Anchor13237086161323708616

1323690320
Anchor
1323690320
1323690320

1323690616
Anchor
1323690616
1323690616

B0031-07
Anchor
1323690616-B0031-07
1323690616-B0031-07

J0036-1033
Anchor
1323690616-J0036-1033
1323690616-J0036-1033

J0034-0534
Anchor
1323690616-J0034-0534
1323690616-J0034-0534

1323708616
Anchor
1323708616
1323708616