...
| Obsid | Duration (sec) | Files | Pulsar(s) / Calibrator(s) | RA/Dec | PC RA/Dec | Az/El | Goal | Processing | Download folder | VCSBeam version* | Beamforming time |
|---|
| 1323690320 | 296 | 24 | In-beam calibration (for 1323690616) | 11.8 / -5.8 | 8.5 / -7.4 | 341.6 / 68.0 | 1, 5 | | /astro/mwavcs/asvo/253001 | v3.3.31_c279695 |
|
| 1323690616 | 1200 | 3600 VCS | B0031-07
J0036-1033
J0034-0534 | 8.0 / -5.2 | 8.5 / -7.4 | 326.3 / 64.7 | 1, 5 | | /astro/mwavcs/asvo/253008 | v3.3.31_c279695 | 1 channel: 1600s
24 channels: 4200-5000s |
| 1323708616 | 296 | 24 | In-beam calibration (for 1323709032) | 95.1 / -26.7 | 97.7 / -28.6 | 0.0 / 90.0 | 1, 4 | | /astro/mwavcs/asvo/253000 |
|
|
| 1323708912 | 120 | 24 | PicA (for 1323709032) | 75.9 / -46.4 | 80.0 / -45.8 | 213.7 / 64.7 | 1, 4 | | /astro/mwavcs/asvo/252998 |
|
|
| 1323709032 | 600 | 1800 VCS | B0628-28 | 97.5 / -26.7 | 97.7 / -28.6 | 0.0 / 90.0 | 1, 4 | | /astro/mwavcs/asvo/253009 |
|
|
| 1323776720 | 120 | 24 | PKS2356-61 (for 1323776840) | 4.3 / -62.7 | 359.8 / -60.9 | 191.3 / 52.8 | 1, 2 | | /astro/mwavcs/asvo/252999 |
|
|
| 1323776840 | 1200 | 3600 VCS | J2241-5236 | 346.9 / -51.9 | 340.4 / -52.6 | 216.9 / 53.6 | 1, 2 | | /astro/mwavcs/asvo/253010 |
|
|
*VCSBeam version is the earliest version that was successfully used for the processing. For calibration observations, this means using mwa_plot_calibration, and for the VCS observations, make_mwa_tied_array_beam.
Processing details
...
Run Hyperdrive
...
Setting up Garrawarla environment
| Code Block |
|---|
| language | bash |
|---|
| theme | Midnight |
|---|
| title | /astro/mwavcs/vcs/1323690320/hyperdrive/hyperdrive.sbatch |
|---|
| collapse | true |
|---|
| #!/bin/bash -l
#SBATCH --job-name=hyp-$1
#SBATCH --output=hyperdrive.out
#SBATCH --nodes=1
#SBATCH --ntasks-per-node=40
#SBATCH --time=01:00:00
#SBATCH --clusters=garrawarla
#SBATCH --partition=gpuq
#SBATCH --account=mwavcs
#SBATCH --export=NONE
#SBATCH --gres=tmp:50g
#SBATCH --gres=gpu:1
# Load the Hyperdrive module
module use /pawsey/mwa/software/python3/modulefiles
module load hyperdrive
set -eux
which hyperdrive
# | Setting up Garrawarla environment |
|
module use /pawsey/mwa/software/python3/modulefiles
module load singularity
module load vcsbeam
module load psrcat
module load hyperdrive |
1323690320
Run Hyperdrive
Create Hyperdrive batch script:
| Code Block |
|---|
| language | bash |
|---|
| theme | Midnight |
|---|
| title | /astro/mwavcs/vcs/1323690320/hyperdrive/hyperdrive.sbatch |
|---|
| collapse | true |
|---|
|
#!/bin/bash -l
#SBATCH --job-name=hyp-$1
#SBATCH --output=hyperdrive.out
#SBATCH --nodes=1
#SBATCH --ntasks-per-node=40
#SBATCH --time=01:00:00
#SBATCH --clusters=garrawarla
#SBATCH --partition=gpuq
#SBATCH --account=mwavcs
#SBATCH --export=NONE
#SBATCH --gres=tmp:50g
#SBATCH --gres=gpu:1
# Load the Hyperdrive module
module use /pawsey/mwa/software/python3/modulefiles
module load hyperdrive
set -eux
which hyperdrive
# The location of the correlated visibility FITS files:
DATADIR=/astro/mwavcs/asvo/253001
# The path to the associated metafits file
CAL_METAFITS=${DATADIR}/1323690320.metafits
# The base source list (you shouldn't need to change this)
SRCLIST=/pawsey/mwa/software/python3/srclists/master/srclist_pumav3_EoR0aegean_fixedEoR1pietro+ForA_phase1+2.txt
# If it hasn't been done already, run Hyperdrive in "srclist-by-beam" to get just the subset of sources in the beam
if [[ ! -r srclist_1000.yaml ]]; then
hyperdrive srclist-by-beam \
-n 1000 \
-m ${CAL_METAFITS} \
/pawsey/mwa/software/python3/srclists/master/srclist_pumav3_EoR0aegean_fixedEoR1pietro+ForA_phase1+2.txt \
srclist_1000.yaml
fi
# Run Hyperdrive to generate a calibration solution
hyperdrive di-calibrate \
-s srclist_1000.yaml \
-d ${DATADIR}/*.fits \
${CAL_METAFITS} |
...
It looks like the solutions are probably fine for most, if not all the antennas (except possibly HexE23, since there's a lot of power in the off-diagonal terms, Dpq and Dqp), but the curviness of the phases makes it hard to tell. Therefore, I will choose a reference antenna to plot all the phases relative to that. Since there's a bunch of tiles whose phases are strongly sloped (in near the middle of the plot), I'll choose a reference tile with a negative slope as well, but whose gradient is not as steep... HexE25 will do. To do this, I need to re-run the plotting script with the following change:
...
| Code Block |
|---|
|
-R NONE -U 0,0
# (and without -X) |
...
NONE -U 0,0
# (and without -X) |
1323690616
Make sure you have a calibration solution ready. this example uses the solution derived from observation 1323690320.
B0031-07
| Anchor |
|---|
| 1323690616-B0031-07 |
|---|
| 1323690616-B0031-07 |
|---|
|
Create a VCSBeam beamforming script:
| Code Block |
|---|
| language | bash |
|---|
| theme | Midnight |
|---|
| title | /astro/mwavcs/vcs/1323690616/vcsbeam/vcsbeam_0031.sbatch |
|---|
| collapse | true |
|---|
|
#!/bin/bash -l
#SBATCH --job-name=1323690616-0031
#SBATCH --output=vcsbeam_0031.out
#SBATCH --nodes=24
#SBATCH --ntasks-per-node=1
#SBATCH --cpus-per-task=1
#SBATCH --mem=370gb
#SBATCH --partition=gpuq
#SBATCH --gres=gpu:1
#SBATCH --time=03:00:00
#SBATCH --account=mwavcs
#SBATCH --nice=0
#SBATCH --export=NONE
# Load the VCSBeam module
module use /pawsey/mwa/software/python3/modulefiles
module load vcsbeam
# Define the directories where the data are
DATADIR=/astro/mwavcs/asvo/253008
CALSOL=/astro/mwavcs/vcs/1323690320/hyperdrive/hyperdrive_solutions.bin
OBS_METAFITS=${DATADIR}/1323690616.metafits
CAL_METAFITS=/astro/mwavcs/asvo/253001/1323690320.metafits
# Run VCSBeam for all 24 coarse channels
# Start 8 seconds in, just to avoid quacktime
# -p -v = Output both PSRFITS and VDIF
srun -N 24 -n 24 make_mwa_tied_array_beam \
-m ${OBS_METAFITS} \
-b 1323690624 \
-T 1192 \
-f 109 \
-d ${DATADIR} \
-P pointings_0031.txt \
-c ${CAL_METAFITS} \
-C ${CALSOL} \
-O \
-R NONE -U 0,0 \
-p \
-v |
Prepare a pointings file (PSR B0031-07):
| Code Block |
|---|
| language | bash |
|---|
| theme | Midnight |
|---|
| title | /astro/mwavcs/vcs/1323690616/vcsbeam/pointings_0031.txt |
|---|
| collapse | true |
|---|
|
00:34:08.8703 -07:21:53.409 |
Run the VCSBeam beamforming script:
| Code Block |
|---|
| language | bash |
|---|
| theme | Midnight |
|---|
| title | Run VCSBeam beamforming on Garrawarla |
|---|
|
cd /astro/mwavcs/vcs/1323690616/vcsbeam
sbatch vcsbeam_0031.sbatch |
Generate an ephemeris:
| Code Block |
|---|
| language | bash |
|---|
| theme | Midnight |
|---|
| title | Run psrcat on Garrawarla |
|---|
|
psrcat -e J0034-0534 > 0034.par |
Use PRESTO's prepfold utility to fold on the pulsar's period from the FITS files:
| Code Block |
|---|
| language | bash |
|---|
| theme | Midnight |
|---|
| title | Run PRESTO prepfold on Garrawarla |
|---|
|
cd /astro/mwavcs/vcs/1323690616/vcsbeam
/pawsey/mwa/singularity/presto/presto.sif prepfold -psr J0034-0721 -nosearch -nodmsearch G0057_1323690616_00:34:08.87_-07:21:53.41_ch109-132_00*.fits |
Image Added
Use DSPSR and PSRCHIVE to fold on the pulsar's period from the VDIF files:
| Code Block |
|---|
| language | bash |
|---|
| theme | Midnight |
|---|
| title | Run PRESTO prepfold on Garrawarla |
|---|
|
cd /astro/mwavcs/vcs/1323690616/vcsbeam
for freq in {109..132}; do /pawsey/mwa/singularity/dspsr/dspsr.sif dspsr -E 0031.par -b 512 -L 10 -A -O B0031-07_ch${freq}.ar G0057_1323690616_00:34:08.87_-07:21:53.41_ch${freq}.hdr; done
/pawsey/mwa/singularity/dspsr/dspsr.sif psradd -o B0031-07.ar -R B0031-07_ch1*
# (Did some pazi flagging: there was something weird in the first subint. This generated B0031-07.ar.pazi)
pav -g B0031-07.png/png -DFT B0031-07.ar.pazi |
Image Added
J0036-1033
| Anchor |
|---|
| 1323690616-J0036-1033 |
|---|
| 1323690616-J0036-1033 |
|---|
|
Create a VCSBeam beamforming script:
| Code Block |
|---|
| language | bash |
|---|
| theme | Midnight |
|---|
| title | /astro/mwavcs/vcs/1323690616/vcsbeam/vcsbeam_0036.sbatch |
|---|
| collapse | true |
|---|
|
#!/bin/bash -l
#SBATCH --job-name=1323690616-0036
#SBATCH --output=vcsbeam_0036.out
#SBATCH --nodes=24
#SBATCH --ntasks-per-node=1
#SBATCH --cpus-per-task=1
#SBATCH --mem=370gb
#SBATCH --partition=gpuq
#SBATCH --gres=gpu:1
#SBATCH --time=03:00:00
#SBATCH --account=mwavcs
#SBATCH --nice=0
#SBATCH --export=NONE
# Load the VCSBeam module
module use /pawsey/mwa/software/python3/modulefiles
module load vcsbeam
# Define the directories where the data are
DATADIR=/astro/mwavcs/asvo/253008
CALSOL=/astro/mwavcs/vcs/1323690320/hyperdrive/hyperdrive_solutions.bin
OBS_METAFITS=${DATADIR}/1323690616.metafits
CAL_METAFITS=/astro/mwavcs/asvo/253001/1323690320.metafits
# Run VCSBeam for all 24 coarse channels
# Start 8 seconds in, just to avoid quacktime
# -p -v = Output both PSRFITS and VDIF
srun -N 24 -n 24 make_mwa_tied_array_beam \
-m ${OBS_METAFITS} \
-b 1323690624 \
-T 1192 \
-f 109 \
-d ${DATADIR} \
-P pointings_0036.txt \
-c ${CAL_METAFITS} \
-C ${CALSOL} \
-O \
-R NONE -U 0,0 \
-p \
-v |
Prepare a pointings file (PSR J0036-1033):
| Code Block |
|---|
| language | bash |
|---|
| theme | Midnight |
|---|
| title | /astro/mwavcs/vcs/1323690616/vcsbeam/pointings_0036.txt |
|---|
| collapse | true |
|---|
|
00:36:15.1 -10:33:14 |
Run the VCSBeam beamforming script:
| Code Block |
|---|
| language | bash |
|---|
| theme | Midnight |
|---|
| title | Run VCSBeam beamforming on Garrawarla |
|---|
|
cd /astro/mwavcs/vcs/1323690616/vcsbeam
sbatch vcsbeam_0036.sbatch |
Get an ephemeris from Nick:
| Code Block |
|---|
| language | bash |
|---|
| theme | Midnight |
|---|
| title | /astro/mwavcs/vcs/1323690616/vcsbeam/0036.par |
|---|
| collapse | true |
|---|
|
PSRJ J0036-1033
RAJ 00:36:14.70
DECJ -10:33:37.18
F0 1.1111412561028151282 1 0.00000000152553465775
F1 -3.9179999999999999999e-14 2.264e-14
PEPOCH 46635
POSEPOCH 46635
DMEPOCH 46635
DM 23.123
EPHEM DE405 |
Use PRESTO's prepfold utility to fold on the pulsar's period from the FITS files:
| Code Block |
|---|
| language | bash |
|---|
| theme | Midnight |
|---|
| title | Run PRESTO prepfold on Garrawarla |
|---|
|
cd /astro/mwavcs/vcs/1323690616/vcsbeam
/pawsey/mwa/singularity/presto/presto.sif prepfold -par 0036.par -nosearch -nodmsearch G0057_1323690616_00:36:15.10_-10:33:14.00_ch109-132_00*.fits |
Image Added
Use DSPSR and PSRCHIVE to fold on the pulsar's period from the VDIF files:
| Code Block |
|---|
| language | bash |
|---|
| theme | Midnight |
|---|
| title | Run PRESTO prepfold on Garrawarla |
|---|
|
cd /astro/mwavcs/vcs/1323690616/vcsbeam
for freq in {109..132}; do /pawsey/mwa/singularity/dspsr/dspsr.sif dspsr -E 0036.par -b 512 -L 10 -A -O J0036-1033_ch${freq}.ar G0057_1323690616_00:36:15.10_-10:33:14.00_ch${freq}.hdr; done |
J0034-0534
| Anchor |
|---|
| 1323690616-J0034-0534 |
|---|
| 1323690616-J0034-0534 |
|---|
|
Create a VCSBeam beamforming script:
| Code Block |
|---|
| language | bash |
|---|
| theme | Midnight |
|---|
| title | /astro/mwavcs/vcs/1323690616/vcsbeam/vcsbeam_0036.sbatch |
|---|
| collapse | true |
|---|
|
#!/bin/bash -l
#SBATCH --job-name=1323690616-0034
#SBATCH --output=vcsbeam_0034.out
#SBATCH --nodes=24
#SBATCH --ntasks-per-node=1
#SBATCH --cpus-per-task=1
#SBATCH --mem=370gb
#SBATCH --partition=gpuq
#SBATCH --gres=gpu:1
#SBATCH --time=03:00:00
#SBATCH --account=mwavcs
#SBATCH --nice=0
#SBATCH --export=NONE
# Load the VCSBeam module
module use /pawsey/mwa/software/python3/modulefiles
module load vcsbeam
# Define the directories where the data are
DATADIR=/astro/mwavcs/asvo/253008
CALSOL=/astro/mwavcs/vcs/1323690320/hyperdrive/hyperdrive_solutions.bin
OBS_METAFITS=${DATADIR}/1323690616.metafits
CAL_METAFITS=/astro/mwavcs/asvo/253001/1323690320.metafits
# Run VCSBeam for all 24 coarse channels
# Start 8 seconds in, just to avoid quacktime
# -p -v = Output both PSRFITS and VDIF
srun -N 24 -n 24 make_mwa_tied_array_beam \
-m ${OBS_METAFITS} \
-b 1323690624 \
-T 1192 \
-f 109 \
-d ${DATADIR} \
-P pointings_0034.txt \
-c ${CAL_METAFITS} \
-C ${CALSOL} \
-O \
-R NONE -U 0,0 \
-p \
-v |
Prepare a pointings file (PSR J0034-0534):
| Code Block |
|---|
| language | bash |
|---|
| theme | Midnight |
|---|
| title | /astro/mwavcs/vcs/1323690616/vcsbeam/pointings_0036.txt |
|---|
| collapse | true |
|---|
|
00:34:21.83422 -05:34:36.722 |
Run the VCSBeam beamforming script:
| Code Block |
|---|
| language | bash |
|---|
| theme | Midnight |
|---|
| title | Run VCSBeam beamforming on Garrawarla |
|---|
|
cd /astro/mwavcs/vcs/1323690616/vcsbeam
sbatch vcsbeam_0034.sbatch |
Use PRESTO's prepfold utility to fold on the pulsar's period from the FITS files:
| Code Block |
|---|
| language | bash |
|---|
| theme | Midnight |
|---|
| title | Run PRESTO prepfold on Garrawarla |
|---|
|
cd /astro/mwavcs/vcs/1323690616/vcsbeam
/pawsey/mwa/singularity/presto/presto.sif prepfold -psr J0034-0534 -nosearch -nodmsearch G0057_1323690616_00:34:21.83_-05:34:36.72_ch109-132_00*.fits |
Image Added
FAIL!!
Generate an ephemeris:
| Code Block |
|---|
| language | bash |
|---|
| theme | Midnight |
|---|
| title | Run psrcat on Garrawarla |
|---|
|
psrcat -e J0034-0534 > 0034.par |
Use DSPSR and PSRCHIVE to fold on the pulsar's period from the VDIF files:
| Code Block |
|---|
| language | bash |
|---|
| theme | Midnight |
|---|
| title | Run PRESTO prepfold on Garrawarla |
|---|
|
cd /astro/mwavcs/vcs/1323690616/vcsbeam
psrcat -e J0034-0534 > 0034.par
for freq in {109..132}; do /pawsey/mwa/singularity/dspsr/dspsr.sif dspsr -E 0034.par -b 512 -L 10 -A -O J0034-0534_ch${freq}.ar G0057_1323690616_00:34:21.83_-05:34:36.72_ch${freq}.hdr; done |
1323708616
...