This page is to capture the general types of issues (with some examples) encountered with the Legacy MWA correlator. Many of these issued had previously gone unnoticed, because of the overly permissive assumptions it made about gpubox aligmnent. With Birli, we see these issues more clearly.

Diagnostic Tools

One of the simplest ways to extract detailed diagnostic information from the metafits and raw gpubox file formats of the legacy correlator is to use the fitsheader  command line tool provided by Astropy. This Python library is also useful for correcting erroneous header values so that the files can be correctly processed.

MILLITIM header fixed to zero gives duplicate HDU timestamps

Symptoms

• Groups of adjacent HDUs in the same gpubox file have the timestamp, according to the combination of the TIME  and MILLITIME headers of each HDU
• Only visible with with non-integer INTTIME  (e.g. 0.5s)

Example

> fitsheader 1059505936_20130802191158_gpubox01_00.fits --keyword '*TIM*'
# HDU 0 in 1059505936_20130802191158_gpubox01_00.fits:
TIME    =           1375470717 / Unix time (seconds)
MILLITIM=                    0 / Milliseconds since TIME 

# HDU 1 in 1059505936_20130802191158_gpubox01_00.fits:
TIME    =           1375470717 / Unix time (seconds)
MILLITIM=                    0 / Milliseconds since TIME 

Potential fixes

• Use a script to update the incorrect MILLITIM  headers

HDU timestamps out of sync between gpubox files

Symptoms

• One or more gpubox files have timestamps that fall in between the timestamps of the other gpuboxes
• Only visible with INTTIME > 1s

Example

# TODO 1092080416

Potential fixes

• Process groups of gpuboxes with common timesteps separately

Data ends ahead of schedule

Symptoms

• some or all gpubox files have less timesteps than specified in the metafits
• in severe cases, the data can run out before GOODTIME, meaning all data is considered contaminated.

Example

# TODO 1088203096