Deletion Round 2024-12

Introduction

This is the second deletion round and supports the Data Retention Policy/Procedure in ensuring capacity is available for new observations by removing the oldest, and/or least valuable data in the archive.

Prepare wiki pages containing details and summaries of data which is proposed for deletion: 15-Nov-2024
Deletion announcement sent to MWA members via email and four week consultation period start: ??-Nov-2024
Four week consultation period end: ?? December 2024 at 23:59 AWST
Sign off: TBA
Commence deletion: TBA
Deletion complete: TBA

Please use this four week consultation period to carefully review the above information. If you would like some or all the data for a delete request retained, as per the policy/procedure, please prepare a submission in writing to the MWA Director before the end of the consultation period and include:

  • the dataset in question;

  • the reason(s) for temporary retention of the dataset- for example, the significance of the dataset, the data retention requirements of the researcher’s institute, and the proposed plan for copying and storing the dataset offsite.

  • total size of the dataset to be retained

The MWA Director (or delegate) will then assess the request for retention and will respond in writing. Please note that any of the data approved for retention will not be deleted this round.

If you have any questions about the data nominated for deletion or this process, please reach out to the Principal Scientists.

Summary of Proposed Deletions by Delete Request

delete_request_id

created / requested by

Request Created

request name

data volume (TB)

observations

Full or Partial delete

comment

delete_request_id

created / requested by

Request Created

request name

data volume (TB)

observations

Full or Partial delete

comment

TOTAL (27 delete requests)

2,490

30,068

Mixed

 

Delete Request 38

Ramesh Bhat

3/10/2023

Bad G0097 observation - clock issues

96

1

Full

Request Created: RRI clocks not in sync, deletion authorised by R Bhat in email to AW on 2023-10-03

Delete Request 39

Bradley Meyers

28/11/2023

Unusable SMART O11 observation, re-observed on July 14

85

1

Full

Request Created: Confirmed by email from B.Meyers to AW on 2023/10/23

Delete Request 40

Natasha Hurley-Walker

11/12/2023

D0044 observations mistakenly scheduled in VCS mode

86

12

Full

Request Created: Confirmed in email from NHW to AW on 2023-12-01

Delete Request 41

Sam McSweeney

12/01/2024

Delete Sam McSweeney's lightning observations for G0081

119

24

Full

Request Created: As confirmed in email from PI on 2023/12/08

Delete Request 43

Gemma Anderson

24/04/2024

G0094 GRB VO trigger false events

57

6

Full

Unneeded buffer dump data

Delete Request 44

Greg Sleap

25/06/2024

Observations which are NO_CAPTURE but have data files in D0004

8

4

Full

Request Created: Unlikely to be useful data

Delete Request 45

Nick Seymour

25/06/2024

D0000 DDT observations for 2022_TC4-poor tile health

10

316

Full

Request Created: Requested by Nick Seymour

Delete Request 46

Greg Sleap

25/06/2024

Legacy VCS observations with test in the observation name

304

129

Full

Request Created: Low value data with very few downloads

Delete Request 47

Gemma Anderson

25/06/2024

LVC_S240623 buffer and VCS trigger data

5

2

Partial-only buffer files to be deleted

Request Created: Event retracted, as per email from Gemma Anderson on 2024-06-24

Delete Request 48

Gemma Anderson

25/06/2024

LVC_S240623 buffer and VCS trigger data

4

1

Partial-only buffer files to be deleted

Request Created: Event retracted, as per email from Gemma Anderson on 2024-06-24

Delete Request 49

Natasha Hurley-Walker

12/07/2024

Corrupted fringe-stopping observations for Natasha Hurley-Walker

5

83

Full

Request Created: As per email from PI on G0080 and D0042, on 2024-07-12

Delete Request 50

John Morgan

15/07/2024

Corrupted fringe-stopping observations for John Morgan

4

64

Full

Request Created: As per email from PI on G0060, on 2024-07-12

Delete Request 51

Natasha Hurley-Walker

14/08/2024

D0044 - Follow-up of Galactic radio transients: low value data- non-detections of transients

26

173

Full

Request Created: Requested to be deleted by the PI (Hurley-Walker)

Delete Request 52

Natasha Hurley-Walker

14/08/2024

G0092 - Monitoring a long-period radio transient: low value MWAX VCS data- non-detections of transient

285

40

Full

Request Created: Requested to be deleted by the PI (Hurley-Walker)

Delete Request 53

Ramesh Bhat

2/09/2024

D0049 - New MWA pulsar discovery timing: pulsar followup observation

57

1

Full

Request Created: Delete as per email from Ramesh Bhat on 2024-08-27

Delete Request 54

Gemma Anderson

4/09/2024

Invalid SWIFT trigger pushed during software testing

14

1

Full

Request Created: As per email from Gemma Anderson on 2024-09-04

Delete Request 56

Gemma Anderson

3/10/2024

Un-needed trigger observations

76

10

Full

Request Created: G0055 and G0094 triggers, deleted as per email from Gemma Anderson on 2024-09-18

Delete Request 57

Greg Sleap

8/10/2024

32T and commissioning observations

148

11165

Full

Request Created: All 32T and observations prior to science operations starting in 1-Jul-2013

Delete Request 58

Greg Sleap

8/10/2024

Partial delete of incomplete recombined Legacy VCS tar files

105

10

Partial-removal of redundant tar files

Request Created: These observations were only partially recombined- we will remove the partial tar files.

Delete Request 59

Greg Sleap

8/10/2024

Partial delete of incomplete recombined Legacy VCS ics files

0.5

10

Partial-removal of redundant ics files

Request Created: These observations were only partially recombined- we will remove the partial ics files.

Delete Request 60

Greg Sleap

8/10/2024

Partial delete of recombined Legacy VCS observations redundant raw files

77

12

Partial-removal of redundant raw files

Request Created: These observations were recombined so redundant raw data can be removed

Delete Request 61

Stefan Duchesne

14/10/2024

D0000 - Unspecified Director's time: Phase I (no confirmed downloads)

401

11892

Full

Request Created: Phase I DDT observations with no confirmed downloads logged

Delete Request 62

Stefan Duchesne

14/10/2024

D0000 - Unspecified Director's time: Phase I (at least one confirmed download)

107

3992

Full

Request Created: Phase I DDT observations with at least one confirmed download logged

Delete Request 63

Ramesh Bhat

1/11/2024

D0049 - New MWA pulsar discovery timing: VCS obs

57

1

Full

Request Created: Insufficient sensitivity, deleted as per email from PI on 2024-10-31

Delete Request 64

Devojyoti Kansabanik

7/11/2024

G0108 - CME magnetic fields: bad observations from 2024A

8

81

Full

Request Created: Deleted as per email from PI on 2024-11-06

Delete Request 65

Chris Riseley

15/11/2024

Phase I less than 50% good tiles

160

1978

Full

Request Created: Phase I observations with less than or equal to 50% good tiles

Delete Request 67

Divya Oberoi

20/11/2024

Unwanted G0002 and G0102 buffer trigger voltage files from 2024A

183

59

Partial- only buffer files to be deleted

Request Created: As per email from Divya Oberoi on 2023/11/14

Delete Request Summary by Project

projectid

description

full_partial

obsids

min_obsid

max_obsid

in_deletion_requests

projectid

description

full_partial

obsids

min_obsid

max_obsid

in_deletion_requests

C001

Default

Full

271

1028454352

1377386760

43,46,56,57,65

C100

Short (~2min) scans on strong calibrator sources. Freq: 80-250 MHz. LST range: all. Subarrays: all

Full

487

1028713936

1057207704

57,65

C101

The Southern Continuum Interferometric Snapshot Survey Of the Radio Sky. Freq: 104-195 MHz. LST range: sunset to sunrise. Subarrays: all.

Full

1722

1031652496

1038440376

57

C102

Night-time drift scans at zenith (DEC -27). Freq: 104-195 MHz. LST range: sunset to sunrise. Subarrays: all.

Full

3285

1031608768

1055715616

57

C103

Night-time drift scans at DEC -47, az=180. Freq: 104-195 MHz. LST range: sunset to sunrise. Subarrays: all.

Full

949

1031867928

1039896616

57

C104

http://mwa-lfd.haystack.mit.edu/twiki/pub/Main/Commissioning/EoR_commissioning_plan_July2012.pdf

Full

1059

1032084248

1040231528

57

C106

Tracking observations of the Sun, often from rise to set. Freq: 80-230 MHz, 270-300 MHz. Subarrays: all.

Full

1617

1032134416

1052803816

57

C110

Moon imaging and RFI

Full

126

1032609736

1051567816

57

C111

LMC

Full

50

1035989472

1035996136

57

C112

W44 Galactic plane field. Freq: 80-230 MHz

Full

207

1032083952

1055270296

57

C113

Galactic micro-quasar. Freq 80-230 MHz. Available Aug/Sept. *Note within C112 field.

Full

69

1034331616

1052769976

57

C117

Test object for high-z HI absorption

Full

120

1037734096

1039213216

57

C118

Freq: 80-230 MHz

Full

238

1034526192

1052752032

57

C119

Freq: FM band, central chan 81.

Full

8

1037967616

1055671576

57

C120

Fixed DEC scan at DEC -6 (corresponding to a sweet spot pointing)

Full

1027

1038913936

1041283352

57

C121

Monitoring of variable sources in GC.

Full

24

1051554792

1051561696

57

C122

A3376 (RA 6, DEC -40), A3667  (RA 5:49, DEC -24:28) and the Bullet Cluster (RA 7, DEC -56)

Full

37

1052732416

1055272216

57

C123

Test observations where the data will be analysed on site, not archived to Pawsey.

Full

1

1398402200

1398402200

56

D0000

Catch-all for Director's time observations that don't have a project ID.

Full

16202

1057583712

1226995216

45,46,61,62

D0002

Test observations for non-standard correlator modes using high time and/or frequency resolution.

Full

1

1108883600

1108883600

65

D0004

Director's time allocated to testing the voltage capture system.

Full

4

1063026824

1064089696

44

D0004

Director's time allocated to testing the voltage capture system.

PARTIAL

2

1095506112

1095506112

58,59

D0005

Tests of the prototype AAVS0.5 tile.

Full

7

1073315112

1074328032

65

D0006

Instrument stability and calibration tests.

PARTIAL

1

1403218160

1403218160

48

D0008

Observations of the GAMA fields at 300 MHz

Full

93

1110218120

1127921640

65

D0011

Interplanetary Scintillation observations.

Full

13

1134865688

1146530504

65

D0012

P.I. Tingay

Full

53

1130761056

1137926872

65

D0020

(P.I. Brendan Henessey)  VCS observations for Space Situational Awareness

PARTIAL

1

1226689160

1226689160

60

D0029

(P.I. Ramesh Bhat) Timing and imaging follow-up of the first pulsar discovery from the MWA

PARTIAL

2

1275177136

1275177136

58,59

D0042

(P.I. Natasha Hurley-Walker) Followup of a long-period transient

Full

2

1404574936

1404659936

49

D0044

(P.I. Natasha Hurley-Walker) Follow-up observations of some Galactic radio transients

Full

185

1382552600

1393454560

40,51

D0049

(P.I. Bhat, Ramesh) Timing observations of a new pulsar discovery from the SMART survey

Full

2

1407613096

1410025688

53,63

G0001

(Bell) The MWA long-term radio sky monitor

Full

17

1063380536

1151441160

65

G0002

(Cairns) Unbiased Solar Observations for Burst, Calibration, and Quiet Sun Studies 

Full

805

1062387616

1132556248

65

G0002

(Cairns) Unbiased Solar Observations for Burst, Calibration, and Quiet Sun Studies 

PARTIAL

54

1403748584

1414825832

67

G0008

(Staveley-Smith) A Galactic and Extragalactic All-Sky MWA Survey

Full

67

1122925144

1153766424

65

G0009

(Webster) Epoch of Reionisation

Full

257

1063726576

1147170480

65

G0012

(Johnston-Hollitt) The Horologium-Reticulum supercluster as a cosmic laboratory to investigate the role of environment on the radio source population.

Full

1

1076498536

1076498536

65

G0017

(McKinley) Using the Moon to detect the global EoR signal.

Full

541

1109686176

1130161840

65

G0021

P.I. Bhat

Full

2

1109156704

1109159016

65

G0021

P.I. Bhat

PARTIAL

4

1276887736

1283267840

58,59

G0023

P.I. Tingay

Full

1

1111654960

1111654960

65

G0026

Detection of HI Absorption toward a z~5.3 Radio-loud QSO

Full

1

1137182984

1137182984

65

G0034

P.I. Ramesh Bhat

Full

117

1240826896

1303072888

46

G0055

(P.I. Gemma Anderson) Proposal for MWA rapid-response observations of GRBs

Full

2

1402040256

1409382560

54,56

G0055

(P.I. Gemma Anderson) Proposal for MWA rapid-response observations of GRBs

PARTIAL

8

1266135128

1273676948

58,59,60

G0057

(P.I. Ramesh Bhat) Southern-sky MWA Rapid Two-metre (SMART) pulsar survey

Full

1

1372266912

1372266912

39

G0060

(P.I. John Morgan) An Interplanetary Scintillation Survey with the extended Phase II MWA

Full

64

1404532200

1404701160

50

G0068

(P.I. Charlotte Sobey) Targeted pulsar search towards promising candidates identified in radio surveys

PARTIAL

13

1271538166

1283453256

58,59,60

G0071

(P.I. Parul Janagal) Investigation of sub-pulse drifting properties for three pulsars

PARTIAL

2

1275751816

1275751816

58,59

G0080

(P.I. Natasha Hurley-Walker) Monitoring the Galactic Plane for minute-timescale radio transients

Full

81

1404555536

1404582952

49

G0081

(P.I. S. J. McSweeney) Pilot study to image lightning in high time and spatial resolution.

Full

24

1348452744

1348479080

41

G0092

(P.I. N. Hurley-Walker) Timing and spectropolarimetric observations of a long-period radio transient. Continues D0038.

Full

40

1378118832

1382958304

52

G0094

(P.I. G. Anderson) Rapid-response triggering on O4 gravitational wave events with the Murchison Widefield Array

Full

12

1377404592

1403219992

43,56

G0094

(P.I. G. Anderson) Rapid-response triggering on O4 gravitational wave events with the Murchison Widefield Array

PARTIAL

2

1403219968

1403219992

47

G0097

(P.I. Cordes, James) Measuring the pulse broadening times of PSR J1935+1616 at low radio frequencies

Full

1

1380278096

1380278096

38

G0102

(P.I. Mondal, Surajit) Coordinated Solar and Heliospheric Observing Campaign using the MWA with Parker Solar Probe and Solar Orbiter

PARTIAL

5

1403752520

1404018920

67

G0108

(P.I. Kansabanik, Devojyoti) Measurement of CME magnetic fields in the heliosphere using Faraday Rotation observations.

Full

81

1402091384

1412339936

64

Delete Request Details