Table of Contents | ||
---|---|---|
|
Introduction
This is the
...
second deletion round and
...
supports the Data Retention Policy/Procedure in ensuring capacity is available for new observations by removing the oldest, and/or least valuable data in the archive.
- Prepare wiki pages containing details and summaries of data which is proposed for deletion: 15-Nov-2024
- Deletion announcement sent to MWA members via email and four week consultation period start: ??-Nov-2024
- Four week consultation period end: ?? December 2024 at 23:59 AWST
- Sign off: TBA
- Commence deletion: TBA
- Deletion complete: TBA
Please use this four week consultation week consultation period to carefully review the above information. If you would like some or all the data for a delete request retained, as per the policy/procedure, please prepare a submission in writing to the the MWA Director before the end of the consultation period and include:
the dataset in question;
the reason(s) for temporary retention of the dataset- for example,
the the significance of the dataset, the data retention requirements of the researcher’s institute, and
the proposed the proposed plan for copying and storing the dataset offsite.
total size of the dataset to be retained
The MWA Director (or delegate) will then assess the request for retention and will respond in writing. Please note that any of the data approved for retention will not be deleted this round.
If you have any questions about the data nominated for deletion or this process, please reach out to the the Principal Scientists.
Summary of Proposed Deletions by Delete Request
delete_request_id | created / requested by | Request Created | request name | data volume (TB) | observations | Full or Partial delete | comment |
---|---|---|---|---|---|---|---|
TOTAL (27 delete requests) | 2,490 | 30,068 | Mixed | ||||
Ramesh Bhat | 3/10/2023 | Bad G0097 observation - clock issues | 96 | 1 | Full | Request Created: RRI clocks not in sync, deletion authorised by R Bhat in email to AW on 2023-10-03 | |
Bradley Meyers | 28/11/2023 | Unusable SMART O11 observation, re-observed on July 14 | 85 | 1 | Full | Request Created: Confirmed by email from B.Meyers to AW on 2023/10/23 | |
Natasha Hurley-Walker | 11/12/2023 | D0044 observations mistakenly scheduled in VCS mode | 86 | 12 | Full | Request Created: Confirmed in email from NHW to AW on 2023-12-01 | |
Sam McSweeney | 12/01/2024 | Delete Sam McSweeney's lightning observations for G0081 | 119 | 24 | Full | Request Created: As confirmed in email from PI on 2023/12/08 | |
Gemma Anderson | 24/04/2024 | G0094 GRB VO trigger false events | 57 | 6 | Full | Unneeded buffer dump data | |
Greg Sleap | 25/06/2024 | Observations which are NO_CAPTURE but have data files in D0004 | 8 | 4 | Full | Request Created: Unlikely to be useful data | |
Nick Seymour | 25/06/2024 | D0000 DDT observations for 2022_TC4-poor tile health | 10 | 316 | Full | Request Created: Requested by |
Delete Requests
...
Nick Seymour | |||||||
Greg Sleap | 25/06/2024 | Legacy VCS observations with test in the observation name | 304 | 129 | Full | Request Created: Low value data with very few downloads | |
Gemma Anderson | 25/06/2024 | LVC_S240623 buffer and VCS trigger data | 5 | 2 | Partial-only buffer files to be deleted | Request Created: Event retracted, as per email from Gemma Anderson on 2024-06-24 | |
Gemma Anderson | 25/06/2024 | LVC_S240623 buffer and VCS trigger data | 4 | 1 | Partial-only buffer files to be deleted | Request Created: Event retracted, as per email from Gemma Anderson on 2024-06-24 | |
Natasha Hurley-Walker | 12/07/2024 | Corrupted fringe-stopping observations for Natasha Hurley-Walker | 5 | 83 | Full | Request Created: As per email from PI on G0080 and D0042, on 2024-07-12 | |
John Morgan | 15/07/2024 | Corrupted fringe-stopping observations for John Morgan | 4 | 64 | Full | Request Created: As per email from PI on G0060, on 2024-07-12 | |
Natasha Hurley-Walker | 14/08/2024 | D0044 - Follow-up of Galactic radio transients: low value data- non-detections of transients | 26 | 173 | Full | Request Created: Requested to be deleted by the PI (Hurley-Walker) | |
Natasha Hurley-Walker | 14/08/2024 | G0092 - Monitoring a long-period radio transient: low value MWAX VCS data- non-detections of transient | 285 | 40 | Full | Request Created: Requested to be deleted by the PI (Hurley-Walker) | |
Ramesh Bhat | 2/09/2024 | D0049 - New MWA pulsar discovery timing: pulsar followup observation | 57 | 1 | Full | Request Created: Delete as per email from Ramesh Bhat on 2024-08-27 | |
Gemma Anderson | 4/09/2024 | Invalid SWIFT trigger pushed during software testing | 14 | 1 | Full | Request Created: As per email from Gemma Anderson on 2024-09-04 | |
Gemma Anderson | 3/10/2024 | Un-needed trigger observations | 76 | 10 | Full | Request Created: G0055 and G0094 triggers, deleted as per email from Gemma Anderson on 2024-09-18 | |
Greg Sleap | 8/10/2024 | 32T and commissioning observations | 148 | 11165 | Full | Request Created: All 32T and observations prior to science operations starting in 1-Jul-2013 | |
Greg Sleap | 8/10/2024 | Partial delete of incomplete recombined Legacy VCS tar files | 105 | 10 | Partial-removal of redundant tar files | Request Created: These observations were only partially recombined- we will remove the partial tar files. | |
Greg Sleap | 8/10/2024 | Partial delete of incomplete recombined Legacy VCS ics files | 0.5 | 10 | Partial-removal of redundant ics files | Request Created: These observations were only partially recombined- we will remove the partial ics files. | |
Greg Sleap | 8/10/2024 | Partial delete of recombined Legacy VCS observations redundant raw files | 77 | 12 | Partial-removal of redundant raw files | Request Created: These observations were recombined so redundant raw data can be removed | |
Stefan Duchesne | 14/10/2024 | D0000 - Unspecified Director's time: Phase I (no confirmed downloads) | 401 | 11892 | Full | Request Created: Phase I DDT observations with no confirmed downloads logged | |
Stefan Duchesne | 14/10/2024 | D0000 - Unspecified Director's time: Phase I (at least one confirmed download) | 107 | 3992 | Full | Request Created: Phase I DDT observations with at least one confirmed download logged | |
Ramesh Bhat | 1/11/2024 | D0049 - New MWA pulsar discovery timing: VCS obs | 57 | 1 | Full | Request Created: Insufficient sensitivity, deleted as per email from PI on 2024-10-31 | |
Devojyoti Kansabanik | 7/11/2024 | G0108 - CME magnetic fields: bad observations from 2024A | 8 | 81 | Full | Request Created: Deleted as per email from PI on 2024-11-06 | |
Chris Riseley | 15/11/2024 | Phase I less than 50% good tiles | 160 | 1978 | Full | Request Created: Phase I observations with less than or equal to 50% good tiles | |
Divya Oberoi | 20/11/2024 | Unwanted G0002 and G0102 buffer trigger voltage files from 2024A | 183 | 59 | Partial- only buffer files to be deleted | Request Created: As per email from Divya Oberoi on 2023/11/14 |
Delete Request Summary by Project
projectid | description | full_partial | obsids | min_obsid | max_obsid | in_deletion_requests |
---|---|---|---|---|---|---|
C001 | Default | Full | 271 | 1028454352 | 1377386760 | 43,46,56,57,65 |
C100 | Short (~2min) scans on strong calibrator sources. Freq: 80-250 MHz. LST range: all. Subarrays: all | Full | 487 | 1028713936 | 1057207704 | 57,65 |
C101 | The Southern Continuum Interferometric Snapshot Survey Of the Radio Sky. Freq: 104-195 MHz. LST range: sunset to sunrise. Subarrays: all. | Full | 1722 | 1031652496 | 1038440376 | 57 |
C102 | Night-time drift scans at zenith (DEC -27). Freq: 104-195 MHz. LST range: sunset to sunrise. Subarrays: all. | Full | 3285 | 1031608768 | 1055715616 | 57 |
C103 | Night-time drift scans at DEC -47, az=180. Freq: 104-195 MHz. LST range: sunset to sunrise. Subarrays: all. | Full | 949 | 1031867928 | 1039896616 | 57 |
C104 | http://mwa-lfd.haystack.mit.edu/twiki/pub/Main/Commissioning/EoR_commissioning_plan_July2012.pdf | Full | 1059 | 1032084248 | 1040231528 | 57 |
C106 | Tracking observations of the Sun, often from rise to set. Freq: 80-230 MHz, 270-300 MHz. Subarrays: all. | Full | 1617 | 1032134416 | 1052803816 | 57 |
C110 | Moon imaging and RFI | Full | 126 | 1032609736 | 1051567816 | 57 |
C111 | LMC | Full | 50 | 1035989472 | 1035996136 | 57 |
C112 | W44 Galactic plane field. Freq: 80-230 MHz | Full | 207 | 1032083952 | 1055270296 | 57 |
C113 | Galactic micro-quasar. Freq 80-230 MHz. Available Aug/Sept. *Note within C112 field. | Full | 69 | 1034331616 | 1052769976 | 57 |
C117 | Test object for high-z HI absorption | Full | 120 | 1037734096 | 1039213216 | 57 |
C118 | Freq: 80-230 MHz | Full | 238 | 1034526192 | 1052752032 | 57 |
C119 | Freq: FM band, central chan 81. | Full | 8 | 1037967616 | 1055671576 | 57 |
C120 | Fixed DEC scan at DEC -6 (corresponding to a sweet spot pointing) | Full | 1027 | 1038913936 | 1041283352 | 57 |
C121 | Monitoring of variable sources in GC. | Full | 24 | 1051554792 | 1051561696 | 57 |
C122 | A3376 (RA 6, DEC -40), A3667 (RA 5:49, DEC -24:28) and the Bullet Cluster (RA 7, DEC -56) | Full | 37 | 1052732416 | 1055272216 | 57 |
C123 | Test observations where the data will be analysed on site, not archived to Pawsey. | Full | 1 | 1398402200 | 1398402200 | 56 |
D0000 | Catch-all for Director's time observations that don't have a project ID. | Full | 16202 | 1057583712 | 1226995216 | 45,46,61,62 |
D0002 | Test observations for non-standard correlator modes using high time and/or frequency resolution. | Full | 1 | 1108883600 | 1108883600 | 65 |
D0004 | Director's time allocated to testing the voltage capture system. | Full | 4 | 1063026824 | 1064089696 | 44 |
D0004 | Director's time allocated to testing the voltage capture system. | PARTIAL | 2 | 1095506112 | 1095506112 | 58,59 |
D0005 | Tests of the prototype AAVS0.5 tile. | Full | 7 | 1073315112 | 1074328032 | 65 |
D0006 | Instrument stability and calibration tests. | PARTIAL | 1 | 1403218160 | 1403218160 | 48 |
D0008 | Observations of the GAMA fields at 300 MHz | Full | 93 | 1110218120 | 1127921640 | 65 |
D0011 | Interplanetary Scintillation observations. | Full | 13 | 1134865688 | 1146530504 | 65 |
D0012 | P.I. Tingay | Full | 53 | 1130761056 | 1137926872 | 65 |
D0020 | (P.I. Brendan Henessey) VCS observations for Space Situational Awareness | PARTIAL | 1 | 1226689160 | 1226689160 | 60 |
D0029 | (P.I. Ramesh Bhat) Timing and imaging follow-up of the first pulsar discovery from the MWA | PARTIAL | 2 | 1275177136 | 1275177136 | 58,59 |
D0042 | (P.I. Natasha Hurley-Walker) Followup of a long-period transient | Full | 2 | 1404574936 | 1404659936 | 49 |
D0044 | (P.I. Natasha Hurley-Walker) Follow-up observations of some Galactic radio transients | Full | 185 | 1382552600 | 1393454560 | 40,51 |
D0049 | (P.I. Bhat, Ramesh) Timing observations of a new pulsar discovery from the SMART survey | Full | 2 | 1407613096 | 1410025688 | 53,63 |
G0001 | (Bell) The MWA long-term radio sky monitor | Full | 17 | 1063380536 | 1151441160 | 65 |
G0002 | (Cairns) Unbiased Solar Observations for Burst, Calibration, and Quiet Sun Studies | Full | 805 | 1062387616 | 1132556248 | 65 |
G0002 | (Cairns) Unbiased Solar Observations for Burst, Calibration, and Quiet Sun Studies | PARTIAL | 54 | 1403748584 | 1414825832 | 67 |
G0008 | (Staveley-Smith) A Galactic and Extragalactic All-Sky MWA Survey | Full | 67 | 1122925144 | 1153766424 | 65 |
G0009 | (Webster) Epoch of Reionisation | Full | 257 | 1063726576 | 1147170480 | 65 |
G0012 | (Johnston-Hollitt) The Horologium-Reticulum supercluster as a cosmic laboratory to investigate the role of environment on the radio source population. | Full | 1 | 1076498536 | 1076498536 | 65 |
G0017 | (McKinley) Using the Moon to detect the global EoR signal. | Full | 541 | 1109686176 | 1130161840 | 65 |
G0021 | P.I. Bhat | Full | 2 | 1109156704 | 1109159016 | 65 |
G0021 | P.I. Bhat | PARTIAL | 4 | 1276887736 | 1283267840 | 58,59 |
G0023 | P.I. Tingay | Full | 1 | 1111654960 | 1111654960 | 65 |
G0026 | Detection of HI Absorption toward a z~5.3 Radio-loud QSO | Full | 1 | 1137182984 | 1137182984 | 65 |
G0034 | P.I. Ramesh Bhat | Full | 117 | 1240826896 | 1303072888 | 46 |
G0055 | (P.I. Gemma Anderson) Proposal for MWA rapid-response observations of GRBs | Full | 2 | 1402040256 | 1409382560 | 54,56 |
G0055 | (P.I. Gemma Anderson) Proposal for MWA rapid-response observations of GRBs | PARTIAL | 8 | 1266135128 | 1273676948 | 58,59,60 |
G0057 | (P.I. Ramesh Bhat) Southern-sky MWA Rapid Two-metre (SMART) pulsar survey | Full | 1 | 1372266912 | 1372266912 | 39 |
G0060 | (P.I. John Morgan) An Interplanetary Scintillation Survey with the extended Phase II MWA | Full | 64 | 1404532200 | 1404701160 | 50 |
G0068 | (P.I. Charlotte Sobey) Targeted pulsar search towards promising candidates identified in radio surveys | PARTIAL | 13 | 1271538166 | 1283453256 | 58,59,60 |
G0071 | (P.I. Parul Janagal) Investigation of sub-pulse drifting properties for three pulsars | PARTIAL | 2 | 1275751816 | 1275751816 | 58,59 |
G0080 | (P.I. Natasha Hurley-Walker) Monitoring the Galactic Plane for minute-timescale radio transients | Full | 81 | 1404555536 | 1404582952 | 49 |
G0081 | (P.I. S. J. McSweeney) Pilot study to image lightning in high time and spatial resolution. | Full | 24 | 1348452744 | 1348479080 | 41 |
G0092 | (P.I. N. Hurley-Walker) Timing and spectropolarimetric observations of a long-period radio transient. Continues D0038. | Full | 40 | 1378118832 | 1382958304 | 52 |
G0094 | (P.I. G. Anderson) Rapid-response triggering on O4 gravitational wave events with the Murchison Widefield Array | Full | 12 | 1377404592 | 1403219992 | 43,56 |
G0094 | (P.I. G. Anderson) Rapid-response triggering on O4 gravitational wave events with the Murchison Widefield Array | PARTIAL | 2 | 1403219968 | 1403219992 | 47 |
G0097 | (P.I. Cordes, James) Measuring the pulse broadening times of PSR J1935+1616 at low radio frequencies | Full | 1 | 1380278096 | 1380278096 | 38 |
G0102 | (P.I. Mondal, Surajit) Coordinated Solar and Heliospheric Observing Campaign using the MWA with Parker Solar Probe and Solar Orbiter | PARTIAL | 5 | 1403752520 | 1404018920 | 67 |
G0108 | (P.I. Kansabanik, Devojyoti) Measurement of CME magnetic fields in the heliosphere using Faraday Rotation observations. | Full | 81 | 1402091384 | 1412339936 | 64 |
Delete Request Details
Child pages (Children Display) | ||||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|
|