Introduction

This is the second deletion round and supports the Data Retention Policy/Procedure in ensuring capacity is available for new observations by removing the oldest, and/or least valuable data in the archive.

Prepare wiki pages containing details and summaries of data which is proposed for deletion: 15-Nov-2024

Deletion announcement sent to MWA members via email and four week consultation period start: 25-Nov-2024

Seven week consultation period end: 13 January 2025 at 23:59 AWST

Sign off: 14 January 2025

Commence deletion: 15 January 2025

Deletion complete: 12 Feb 2025

Please use this four week consultation period to carefully review the above information. If you would like some or all the data for a delete request retained, as per the policy/procedure, please prepare a submission in writing to the MWA Director before the end of the consultation period and include:

the dataset in question;
the reason(s) for temporary retention of the dataset- for example, the significance of the dataset, the data retention requirements of the researcher’s institute, and the proposed plan for copying and storing the dataset offsite.
total size of the dataset to be retained

The MWA Director (or delegate) will then assess the request for retention and will respond in writing. Please note that any of the data approved for retention will not be deleted this round.

If you have any questions about the data nominated for deletion or this process, please reach out to the Principal Scientists.

Summary of Proposed Deletions by Delete Request

delete_request_id	created / requested by	Request Created	request name	data volume (TB)	observations	Full or Partial delete	comment

delete_request_id	created / requested by	Request Created	request name	data volume (TB)	observations	Full or Partial delete	comment
TOTAL (31 delete requests)				2,892	30,097	Mixed
Delete Request 38	Ramesh Bhat	3/10/2023	Bad G0097 observation - clock issues	96	1	Full	Request Created: RRI clocks not in sync, deletion authorised by R Bhat in email to AW on 2023-10-03
Delete Request 39	Bradley Meyers	28/11/2023	Unusable SMART O11 observation, re-observed on July 14	85	1	Full	Request Created: Confirmed by email from B.Meyers to AW on 2023/10/23
Delete Request 40	Natasha Hurley-Walker	11/12/2023	D0044 observations mistakenly scheduled in VCS mode	86	12	Full	Request Created: Confirmed in email from NHW to AW on 2023-12-01
Delete Request 41	Sam McSweeney	12/01/2024	Delete Sam McSweeney's lightning observations for G0081	119	24	Full	Request Created: As confirmed in email from PI on 2023/12/08
Delete Request 43	Gemma Anderson	24/04/2024	G0094 GRB VO trigger false events	57	6	Full	Unneeded buffer dump data
Delete Request 44	Greg Sleap	25/06/2024	Observations which are NO_CAPTURE but have data files in D0004	8	4	Full	Request Created: Unlikely to be useful data
Delete Request 45	Nick Seymour	25/06/2024	D0000 DDT observations for 2022_TC4-poor tile health	10	316	Full	Request Created: Requested by Nick Seymour
Delete Request 46	Greg Sleap	25/06/2024	Legacy VCS observations with test in the observation name	304	129	Full	Request Created: Low value data with very few downloads Request cancelled due to retained observation 1293315072. New request created with all obsids from this request except 1293315072 as delete request 72.
Delete Request 47	Gemma Anderson	25/06/2024	LVC_S240623 buffer and VCS trigger data	5	2	Partial-only buffer files to be deleted	Request Created: Event retracted, as per email from Gemma Anderson on 2024-06-24
Delete Request 48	Gemma Anderson	25/06/2024	LVC_S240623 buffer and VCS trigger data	4	1	Partial-only buffer files to be deleted	Request Created: Event retracted, as per email from Gemma Anderson on 2024-06-24
Delete Request 49	Natasha Hurley-Walker	12/07/2024	Corrupted fringe-stopping observations for Natasha Hurley-Walker	5	83	Full	Request Created: As per email from PI on G0080 and D0042, on 2024-07-12
Delete Request 50	John Morgan	15/07/2024	Corrupted fringe-stopping observations for John Morgan	4	64	Full	Request Created: As per email from PI on G0060, on 2024-07-12
Delete Request 51	Natasha Hurley-Walker	14/08/2024	D0044 - Follow-up of Galactic radio transients: low value data- non-detections of transients	26	173	Full	Request Created: Requested to be deleted by the PI (Hurley-Walker)
Delete Request 52	Natasha Hurley-Walker	14/08/2024	G0092 - Monitoring a long-period radio transient: low value MWAX VCS data- non-detections of transient	285	40	Full	Request Created: Requested to be deleted by the PI (Hurley-Walker)
Delete Request 53	Ramesh Bhat	2/09/2024	D0049 - New MWA pulsar discovery timing: pulsar followup observation	57	1	Full	Request Created: Delete as per email from Ramesh Bhat on 2024-08-27
Delete Request 54	Gemma Anderson	4/09/2024	Invalid SWIFT trigger pushed during software testing	14	1	Full	Request Created: As per email from Gemma Anderson on 2024-09-04
Delete Request 56	Gemma Anderson	3/10/2024	Un-needed trigger observations	76	10	Full	Request Created: G0055 and G0094 triggers, deleted as per email from Gemma Anderson on 2024-09-18
Delete Request 57	Greg Sleap	8/10/2024	32T and commissioning observations	148	11165	Full	Request Created: All 32T and observations prior to science operations starting in 1-Jul-2013
Delete Request 58	Greg Sleap	8/10/2024	Partial delete of incomplete recombined Legacy VCS tar files	105	10	Partial-removal of redundant tar files	Request Created: These observations were only partially recombined- we will remove the partial tar files.
Delete Request 59	Greg Sleap	8/10/2024	Partial delete of incomplete recombined Legacy VCS ics files	0.5	10	Partial-removal of redundant ics files	Request Created: These observations were only partially recombined- we will remove the partial ics files.
Delete Request 60	Greg Sleap	8/10/2024	Partial delete of recombined Legacy VCS observations redundant raw files	77	12	Partial-removal of redundant raw files	Request Created: These observations were recombined so redundant raw data can be removed
Delete Request 61	Stefan Duchesne	14/10/2024	D0000 - Unspecified Director's time: Phase I (no confirmed downloads)	401	11892	Full	Request Created: Phase I DDT observations with no confirmed downloads logged
Delete Request 62	Stefan Duchesne	14/10/2024	D0000 - Unspecified Director's time: Phase I (at least one confirmed download)	107	3992	Full	Request Created: Phase I DDT observations with at least one confirmed download logged
Delete Request 63	Ramesh Bhat	1/11/2024	D0049 - New MWA pulsar discovery timing: VCS obs	57	1	Full	Request Created: Insufficient sensitivity, deleted as per email from PI on 2024-10-31
Delete Request 64	Devojyoti Kansabanik	7/11/2024	G0108 - CME magnetic fields: bad observations from 2024A	8	81	Full	Request Created: Deleted as per email from PI on 2024-11-06
Delete Request 65	Chris Riseley	15/11/2024	Phase I less than 50% good tiles	160	1978	Full	Request Created: Phase I observations with less than or equal to 50% good tiles
Delete Request 67	Divya Oberoi	20/11/2024	Unwanted G0002 and G0102 buffer trigger voltage files from 2024A	183	59	Partial- only buffer files to be deleted	Request Created: As per email from Divya Oberoi on 2023/11/14
Delete Request 68	Gemma Anderson	03/12/2024	Full G0055 VCS deletions, after partial deletions in requests 58,59,60	15	7	Full	Request Created: As per email from Gemma Anderson on 2024-12-02
Delete Request 69	Chia Min Tan	07/01/2025	G0110 corrupted observations over break	278	6	Full	Request Created: Deleted as per email from PI on 2025-01-07
Delete Request 70	Chia Min Tan	07/01/2025	G0110 corrupted calibration observations over break	1.6	12	Full	Request Created: Deleted as per email from PI on 2025-01-07
Delete Request 71	Christopher Lee	08/01/2025	Corrupted G0098 VCS observations from 2024-12-16	112	5	Full	Request Created: As per email from PI on 2025-01-08
Delete Request 72	Greg Sleap	14/01/2025	Legacy VCS observations with test in the observation name	301	128	Full	Request Created: Low value data with very few downloads. (Same as cancelled DR 46, except 1293315072 is excluded as it was retained.)

Delete Request Summary by Project

projectid	description	full_partial	obsids	min_obsid	max_obsid	in_deletion_requests

projectid	description	full_partial	obsids	min_obsid	max_obsid	in_deletion_requests
C001	Default	Full	271	1028454352	1377386760	43,56,57,65,72
C100	Short (~2min) scans on strong calibrator sources. Freq: 80-250 MHz. LST range: all. Subarrays: all	Full	487	1028713936	1057207704	57,65
C101	The Southern Continuum Interferometric Snapshot Survey Of the Radio Sky. Freq: 104-195 MHz. LST range: sunset to sunrise. Subarrays: all.	Full	1722	1031652496	1038440376	57
C102	Night-time drift scans at zenith (DEC -27). Freq: 104-195 MHz. LST range: sunset to sunrise. Subarrays: all.	Full	3285

Deletion Round 2024-12 (Complete)

Introduction

Summary of Proposed Deletions by Delete Request

Delete Request Summary by Project