Greg's kill-list

Observations that require follow-up

Obsid	Name	Project	Date recombined	Count of raw files	Sum of raw (bytes)	Sum of raw (TB)	Notes/Instructions (please include date of annotation)
1217180536	PSR_J2241-5236	G0021	2018-09-17 08:26:49.839027+00	49593	12,568,849,920,000	12.57
1229240240	PSR2145	G0034	2019-01-08 08:12:49.487121+00	64	16,220,160,000	0.02
1229239944	PSR2145	G0034	2019-01-08 11:48:32.389172+00	9408	2,384,363,520,000	2.38
1229239648	PSR2145	G0034	2019-01-08 15:39:28.07119+00	9114	2,309,852,160,000	2.31
1216745600	PSR_J2145-0750	G0021	2019-02-03 17:32:40.925772+00	142512	36,118,241,280,000	36.12
1216447760	PSR_J0953+0755	G0024	2019-02-04 15:02:59.651862+00	41576	10,537,021,440,000	10.54
1226689160	ssa_az180_el75	D0020	2019-02-05 11:38:53.973155+00	38602	9,783,290,880,000	9.78
1116345688	PSR1713+0747	G0024	2019-02-09 06:38:05.239847+00	147236	37,315,491,840,000	37.32
1233746432	bhat2019A_2_PSR_J0437-4715_145	G0021	2019-04-06 12:04:11.967333+00	114936	29,129,379,840,000	29.13
1114997432	47_Tuc	G0024	2019-04-06 21:50:55.04732+00	39652	10,049,402,880,000	10.05
1218644600	PSR_J2241-5236	G0021	2019-05-20 18:23:25.448292+00	163103	41,336,824,320,000	41.34
1214936120	PSR_J2145-0750	G0021	2019-05-20 18:48:25.024669+00	163296	41,385,738,240,000	41.39
1212182120	PSR_J2241-5236	G0021	2019-05-20 20:35:21.9385+00	161803	41,007,352,320,000	41.01
1204381096	PSR_J0941-3941	G0024	2019-05-20 20:51:32.334344+00	161720	40,986,316,800,000	40.99
1240990216	bhat2019A_2_PSR_J0437-4715_[110,111,...,155,156]	G0021	2019-06-02 04:32:25.304568+00	104307	26,435,566,080,000	26.44
1243575016	bhat2019A_2_PSR_J0437-4715_[110,111,...,155,156]	G0021	2019-06-06 17:12:04.82024+00	114873	29,113,413,120,000	29.11
1114304856	VCS_77	D0000	2019-06-09 08:06:14.930428+00	4672	1,184,071,680,000	1.18
1244457048	Krishnan2019A_PSR_J1141-6545_[91,92,...,166,167]	G0062	2019-07-05 14:12:13.397889+00	112838	28,597,662,720,000	28.60
1114305072	VCS_77	D0000	2019-07-06 01:32:22.766103+00	52714	13,359,836,160,000	13.36
1114293688	ISS_Drift	D0002	2019-07-06 03:28:51.028053+00	16816	4,261,847,040,000	4.26
1246556496	kaur019A_3C444_[63,64,...,171,172]	G0065	2019-07-08 17:34:05.584808+00	19134	4,849,320,960,000	4.85
1246454920	test_uxtime1562419685	G0034	2019-07-11 13:50:31.568092+00	9638	2,442,654,720,000	2.44
1246567960	kaur019A_PSR_J2241-5236_[63,64,...,171,172]	G0065	2019-07-12 18:43:33.746983+00	19136	4,849,827,840,000	4.85	Full orbit data (Please keep)
1246566160	kaur019A_PSR_J2241-5236_[63,64,...,171,172]	G0065	2019-07-13 04:42:24.87493+00	19136	4,849,827,840,000	4.85	Full orbit data (Please keep)
1246564360	kaur019A_PSR_J2241-5236_[63,64,...,171,172]	G0065	2019-07-13 14:59:51.246946+00	19134	4,849,320,960,000	4.85	Full orbit data (Please keep)
1246562560	kaur019A_PSR_J2241-5236_[63,64,...,171,172]	G0065	2019-07-14 00:25:58.102312+00	19136	4,849,827,840,000	4.85	Full orbit data (Please keep)
1246560760	kaur019A_PSR_J2241-5236_[63,64,...,171,172]	G0065	2019-07-15 03:54:59.04595+00	19136	4,849,827,840,000	4.85	Full orbit data (Please keep)
1246558960	kaur019A_PSR_J2241-5236_[63,64,...,171,172]	G0065	2019-07-16 08:36:44.563914+00	19134	4,849,320,960,000	4.85	Full orbit data (Please keep)
1247832024	test_uxtime1563796785	G0034	2019-07-24 00:21:09.630967+00	9592	2,430,996,480,000	2.43
1247341936	kaur019A_PSR_J2241-5236_[63,64,...,171,172]	G0065	2019-07-29 17:24:32.126953+00	18538	4,698,270,720,000	4.70	Full orbit data (Please keep)
1247340136	kaur019A_PSR_J2241-5236_[63,64,...,171,172]	G0065	2019-07-30 07:46:07.327391+00	19136	4,849,827,840,000	4.85	Full orbit data (Please keep)
1247338336	kaur019A_PSR_J2241-5236_[63,64,...,171,172]	G0065	2019-07-30 22:27:22.821675+00	19136	4,849,827,840,000	4.85	Full orbit data (Please keep)
1247335872	kaur019A_3C444_[63,64,...,171,172]	G0065	2019-08-01 02:23:14.319733+00	19136	4,849,827,840,000	4.85
1246569760	kaur019A_PSR_J2241-5236_[63,64,...,171,172]	G0065	2019-08-01 02:30:13.32327+00	19134	4,849,320,960,000	4.85	Full orbit data (Please keep)
1249312816	bhat2019A_2_PSR_J2145-0750_[63,64,...,171,172]	G0021	2019-08-25 19:20:39.763494+00	115030	29,153,203,200,000	29.15
1248354296	bhat2019A_2_PSR_J1744-1134_121	G0021	2019-08-27 03:13:43.812146+00	110560	28,020,326,400,000	28.02
1247336536	kaur019A_PSR_J2241-5236_[63,64,...,171,172]	G0065	2019-08-29 20:01:47.164135+00	17626	4,467,133,440,000	4.47	Full orbit data (Please keep)
1246557160	kaur019A_PSR_J2241-5236_[63,64,...,171,172]	G0065	2019-08-29 21:44:35.404804+00	17632	4,468,654,080,000	4.47	Full orbit data (Please keep)
1109156704	0437_picket	G0021	2019-08-30 02:05:39.191955+00	43393	10,997,521,920,000	11.00
1250109016	bhat2019A_2_PSR_J2241-5236_[63,64,...,171,172]	G0021	2019-09-03 10:09:28.123234+00	114819	29,099,727,360,000	29.10
1109092248	FRBDrift	G0024	2019-09-03 20:21:05.53759+00	74600	18,906,624,000,000	18.91
1251838816	SMART_test_PSR_J0437-4715_121	G0057	2019-09-09 11:14:38.389819+00	9406	2,383,856,640,000	2.38
1107478712	1819_Zenith_Drift	D0004	2019-09-12 00:09:33.759495+00	64822	16,428,487,680,000	16.43
1252177744	SMART_R01_RADec43.4,1.6_121	G0057	2019-09-16 09:52:25.25784+00	152900	38,750,976,000,000	38.75
1249054216	bhat2019A_2_PSR_J1909-3744_121	G0021	2019-09-18 08:43:01.60708+00	110648	28,042,629,120,000	28.04
1242151736	gong2019A_PSR_J1820-0427_[92,93,...,154,155]	G0066	2019-09-18 09:04:09.567233+00	171964	43,582,556,160,000	43.58	Bad data (can't be calibrated), delete (RB 13/08/20)
1239190568	deshpande2019A_PSR_J0633+1746_113	G0063	2019-09-23 11:02:27.782779+00	86080	21,816,115,200,000	21.82
1252780888	SMART_R02_RADec43.4,-26.7_121	G0057	2019-09-25 01:40:11.630935+00	148629	37,668,533,760,000	37.67
1106568152	0437_picket	G0021	2019-10-01 00:57:56.889838+00	52764	13,372,508,160,000	13.37
1253471952	SMART_R03_RADec50.7,-55.0_121	G0057	2019-10-02 02:36:08.94674+00	152612	38,677,985,280,000	38.68
1253991112	SMART_R04_RADec59.8,-40.5_121	G0057	2019-10-06 12:39:58.647645+00	153151	38,814,589,440,000	38.81
1102279816	PSR_Vela	D0004	2019-10-06 23:37:49.924814+00	20182	5,114,651,869,184	5.11
1251093616	sparktest_AzEl0.0,90.0_108	C001	2019-10-10 15:11:11.31369+00	19032	4,823,470,080,000	4.82
1254594264	SMART_R05_RADec59.8,18.3_121	G0057	2019-10-17 23:37:00.420077+00	153339	38,862,236,160,000	38.86
1255197408	SMART_R06_RADec59.8,-13.0_121	G0057	2019-10-23 01:15:53.205931+00	153532	38,911,150,080,000	38.91
1255803168	SMART_R07_RADec70.7,-72.0_121	G0057	2019-10-31 09:10:18.322545+00	152925	38,757,312,000,000	38.76
1256407632	SMART_R08_RADec76.2,1.6_121	G0057	2019-11-03 10:57:52.704512+00	152642	38,685,588,480,000	38.69
1257010784	SMART_R09_RADec76.2,-26.7_121	G0057	2019-11-10 08:30:43.681791+00	152293	38,597,137,920,000	38.60
1255444104	SMART_B08_RADec10.5,1.6_121	G0057	2019-11-10 10:04:04.495672+00	153335	38,861,222,400,000	38.86
1257617424	SMART_R10_RADec90.8,-55.0_121	G0057	2019-11-17 04:10:31.395538+00	152299	38,598,658,560,000	38.60
1257252800	bhat2019A_2_PSR_J2241-5236_[63,64,...,171,172]	G0021	2019-11-19 17:46:35.857412+00	85550	21,681,792,000,000	21.68
1258354816	BachTestVCS_Sun_77	C001	2019-11-22 04:40:31.370228+00	1215	307,929,600,000	0.31
1258221008	SMART_R11_RADec92.6,-40.5_121	G0057	2019-12-02 01:50:11.01283+00	152699	38,700,034,560,000	38.70
1259068352	bhat2019A_2_PSR_J2241-5236_[63,64,...,171,172]	G0021	2019-12-06 17:55:06.529296+00	85287	21,615,137,280,000	21.62
1257248136	bhat2019A_2_PSR_J2145-0750_[63,64,...,171,172]	G0021	2019-12-10 02:14:48.103613+00	85329	21,625,781,760,000	21.63
1259063680	bhat2019A_2_PSR_J2145-0750_[63,64,...,171,172]	G0021	2019-12-10 02:30:46.799875+00	84786	21,488,163,840,000	21.49
1259392520	BachTestVCS_2_Sun_77	C001	2019-12-10 03:54:40.646715+00	1210	306,662,400,000	0.31
1259391616	BachTestVCS_1_Sun_77	C001	2019-12-10 04:29:56.673558+00	1214	307,676,160,000	0.31
1259685792	SMART_R12_RADec92.6,18.3_121	G0057	2019-12-13 11:35:45.452819+00	153216	38,831,063,040,000	38.83
1260302416	_PSR_J0953+0755_121	C001	2019-12-16 16:25:57.217322+00	19136	4,849,827,840,000	4.85
1259427304	SMART_R13_RADec92.6,-13.0_121	G0057	2019-12-17 09:48:57.952237+00	152438	38,633,886,720,000	38.63
1256148080	bhat2019A_2_PSR_J0437-4715_[110,111,...,155,156]	G0021	2019-12-18 00:58:38.977145+00	114649	29,056,642,560,000	29.06
1248555920	bhat2019A_2_PSR_J2241-5236_[63,64,...,171,172]	G0021	2019-12-18 01:15:29.150488+00	113708	28,818,155,520,000	28.82
1260638120	SMART_G01_RADec109.0,1.6_121	G0057	2019-12-22 09:17:56.971203+00	146166	37,044,311,040,000	37.04
1260238984	_AzEl0.0,90.0_121	C001	2019-12-22 10:06:08.438945+00	960	243,302,400,000	0.24
1260973264	bhat2019A_2_PSR_J0437-4715_[110,111,...,155,156]	G0021	2020-01-11 02:18:32.033402+00	114832	29,103,022,080,000	29.10
1258560672	bhat2019A_2_PSR_J0437-4715_[110,111,...,155,156]	G0021	2020-01-12 09:26:01.636941+00	114498	29,018,373,120,000	29.02
1102276816	PSR_Vela	D0004	2020-01-12 09:34:26.580837+00	20210	5,122,022,400,000	5.12
1102273216	PSR_0437	D0004	2020-01-13 08:47:43.106704+00	20116	5,098,199,040,000	5.10
Obsid	Name	Project	Date recombined	Count of raw files	Sum of raw (bytes)	Sum of raw (TB)	Notes/Instructions (please include date of annotation)
1217180536	PSR_J2241-5236	G0021	17/09/18 08:26	49,593	12,568,849,920,000	12.57	(please keep)
1229240240	PSR2145	G0034	08/01/19 08:12	64	16,220,160,000	0.02	(please keep)
1229239944	PSR2145	G0034	08/01/19 11:48	9,408	2,384,363,520,000	2.38	(please keep)
1229239648	PSR2145	G0034	08/01/19 15:39	9,114	2,309,852,160,000	2.31	(please keep)
1216745600	PSR_J2145-0750	G0021	03/02/19 17:32	142,512	36,118,241,280,000	36.12	(please keep)
1216447760	PSR_J0953+0755	G0024	04/02/19 15:03	41,576	10,537,021,440,000	10.54
1226689160	ssa_az180_el75	D0020	05/02/19 11:38	38,602	9,783,290,880,000	9.78	(quality check still pending, keep for now)
1116345688	PSR1713+0747	G0024	09/02/19 06:38	147,236	37,315,491,840,000	37.32
1233746432	bhat2019A 2 PSR J0437-4715_145	G0021	06/04/19 12:04	114,936	29,129,379,840,000	29.13
1114997432	47_Tuc	G0024	06/04/19 21:50	39,652	10,049,402,880,000	10.05
1218644600	PSR_J2241-5236	G0021	20/05/19 18:23	163,103	41,336,824,320,000	41.34	(please keep)
1214936120	PSR_J2145-0750	G0021	20/05/19 18:48	163,296	41,385,738,240,000	41.39	(please keep)
1212182120	PSR_J2241-5236	G0021	20/05/19 20:35	161,803	41,007,352,320,000	41.01	(please keep)
1204381096	PSR_J0941-3941	G0024	20/05/19 20:51	161,720	40,986,316,800,000	40.99
1240990216	bhat2019A 2 PSR J0437-4715_[110,111,...,155,156]	G0021	02/06/19 04:32	104,307	26,435,566,080,000	26.44
1243575016	bhat2019A 2 PSR J0437-4715 [110,111,...,155,156]	G0021	06/06/19 17:12	114,873	29,113,413,120,000	29.11
1114304856	VCS 77	D0000	09/06/19 08:06	4,672	1,184,071,680,000	1.18
1244457048	Krishnan2019A_PSR_J1141-6545_[91,92,...,166,167]	G0062	05/07/19 14:12	112,838	28,597,662,720,000	28.60
1114305072	VCS_77	D0000	06/07/19 01:32	52,714	13,359,836,160,000	13.36
1114293688	ISS_Drift	D0002	06/07/19 03:28	16,816	4,261,847,040,000	4.26
1246556496	kaur019A_3C444_[63,64,...,171,172]	G0065	08/07/19 17:34	19,134	4,849,320,960,000	4.85	(Please keep: Full orbit data)
1246454920	test_uxtime1562419685	G0034	11/07/19 13:50	9,638	2,442,654,720,000	2.44
1246567960	kaur019A_PSR_J2241-5236_[63,64,...,171,172]	G0065	12/07/19 18:43	19,136	4,849,827,840,000	4.85	(Please keep: Full orbit data)
1246566160	kaur019A_PSR_J2241-5236_[63,64,...,171,172]	G0065	13/07/19 04:42	19,136	4,849,827,840,000	4.85	(Please keep: Full orbit data)
1246564360	kaur019A_PSR_J2241-5236_[63,64,...,171,172]	G0065	13/07/19 14:59	19,134	4,849,320,960,000	4.85	(Please keep: Full orbit data)
1246562560	kaur019A_PSR_J2241-5236_[63,64,...,171,172]	G0065	14/07/19 00:25	19,136	4,849,827,840,000	4.85	(Please keep: Full orbit data)
1246560760	kaur019A_PSR_J2241-5236_[63,64,...,171,172]	G0065	15/07/19 03:54	19,136	4,849,827,840,000	4.85	(Please keep: Full orbit data)
1246558960	kaur019A_PSR_J2241-5236_[63,64,...,171,172]	G0065	16/07/19 08:36	19,134	4,849,320,960,000	4.85	(Please keep: Full orbit data)
1247832024	test_uxtime1563796785	G0034	24/07/19 00:21	9,592	2,430,996,480,000	2.43
1247341936	kaur019A_PSR_J2241-5236_[63,64,...,171,172]	G0065	29/07/19 17:24	18,538	4,698,270,720,000	4.70	(Please keep: Full orbit data)
1247340136	kaur019A_PSR_J2241-5236_[63,64,...,171,172]	G0065	30/07/19 07:46	19,136	4,849,827,840,000	4.85	(Please keep: Full orbit data)
1247338336	kaur019A_PSR_J2241-5236_[63,64,...,171,172]	G0065	30/07/19 22:27	19,136	4,849,827,840,000	4.85	(Please keep: Full orbit data)
1247335872	kaur019A_3C444_[63,64,...,171,172]	G0065	01/08/19 02:23	19,136	4,849,827,840,000	4.85	(Please keep: Full orbit data)
1246569760	kaur019A_PSR_J2241-5236_[63,64,...,171,172]	G0065	01/08/19 02:30	19,134	4,849,320,960,000	4.85	(Please keep: Full orbit data)
1249312816	bhat2019A_2_PSR_J2145-0750_[63,64,...,171,172]	G0021	25/08/19 19:20	115,030	29,153,203,200,000	29.15	(please keep)
1248354296	bhat2019A_2_PSR_J1744-1134_121	G0021	27/08/19 03:13	110,560	28,020,326,400,000	28.02
1247336536	kaur019A_PSR_J2241-5236_[63,64,...,171,172]	G0065	29/08/19 20:01	17,626	4,467,133,440,000	4.47	(Please keep: Full orbit data)
1246557160	kaur019A_PSR_J2241-5236_[63,64,...,171,172]	G0065	29/08/19 21:44	17,632	4,468,654,080,000	4.47	(Please keep: Full orbit data)
1109156704	0437_picket	G0021	30/08/19 02:05	43,393	10,997,521,920,000	11.00
1250109016	bhat2019A_2_PSR_J2241-5236_[63,64,...,171,172]	G0021	03/09/19 10:09	114,819	29,099,727,360,000	29.10	(please keep)
1251838816	SMART_test_PSR_J0437-4715_121	G0057	09/09/19 11:14	9,406	2,383,856,640,000	2.38

Problematic Observations

Here is a list of observations that we could not calibrate or could not detect any pulsars in and for that reason believe that are unusable and all data should be deleted, even the non-redundant ones.

Observations which should be EXCLUDED from Greg's Recombine

Observation ID	User	Reason
1274143152	RB	RB has done recombine on Galaxy
1275561016	AW/CJ	Cosmic Ray will recombine on Pawsey as a test

Observations which are OK to Safe/Raw Delete

Definition

Raw / Safe delete: delete ONLY the redundant raw files. This can only happen if an observation:

Has been recombined
Has been checked by the PI that the recombined files are OK
Added to this table by the PI or someone approved by VCS team to do so.

Observation ID	User	Reason	Raw Deleted (Date)
1241121600	RB	checked by RB, safe to delete raw	1-Jul-2020
1113312344	MX	checked by MX, safe to delete raw	1-Jul-2020
1113312600	MX	checked by MX, safe to delete raw	1-Jul-2020
1112710144	MX	checked by MX, safe to delete raw	1-Jul-2020
1112709888	MX	checked by MX, safe to delete raw	1-Jul-2020
1247924728	MX	checked by MX, safe to delete raw	1-Jul-2020
1248101192	RB	checked by RB, safe to delete raw	1-Jul-2020

Observations to be deleted COMPLETELY (Full Delete)

Definition

Full delete= delete ALL data files for this observation.

This will include:

Raw (if any)
ICS
Combined (TAR) files
We generally leave the metafits_ppds file as it could be useful for the health of the array.

Added into this table by the PI or someone approved by VCS team to do so.

Observation ID	User	Reason	Deleted (Date)
1226406800	Nick	The calibration solutions looked fine but rfifind flagged 80% of the observation and broke prepfold	Jun-2020
1180199776	Nick	All calibration observations are missing gpubox 22	Jun-2020
1120799848	Mengyao	Daytime obs, poor data quality	Jun-2020
1153283432	Mengyao	Daytime obs, poor data quality	Jun-2020
1187662520	Mengyao	Affected by thunder, poor data quality	Jun-2020
1194519440	Dilpreet	PF, J2241-5236, no detection of this pulsar, Bad calibration, In-beam calibration also didn't work for this obs	Jun-2020
1195898000	Dilpreet	PF, J2241-5236, no detection of this pulsar, Bad calibration, In-beam calibration also didn't work for this obs	Jun-2020
1195811016	Dilpreet	PF, J2241-5236, no detection of this pulsar, Bad calibration, In-beam calibration also didn't work for this obs	Jun-2020
1107886888	Mengyao	data lost, only 13s left instead of the entire 4800s	Jun-2020
1248519616	Alex	Data has been checked, feel free to delete all	Jun-2020
1273149616	Alex	Data has been checked, feel free to delete all
1273408816	Alex	Data has been checked, feel free to delete all
1273752616	Alex	Data has been checked, feel free to delete all
1274011816	Alex	Data has been checked, feel free to delete all
1274355616	Alex	Data has been checked, feel free to delete all
1274958616	Alex	Data has been checked, feel free to delete all
1275217816	Alex	Data has been checked, feel free to delete all
1275561016	Alex	Data has been checked, feel free to delete all