MWA Services Outage Notices

MWA Services Outage Notices

This page provides details about current and in-progress outages of the MWA ASVO system. If you have any questions please see MWA ASVO: Getting Help.

Statuses:

planned: Upcoming outage

CURRENT : Outage window started or unplanned outage in progress

COMPLETE: Outage completed/resolved

Current / Planned Outages

Status

Start Time (UTC+8)

Estimated / Planned End

Services Affected

Reasons

Status

Start Time (UTC+8)

Estimated / Planned End

Services Affected

Reasons

CURRENT

7 Oct 2025 08:00 AWST

7 Oct 2025 20:00 AWST

MWA ASVO job submission and job processing

Previous Outages

Status

Start Time (UTC+8)

Estimated / Planned End

Actual End

Services Affected

Reasons

 

Status

Start Time (UTC+8)

Estimated / Planned End

Actual End

Services Affected

Reasons

 

COMPLETE

2 Sep 2025 08:00 AWST

2 Sep 2025 18:00 AWST

2 Sep 2025 18:00 AWST

MWA ASVO job submission and job processing

 

COMPLETE

5 Aug 2025 07:00 AWST

 5 Aug 2025 17:00 AWST

5 Aug 2025 21:00 AWST

MWA ASVO job submission and job processing

 

COMPLETE

23 Jun 2025 17:00 AWST

25 Jun 2025 17:00 AWST

25 Jun 2025 17:30 AWST

MWA ASVO job submission and job processing

 

COMPLETE

6 May 2025 08:00 AWST

6 May 2025 20:00 AWST

7 May 2025 15:00 AWST

MWA ASVO job submission and job processing

Pawsey extended the maintenance till the next day.

COMPLETE

7 APR 2025 15:00 AWST

8 Apr 2025 21:00 AWST

8 Apr 2025 16:00 AWST

MWA ASVO job submission and job processing

 

COMPLETE

4 Mar 2025 08:00 AWST

5 Mar 2025 11:00 AWST

5 Mar 2025 15:00 AWST

MWA ASVO job submission and job processing

 

COMPLETE

3 Feb 2025 12:00 AWST

6 Feb 2025 12:00 AWST

7 Feb 2025 12:00 AWST

MWA ASVO job submission and job processing

 

COMPLETE

3 Dec 2024 05:00 AWST

3 Dec 2024 20:00 AWST

3 Dec 2024 21:00 AWST

MWA ASVO job submission and job processing

 

COMPLETE

5 Nov 2024 08:00 AWST

5 Nov 2024 18:00 AWST

6 Nov 2024 11:00 AWST

MWA ASVO job submission and job processing

 

COMPLETE

8-OCT-2024 5:00 AWST

10-OCT-2024 13:00 AWST

11-OCT-2024 13:30 AWST

MWA ASVO job submission and job processing

  • Pawsey Regular Maintenance

outage extended due to a failure of one of the garrawarla nodes

COMPLETE

4-SEP-2024 7:00 AWST

N/A

12-SEP-2024 11:00 AWST

MWA ASVO job submission for the observations in Banksia

  • Nimbus network issue is still impacting the ASVO staging server (hosted in Nimbus), resulting in communication problems between Banksia and Nimbus instances. we are able to process jobs only if the observation is archived in Acacia. (edited) 

 

COMPLETE

10-SEP-2024 7:00 AWST

10-SEP-2024 17:00 AWST

10-SEP-2024 17:00 AWST

MWA ASVO job submission and job processing

  • Pawsey Regular Maintenance

 

COMPLETE

9-AUG-2024 8:00 AWST

14-AUG-2024 16:00 AWST

14-AUG-2024 16:00 AWST

MWA ASVO job submission and job processing

 

COMPLETE

2-JUL-2024 7:00 AWST

2-JUL-2024 16:00 AWST

2-JUL-2024 18:30 AWST

MWA ASVO job submission and job processing

 

COMPLETE

4-JUN-2024 08:00 AWST

4-JUN-2024 20:00 AWST

4-JUN-2024 20:00 AWST

All MWA ASVO services

Pawsey Regular Maintenance

 

COMPLETE

14-May-2024 07:00 AWST

15-May-2024 20:00 AWST

15-May-2024 20:30 AWST

MWA ASVO website, client and job processing

 

COMPLETE

24-Apr-2024 1400

N/A

26-Apr-2024 1115

MWA ASVO job submission and job processing

  1. Pawsey’s scratch filesystem was degraded.

    • This has been resolved

  2. Garrawarla nodes are still drained from the scratch issue.

    • Ticket has been lodged with Pawsey, no ETA yet

  3. MWA ASVO new jobs submission is failing with “Unable to stage data, please try again“.

    • MWA ASVO team are Investigating, no ETA yet

 

COMPLETE

23 Apr 2024 9000 AWST

23 Apr 2024 2100 AWST

24 Apr 2024 1100 AWST

All MWA ASVO services

[23 Apr 2024 1800 AWST] Update: ASVO job processing is failing the tests as there are some breaking changes done during the DB upgrade, we are working on it and will notify you once it is fixed.

 

Critical database upgrade that ASVO heavily relies on for retrieving observation information.

 

COMPLETE

8 Apr 2024 17:00 AWST

9 Apr 2024 20:00 AWST

10 Apr 2024 10:00 AWST

All MWA ASVO services

Pawsey Regular Maintenance

 

COMPLETE

27/03/2024 1900

N/A

28/03/2024 1500

All MWA ASVO services

/scratch file system has experienced a failure.

 

COMPLETE

7-MAR-2024

N/A

12/03/2024 15:00

/scratch

Pawsey Regular Maintenance completed but
unfortunately scratch fs failed after neo 6.6-021 updates
For more details please refer: https://status.pawsey.org.au/

 

COMPLETE

5-MAR-024 0700

7-MAR-2024 1900

N/A

MWA ASVO website, client and job processing

 

COMPLETE

26-Feb-2024 0900

N/A

N/A

  • job processing - data from Bansia

  • Pawsey has resolved the issue with Banksia tapes and started staging the files, Concurrently, ASVO has resumed processing jobs.

  • Staging in Banksia not working: ASVO is currently experiencing issues processing data from Banksia due to staging issues in Banksia. We have raised a ticket with Pawsey, and they are actively working on resolving the issue. For real-time updates, you can check the status of Pawsey at Pawsey Status Page.

 

COMPLETE

22-Jan-2024 0900

26-Jan-2024 1200

19-Feb-2024 0900

MWA ASVO website, client and job processing

Original outage reason
Pawsey HV maintenance

Ongoing outage reasons

  • Acacia Issues

  • Banksia issues

Pawsey's LTS system is currently experiencing some instability. We are testing MWA ASVO from our end while Pawsey continues to work on improving stability. MWA ASVO jobs are temporarily on hold during this period. We apologise for any inconvenience this may have caused.

FYI: MWA ASVO requires Acacia and Banksia to be able to retrieve data for users, Garrawarla to run jobs and Acacia to allow users to download data to users via signed urls.

 

Updates: (see: https://status.pawsey.org.au/ for the latest)

Thu, 25-Jan, 17:00 - Pawsey brings Garrawarla online, but Banksia is offline.
Mon, 29-Jan, 08:00 - Pawsey restores Banksia (1 of 2 libraries); Acacia troubleshooting continues.

Thu 01-Feb - Second Banksia library fails. Banksia is offline. Acacia restoration continues.

Fri 02-Feb - Pawsey restores Banksia (1 of 2 libraries). Acacia restoration continues.

Tue 06-Feb - Pawsey provides update on Acacia- work continues to return the service.

Wed 07-Feb - Both Banksia libraries operational. Banksia is now back online. Acacia remains offline while restoration continues.
Thu 15-Feb - ASVO has started processing jobs with data stored on Banksia. Additionally, we've received an update from Pawsey indicating that Acacia will be accessible soon.

Mon 19-Feb - ASVO is now fully operational as Pawsey has successfully restored Acacia. We've initiated the processing of a backlog comprising more than 1800 jobs. Your patience during this period is greatly appreciated. For any issues encountered, please don't hesitate to reach out to ASVO support.

 

COMPLETE

18-Jan-2024 0900

18-Jan-2024 1200

18-Jan-2024 2000

MWA ASVO website, client and job processing

 

 

COMPLETE

18-Dec-2023 0945

-

20-Dec-2023 1500

MWA ASVO website, client and job processing

  • Pawsey has experienced an outage of /scratch and acacia

 

COMPLETE

13-Dec-2023 0900

13-Dec-2023 1000

13-Dec-2023 1235

MWA ASVO website, client and job processing

 

COMPLETE


02-Dec-2023 0954

12-Dec-2023

12-Dec-2023 1315

All MWA ASVO services

 

COMPLETE

22-Nov-2023 0900

22-Nov-2023 1200

22-Nov-2023 1100

MWA ASVO website, client and job processing

 

COMPLETE

07-Nov-2023 0800

07-Nov-2023 2200

07-Nov-2023 2100

MWA ASVO website, client and job processing

 

COMPLETE



03-Oct-2023 0800

03-Oct-2023 2200

04-Oct-2023 0800

MWA ASVO website, client and job processing