This item relates to the server back-end of the MWA ASVO system, which includes the dispatch service, processor service and cotter.
Status
subtle
true
colour
Red
title
Breaking
This represents a breaking change to existing functionality
Status
colour
Blue
title
client
Fixed bug where stream untar downloads were being written to your current directory rather than the directory you specify in the -d/--download-dir argument.
Status
colour
Yellow
title
backend
Status
colour
Green
title
web
Multiple new Job states are included. It is handled in the backend and new status description displayed in the front end. Version of the ASVO server is bumped up to 2.0.0
New job states
Queued
Waiting for Calibration
Staging
Staged
Retrieving Files from Archive
Preprocessing
Imaging
Delivering
Completed
Error
Cancelled
Status
colour
Blue
title
client
Both the mwa asvo CLI clients mwa_client and giant-squid are updated to handle the new job states. Versions of both the clients are upgraded to 2.0.0.
03 Feb 2025
Status
colour
Yellow
title
backend
Adaptive wall time for birli(pre-processor). Birli calculates the size of the observation and decides on the wall time it needs to successfully complete the pre-processing without hitting the walltime.
Status
colour
Yellow
title
backend
Status
colour
Green
title
web
Users can now search the Trigger information from the MWA ASVO search page and. the trigger ID ha been added to the TAP service and the observation results table in the web UI.
Status
colour
Yellow
title
backend
Voltage job submission through CLI client now will validate and throw error if the delivery option is not 'scratch'
Status
colour
Yellow
title
backend
Processor package has been updated.
Status
colour
Yellow
title
backend
Status
colour
Green
title
web
New archive location has been added and outage of the new location is also handled in the admin settings.
Status
colour
Yellow
title
backend
Issue in login with username has been fixed.
Status
colour
Yellow
title
backend
MWA access permissions have been redefined.
Status
colour
Yellow
title
backend
Birli is updated to a newer version.
Status
colour
Yellow
title
backend
The new Calibration service has been implemented. Now, Calvin provides the calibration solution. ASVO will hold jobs in the queue until it receives a response from Calvin with the new calibration solution if one is not available, instead of failing the job.
03 Dec 2024
Status
colour
Yellow
title
backend
update processor to use either native Birli or the singularity version of Birli through the configuration.
05 Nov 2024
Status
colour
Yellow
title
backend
Migrating the processor from Garrawarla to Setonix.
14 Aug 2024
Status
colour
Blue
title
client
TAP service is now accessible via https (http will still work though). It is recommended to use https://vo.mwatelescope.org/mwa_asvo/tap instead of http as sometime in the future the http endpoint will be deprecated.
9 Aug 2024
Status
colour
Green
title
web
Status
colour
Yellow
title
backend
Allow scratch delivery to deliver as a tar file. User can choose the delivery format as tar when delivery is selected as scratch.
Status
colour
Yellow
title
backend
Fixed bug where birli manifest hash verification was failing.
Status
colour
Green
title
web
Status
colour
Yellow
title
backend
Allow MWAX_VCS jobs to specify a range of coarse channels. User can select a range of channels they want to download instead of all the channels.
Status
colour
Blue
title
client
(Giant-squid): Submitting jobs should be able to continue after the failure of a single job. When multiple jobs are submitted through Giant-squid, a failure in a single job caused it to quit, which is now fixed. Giant-squid now will proceed to the next job if a job fails.
2 Jul 2024
Status
colour
Yellow
title
backend
Fix SQL bug in db.py
Status
colour
Green
title
web
Jobs page data fetching logic has been updated
Status
colour
Green
title
web
Fixed blank login page
Status
colour
Yellow
title
backend
Migrating Dev environment onto Setonix(on going)
14 May 2024
Status
colour
Green
title
web
Status
colour
Yellow
title
backend
Admin setting: This is an admin feature enables the admin to schedule maintenance , post maintenance message , partially outage some of the jobs. for example, blocking only the jobs that delivers to acacia when acacia is down. This will allow us to keep working parts of the system operational when only one Pawsey component is offline or not working.
Status
colour
Green
title
web
Status
colour
Yellow
title
backend
Added ORCID field to the registration and my profile, this is an optional field. Existing users can go to their profile and update their ORCID. We capture ORCIDs from users to better understand how MWA data is used by researchers.
Status
colour
Green
title
web
Status
colour
Yellow
title
backend
Allow users to unsubscribe from email status updates from MWA ASVO team. The user can go to their profile and uncheck the option to opt out. We will only send status emails when there is a major issue or disruption to users.
Status
colour
Green
title
web
Status
colour
Yellow
title
backend
Status
colour
Blue
title
client
Allow resubmission / retry of completed or errored or cancelled jobs.
Retry feature: For failed or cancelled voltage jobs, "retry" allows a partially completed voltage job to be resumed from where it left off. (via web front end only).
Resubmit: All type of jobs that are failed or cancelled or completed can be resubmitted using the same parameters.
Use -ar, --allow-resubmit to resubmit the jobs through the manta-ray-client CLI
Use -r, --allow-resubmit to resubmit the jobs through the giant-squid CLI
Status
colour
Blue
title
client
giant-squid CLI now has a new download command line argument --download-dir. This allows the user to specify which directory to download data to. If omitted, it will default to the current working directory ('.') which was the behaviour prior to this release.
Status
colour
Green
title
web
Status
colour
Yellow
title
backend
Cosmetic changes: Date formatting; redirect to home after password reset; error message handling; removed some deprecated code; removed a column an internal table data_files that was no longer needed.
Status
colour
Yellow
title
backend
Distinguish between different job types in SLURM queue.
Visibility Download jobs are named {MWA ASVO jobid}vis
Voltage Download jobs are named {MWA ASVO jobid}volt
Conversion jobs have several steps:
Download data step jobs are named {MWA ASVO jobid}convdload
Birli step jobs are named {MWA ASVO jobid}convbirli
Delivery of data step jobs are named {MWA ASVO jobid}convdelivery
Cleanup/Error step jobs are named {MWA ASVO jobid}converror
05 March 2024
Status
colour
Yellow
title
backend
Refining the way we choose different VSS server when attempt fails downloading from Banksia
Status
colour
Yellow
title
backend
staging only required files from Banksia for VCS and Visibility meta jobs - to decrease the waiting time of a job in the queue.
Status
colour
Yellow
title
backend
Add download and upload throughput measurements to processor logs to find the speed of download.
Status
colour
Green
title
web
Fixing sorting issue in admin interface.
18 January 2024
Status
colour
Blue
Yellow
title
client
backend
Calibration:
Conversion jobs now have the option of finding and applying a calibration solution so it returns a calibrated measurement set or uvfits file. This output can then be used in standard radio astronomy tools for analysis / imaging (e.g. CASA, WSClean, etc)
From the website or via the mwa_client / API you can now opt to try and apply a calibration solution to your conversion job.
If there exists an appropriate calibration solution for the observation, the MWA ASVO will provide you with a measurement set or uvfits file which has the calibration solution applied.
If a an appropriate calibration solution cannot be found for the observation then the job will fail. NOTE: not all observations have calibration solutions, yet- this is something the MWA ASVO team are working on completing in the next few weeks.
manta-ray-client now uses an API key for authentication:
You will need to obtain the newest version of the manta-ray-client (mwa_client and API).
API key now replaces username/password for the API and mwa_client.
ASVO_USER and ASVO_PASS environment variables are no longer used and should be removed from your .profile or .bashrc.
MWA_ASVO_API_KEY environment variable is now used to authenticate with the API / mwa_client.
Find your API key from your "Profile" on the MWA ASVO website- it has been auto-generated for you already and then set your MWA_ASVO_API_KEY environment variable to it.
The mwa_client and API now checks the API version on the server and if your client is out of date you will receive an error message asking you to get the latest version.
Package updates: Python packages are updated from 3.8 to 3.11 except processor.
Status
colour
Green
title
web
Package updates: React is updated to v18 except axios.
Status
colour
Green
title
web
Status
colour
Yellow
title
backend
Removal of /astro as a delivery option and processing. Please be aware that the /astro option will be removed from ASVO after the January 18th release. If any jobs with the delivery option as /astro were submitted just before the release, they might encounter issues after Pawsey removes the /astro filesystem on the 22nd. Also, any job data that is left in astro will be lost.
Status
colour
Green
title
web
UI / UX changes: fixed in search button observation page , filtering issue in jobs page.
Status
colour
Green
title
web
Status
colour
Yellow
title
backend
log in locally using email address.
Status
colour
Yellow
title
backend
fixing permission issues with readme.
13 December 2023
Status
colour
Green
title
web
Fix delete request filter issues
Status
colour
Green
title
web
Remove column "Flags" from search results grid
Status
colour
Yellow
title
backend
Priority penalty for ASVO jobs according to the Env
29 November 2023
Status
colour
Yellow
title
backend
Fix to download VCS data directly into the delivery location.
22 November 2023
Status
colour
Green
title
web
UI improvements:
Verification and welcome emails now have html formatting for email clients that support it.
All help and documentation for the MWA ASVO has been moved to this wiki.
Minor look and feel improvements to the underlying web page template.
Fixes:
Removal of SSO Login
Status
colour
Green
title
web
Clicking the link in the email verification email sent during the registration process now correctly informs you that your verification was successful.
New login page
Status
colour
Green
title
web
When user submits data in a form e.g. registration, errors are more clearly highlighted in the browser.
5-Sep-2018
Enhancements:
Scratch Delivery option
Status
colour
Yellow
title
backend
Restrict SSO Login from ASVO CLI clients
Status
colour
Green
Yellow
title
web
The cone search now has a checkbox. When unchecked, it will perform a strict cone search against the observation pointing. When checked (this used to be the default behaviour), the cone search will show any results where the cone is anywhere within the primary beam. This will mean you get a lot more results than the strict cone search.
backend
Binding Scratch to SLURM
Status
colour
Blue
title
client
manta-ray-client and giant-squid will support scratch delivery option
07 November 2023
Status
colour
Green
title
web
Added new wiki URLs.
Status
colour
Blue
Green
title
client
Conversion jobs now have the option to apply a unity bandpass correction. This is equivalent to the cotter “-sbpassband” option. Ticking the box will effectively cause the MWA ASVO to not apply the corrections by passing all 1’s to cotter.
24-Jul-2018
Enhancements:
web
Internal admin page, user activation and security fixes.
Status
colour
Blue
Yellow
title
client
new command line option: -e <error_file> | --error-file=<error_file> | --errfile=<error_file>. This allows users to specify a file which all job-related errors are written to in a machine-readable format (JSON). This is to make it easier for users to write batch processes to submit, download and track MWA ASVO jobs.
backend
New MWAX voltage download validations.
Status
colour
Yellow
title
backend
Hash Manifest of files created by Birli.
Status
colour
Yellow
title
backend
Restricting Jobs from SSO users.
03 October 2023
Status
colour
Green
title
web
Frontend / REACT refactor.
Status
colour
Blue
Green
title
client
mwa_client now uses the argparse module instead of the deprecated optparse module to process command line arguments
Command line option -w | --download-only= now accepts "all" as well as a job id of 0 to mean- download any jobs which are available for download.
26-Jun-2018
Fixes
backend
v1 of Admin interface merged into main website for superusers.
Status
colour
Yellow
title
backend
changed the way internal worker processes communicate, in order to prevent the stdout errors such as "Invalid file object..." when running jobs.Enhancements:
Conversion job products now ship a manifest file containing the filenames and sha1 checksum before the files are delivered to /astro or Acacia so filesystem errors can be more easily detected by users.
Status
colour
Green
Yellow
title
web
all new job products will now have their sha1 hash calculated (you can see it under the "Download" button). To verify the integrity of your download, use an sha1 tool (for example sha1sum <filename>) to compare the expected versus the actual checksum.
Status
colour
Blue
title
client
the sha1 hash is now displayed in the mwa_client when a download completes
backend
Backend logs now contain more information about the Banksia endpoint used to download data from tape in order to allow easier debugging when there are issues.
05 September 2023
Status
colour
Green
title
web
Many minor text changes, fixes and updates to the static pages of the MWA ASVO website.
Status
colour
Blue
Green
title
client
the mwa_client will now display the file size (in bytes) of completed jobs along side the other job information when using the -l (--list-only) option
24-Jun-2018
Enhancements:
web
Updated calibration option text and tooltip.
Status
colour
Blue
Green
title
client
new command line options for mwa_client, allows you to submit jobs and exit (-s); list your jobs and exit (-l); download a job (-w JOBID); download all your jobs (-w 0). It still supports submitting, monitoring and blocking until all downloads are complete as it did before. See manta-ray-client github for the new options and examples
web
Removed twitter widget from front page and replaced with text and a link to our outages page, as there is still no fix from X.
Status
colour
Green
title
web
Profile page: Added list of projects that user is a PI of to profile page. These are the projects where you are able to submit delete requests.
Status
colour
Green
title
web
Profile page: Show user ID, superuser status and MWA Member status.
Status
colour
Green
title
web
Profile page: Show list of projects the user has special permissions for.
Status
colour
Blue
Green
title
client
added an "example.csv" template to make it easier for new users to craft a csv file
web
Observations (search) page: MWAX_BUFFER has been added to the "Correlator Mode" dropdown (and corresponding "ANY VCS" option.
Status
colour
Blue
Green
title
client
minor updates to the output text, including a new option (-v) to show verbose output.
20-Jun-2018
Fixes:
Status
colour
Green
title
web
Accessing a web page which requires the user to be logged in will now take them to a login page
web
Observations (search) page: New search criteria: "Archived Data Files"- a range allowing you to restrict results to only those observations with that many data files (note: Metafits files or flags are NOT included in that number).
Status
colour
Green
title
web
On query page, "project" drop down is now sorted correctly and includes a short description (which is also searchable)
Observations (search) page: New search criteria: "Archived Data Size"- a range allowing you to restrict results to only those observations with that total size of data (note: Metafits files or flags are NOT included in that number). Choose units (B, KB, MB, GB, TB). NOTE units are SI/metric prefix not binary prefix.
Status
colour
Green
title
web
Status
colour
Yellow
title
backend
Status
colour
Blue
title
client
Fixed an issue where the "Jobs" page and the manta-ray-client did not allow the use of a non-integer time resolution setting. e.g. 0.5 would result in an error: "Time resolution not of type integer"
Observations (search) page: "Total archived data bytes" now provides a human readable value instead of a huge unformatted number of bytes. E.g 1234567890 bytes will be shown as 1.2 GB. NOTE units are SI/metric prefix not binary prefix.
Status
colour
Green
title
web
Fixed an issue where the query form is not showing all observations when performing a search.
Status
colour
Blue
title
client
Fixed an issue where rerunning the manta-ray-client with the same csv file produces multiple jobs (which are all the same except for the order of the parameters), instead of 'reconnecting' to the existing job(s).
Observations (search) page: issues with the search table's pagination have now been fixed.
Status
colour
Yellow
title
backend
New user registration info will now also include the Institution/affiliation, allowing admins to more easily approve new users.
01 August 2023
Status
colour
Yellow
title
backend
Fixed several issues when closing down processes.
Various OS patches
Status
colour
Yellow
title
backend
The processor will explicitly ignore files in the archive which are not required for the data job. This will prevent errors like this: "MWA: 50 and NGAS: 51 file number mismatch; ignoring: 1066572736" from occurring.Enhancements:
SSL certificates updated
Status
colour
Green Updated look and feel
Yellow
title
web
backend
If an internal server error occurs with status code 500. It will try an alternative webserver before giving an error.
Status
colour
Green
Yellow
title
web
Changed font to be much more readable for numbers.
Status
colour
Green
title
web
We've added a twitter feed (@mwa_asvo) to the front page which will be used to update users of any service status changes or issues to the
backend
Logging messages are updated with descriptive messages and provide absolute paths for jobs.
Yellowbackend Added MWA_ASVO_README.md to downloaded files. Now, users will have a new file in their downloads that gives information about MWA ASVO.
giant-squid client now supports voltage jobs (note: usual restrictions apply- please Contact Support if you need to be able to download voltages)
Status
colour
Green
title
web
On query page, "from date" can be searched without "to date" and vice-versa
ASVO is added with filters in the "My Jobs" page for Job type and status.
Status
colour
Green
title
web
Upon registering, users will now be shown a message box telling them their registration is successful and that they will need to verify their email address. This should prevent users from clicking register multiple times
Total Archieved Bytes(Size of observation) in the Observations page is formatted.
Status
colour
Green
title
web
Added information about compliance with privacy policy.
30 May 2018
Fixes:
Status
colour
Yellow
title
backend
Pre-submission validations are added in both web-UI and the backend to capture pre-processor errors in advance.
26 July 2023
Status
colour
Blue
Yellow
title
client
Added keyboard interrupt handler to the mwa_client to prevent nuisance error messages when sending Ctrl-C key sequence.Enhancements:
Status
colour
Blue
title
client
Made white text in mwa_client brighter.
backend
Birli version bumped to v0.9.2 which resolves an issue where CASA measurement sets created by Birli may contain files which have a last access time in 2021. This was causing issues for users who are on filesystems with a purge policy which deletes those files as they are too old. Now Birli writes the files with up to date timestamps.
21 July 2023
Status
colour
Blue
title
client
mwa_client now ignores lines beginning with # so you can now comment your csv files.
23 May 2018
Fixes:
manta-ray-client now prints the line/job number with submission issues in order to make finding and fixing issues in the csv file easier.
19th July 2023
Status
colour
Blue
Yellow
title
client
Modified prerequisites so it includes a minimum version number of the "requests" package. Users reported that using "requests" package below version 2.18.3 was causing errors.
26 February 2018
Fixes:
backend
Changed copyq partition to asvo-copyq partition, Updating the Slurm output logs, and adding birli_manifest to check for better astro filesystem debugging.
4th July 2023
Status
colour
Green
title
web
VO TAP service returns correct output for availability and capabilities; also is now MWA branded.
12 February 2018
Fixes:
Status
colour
Yellow
title
backend
Processor now ignores directory structure of flag file when unzipping which was causing issues for some older observations.
9 February 2018
Enhancements:
Status
colour
Yellow
title
backend
The processor now uses a round robin user queue for processing jobs. This means if user A submits 100 jobs and, a few minutes later, user B submits 2 jobs, then it will alternate between processing A's and B's jobs such that user B is not waiting for user A's jobs to finish before user B's jobs start. Instead it would process them: A, B, A, B, A, A, A... and so on. This will result in a much more fair allocation of jobs for users.
Status
colour
Yellow
title
backend
If the processor is shutdown, it will now re-queue the job.
7 February 2018
Enhancements:
New feature: If you are the PI of an MWA project/proposal (or an MWA ASVO superuser), you will see a new icon on the "Observations" page called "Request Deletion". If, as a PI, you want to nominate one or many observations from your project for deletion, click on the button and provide a name for the request and the reason for nominating for deletion. At a future date, the details of observations in this (and other) delete requests will be emailed to the MWA collaboration for a 4 week consultation process. If no objection is received in writing by the Director, the request will be approved, and then the data will be deleted. You can view existing Delete Requests by clicking on your profile (name) in the top right and selecting "Delete Requests". You can then view or cancel your delete requests. There are also filters available to manage the list if it becomes too large (useful for superusers especially).
Status
colour
Green
title
web
Added buttons on the query results page to allow export of the results to csv format so they can be used as inputs to the manta-ray-client.
Status
colour
Blue
title
client
Jump out of mwa_client earlier and report error, if there are no jobs specified in the csv file.
Status
colour
Blue
title
client
mwa_client will ignore empty rows in csv file
The 2 new ARDC Collections have been added to the About→Data Collections menu & search options.
24th January 2023
Status
subtle
true
colour
Red
title
Breaking
Following a discussion at the 2022A MWA project meeting, Cotter has been removed from the MWA ASVO entirely. Birli will now be used for all conversion jobs.
Status
colour
Yellow
title
backend
The generated metafits file passed to the cotter process is now included in the output zip file for conversion jobs.
18 January 2018
Enhancements:
Status
colour
Green
title
web
Change from displaying channel number to channel frequency in search results.
27 December 2017
Status
colour
Green
title
web
Status
colour
Blue
title
client
Status
colour
Yellow
title
backend
Initial release
Following user feedback, metafits files are now included with the output products of conversion jobs.
Status
subtle
true
colour
Red
title
Breaking
The names of parameters that are passed to conversion jobs have changed.
Users can still use the web frontend to submit jobs
Users will not need to update the manta-ray-client
Users will need to update the CSV that they use to submit jobs with the manta-ray-client.