Go to the website

Register

You will need to register to create an account. There are two ways to register (and then log in) with the MWA ASVO:

Choose How to Login / Register

Option 1: Log in / Register with a AAO Data Central Account

• Click on "Register with your AAO data central account"
• This will take you to their sign in page. Log in to Data Central as normal.
• You will then be automatically logged in to the MWA ASVO!

Option 2: Log in / Register by creating an MWA ASVO username and password

• Click on "Register for an MWA ASVO account"
• Fill in and submit the registration form.
• You will be sent an email to verify your email address.
• Confirm your email address by clicking on the link in the email.
• An administrator will review the registration and then activate your account..
• You will receive an email confirming your account is active. Until then you will not be able to log in to the system.

Logging In

Once your account is activated, you will now be able to login to the system. Click "Login" in the top right of the home page.

If you chose Option 1 above, then click on "Login through an AAO Data Central account", otherwise click "Login with MWA ASVO account".

Searching for Observations

The first thing you'll want to do is to search for observations via the Search for Observations page. Click on "Search".

• You can specify parameters on the left-hand panel (MWA ASVO Cone Search Query)
• OR, if you are an advanced user, write your own ADQL query against the obscore schema.

Review the list of results in the table at the right side of the page. You may do any of the following:

• Create a conversion job or download job for a single observation through this web interface (see Create a Data Job section below)
• Select any number of rows in the table (or use the "Select All/None" buttons), then click:
• Submit Conversion: this will allow you to submit / generate a CSV file based on the conversion job options and observations you have selected, which can be used as input to the manta-ray-client (the command-line download tool)
• Submit Download: this will do the same as "Submit 44Conversion", except for visibility download job.

Create a Data Job

Start a new data job

While in the Query Results panel, clicking on an observation ID (obsid) will take you to the New Data Job page where you can specify how you want your data.
Alternatively, if you already know the obsid you want to download, you can go My Jobs. Then, click on New Data Job button. Next, you must decide if you want to run a Conversion job or a Visibility Download job or a voltage Download Job.

Conversion Job

This will retrieve raw visibilities from the MWA Archive and convert the MWA-specific file format into a CASA measurement set or uvfits file format using the cotter pre-processing utility. Optionally you may opt for an appropriate calibration solution to be found and applied to your data. You must also specify the frequency & time averaging options, as well as the edge-width and other settings. (See below)

• Time Resolution (s): Average N seconds of time steps together before writing output.
• Freq. Resolution (kHz): Average N kHz bandwidth of channels together before writing output. When averaging: flagging, collecting statistics and cable length fixes are done at the highest resolution. UVW positions are recalculated for new time steps.
• Edge Width (kHz): Flag the given width of edge channels of each coarse channel (default: 80 kHz)
• Calibrate: The system will try to find an appropriate calibration solution for this observation. The solution is applied before averaging. If you select this and it cannot find a calibration solution, the job will fail, however most observations will have a calibration solution available by Q2 2019. For more information on how the "calibrate" feature works, please see MWA ASVO: Calibration Option.
• Delivery: By default, ASVO delivers the data to Acacia, which is an object storage. Alternatively, users who have a Pawsey account set up in their profile will be able to select /scratch, which is a file system provided by Pawsey.

Now you submit your data job. If there are any problems with your parameters you will see an appropriate message on the page.

Visibility Download Job

This will retrieve either just the metadata files associated with the observation and/or the raw visibilities (still in their MWA-specific format). This option is intended for advanced users who are familiar with MWA tools such as cotter, the MWA RTS, etc and want more fine-grained control. Now you submit your data job. If there are any problems with your parameters you will see an appropriate message on the page.

Voltage Download Job

This type of job allows you to download raw MWA voltage data in raw format.  This option is only for advanced users as the data is in an MWA-specific raw voltage format. This can only be delivered to /scratch as the data will be usually huge. Now you submit your data job. If there are any problems with your parameters you will see an appropriate message on the page.

Monitor Jobs

After submitting your data job, or if you want to come back and check on the status of your job(s), go to the Data Jobs page. You will see all of your current jobs and you can take different actions depending on their status. MWA ASVO data jobs go through the following statuses:

• Queued: Your data job is submitted and is awaiting processing. You may cancel your data job during this phase using the Cancel button.
• Processing: Your data job has been picked up by a worker node and the data job is running. The worker process will be downloading the data from the MWA Archive which is located at the Pawsey Supercomputing Centre, processing a data conversion job using cotter (if you selected a data conversion job) and then placing the resultant data product in a data retrieval area on our servers. You may cancel your data job during this phase using the Cancel button.
• Complete: Your data job completed successfully and the data product is ready to download (see below).
• Error: Something went wrong and the system could not produce the output you requested. The error message may provide you with details of what went wrong. If you are having difficulty processing an observation please contact MWA ASVO Technical Support and provide the obsid and job_id you are having trouble with.

Download Data

There are two ways we deliver the data. 

• Acacia: This is an object storage. Once your data job is successfully completed, ASVO uploads the data into Acacia. There will be a hyperlink to your data product in the "Download" column of the table on the Job Results page. MWA ASVO downloads can be very large, so we recommend copying the link URL and using tools such as wget to download your data. Your download will be available for 7 days from completion, after which it will be removed from the MWA ASVO servers.
• Scratch: This is a file system provided by Pawsey. You need to have a Pawsey account to access this storage, where ASVO directly delivers the data. It is up to the user to manage and clean up the data under their allocation.

Conversion Job Contents

After a conversion job (obsid_ms.zip or obsid_uvfits.zip) and you unzip the contents you will have the following files:

Output type: CASA Measurement Set

Output type: UVFITS

Download Job Contents

Bulk Downloads

Once you have submitted and downloaded a few jobs via the web interface you might be interested in a more efficient method to submit jobs and download data so you can do it in bulk. It is recommended that you use the manta-ray-client command line tool and API which makes submitting and downloading batches of jobs easier. Please see: MWA ASVO: Command Line Clients for more information.