MWA ASVO: Command Line Client (giant-squid)

Description

A Rust command-line client to interact with the MWA ASVO.

For general help on using the MWA ASVO, please visit: MWA ASVO wiki.

mwa_giant_squid

mwa_giant_squid is a newer alternative to the manta-ray-client, is designed to work better in HPC environments, is better tested and receives more updates. The MWA ASVO team recommends using this client.

• By default, giant-squid stream untars the downloads from ASVO. In other words, rather than downloading a potentially large (> 100 GiB!) tar file and then untarring it yourself (thereby occupying double the space of the original tar and performing a very expensive IO operation), it is possible to get the files without performing an untar using --keep-zip
• giant-squid does not require a CSV file to submit jobs; this is instead handled by command line arguments.
• For any commands that accept obsids or job IDs, it is possible use text files instead. These files are unpacked as if you had typed them out manually, and each entry of the text file(s) are checked for validity (all ints and all 10-digits long); any exceptions are reported and the command fails.
• One can ask giant-squid to print their ASVO queue as JSON; this makes parsing the state of your jobs in another programming language much simpler.
• By default, giant-squid will validate the hash of the archive. You can skip this check with --skip-hash