Transferring Data

Where are the data transfer nodes (DTNs) located?

The cluster has one DTN located at koa-dtn.its.hawaii.edu

What is the Globus endpoint/collection for Koa called?

The Globus endpoint/collection that represents Koa is named - UH Koa Collection

When I use rsync to sync files to Mana from another location, it always thinks the files are different, even if the files are identical.  Why is this and how can I fix this?

On Koa, all the file systems, apply transparent compression to each file.  This compression is a good thing as it allows you to store more data than you would normally be able to.  The drawback to this is, that the default modes in which rsync compares files will not work.  By default, rsync compares the file size, and timestamps, but due to the compression, it will be a different size when compared directly to the same file at another location which compression is not applied in the exact same manner.  While this is the default behavior of rsync, the user does have the option to turn on comparison by using file checksums, which will be able to accurately compare the two files.   To enable comparison by checksum, one only needs to use the "--checksum" flag with rsync.  The original answer to this was found at https://stackoverflow.com/a/13779300 .

How do I revoke rclone access to my Google Drive?

To revoke access by rclone to your google drive, you would go into your Google account settings and revoke access for the 3rd party access that is related to rclone.  If you are using the rclone client ID and not your own client ID, the 3rd party access should be using an icon with the words "RCLONE" in it.

I am trying to transfer data to and from Koa and it is going very slowly.  Can you help me?

Please contact us at  uh-hpc-help@lists.hawaii.edu if you are experiencing slow data transfers when moving data on and off of Koa so that we can work with you to try to determine where the bottleneck is and how we can possibly increase the speed of your data transfer.