Transferring Data

Owned by davidls
Last updated: Apr 23, 2021
2 min read


  1. Where are the data transfer nodes (DTNs) located?

    The cluster has two DTNs located at hpc-dtn1.its.hawaii.edu and hpc-dtn2.its.hawaii.edu 


  2. What is the Globus endpoint/collection for Mana called?

    The Globus endpoint/collection that represents Mana is named - UH-HPC


  3. When I use rsync to sync files to Mana from another location, it always thinks the files are different, even if the files are identical.  Why is this and how can I fix this?

    On Mana, all the file systems, except for lus_scratch, apply transparent compression to each file.  This compressions is a good thing as it allows you to store more data than you would normally be able to.  The drawback to this is, that the default modes in which rsync compares files will not work.  By default, rsync compares the file size, and timestamps, but due to the compression, it will always be a different size when compared directly to the same file at another location which compression is not applied in the exact same manner.  While this is the default behavior of rsync,, the user does have the option to turn on comparison by using file checksums, which will be able to accurately compare the two files.   To enable comparison by checksum, one only needs to use the "--checksum" flag with rsync.  The original answer to this was found at https://stackoverflow.com/a/13779300 .

  4. How do I revoke rclone access to my Google Drive?

    To revoke access by rclone to your google drive, you would go into your google account settings and revoke access for the 3rd party access that is related to rclone.  If you are using the rclone client ID and not your own client ID, the 3rd party access should be using and icon with the words "RCLONE" in it.

  5. I am trying to transfer data to and from Mana and it is going very slowly.  Can you help me?

    Yes!  Please contact us at  uh-hpc-help@lists.hawaii.edu if you are experiencing slow data transfers when moving data on and off of Mana so that we can work with you to try to determine where the bottleneck is and how we can possibly increase the speed of your data transfer.