Tuesday, April 15, 2014

High-speed automated file transfers

Do you have a large amount of data that you need to move?
Do you need to move data reliably, even over unreliable networks?
Would you like to start a moving data and ignore it until you get a notification that it is complete?
Do you move data often between UM and XSEDE or Flux and your laptop?

Globus can be a tremdous help in any of those scenarios, and we have good support for it on campus, especially on Flux!

The source and destination for file transfers using Globus are called endpoints, and Flux’s endpoint supports access to /scratch, files in your Flux home directory, and files in any Value Storage shares that are available to Flux. The other endpoint could be your laptop, an XSEDE site, or even another location on Flux (for example, you can use Globus to move data between a Value Storage share on Flux and /scratch on Flux).

Using Globus is as simple as using a graphical file-transfer client, detailed instructions are at http://cac.engin.umich.edu/resources/login-nodes/globus-gridftp. As always, the HPC support staff on campus are available to help, simply send an email to hpc-support@umich.edu.