<aside> 🔁

How we move data between ResearchDrive, CHTC, and our own machines. Globus is the default for anything large. The command-line options below are for small files, scripted steps, and the occasional job where Globus is overkill.

</aside>

Where data lives

Store Globus endpoint Notes
ResearchDrive `wisc-drive-mzamanian
wisc-drive-jchan32` Our lab share. Raw and processed data.
CHTC staging `chtc#staging
/groups/zamanian_group/` 1 TB / 100k files. Large job inputs and outputs.
CHTC home 20 GB at /home/{net-id}. Submit scripts and small auxiliary files only.
Your computer Personal collection you create See below.

Globus

Globus is faster and far more reliable than SFTP or scp, resumes after interruptions, and emails you when a transfer finishes. Log in at app.globus.org with your NetID.

<aside> 🚨

Use Globus for batch transfers and anything over ~100 MB. Drag-and-drop SFTP clients and scp are unstable at that size and can fail unpredictably.

</aside>

Transferring through the web interface

  1. Log in to the Globus web interface with your NetID.
  2. Set the view to two panels using the icon on the top right.
  3. On one side, click Collection and choose your source — wisc-drive-mzamanian, chtc#staging, or your own computer.
  4. Choose the other collection on the other side.
  5. For CHTC staging, type /groups/zamanian_group/ into the Path box and press Enter. You may be asked to log in with your NetID again.
  6. Navigate to the directories you want, then drag and drop across the collections. You'll get an email when the transfer completes.

See the UW KB article for further instructions.

Personal collections (your own computer)

To pull data from the lab ResearchDrive or CHTC Staging collection down to your laptop, or push files up, install Globus Connect Personal. It turns your machine into a collection you can select in the web interface like any other.