CRC Getting Started on Globus DTN network

Introduction

Rice University CRC's Globus Data Transfer Node (DTN) network nodes provide massively parallel file transfers to facilitate moving large data sets efficiently. A transfer to similarly configured Endpoints will take advantage of high-throughput networking.  You will be able to move data between participating institutions via Globus, including between our DTN endpoints.  Additionally, if you install and configure the Globus Connect software you will be able to transfer files using your local computer as an Endpoint.

DTN Nodes

• Rice University CRC DTN for /scratch on NOTS 
  • facilitates the movement of data into and out of the "/scratch" shared filesystem available for NOTS.
• Rice University CRC DTN for /home on NOTS 
  • facilitates the movement of data into and out of the "/home" shared filesystem available for NOTS.
• Rice University CRC DTN for /projects on NOTS 
  • facilitates the movement of data into and out of the "/projects" shared filesystem available for NOTS.
• Rice University CRC deepsC in storage condo
  • facilitates the movement of data into and out of the "/storage/condo/*"  shared filesystem available for NOTS.
• Rice University CRC Data transfer node Google Drive connector for "Shared Drives" 
  • provides access to create a collection using your Rice Google account ("Shared Drives") as an endpoint allowing you to transfer data between your Rice Google Drive account and other Globus endpoints. 

  • When creating this collection "Base Directory" should be left blank on the Create a Guest Collection page

• Rice University CRC Data transfer node for Google Drive connector for "My Drive"
  • provides access to create a collection using your Rice Google Drive account ("My Drive") as an endpoint allowing you to transfer data between your Rice Google Drive account and other Globus endpoints.

• Rice CRC Work
  • facilitates the movement of data into and out of the "/work" shared filesystem available for NOTS ("/storage/hpc/work" from the NOTS login nodes).
• Rice University CRC RDF Endpoint
  • facilitates the movement of data from the RDF's SMB-based research file shares to other Globus endpoints for users of Rice's Research Data Facility

Prerequisite for Using This System

You must have a cluster account to access NOTS resource, or RDF file share access to access RDF resources.

Your Rice NetID must be registered with Globus.org.

1. Go to  https://www.globus.org/SignUp , choose "Rice University" as the organization, and log in with your Rice netID.
2. If you already have a Globus account you can choose to link your Rice identity with an existing account.
3. If this is your first time using Globus, choose continue to create a new account.

You must read the relevant quick start guides on https://docs.globus.org/

 

 

Using Globus to transfer files

To receive or send data, you will need to pick a subdirectory where you have read and write access. For "/work", "/projects", or "/storage/condo/*" this will be a subdirectory you create under your sponsor's NetID directory within the "/work", "/projects", or "/storage/condo/*" structure. When using the respective "scratch" directory, use a subdirectory you have created. Use "/" for your Path to see all of the filesystems currently available on the endpoint or collection you have chosen.

To access the RDF from the RDF endpoint, you will be required to authenticate to the endpoint directly using your NetID credentials after opening the endpoint in the file manager. Once authenticated, you will be able to access folders via the Globus file manager that you have access to on the RDF.  Note that due to the mode of authentication, your Globus authorization for RDF access will expire after 24 hours. It is possible to extend your credentials prior to them expiring.

CRC Globus Network Map