Topics Map > •Research Computing

CRC Getting Started on Globus DTN network

CRC Getting Started on Globus DTN network

Introduction

Rice University CRC's Globus Data Transfer Node (DTN) network nodes provide massively parallel file transfers to facilitate moving large data sets efficiently. A transfer to similarly configured Endpoints will take advantage of high-throughput networking.  You will be able to move data between participating institutions via Globus, including between our DTN endpoints.  Additionally, if you install and configure the Globus Connect software you will be able to transfer files using your local computer as an Endpoint.

DTN Nodes

How to find the DTNs

Proceed to https://app.globus.org/endpoints and search for the bolded item names above to find the respective endpoint. From there you can create your collection.

Prerequisite for Using This System

You must have a cluster account to access NOTS resources, or RDF file share access to access RDF resources.

Your Rice NetID must be registered with Globus.org.

  1. Go to  https://www.globus.org/SignUp , choose "Rice University" as the organization, and log in with your Rice netID.
  2. If you already have a Globus account you can choose to link your Rice identity with an existing account.
  3. If this is your first time using Globus, choose continue to create a new account.

You must read the relevant quick start guides on https://docs.globus.org/

 

How to Access DTN Collections

Visit and search for "Rice CRC NOTS"

Follow the Globus documentation to get setup.

Create a guest collection via a POSIX storage gateway

How to Access your Google Drive with Globus

 

How to Access the DTN /work endpoint

Visit and search for "Rice University CRC HPC WORK Directory NOTS"

Click on the link for the DTN, then select Open in File Manager

Authenticate to the collection using your Rice NetID credentials, after selecting Rice University as your identity provider

Navigate to your files in the work directory using the Globus File Manager

Using Globus to transfer files

To receive or send data, you will need to pick a subdirectory where you have read and write access. For "/work", "/projects", or "/storage/condo/*" this will be a subdirectory you create under your sponsor's NetID directory within the "/work", "/projects", or "/storage/condo/*" structure. When using the respective "scratch" directory, use a subdirectory you have created. Use "/" for your Path to see all of the filesystems currently available on the endpoint or collection you have chosen.

To access the RDF from the RDF endpoint, you will be required to authenticate to the endpoint directly using your NetID credentials after opening the endpoint in the file manager. Once authenticated, you will be able to access folders via the Globus file manager that you have access to on the RDF.  Note that due to the mode of authentication, your Globus authorization for RDF access will expire after 24 hours. It is possible to extend your credentials prior to them expiring.

CRC Globus Network Map

Globus Network Diagram

 



Keywords:
CRC Getting Started on Globus DTN network 
Doc ID:
108242
Owned by:
Bryan R. in Rice U
Created:
2021-01-11
Updated:
2024-08-22
Sites:
Rice University