Data Transfer, Storage, and Reference Data
Data management is an important part of every project and NCGAS staff can help setup a data management plan that best suits your project.
Data Transfer- IU clusters have an active paid Globus subscription, allowing users to use Globus to transfer data between the clusters (Carbonate, Karst) to your local computer, or Scholarly Data Archive(SDA). Globus is a research management service to help transfer terabytes of data quickly. For help on using Globus, read the blog posts, Getting started on Globus, setting up Globus endpoint on Jetstream
Data Storage Plan- NCGAS provides solutions to both long-term and short-term data management plans.
- Short-term- We provide a default allocation of 10 Terabytes (TB) on our Data Capacitor (dc2) high-speed disk system for your project data during analysis. We can help you set up a project space on Data Capacitor to allow researchers to work collaboratively.
- Long-term- NCGAS offers a persistent (minimum of three years) allocation of archival storage space on the IU Scholarly Data Archive. Default allocations are 50 TB of data storage, with data stored in duplicate in tape silos in Bloomington and Indianapolis, IN. NCGAS will maintain data on tape for three years after the end of the award.
- To request space on SDA click here - select "Request" as the topic and make sure to include your IU username, your most used email, and that you are requesting access to the SDA.
- To help move files from cluster/local computer to SDA, here are some blog posts to help, Getting started on Globus, and Archiving 101.
Reference databases- NCGAS also makes available commonly used reference data sets for referenced-based assembly, alignment, and other tasks, on the Data Capacitor.
We also have other posts talking about managing files on the cluster (click here), manipulate tar files (click here), and managing your workflows (click here).
If you have any question or need help, please contact us at help@ncgas.org.