Storing and Sharing Data

Our CCB cluster stores sensitive data and sometimes research secrets.  Therefore, we have our own conventions to keep the users accountable for the data.

PROJECT SPACES

We provide personal directories and project spaces. Principal investigators can create multiple project spaces to share with multiple research collaborators. This helps researchers to share data on a need-to-know basis. In each project space, each participant has a dedicated directory. This keeps the participant accountable for the collected or generated data pieces.

The project spaces are snapshot after midnight, from Tuesday to Saturday. The snapshots are accessible to the authorised users of the project.

SCRATCH DRIVES

Scratch drive is available when a program runs as a SLURM job. Each worker node of JADE has an unmetered and directly attached drive space as specified by $TMPDIR environment variable. This allows you to work on temporary large files independent from the network and your original storage quota, such as starting a temporary database for sequence matching.

To avoid resource and data leakage, the temporary directory is automatically removed after use.

DATA SHARING SERVICE

We provide a straightforward mechanism for sharing data over the Internet so it can be downloaded by other people. Unlike hiring from a typical web hosting, our data share service runs on the same distributed file storage system. Files can be moved and copied with little effort.

Please note that only data classified as 'Public' may be shared in this way.

SEQUENCING SERVICE

As a member of WIMM, you can request sequencing services for your samples. Upon successful analysis, an automated process creates an archive file and sends you an email. The email tells you the exact name of your archive and its location.

The result archive file is stored free of additional charge on CCB for 28 days. The archive file sits in a separate directory which you, with a valid CCB user account, can download it or copy it to your project storage.

Archive Service

In addition to our high-performance storage, you are recommended to acquire additional offsite storage space such as WIMM KEEP to archive your research result.