Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file not shown.
Binary file added docs/assets/pdfs/hsi_9.3_reference_manual.pdf
Binary file not shown.
74 changes: 74 additions & 0 deletions docs/snippets/compress.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,74 @@
# Archive and Compression

There are several options for archiving and compressing groups of files or directories. The most commonly used options are:

## tar

See the [official documentation for tar](http://www.gnu.org/software/tar/tar.html) for more information.

Saves many files together into a single archive file, and restores individual files from the archive. Includes automatic archive compression/decompression options and special features for incremental and full backups.

Examples:

```
(list contents of archive somefile.tar)
$ tar tvf somefile.tar

(extract contents of somefile.tar)
$ tar xvf somefile.tar

(extract contents of gzipped archive somefile.tar.gz)
$ tar xzvf somefile.tar.gz

(extract contents of bzip2 archive somefile.tar.bz2)
$ tar xjvf somefile.tar.bz2

(archive all ".c" files in current directory into one archive file)
$ tar cvf somefile.tar *.c

(archive and gzip-compress all files in a directory into one archive file)
$ tar czvf somefile.tar.gz somedirectory/

(archive and bzip2-compress all files in a directory into one archive file)
$ tar cjvf somefile.tar.bz2 somedirectory/
```

Other arguments for `tar` can be explored by using the `man tar` command.

## gzip

See the [official documentation for gzip](http://www.gnu.org/software/gzip/gzip.html) for more information.

The standard compression system for all GNU software.

Examples:

```
(compress file somefile - also removes uncompressed file)
$ gzip somefile

(uncompress file somefile.gz - also removes compressed file)
$ gunzip somefile.gz
```

## bzip2

See the [official documentation for bzip](http://www.bzip.org/) for more information.

Strong, lossless data compressor based on the Burrows-Wheeler transform. Stronger compression than gzip.

Examples:

```
(compress file somefile - also removes uncompressed file)
$ bzip2 somefile

(uncompress file somefile.bz2 - also removes compressed file)
$ bunzip2 somefile.bz2
```

There are several other, less commonly used, options available as well:

- zip
- 7zip
- xz
7 changes: 7 additions & 0 deletions docs/snippets/sharing_globus.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,7 @@
Data on any RCAC resource can be shared with other users within Purdue or with collaborators at other institutions. Globus allows convenient sharing of data with outside collaborators. Data can be shared with collaborators' personal computers or directly with many other computing resources at other institutions.

To share files, login to [https://transfer.rcac.purdue.edu](https://transfer.rcac.purdue.edu/), navigate to the endpoint (collection) of your choice, and follow instructions as described in Globus documentation on how to share data:

- <https://docs.globus.org/how-to/share-files/>

See also [RCAC Globus presentation](https://www.rcac.purdue.edu/training/globus).
37 changes: 37 additions & 0 deletions docs/userguides/boxfolder/accounts.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,37 @@
---
tags:
- Box Research Lab Folder
authors:
- jin456
search:
boost: 2
draft: false
---

# Accounts on Box Research Lab Folders

## Access to Box Research Lab Folder

### Obtaining an Account

All Purdue faculty, staff, and students have a Box.com account for personal files.

Research projects requiring regulated storage are assigned group data storage space within Box Research Lab Folder. Project PIs may authorize additional users to collaborate within the folder.

Box research lab Folders **are not** intended to store data protected by Federal privacy and security laws. REED Folders are designed to align with the NIST SP 800-171 standard, and are approved for storing L3 projects requiring HIPAA-aligned storage. Compliance with additional regulations such as CUI, ITAR, EAR, or FERPA are under review.

Neither Purdue or Box set any limits on the total amount or number of files that you may store within your Box Research Lab Folder. However, there are several restrictions on the nature of files you may store:

- Any one individual file may be no larger than 15 GB.

### Outside Collaborators

Within the bounds of your data use agreements, IRB protocols, or technology control plans, Box Research Lab Folders data may be shared with Purdue or non-Purdue collaborators.

### Login to Box to Access your Research Lab Folder

Access to your Box Research Lab Folder is done using your Purdue Career Account by visiting [purdue.box.com](https://purdue.box.com).

### Transferring Files into Box

Files may be up/downloaded from Box via [FTPS](https://support.box.com/hc/en-us/articles/360043697414-Using-Box-with-FTP-or-FTPS).
86 changes: 86 additions & 0 deletions docs/userguides/boxfolder/faqs.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,86 @@
---
tags:
- Box Research Lab Folder
authors:
- jin456
search:
boost: 2
draft: false
---

# Frequently Asked Questions

Frequently asked questions about Box Research Lab Folder.

## About Box Research Lab Folder

### What is a Box Managed Account and REED Folder?

A Box Managed account is your Purdue managed Box account. A REED folder is a project folder created in secure folder structured within Box.

### Does Purdue have a Business Associate Agreement with Box?

Box supports the HIPAA and HITECH regulations, as well as the ability to sign HIPAA Business Associate Agreements (BAAs) with customers. Customers who are required by law to comply with HIPAA, such as HIPAA Covered Entities and HIPAA Business Associates, must have an Enterprise or Elite account with Box and sign a HIPAA Business Associate Agreement (BAA).

- Purdue University signed a Business Associate Agreement with Box, and Box accounts are Enterprise.
- Box provides the ability to use O365 online office application to open and work with content. Purdue University has signed a Business Associate Agreement with Microsoft.
- All other third-party service providers with our instance of Box Enterprise are not covered by a Business Associate Agreement (BAA).

Do not use third-party applications to process data considered Restricted via your Purdue managed Box account. Purdue University does not maintain a contractual agreement with the vendor, and the required security controls are not in place.

## Data

### Can I integrate 3rd-Party Apps with my Box folder?

While official Box add-on applications are approved for use with Purdue Box.com folders, third-party apps have not been reviewed for impact to security and are not approved for use until a security review has been completed by IT Security and Policy. If the official Box apps cannot provide the functionality you need, you may request a security review of the third-party app you are considering by submitting an email including the app name and the functionality you are addressing with the app to itpolicyreq@purdue.edu.

### Can I use Unmanaged Box accounts, and other Cloud Storage Options?

Unmanaged (free and commercial) Box accounts and all other Cloud Storage options are not approved for storing or sharing sensitive or restricted data. Purdue University does not maintain a contractual agreement with the vendor, and the required security controls are not in place. Personal use of cloud storage can continue, however sensitive and restricted data must not be stored in the account. The table below will help you determine where to store your data.

| Classification | Personal Box Folder | REED Folder |
| --- | --- | --- |
| Individually Identifiable Health Information | No | Determined by Review |
| Limited Data Set | No | Yes |
| De-Identified Data | No | Yes |
| De-Identified Data with Contractual Requirements | No | Yes |

### Should I use Box Drive if I work with Restricted Data?

Currently, Box Drive is not recommended for use to work with restricted data. However, if you have a business need for Box Drive, contact IT Security and Policy so we can help you understand the risk and ensure you have the appropriate controls in place to protect the data.

### Will Box Drive or Box Edit cache files on the local machine?

Box Drive does locally cache files that you have opened. Box Drive's cache size limit is based on your free disk space (50% of available space) and has a maximum limit of 25 GB. If you reach this limit, Box Drive begins removing files, starting with those files that have gone the longest without your accessing them. Also, if a cached file has a new version created on Box, Box Drive discards the locally cached version. Do not open data in Box Drive containing restricted data. More details: [Technical Information for Box Drive Administrators](https://community.box.com/t5/Deploying-Managing-Box-Drive/Technical-Information-for-Box-Drive-Administrators/ta-p/37454)

Box Edit does download the file to a cache when you are modifying a file. The cache can be cleared. See: [Clear Your Box Edit Cache](https://support.box.com/hc/en-us/articles/360043695814-Clear-Your-Box-Edit-Cache)

### Can I use FTP to access Box?

No, FTP is disabled.

### Can I delete my files permanently from Box?

Individuals can delete a file or folder, and the item will be placed in the Trash. Individuals will not be able to permanently delete the items. An automated process is in place to remove data older than 90 days. Once the item is purged, it can't be recovered using the built in Box tools.

### What are the recommended permission levels?

| Role | Permission Level |
| --- | --- |
| Project Team member who needs full control | Editor |
| Project Team members who just needs to work within Box | Viewer Uploader |
| Project Team member who needs Read/Download access | Viewer |
| Partner who needs Read access | Previewer |
| Partner who need to upload data | Uploader |

### How do I host sensitive or restricted data in Box?

Storage of restricted data in Box is subject to review from Purdue's IT Security and Policy group (ITSP). Access may also require approval from campus offices and committees responsible for contractual compliance and research regulatory affairs.

Purdue's managed Box environment can be used to store, de-identified data and limited data sets in scope of HIPAA for research. Fully identified data is subject to a security review and approval process.

All restricted data must be stored in a REED Folder. Do not use Box for an actual medical practice.

See the data map below for more details:

![HIPAA data map](/assets/images/userguides/storage/hipaa-dm.png)
16 changes: 16 additions & 0 deletions docs/userguides/boxfolder/index.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,16 @@
---
tags:
- Box Research Lab Folder
authors:
- jin456
search:
boost: 2
---

# Box Research Lab Folder User Guide

A Box Research Lab Folder is a managed storage solution built on top of the Box.com cloud platform, for research labs to share and collaborate within the lab and with outside collaborators.

- [**Box Research Lab Folder Overview**](overview.md)
- [**Accounts**](accounts.md)
- [**Frequently Asked Questions**](faqs.md)
53 changes: 53 additions & 0 deletions docs/userguides/boxfolder/overview.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,53 @@
---
tags:
- Box Research Lab Folder
authors:
- jin456
search:
boost: 2
draft: false
---

# Box Research Lab Folder Overview

Research labs requiring a lab collaboration space can request Box Research Lab Folders by emailing [rcac-help@purdue.edu](mailto:rcac-help@purdue.edu).

## Box Research Lab Folder Features

A Box Research Lab Folder offers research groups in need of centralized data storage for research collaboration many unique features and benefits:

- **Available**

To any Purdue research group requiring data storage space for research collaboration.

- **Accessible**

Easily accessible through your web browser, and facilitates easy sharing with collaborators within Purdue and without.

- **Capable**

A Box Research Lab folder facilitates joint work on shared files across your research group, avoiding the need for numerous copies of datasets across individuals' private storage. It is an ideal place to store a project's data and documents. A Lab Folder can store unlimited data, with a maximum size of a single file up to 15 GB.

- **Controllable Access**

Access management is under your direct control, within the bounds of the appropriate data use agreements, IRB protocols, or technology control plans.

- **Data Retention**

All data kept in the Box Research Lab Folder remains owned by the research group's lead faculty. Files kept in the project's lab folder remain with the research group, unaffected by turnover, and could head off potentially difficult disputes. Data is also retained and protected in alignment with the appropriate data security standards governing your research projects.

- **Never Purged**

A Box Research Lab Folder is never subject to purging.

- **Reliable**

Box Research Lab Folders are built on Purdue's centrally-managed Box.com service, which is a highly-available, secure cloud storage platform.

- **Restricted Data**

Box Research Lab Folders are not designed to align with the NIST SP 800-171 standard, and are not approved for storing L3 projects requiring HIPAA-aligned storage. Please request a REED Folder for sensitive or restricted research data.

## Box Research Lab Folder Hardware Details

Box Research Lab Folders are built on Box.com, an enterprise-grade cloud platform for file storage and collaboration.
75 changes: 75 additions & 0 deletions docs/userguides/depot/faqs.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,75 @@
---
tags:
- Data Depot
authors:
- jin456
search:
boost: 2
draft: false
---

# Frequently Asked Questions

Frequently asked questions about Data Depot.

## About Data Depot

### Can you remove me from the Data Depot mailing list?

Your subscription in the Data Depot mailing list is tied to your account on Data Depot. If you are no longer using your account on Data Depot, your account can be deleted from the [My Accounts](https://www.rcac.purdue.edu/account/myinfo) page. Hover over the resource you wish to remove yourself from and click the red 'X' button. Your account and mailing list subscription will be removed overnight. Be sure to make a copy of any data you wish to keep first.

### What sort of performance should I expect to and from the Data Depot?

The Data Depot is designed to be a high-capacity, fast, reliable and secure data storage system for research data. During acceptance testing, a number of performance baselines were measured:

| Access type | Large file, reading | Large file, writing | Many small files, reading | Many small files, writing |
|---|---|---|---|---|
| CIFS access, single client (GigE) | 102.1 MB/sec | 71.64 MB/sec | 12.43 MB/sec | 11.57 MB/sec |

### Is the Data Depot just a file server?

The Data Depot is a suite of file service tools, specifically targeted at the needs of an academic research lab. More than just the file service infrastructure and hardware, the Data Depot also encompasses self-service access management, permissions control, and file sharing with [RCAC Globus Server](http://transfer.rcac.purdue.edu).

### Do I need to do anything to my firewall to access Data Depot?

No firewall changes are needed to access Data Depot. However, to access data through [Network Drives / CIFS](storage/transfer.md#windows-network-drive--smb) (i.e., CIFS, "Z: Drive"), you must be on a Purdue campus network or connected through [VPN](https://it.purdue.edu/services/vpn.php).

### What is the best way to mount Data Depot in my lab?

You can mount your Data Depot space via [Network Drives / CIFS](storage/transfer.md#windows-network-drive--smb) using your Purdue Career Account credentials.

See the [Windows Network Drive / SMB](storage/transfer.md#windows-network-drive--smb) documentation for step-by-step instructions for Windows, Mac OS X, and Linux.

### How do Data Depot, Fortress, and PURR relate to each other?

The Data Depot, Fortress, and PURR, are complementary parts of Purdue's infrastructure for working with research data. The Data Depot is designed for large, actively-used, persistent research data; Fortress is intended for long-term, archival storage of data and results; and PURR is for management, curation, and long-term preservation of research data.


## Data

### Can I store Export-controlled data on Data Depot?

The Data Depot is not approved for storing data requiring Export control including ITAR, FISMA, DFAR-7012, NIST 800-171.

Please contact the [Export Control Office](http://www.purdue.edu/research/research-compliance/export-control/) to discuss technology control plans and data storage appropriate for export controlled projects.

### Can I store HIPAA data on Data Depot?

The Data Depot is not approved for storing data covered by HIPAA. Please contact the [HIPAA Compliance Office](http://www.purdue.edu/hipaa/) to discuss HIPAA-compliant data storage.

### What do I need to do in order to store non-HIPAA human subjects data in the Data Depot?

Use the following IRB-approved text in your IRB documentation when describing your data safeguards, substituting the PI's name for "PROFESSORNAME":

!!!info
Only individuals specifically approved by PROFESSORNAME may access project data in the Research Data Depot. All membership in the PROFESSORNAME group is authorized by the project PI(s) and/or designees. Purdue University has network firewalls and other security devices to protect the Research Data Depot infrastructure from outside the campus.

Purdue Career accounts have password security policies that enforce age and quality requirements.

Auditing is enabled on Research Data Depot fileservers to track login attempts, maintain logs, and generate reports of access attempts.

### Can I share data with outside collaborators?

Yes! Globus allows convenient sharing of data with outside collaborators. Data can be shared with collaborators' personal computers or directly with many other computing resources at other institutions. See the Globus documentation on how to share data:

- <https://docs.globus.org/how-to/share-files/>
18 changes: 18 additions & 0 deletions docs/userguides/depot/index.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,18 @@
---
tags:
- Data Depot
authors:
- jin456
search:
boost: 2
---

# Data Depot User Guide

The Data Depot is a high-capacity, fast, reliable and secure data storage service designed, configured and operated for the needs of Purdue researchers in any field and shareable with both on-campus and off-campus collaborators.

- [**Data Depot Overview**](overview.md)
- [**File Storage and Transfer**](storage/index.md)
- [**Lost File Recovery**](recover/index.md)
- [**Access Permissions and Directories**](permissions/index.md)
- [**Frequently Asked Questions**](faqs.md)
Loading