Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

By default, Koa users are granted access to two storage locations, but they could be granted access to two other types of storage locations.The two default storage locations users are given access to are:

  1. home storage (home) and

  2. scratch storage (Koa Scratch).

The two additional types of storage locations could be granted access to includeto a user, but are typically tied to a lab or project:

  1. Lab storage (free) and

  2. KoaStore storage (for fee).

...

Table of Contents
maxLevel3
minLevel1
include
outlinefalse
indent
exclude
styledefault
typelist
printabletrue
class

...

Common Storage Locations

Home (Free)

Each user is provided a home storage location on Koa. Each user's home is provided 50 GB of space that can be used as the user chooses. Upon initialization, user homes are setup with an examples directory, a symlink for Koa Scratch and other basic configurations needed to allow users to take advantage of Koa.

...

File system

Per user storage quota

File & Dir (inode) Quota

Compression

Persistent

ZFS + NFS v4

50 GB

N/A

zstd-3

Yes

...

...

Scratch (Free)

Scratch, also known by the symlink “koa_scratch”, provides each user access to an 800TB pool of storage on which files may live 90 days on from the last time they were modified. In total, this file system can support up to 400,000,000 files and directories. Users are not provided an individual quota allowing for flexibility based on need. Scratch directly accesses the underlying Koa Storage system providing the high performance possible from the storage system.

...

Scratch provides direct access to the underlying high performance file system: Koa Storage, which utilizes Lustre. Lustre is designed for situations where many servers and workloads need to read and write data as quickly as possible. While Lustre works best with long sequential read/writes, and exhibits poorer performance with small random reads, but methods exist to work around this limitation. Workaround Workarounds would include the use of squashfs as we cover in our documentation or archive formats that combine multiple small files that align with your workflow, such as HDF5.

...

File system

Storage Quota

File & Dir (inode) Quota

Compression

Persistent

Lustre + ZFS

800 TB

400,000,000

zstd-3

No (90 day purge)

...

...

Per lab or project storage

Lab and purchased storage processing

Lab (Free)

Lab storage is limited to one free storage location per Lab at UH. A lab will be granted 500GB of space and a limit of 512,000 files and directories. The lab will be assigned a posix group which users can be added and removed from upon request. A lab space will allow them to share applications, data and environments between members of the lab.

Info

In the case the lab or Faculty member requesting the space already lease KoaStore storage, the same posix group will be utilized.

Details

Lab storage has direct access to the Koa Storage system, just like Scratch. It follows a different progressive file layout, in which solid state storage is not utilized.

...

KoaStore (For Fee Storage)

KoaStore is storage that is leased year to year on Koa in 1 TB increments with a limit of 1,024,000 files and folders per TB leased. Funds for this storage must come from an account at UH. Access control to this storage for a given group, lab or project is handled through a posix group which users can be added and removed from upon request.

Info

If the lab or faculty member requesting the space already has a lab storage, we will typically utilize the same posix group as the lab storage unless requested otherwise.

Details

Lab storage has direct access to the Koa Storage system, just like Scratch. It follows a different progressive file layout, in which solid state storage is not utilized.

...