Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

On Koa, users cane create a squashfs archive using the mksquashfs on a compute node. For example, let us assume we have a folder located at ~/koa_scratch/database which contains 10K files with an average file size of 512K. I could create a single file, let us call it database.sfssqfs and also save it in ~/koa_scratch with the following command:

Code Block
languagebash
mksquashfs ~/koa_scratch/database ~/koa_scratch/database.sfssqfs -comp zstd -Xcompression-level 3 -b 1M

...

Note

Note: the squashfs archive can only be mounted on folder that reside in your home directory or in /tmp on a given node. Also be aware that squashfuse will only mount the archive on the node the command is executed from and would only be accessible on that node. An archive can be mounted on multiple nodes at the same time on the same folder in your user home directory.

Code Block
mkdir ~/database
squashfuse_ll -otimeout=43200 ~/koa_scratch/database.sfssqfs ~/database

In the above example, the database.sfs will be unmounted from ~/database after 43,200 seconds (12 hrs) of inactivity. Also

...