Using the GWDG Scientific Compute Cluster – An Introduction


This is a very old introduction to our HPC system. A lot has changed since then.
The basic principles still apply, so we kept this up for reference, but most names,
especially hostnames, names of partitions, etc. have changed and are no longer valid.

Please take a look at our current documentation for up-to-date information.

Slides

The slides for the course can be found here.

Please read before watching

These videos were recorded a while ago and a few things have changed since then. They remain largely relevant and are still helpful today, so we'll keep them online, but please take the exact commands used, especially when connecting to the cluster via ssh with a grain of salt. Please refer to our documentation for up-to-date information on anything that did not work as shown in the videos.

Important Linux Commands

Specifics of the GWDG Cluster

Modules

Compiling Software

Introduction into Slurm

https://www.youtube.com/embed/JCS9PO-Jp1I 560,315 noscroll noborder

Resource Selection

https://www.youtube.com/embed/cl3HNS94QR8 560,315 noscroll noborder

Jobscripts and /scratch Usage

https://www.youtube.com/embed/F-iYYgw-X5g 560,315 noscroll noborder

Longer Jobs, the fat+ partition, GPUs and Debugging

https://www.youtube.com/embed/yFWlDu28pFA 560,315 noscroll noborder

Job Arrays, Dependencies and Useful Slurm Parameters

https://www.youtube.com/embed/yFWlDu28pFA 560,315 noscroll noborder