This course will consolidate material presented in the beginner cluster course and expand on the concepts to be aware of when trying to optimize use of the cluster.
Number of course hours : 9h
Date : 6-7-8 November 2024
Level: Medium
Topics Covered:
- What is a cluster and Logging in
- Queuing / the scheduler
- What resource are available at the CRG cluster
- Simple batch scripts - directives and Troubleshooting
- Supercomputers, beowulf clusters, horizontal v vertical scaling
- Hardware considerations
- Multithreaded jobs, parallelism, Amdahl's Law
- Job arrays and Job dependencies
- Building a pipeline / Storage issues, treemap
- Job stats, resource estimation / Scaling analysis