v1.39.0: Slurm reservations during maintenance windows, Improved GKE Support, removed CentOS 7 references

What's Changed

Key New Features 🎉

• Add reservation support in slurm sync for scheduled maintenance by @harshthakkar01 in #2880
• Support multivpc with GKE by @sharabiani in #2797
• adding optional fields to redirect use of embedded modules to pull fr… by @RachaelSTamakloe in #2945

Module Improvements 🔨

• Make CloudSQL secret replication configurable by @dgouju in #2828
• GKE Blueprints to support reservations by @arajmane-g in #2891
• Expose maintenance interval as a blueprint setting for node pools in GKE by @annuay-google in #2971
• Support named placements in GKE node pools by @arajmane-g in #2969
• Add machine type availability checks to slurm-gcp-v6-nodeset by @annuay-google in #2962
• Revisit the Reservation Interface for GKE Blueprints by @arajmane-g in #2997

Improvements 🛠

• Add sort_nodes.py by @mr0re1 in #2853
• replacing centos7 with rocky8 in vm-instance modules by @RachaelSTamakloe in #2900
• replacing centos7 with rocky8 in nfs-server modules by @RachaelSTamakloe in #2901
• replacing centos7 with rocky8 in packer modules by @RachaelSTamakloe in #2899
• Update batch image to hpc-rocky-linux-8 by @ankitkinra in #2884
• OFE - various updates and fixes by @scott-nag in #2921
• Don't set automaticRestart: false by @mr0re1 in #2981

Bug fixes 🐞

• Add slurmgcp-managed infix to resource policy name by @mr0re1 in #2892
• Move pytest and other package installation to make by @annuay-google in #2890
• Prevent use of google provider 6.0 where breaking changes are in use by @tpdownes in #2978
• Fix local_ssd_config issue that forces node-pool recreation by @sharabiani in #2968
• kubernetes provider added to gke-cluster module by @sharabiani in #2985
• Fix for cleanup script. The last input is optional by @cdunbar13 in #2993
• Catch "None" fields in slurm job datetime data for BigQuery by @fdmalone in #2992

Other changes

• Use local-ssd for enroot temp space. by @samskillman in #3011

New Contributors

• @scott-nag made their first contribution in #2921
• @abbas1902 made their first contribution in #2956
• @fdmalone made their first contribution in #2992

Full Changelog: v1.38.0...v1.39.0

v1.38.0: Slurm GCP v6 for a3-highgpu-8g and added ability to disable automatic updates

What's Changed

Key New Features 🎉

• Add Slurm-GCP v6 based solution for provisioning a3-highgpu-8g compute nodes by @tpdownes in #2859
• Add allow_automatic_updates flag by @rohitramu in #2778
• Update slurm-gcp module to use custom endpoints. by @cdunbar13 in #2653
• Add local ssd RAID0 startup script by @alyssa-sm in #2720

New Modules 🧱

• Move GKE Modules to Core by @chengcongdu in #2758

Module Improvements 🔨

• Move slurm_files to the repo. by @mr0re1 in #2739
• Fix cleanup compute for different versions of gcloud by @cdunbar13 in #2794
• change default disk_type for GKE nodepool to null by @chengcongdu in #2818
• Add instance_properties var to nodeset by @mr0re1 in #2843
• Enable local SSD formatting solution to set POSIX permissions by @tpdownes in #2863
• support for min_cpu_platform usage on vm-instance by @RachaelSTamakloe in #2873

Improvements 🛠

• Gke optional accelerator by @ankitkinra in #2736
• add test for gke n2 pool with default driver by @chengcongdu in #2811
• Update local ssd examples to use local ssd startup solution by @alyssa-sm in #2870
• Update a3-megagpu-8 example to use local ssd solution by @alyssa-sm in #2871

Deprecations 💤

• Deprecate enable_devel by @mr0re1 in #2764

Version Updates ⏫

• Update to SlurmGCP 6.6.0 by @mr0re1 in #2830
• SlurmGCP move to 5.12 by @mr0re1 in #2848

Bug fixes 🐞

• Fix construction of cloud.conf by @mr0re1 in #2810
• SlurmGCP. Fix broken --trace-api flag. by @mr0re1 in #2817
• SlurmGCP6. Fix nodes stack in down* state. by @mr0re1 in #2856
• SlurmGCP. Fix bugs around nodeset zones by @mr0re1 in #2864
• Roll back changes in go.mod to release v1.37.2 by @nick-stroud in #2934

New Contributors

• @chengcongdu made their first contribution in #2758
• @ctk21 made their first contribution in #2761
• @arajmane-g made their first contribution in #2854

Full Changelog: v1.37.2...v1.38.0

v1.37.2 Fix SlurmGCP cleanup of resource policies

What's Changed

Bug fixes 🐞

• Delete at most one resource policy at a time by @mr0re1 in #2895

Full Changelog: v1.37.1...v1.37.2

v1.37.1: Documentation update

Fix minor typographical errors in documentation

Full Changelog: v1.37.0...v1.37.1

v1.37.0

The HPC Toolkit has been rebranded to Cluster Toolkit. More details will follow shortly. The github repository has been renamed to match. This should not break existing workflows. References to the old name should seamlessly redirect to the updated repo. The binary has been renamed to gcluster (formally ghpc) but ghpc has been symlinked and will continue to work. If any unexpected behavior is noticed as part of this transition, please report it.

What's Changed

Key New Features 🎉

• Rename binary ghpc -> gcluster by @mr0re1 in #2813
• Update references to HPC Toolkit to Cluster Toolkit by @alyssa-sm in #2829

Other changes

• Roll version number to v1.37.0 by @nick-stroud in #2839

Full Changelog: v1.36.1...v1.37.0

v1.36.1: Fix Slurm GCP Cloud Parameter Defaults

What's Changed

Bug fixes 🐞

• Hot fix to add defaults to cloud params by @nick-stroud in #2812

Full Changelog: v1.36.0...v1.36.1

v1.36.0 - Parallelstore support

What's Changed

Key New Features 🎉

• Add support for parallelstore in pre-existing-network-storage by @harshthakkar01 in #2701
• Develop and adopt boot-time fix for EOL CentOS 7 repositories by @tpdownes in #2738

New Modules 🧱

• Create 'pre-existing-gke-cluster' module by @sharabiani in #2704
• Add parallelstore module and support for rocky 8, ubuntu 22.04 and debian 12 by @harshthakkar01 in #2695
• Add schedmd-slurm-gcp-v6-nodeset-dynamic module by @mr0re1 in #2696

Module Improvements 🔨

• Add 'source' argument for path to prolog or epilog scripts by @andybubu in #2670
• Allow users to turn on access to cluster via GCP public IP address space by @ankitkinra in #2687
• Add known gpu types and their accelerators to gke module by @ankitkinra in #2680
• Add disk_type for HTCondor's EP template by @aneo-ssam in #2705

Improvements 🛠

• Update A3 mega blueprint to use Slurm-GCP 6.5.12 by @tpdownes in #2763

Bug fixes 🐞

• Revert "Remove installation of enroot and pyxis from a3-highgpu-8g blueprint" by @samskillman in #2722
• Only enable gpu taints if guest_acclerator list is not empty by @ankitkinra in #2727
• Move GCESysPrep to provisioner in Windows scripts by @tpdownes in #2728
• Modify a3-highgpu-8g image-building blueprint network by @tpdownes in #2744
• Update image to new centos image for both login and builder nodes by @ankitkinra in #2780

Other changes

• Add validator for Terraform version and SlurmGCP6 by @mr0re1 in #2772

New Contributors

• @sharabiani made their first contribution in #2704
• @aneo-ssam made their first contribution in #2705

Full Changelog: v1.35.1...v.1.36.0

v1.35.1: Fix SlurmGCP prolog/epilog scripts bug

Full Changelog: v1.35.0...v1.35.1

v1.35.0: Shared reservations, TF provider configuration, and targeted group deployment

What's Changed

Key New Features 🎉

• Ability to configure the Terraform provider in blueprint @cdunbar13 in #2635
• Add --skip and --only to deploy and destroy commands by @mr0re1 in #2658
• Add support for shared reservations by @mr0re1 in #2640

New Modules 🧱

• Add stand alone MIG module by @mr0re1 in #2682
• Add pre-existing-subnetwork module by @LasseHjorth in #2597

Module Improvements 🔨

• NFS export options for Filestore by @wiktorn in #2615
• Add option to specify address range for psa by @andybubu in #2633
• Add options to specify authorized networks for slurm-cloudsql by @andybubu in #2631
• Update GKE ML blueprint to use native GKE driver by @ankitkinra in #2662
• Exposes TreeWidth and TopologyPlugin in blueprints by @nick-stroud in #2683
• OFE: new features - edited history by @ek-nag in #2700

Improvements 🛠

• Add topologically-aware NCCL tests solution to A3 Mega by @tpdownes in #2657

Deprecations 💤

• SlurmGCP V6 remove support for custom instance templates by @mr0re1 in #2664
• SlurmGCP V6 remove support for custom instance templates by @mr0re1 in #2667

Bug fixes 🐞

• Update to fix OFE filestore by @cdunbar13 in #2688

New Contributors

• @andybubu made their first contribution in #2633
• @LasseHjorth made their first contribution in #2597

Full Changelog: v1.34.3...v1.35.0

v1.34.3 Documentation update

What's Changed

Other changes

• Add link to newly published A3 Mega documentation by @tpdownes in #2677

Full Changelog: v1.34.2...v1.34.3