-
Notifications
You must be signed in to change notification settings - Fork 748
Open
Labels
Description
New feature
Add support for Google Cloud's new generation machine families:
- C3, C3D
- C4, C4D, C4A
- N4, N4D, N4A
These machine families have specific disk requirements. They only support the following disk types for both boot and mounted disks:
hyperdisk-balancedhyperdisk-balanced-high-availabilityhyperdisk-throughput
Note: C3 and C3D families still support the older disk types (pd-balanced, pd-ssd, pd-standard), but the other new families do not.
Use case
Users want to leverage the improved performance and cost-efficiency of Google Cloud's newest machine generations (C3, C4, N4 series) for their Nextflow pipelines. Currently, Nextflow's Google Cloud Batch integration does not automatically handle the specific disk type requirements (Hyperdisk) for these families, preventing their use or requiring manual and error-prone configuration.
Suggested implementation
- Update
GoogleBatchMachineTypeSelectoror equivalent logic to recognize these new machine families. - When a user selects one of these machine types, automatically default to a supported Hyperdisk type (e.g.,
hyperdisk-balanced) if no specific disk type is provided. - Validate that the requested disk type is compatible with the selected machine family to prevent launch failures.
- Ensure
hyperdisk-*types are recognized as valid options in thediskdirective and config.
References: