Skip to content

Support for Google Cloud new generation machine families (C3, C4, N4) and Hyperdisk #6614

@sosoihd

Description

@sosoihd

New feature

Add support for Google Cloud's new generation machine families:

  • C3, C3D
  • C4, C4D, C4A
  • N4, N4D, N4A

These machine families have specific disk requirements. They only support the following disk types for both boot and mounted disks:

  • hyperdisk-balanced
  • hyperdisk-balanced-high-availability
  • hyperdisk-throughput

Note: C3 and C3D families still support the older disk types (pd-balanced, pd-ssd, pd-standard), but the other new families do not.

Use case

Users want to leverage the improved performance and cost-efficiency of Google Cloud's newest machine generations (C3, C4, N4 series) for their Nextflow pipelines. Currently, Nextflow's Google Cloud Batch integration does not automatically handle the specific disk type requirements (Hyperdisk) for these families, preventing their use or requiring manual and error-prone configuration.

Suggested implementation

  • Update GoogleBatchMachineTypeSelector or equivalent logic to recognize these new machine families.
  • When a user selects one of these machine types, automatically default to a supported Hyperdisk type (e.g., hyperdisk-balanced) if no specific disk type is provided.
  • Validate that the requested disk type is compatible with the selected machine family to prevent launch failures.
  • Ensure hyperdisk-* types are recognized as valid options in the disk directive and config.

References:

Metadata

Metadata

Assignees

No one assigned

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions