Skip to main content

Gang Scheduling

RBG supports gang scheduling through integration with scheduler-plugins.

What is Gang Scheduling?​

Gang scheduling ensures all pods of a role start together, which is critical for distributed inference workloads.

Configuration​

Enable gang scheduling in the role spec:

roleSpec:
  scheduling:
    gangScheduling: true

Example​