RBG Blog https://rolebasedgroup.github.io/blog RBG Blog Wed, 01 Apr 2026 00:00:00 GMT https://validator.w3.org/feed/docs/rss2.html https://github.com/jpmonette/feed en <![CDATA[RBG v0.7.0-alpha.2 Released]]> https://rolebasedgroup.github.io/blog/2026/04/01/v0.7.0-alpha.2 https://rolebasedgroup.github.io/blog/2026/04/01/v0.7.0-alpha.2 Wed, 01 Apr 2026 00:00:00 GMT We're excited to announce the release of RBG v0.7.0-alpha.2!

What's New​

This alpha release includes several improvements and new features. Please check out the release notes for more details.

Getting Started​

Install the latest version:

kubectl apply --server-side -f https://github.com/sgl-project/rbg/releases/download/v0.7.0-alpha.2/manifests.yaml

Feedback​

We welcome your feedback! Please report any issues on GitHub.

]]> release alpha <![CDATA[RBG v0.4.0 Released]]> https://rolebasedgroup.github.io/blog/2025/09/23/v0.4.0 https://rolebasedgroup.github.io/blog/2025/09/23/v0.4.0 Tue, 23 Sep 2025 00:00:00 GMT We're excited to announce the release of RBG v0.4.0!

Key Features​

This release includes:

  • Improved multi-role coordination
  • Enhanced autoscaling support
  • Better failure handling mechanisms

Check out the release notes for complete details.

Version Compatibility​

RBG VersionKubernetes VersionLeaderWorkerSet Version
v0.4.0>=v1.28.x>=v0.7.0
]]> release <![CDATA[Introducing RoleBasedGroup]]> https://rolebasedgroup.github.io/blog/2025/08/28/introducing-rbg https://rolebasedgroup.github.io/blog/2025/08/28/introducing-rbg Thu, 28 Aug 2025 00:00:00 GMT RoleBasedGroup (RBG) is a Kubernetes API for orchestrating distributed, stateful AI inference workloads.

Why RBG?​

Traditional Kubernetes primitives are ill-suited for LLM inference services that:

  • Run as multi-role topologies (gateway/router/prefill/decode)
  • Are performance-sensitive to GPU/network topology
  • Require atomic, cross-role operations

RBG treats an inference service as a role-based group, managing it as a single coordinated unit.

The SCOPE Framework​

RBG provides five core capabilities:

  • Stable - Topology-aware deterministic operations
  • Coordination - Cross-role policy engine
  • Orchestration - Role dependencies and startup sequences
  • Performance - Topology-aware placement
  • Extensible - Future-proof deployment abstraction

Getting Started​

Check out our Quick Start Guide to begin deploying LLM inference services with RBG.

]]> announcement