Dynamic Resource Allocation for GPU Allocation on Rafay's MKS (Kubernetes 1.34)
This blog demonstrates how to leverage Dynamic Resource Allocation (DRA) for efficient GPU allocation using Multi-Instance GPU (MIG) strategy on Rafay's Managed Kubernetes Service (MKS) running Kubernetes 1.34.
In our previous blog series, we covered various aspects of Dynamic Resource Allocation (DRA) in Kubernetes:
- Introduction to Dynamic Resource Allocation (DRA) in Kubernetes — what it is and why it matters
- Enable Dynamic Resource Allocation (DRA) in Kubernetes — configuring DRA on a Kubernetes 1.34 cluster using kind
- Deploy Workload using DRA ResourceClaim/ResourceClaimTemplate in Kubernetes — deploying and managing DRA workloads natively on Kubernetes
DRA is GA in Kubernetes 1.34
With Kubernetes 1.34, Dynamic Resource Allocation (DRA) is Generally Available (GA) and enabled by default on MKS clusters. This means you can immediately start using DRA features without additional configuration.
Prerequisites
Before we begin, ensure you have:
- A Rafay MKS cluster running Kubernetes 1.34 (see MKS v1.34 Blog)
- GPU nodes with compatible NVIDIA GPUs (A100, H100, or similar MIG-capable GPUs)
- Container Device Interface (CDI) enabled (automatically enabled in MKS for Kubernetes 1.34)
- Basic understanding of Dynamic Resource Allocation concepts (covered in our previous blog series)
- Active Rafay account with appropriate permissions to manage MKS clusters and addons