New functionality and enhancements from the v1.25 release is now available in Production Orgs. Read the release notes for details
logo
Rafay Product Documentation
Get Started with Upstream Kubernetes for Bare Metal and VM Environments
Initializing search
    • Home
    • Get Started/Tutorials
    • Recipes
    • Releases
    • Blog
    • Contact

    For Upstream Kubernetes on Bare Metal and VM Environments

    Cluster Lifecycle Management

    Provision and manage the lifecycle of Upstream Kubernetes clusters on bare metal and VMs.

    Windows

    Provision and manage Windows worker nodes. Deploy and operate Windows containers.

    Backup & Restore

    Securely backup your Upstream Kubernetes cluster resources and volumes to protect against infrastructure loss, data corruption, and/or service outages.

    Managed Storage

    Deploy and operate Rook/Ceph based managed storage for Block, File and Object based storage for your stateful applications.

    Nvidia GPUs

    Operate AI/ML applications on Upstream Kubernetes clusters with Nvidia GPU enabled nodes

      • Home
        • Architecture
        • Organizations
        • Icons
        • Overview
          • Overview
          • Setup
            • AddOns
            • Agents
            • Backup
            • Blueprints
            • Blueprint Schema
            • Catalog
            • Clusters
            • Cloud Credentials
            • IdP/SSO
            • Namespaces
            • Namespace Schema
            • Network Policy
            • Overrides
            • Pipelines
            • Policy
            • Projects
            • Repository
            • RBAC
            • Secret Groups
            • Secret Stores
            • Service Mesh
            • Templating
            • Trigger
            • Workloads
            • Overview
            • Blueprints
            • Addons
            • Agents
            • Clusters
            • Credentials
            • Namespaces
            • Pipeline
            • Projects
            • Repository
            • Trigger
            • Workloads
        • Terraform Provider
        • APIs
        • Home
        • Overview
          • Location
          • Cluster Labels
          • Node Labels
          • Node Taints
          • Health
            • Overview
            • Supported Environments
            • Gateway
            • Provisioning
            • CLI
            • Deprovision
          • Overview
          • Supported Environments
            • Create Cluster Template
            • Create Cluster from Template
            • CLI for Cluster Template
          • Credentials
            • Overview
            • Full
            • Customer-Managed VPC
            • Customer-Managed VPC & IAM
            • Customer-Managed VPC & IAM with Restrictions
          • Cluster Config
            • Overview
              • Overview
              • Day-2 Operations
              • Examples
          • Config Schema
          • Unified Config Schema
          • Provision
          • Day-2 Operations
          • Convert to Managed
            • Overview
            • CLI for IRSA
          • CNI Providers
          • Control Plane
            • Overview
            • Custom Networking
            • Secondary CIDR with VPC
            • Overview
            • Custom AMI
          • Wavelength Zone
          • AWS Tags
          • Spot Instances
          • Node Labels
          • Visibility and Monitoring
          • RBAC based KubeCTL
          • Identity Mapping
          • Deprovision
          • Upgrade Strategies
          • k8s Upgrades
          • AMI Upgrades
          • Audit
          • API
          • Best Practices
          • FAQ
          • Troubleshooting
          • Overview
          • Supported Environments
            • Create Cluster Template
            • Create Cluster from Template
            • CLI for Cluster Template
          • Azure Setup
          • Credentials
          • Provision
          • Convert to Managed
          • Node Labels
          • Spot Price
          • Visibility and Monitoring
          • Deprovision
          • K8s Upgrades
          • Audit
            • Overview
              • Overview
              • Examples
          • Config Schema
          • Troubleshooting
          • Approaches
          • Overview
          • Supported Environments
          • Configuration
          • Preflight Checks
          • Provisioning
          • Master Nodes
          • Worker Nodes
          • CLI
          • Config Schema
          • Kubernetes Access
          • Kubernetes Upgrades
          • Node OS Upgrades
          • Deprovision
          • Troubleshooting
          • Retry and Backoff
          • Reset Node
            • Add Storage
            • Overview
              • Single Command-Node
              • Multiple Command-Node
              • Command-Cluster
              • Command History
          • Overview
          • Simulator
          • Overview
          • Provision Servers
          • Provision Kubernetes
          • Overview
          • Supported Environments
            • Create Cluster Template
            • Create Cluster from Template
            • CLI
          • GCP IAM
          • Credentials
          • Provisioning
          • Provisioning Explained
          • preBootstrapCommands
          • CLI
          • Config Schema
          • Scale Nodes
          • Upgrade K8s
          • Troubleshooting
          • Overview
          • Imperative
          • Declarative
          • Import Failures
          • Remove Operator
          • Analysis
          • Overview
          • Provision
          • Deprovision
          • Lifecycle
          • FAQ
          • Overview
          • Provision
          • Import
          • Blueprints
          • Dashboards
          • Overview
          • Provision
          • Deprovision
          • Lifecycle
          • vSphere Example
          • SSH Example
          • Overview
          • Supported Environments
          • Gateway
          • Credentials
          • Provisioning
          • Custom OS Image
          • CLI
          • Config Schema
          • Scale Nodes
          • Troubleshooting
        • Overview
        • Overview
        • Hard Tenancy
          • Overview
          • Description
          • Project Tags
          • Resource Quotas
          • Cluster Sharing
          • CLI
          • Workspace
            • Overview
            • Management
            • Reconciliation
            • CLI
        • Overview
          • Overview
            • Overview
            • AWS S3 Bucket
            • Azure Blob Storage
            • S3 Compatible Storage
          • CLI
            • Overview
            • AWS
            • Azure
            • S3 Compatible
          • Data Agent
          • Backup Policy
          • Backup Job
          • Restore Policy
          • Restore Job
          • Considerations
          • Overview
          • Custom Add-Ons
            • Overview
              • Background
              • Managed Ingress
              • Overview
              • Minimal Blueprint
              • Standard Default Blueprint
              • Default AKS
              • Default GKE
              • Default Openshift
              • Default Upstream
              • Custom Blueprint
              • Golden Blueprint
          • Cluster Fleet Management
          • Sharing
          • Cluster Overrides
          • Update Blueprint
          • Pod Security Policy (EOL)
          • Troubleshooting
            • Blueprint CLI
            • Add-Ons CLI
          • API
          • Overview
          • Manage Catalogs
          • CLI
          • Overview
          • Cost Profiles
          • Cloud Credentials
          • AWS Integration
          • Azure Integration
          • Visibility
          • Chargeback/Showback
            • Profiles
            • Chargeback Groups
          • Overview
          • Benefits
          • Pipelines
            • Overview
            • Approval
            • Deploy Workload
              • Overview
              • CLI
            • System Sync
            • Workload Template
            • Overview
            • Troubleshooting
            • Pipeline Secret Groups
            • CLI
          • Agents
          • Background
          • Overview
          • Installation Profiles
            • Overview
            • Cluster-Wide Network Policy Rules
            • Namespace Network Policy Rules
          • Cluster-Wide Network Policies
          • Namespace Network Policies
          • Network Visibility
          • CLI
          • Overview
          • Installation Profiles
          • Constraint Templates
          • Constraints
          • Policies
          • Policy Violations
          • Visibility
          • CLI
            • Secrets Store Add-on
            • Secret Provider Classes
            • Configure IRSA
            • Annotations
            • CLI
            • Overview
            • Configure Vault
              • ENV Variables
              • Files
              • Use Vault-Wizard
            • Secret Sealer
            • Use Secret Sealer
          • Background
          • Overview
          • Installation Profiles
            • Overview
            • Cluster-Wide Rules
            • Namespace-Wide Rules
          • Cluster-Wide Policies
          • Namespace Policies
          • Visibility
          • CLI
            • mTLS (Self-signed)
            • mTLS (Vault)
            • mTLS (ACM)
            • Overview
            • Organization
            • Projects
            • Cluster
            • My Clusters
            • Nodes
              • View/Edit/Delete
              • Create
            • Kubernetes Events
            • Pod Dashboard
            • Container Dashboard
            • Configuration
            • GPU Dashboard
            • Overview
            • Alerts
            • Notifications
            • Custom Metrics HPA
          • Background
          • Overview
            • Browser
            • KubeCTL CLI
          • Configuration
          • RBAC
          • Audit Trail
          • Private Kube API Proxy
          • FAQ
        • Overview
        • Kubectl
        • Helm
          • Overview
          • Helm Charts
          • k8s YAML
            • Overview
            • System Registry
            • Overview
            • Public Repos
            • Private Repos
            • Lifecycle
            • Agents
            • Overview
            • Ingress
            • DNS based GSLB
            • Containers
            • Container Registry
            • Upgrade Strategy
            • Storage
            • Policy
            • Publish
          • VM Wizard
            • Overview
            • New Certificate
          • Cluster Overrides
          • CLI
            • Overview
            • Developer Tools
            • Overview
            • Common Patterns
              • Overview
              • Workload Basics
              • Workload Wizard
              • Helm Workloads
              • YAML Workloads
              • Provision Upstream k8s
              • Provision Amazon EKS
            • CircleCI
            • GitLab
            • Azure DevOps
        • Integrated GitOps
          • ArgoCD
        • Overview
        • Users
        • MFA
        • Groups
        • Roles
        • CLI
          • Overview
          • ADFS
          • AWS SSO
          • Azure AD
          • Duo SSO
          • Google Workspace
          • KeyCloak
          • Okta
          • Ping One
          • CLI
          • Webhooks
        • Multiple Orgs
        • Overview
        • White Listing
        • Audit Logging
          • Overview
          • CloudWatch
          • DataDog
          • Splunk
        • Compliance
        • Vulnerabilities
        • CIS Benchmark
        • Contact
        • Home
        • Overview
        • Supported Versions
            • Requirements
            • Installation
            • Air Gap Config YAML
            • Load Balancer Config
            • Requirements
            • Installation
            • Backup and Restore
            • Requirements
            • Installation
            • IRSA Role
            • Terraform Configuration
            • Requirements
            • Installation
            • Backup and Restore
            • Requirements
            • Installation
            • Backup and Restore
            • Requirements
            • Installation
            • Overview
            • GKE Self Hoste v1.24
            • 1.5.x to 1.6.x
            • 1.4.x to 1.5.x
      • Support Matrix
        • Overview
        • Operations
        • Cluster Health State
        • Whitelabeling
      • Home
      • Overview
        • Overview
        • Install MicroK8s
          • Part 1: Using Namespaces
          • Part 2: Using Pods
          • Part 3: Using Deployments
          • Part 4: Using Services
          • Part 5: Using Ingress
          • Part 1: Using ConfigMaps
          • Part 2: Using Secrets
          • Part 3: Using PV
          • Part 4: Using PVC
          • Deployments, StatefulSets, DaemonSets
          • Part 1: Using StatefulSets
          • Part 2: Using DaemonSets
        • Overview
        • Prerequisites
        • Part 1: Create Project
        • Part 2: User Management
        • Part 3: Zero Trust Kubectl
        • Part 4: Namespaces
        • Part 5: Cluster Blueprints
        • Part 6: Visibility & Monitoring
        • Part 7: GitOps Pipelines
        • Part 8: Policy Management
        • Part 9: Backup/Restore
        • Clean Up
          • Overview
          • Alerts
          • Notifications
        • Alerts
        • Notifications
        • Home
          • Overview
          • Part 1: Setup Environment
          • Part 2: Create Resources
          • Part 3: Backup/Restore
          • Overview
          • Part 1: Setup
          • Part 2: Provision
          • Part 3: Workload
          • Part 4: Deprovision
          • Overview
          • Prerequisites
          • Part 1: Provision
          • Part 2: Scale
          • Part 3: Node Group
          • Part 4: Upgrade
          • Part 5: Deprovision
          • Overview
          • Part 1: Setup
          • Part 2: Utilize
          • Overview
          • Part 1: Setup
          • Part 2: Provision
          • Part 3: Blueprint
          • Part 4: Deprovision
          • Overview
          • Part 1: Setup
          • Part 2: Blueprint
          • Part 3: Provision
          • Part 4: Workload
          • Part 5: Deprovision
          • Overview
          • Provision
          • Deploy Workload
          • Deprovision
          • Overview
          • Part 1: Setup
          • Part 2: Sync from Git
          • Part 3: Sync from System
          • Overview
          • Provision
          • Deploy Workload
          • Deprovision
          • Overview
          • Part 1: Setup
          • Part 2: Provision
          • Part 3: Pipeline
          • Part 4: Utilize
          • Part 5: Deprovision
          • Overview
          • Part 1: Setup
          • Part 2: Provision
          • Part 3: Blueprint
          • Part 4: Workload
          • Part 5: Deprovision
          • Overview
          • Provision
          • Deploy Workload
          • Deprovision
          • Overview
          • Part 1: Setup
          • Part 2: Provision
          • Part 3: Blueprint
          • Part 4: Workload
          • Part 5: Deprovision
          • Overview
          • Part 1: Provision
          • Part 2: Blueprint
          • Part 3: Workload
          • Part 4: Deprovision
          • Overview
          • Part 1: Provision
          • Part 2: Deprovision
          • Overview
          • Import & Takeover
          • Lifecycle Operations
          • Deprovision
          • Overview
          • Part 1: Setup
          • Part 2: Provision
          • Part 3: Deprovision
          • Overview
          • Part 1: Provision
          • Part 2: Workload
          • Part 3: Deprovision
          • Overview
          • Part 1: Provision
          • Part 2: Deprovision
          • Overview
          • Part 1: YAML
          • Part 2: Helm
          • Part 3: Update
          • Overview
          • Scenario 1: Misconfigured Requests
          • Scenario 2: Incorrect Container Image
        • Home
          • Overview
          • Part 1: Setup Environment
          • Part 2: Create Resources
          • Part 3: Backup/Restore
          • Overview
          • Prerequisites
          • Part 1: Provision
          • Part 2: Scale
          • Part 3: Node Pool
          • Part 4: Upgrade
          • Part 5: Deprovision
          • Overview
          • Part 1: Provision
          • Part 2: Deprovision
          • Overview
          • Part 1: Setup
          • Part 2: Utilize
          • Overview
          • Part 1: Setup
          • Part 2: Provision
          • Part 3: Deprovision
          • Overview
          • Part 1: Create
          • Part 2: Update
          • Part 3: Monitor
          • Overview
          • Part 1: Create
          • Part 2: Utilize
          • Overview
          • Part 1: Detect
          • Part 2: Block
          • Overview
          • Part 1: Create
          • Part 2: Manage
        • Home
          • Overview
          • Part 1: Provision
          • Part 2: Scale
          • Part 3: Upgrade
          • Part 4: Deprovision
          • Overview
          • Part 1: Setup
          • Part 2: Utilize
        • Home
          • Overview
          • Part 1: Setup Environment
          • Part 2: Create Resources
          • Part 3: Backup/Restore
          • Overview
          • Part 1: Provision
          • Part 2: Scale
          • Part 3: Upgrade
          • Part 4: Deprovision
          • Overview
          • Part 1: Setup
          • Part 2: Blueprint
          • Part 3: Workload
          • Part 4: Deprovision
          • Overview
          • Part 1: Setup
          • Part 2: Blueprint
          • Part 3: Utilize
          • Part 4: Expand
          • Overview
          • Part 1: Setup
          • Part 2: Provision
          • Part 3: Deprovision
          • Overview
          • Part 1: Provision
          • Part 2: Workload
          • Part 3: Deprovision
          • Overview
          • Part 1: Setup
          • Part 2: Provision
          • Part 3: Scale
          • Part 4: Upgrade
          • Part 5: Deprovision
          • Overview
          • Part 1: Setup
          • Part 2: Provision
          • Part 3: Deprovision
          • Overview
          • Setup
          • Recreate
          • Rolling Update
          • Blue-Green
          • Canary
          • Overview
          • Part 1: Setup
          • Part 2: Sync Blueprint
          • Part 3: Sync Workload
          • Overview
          • Part 1: Setup
          • Part 2: Provision
          • Part 3: Deprovision
        • Overview
        • Project based isolation
        • Shared clusters
          • Overview
          • Part 1: Setup
          • Part 2: Policy
          • Part 3: Blueprint
          • Part 4: Workload
          • Overview
          • Part 1: Setup
          • Part 2: Apply
          • Part 3: Test
        • Overview
        • Part 1: Setup
        • Part 2: Network Visibility
        • Part 3: Namespace Isolation
        • Part 4: Self-Service via RBAC
        • Overview
        • Part 1: Setup
        • Part 2: Visualization
        • Part 3: Chargeback/Showback
        • Overview
        • Part 1: Setup
        • Part 2: Service Mesh Visibility
        • Part 3: Enforce strict mTLS
          • Overview
          • Scenario 1: Misconfigured Requests
          • Scenario 2: Incorrect Container Image
        • Overview
        • Controlled Access
        • Break Glass
        • Audit Logs
      • Overview
      • Contributors
        • Overview
          • Overview
          • Configure
          • Test
        • Slack
        • PagerDuty
        • Opsgenie
        • Microsoft Teams
        • CloudCasa
          • Overview
          • Credentials - IAM Role
          • Credentials - IAM User
          • Credentials - MinIO
          • Use Velero
        • Overview
        • Kubecost
        • Overview
        • Create Addon
        • Use Cert-Manager
        • Redis
        • InfluxDB
        • Backstage
        • Vclusters
          • Overview
          • Provision Cluster
          • Import Cluster
        • Kubeless
          • Overview
          • Policies
            • Container without limits configured
            • Container without probes configured
            • Pull container images from only ECR registry
            • Unique Service Selector
            • Unique Ingress Host
            • Run Containers only with selective users
          • Overview
          • Policies
        • Overview
        • Nvidia GPU Operator
        • Test GPU
          • Overview
          • Create
          • Configure
          • Access
        • Ambassador
        • Citrix
          • Install Kong
          • Enable Monitoring
          • Enable Logging
          • Sample Application
          • Overview
          • Create Blueprint
          • Test Workload
          • Overview
          • Create
          • Configure
          • Access
        • CloudWatch
          • Overview
          • Create
          • Configure
          • Access
        • Splunk
        • Sumologic
        • New Relic
          • Overview
          • Create
          • Configure
          • Access
        • CloudWatch
        • Datadog Agent
        • Grafana
        • New Relic
        • OpsVerse Agent
        • Prometheus Operator
        • Splunk Connect
        • Overview
          • Install
          • Test
          • Install
          • Overview
          • Create
          • Configure
          • Access
          • Overview
          • Create
          • Configure
          • Access
        • Sealed Secrets
        • Araali
        • Kube-bench
          • Overview
          • Use Istio
          • Overview
          • Use Linkerd
        • MinIO
        • Ondat
        • Portworx
        • Sosivio
      • Overview
          • June
          • May
          • Apr
          • Mar
          • Feb
          • Jan
        • 2022
        • 2021
        • 2020
        • 2019
        • Overview
        • Features
        • 2023
      • Index
        • 2023
        • 2022
        • AI/ML for Kubernetes
        • Amazon EKS Anywhere on Bare Metal
        • Amazon EKS Lifecycle Management
        • Amazon EKS v1.25
        • Amazon EKS
        • AWS
        • Azure AKS
        • Backstage
        • Bare Metal and VM based Environments
        • Basics of Kubernetes
        • Best Practices
        • Challenges
        • Cluster Templates
        • Cluster Upgrades
        • Compliance
        • Cost Management
        • Developer Self Service
        • Discovery
        • Drift Detection
        • EBS Volumes
        • GKE
        • Hands-on Learning
        • Infrastructure as Code (IaC)
        • Infrastructure
        • Istio Service Mesh
        • Kubernetes Components
        • Kubernetes for AI/ML
        • Kubernetes v1.26
        • May 2023 Release
        • New Releases
        • Platform Teams
        • Preview Environment
        • Product Blog
        • Product Documentation
        • Rafay Terraform Provider
        • Security
        • Solutions for Challenges
        • Terraform
        • Training
        • Upgrade to EKS v1.23
        • Windows Containers on Kubernetes
      • Email
      • Slack
    Previous
    Part 2: Utilize
    Next
    Overview
    Copyright © 2017-2023 Rafay Systems