Managed Compute Instances & Services
In addition to being able to create and curate "compute profiles" and "service profiles", admins with a PaaS Admin role can also launch and operate compute instances and services as a "managed service" for their users.
There are situations where administrators will need to deploy and operate compute and service instances on behalf of their end users. For example, an organization may want to provide their Data Scientists and ML Researchers with a "managed service" internally for MLOps. To deliver this, the administrator can deploy Rafay's Kubeflow based MLOps Platform (a service profile) and the "compute instance" needed to operate it.
Managed Compute Instance¶
PaaS Admins can configure and launch compute instances by following the steps described below.
- Click on Compute Instances in the left menu
- Click on Add Compute Instance
The workflow is identical to the end user workflows for a compute instance.
Info
A good example of a compute instance managed by an admin is a large, dedicated cluster with 100 GPUs meant for training of a LLM. Clusters like this need to have a high uptime and operational issues can result in significant delays to the training job.
Managed Service¶
PaaS Admins can configure and launch services by following the steps described below.
- Click on Services in the left menu
- Click on Add Service
The workflow is identical to the end user workflows for a Service.
Info
A good example of a compute instance managed by an admin is a centralized MLOps platform based on Kubeflow etc operating on a large Kubernetes cluster in a data center. Given this is a centralized platform, the organization will want IT/Ops to provide a SLA and guaranteed uptime.