Skip to content

Storage Namespace

A storage namespace is a locally available storage resource (backed by local, high speed Object storage) where the admin can upload model weights etc. This ensures that models can be loaded into GPU memory very quickly. There is no need to download the model's weights etc from remote repositories such as Hugging Face etc which can take 30-60 mins just for the download itself.

Create Namespace

In the Ops Console,

  • Click on GenAI and then Storage Namespaces.
  • Click on "New Storage Namespace"
  • Provide a name (unique to the controller)

Create Storage NS

Now select the storage provider type setup in your datacenter.

Storage Type

Next, for the selected storage provider, provide the bucket name, endpoint and access credentials. Click Save

Storage Credentials

View All Namespaces

To view all storage namespaces, in the Ops Console, Click on GenAI and then Storage Namespaces. This will present the list of all storage namespaces.

View All Storage NS

Delete Namespace

To delete a storage namespace, in the Ops Console, click on GenAI and then Storage Namespaces. Click on the "ellipses" (3 dots on the far right) under Action for an existing storage namespace.

  • Click on "Delete"
  • You will be prompted to confirm deletion

Access Keys

Once a storage namespace has been created on the object storage, the admins will need access keys in order to upload model weights etc. Admins will use the "AWS CLI" utility to authenticate to the storage namespace and upload model weights.

Info

At any given time, only two access keys can be active.

Create Key

Click on "Create New Key" to generate a new Access Key.

Delete Key

Click on "Delete" under actions for an existing access key