How to add local models and BYOK models

18 Nov 20181 minute to read

Local Models:

Click the model’s section dropdown and click ‘Add Chat Model’ option.

local

In the Add Chat Model dialog box choose the provider and model you want to use and add the API key of that particular provider and click connect button.

local

you can see the added model appear in local model category in model’s section

local

BYOK models:

Navigate to Code Studio dashboard website by clicking the dashboard button in the profile icon.

BYOK
BYOK

In the dashboard website navigate to BYOK/LLM keys section and add the LLM key by clicking ‘Add LLM key’ button

BYOK
BYOK

After adding the LLM key navigate to the BYOK/Models section and add the model by clicking ‘Add Model’ button

BYOK
BYOK

After adding the model, the added model will appear in Code Studio models section under BYOK models category.

BYOK