How to Set Up Custom AI Models in GPT Breeze

GPT Breeze allows you to bring your own AI models by configuring custom models and credentials. This guide will walk you through the process.

Setting Up Credentials

Before adding a custom model, you'll need to set up your API credentials.

A credential is a set of authentication information used to access an AI service. It includes:

• Your API key - a unique identifier that authenticates your requests to the AI service provider
• The base URL for the API service you're connecting to
• A name you assign to easily identify this credential set

Think of credentials as your digital pass that allows GPT Breeze to securely access and use external AI services on your behalf while keeping your authentication information secure.

1. Access Credentials
   • Go to the General tab in GPT Breeze settings
   • Scroll down to the "Credentials" section
   • Click "Add New Credential" button
2. Fill in Credential Details
   • Credential Name : Give your credential a recognizable name (e.g., "My OpenAI Account")
   • Base URL : Enter the API endpoint URL
     • For OpenAI: https://api.openai.com
     • For Azure: Your Azure endpoint URL
     • For other providers: Use their respective API endpoints
   • API Key : Enter your API key from the provider
3. Save Your Credential
   • Click "Save" to store your credential
   • Your credential will appear in the credentials list
   • You can edit or delete credentials using the respective buttons

Adding Custom Models

After setting up your credentials, you can add custom models:

1. Access Custom Models
   • In the General tab, find "Choose default AI Model" section
   • Click "Add Custom Model" button
2. Configure Your Model
   • Model Name : Enter the actual model identifier
     • For OpenAI: gpt-4 , gpt-3.5-turbo , etc.
     • For Azure: Your deployed model name
     • For other providers: Their respective model identifiers
   • Display Name : Enter a friendly name that will appear in the UI
   • Select Credential : Choose the credential you created earlier
3. Save Your Model
   • Click "Save" to add your custom model
   • The model will appear in your models list
   • You can edit or delete models using the respective buttons