Content Comparison

...

models: {
  "GPT-4 Turbo": {
    provider: "openai",
    model: "gpt-4-1106-preview",
    apiKey: "sk-....."
  },
  "GPT-3.5 Turbo": {
    provider: "openai",
    model: "gpt-3.5-turbo-1106",
    apiKey: "sk-....."
  },
  "Mistral 7B": {
    endpoint: "https://api.endpoints.anyscale.com/v1",
    apiFormat: "completion",
    model: "mistralai/Mistral-7B-Instruct-v0.1",
    apiKey: "esecret_......"
  }
}

Model Properties

provider

When this property is specified (e.g. “openai” or “google”), the endpoint and apiFormat properties assume default values for each respective provider.

model

The provider or endpoint may expose multiple models. This property identifies the specific model to use.

endpoint

Use this property to specify a custom endpoint or API URL. This may be necessary for custom or inhouse models.

apiFormat

Use this property to override the default format of how the data is exchanged with the model. Providers may support different formats. For example, OpenAI offers “completion” and “assistant” API formats.

apiKey

This property contains the API key or secret key associated with the respective model. These keys are used for authentication when making requests to the API.

OpenAI Models

To setup and OpenAI model, you will need an API key. Follow these steps to create the key:

...