...

models: {
  "GPT-4 Turbo": {
    provider: "openai",
    model: "gpt-4-1106-preview",
    apiKey: "sk-....."
  },
  "GPT-3.5 Turbo": {
    provider: "openai",
    model: "gpt-3.5-turbo-1106",
    apiKey: "sk-....."
  },
  "Gemini Pro": {
    provider: "google",
    model: "gemini-pro",
    apiKey: "AI......"
  },
  "Azure OpenAI GPT-3.5": {
    provider: "azure",
    model: "azure-gpt-35-0613",
    resource: "profound-openai",
    apiKey: "......",
    apiVersion: "2023-12-01-preview"
  },  
  "Mistral Medium with Streaming": {
    provider: "mistral",
    model: "mistral-medium",
    stream: true,
    apiKey: "......"
  },
  "Mistral 7B via Anyscale": {
    endpoint: "https://api.endpoints.anyscale.com/v1",
    apiFormat: "completion",
    model: "mistralai/Mistral-7B-Instruct-v0.1",
    apiKey: "esecret_......"
  },
  "Llama 2 70B": {
    endpoint: "https://myserver",
    apiFormat: "completion",
    model: "Llama-2-70b-chat-hf-function-calling-v2",
    apiKey: "esecret_......"
  },
  "Claude 2 Streaming": {
    provider: "anthropic",
    model: "claude-2.1",
    apiKey: "sk-ant-......",
    stream: true
  }  
}

Model Properties

provider

...

Prior to using models from Google, you must install the following prerequesitesprerequisites:

• Node.js v18+

• GoogleGenerativeAI package - use command below to install:

...

1. Go to https://portal.azure.com and sign in.

2. Search and select the Azure OpenAI service.

3. Click Create a resource and follow the steps to create the resource.

4. Go to the resource you created and select Keys and Endpoint.

   1. Copy those items into your config.js file as endpoint and apiKey properties of your model.

   2. Alternatively, instead of the endpoint property, you can also set the resource property based on the resource name you chose. With this property set, the endpoint will be constructed automatically.

   3. Set the provider property to “azure”.

5. Go to Manage Deployments.

6. Select Create Deployment.

7. Select desired model and model version; then give it a name. Supply this name as the model property in your config.js file. Ensure the model and version you select supports function calling. It may take a few minutes before the model is fully deployed and you are ready to try it.

Anthropic Models

Use the Anthropic Console online to generate an API key and copy it into your config.js file assigning it to the “apiKey” property.

Prior to using models from Anthropic, use the command below to install the Anthropic SDK npm package:

npm install @anthropic-ai/sdk