Skip to end of metadata
Go to start of metadata

You are viewing an old version of this page. View the current version.

Compare with Current View Version History

« Previous Version 20 Next »

Available models are configured in your config.js file. Add or modify the “models” property to add new large language models. For example:

models: {
  "GPT-4 Turbo": {
    provider: "openai",
    model: "gpt-4-1106-preview",
    apiKey: "sk-....."
  },
  "GPT-3.5 Turbo": {
    provider: "openai",
    model: "gpt-3.5-turbo-1106",
    apiKey: "sk-....."
  },
"Gemini Pro": {
    provider: "google",
    model: "gemini-pro",
    apiKey: "AI......"
  },
  "Mistral Medium with Streaming": {
    provider: "mistral",
    model: "mistral-medium",
    stream: true,
    apiKey: "......"
  },
  "Mistral 7B via Anyscale": {
    endpoint: "https://api.endpoints.anyscale.com/v1",
    apiFormat: "completion",
    model: "mistralai/Mistral-7B-Instruct-v0.1",
    apiKey: "esecret_......"
  }
}

Model Properties

provider

When this property is specified (e.g. “openai”, “google”, “mistral”), the endpoint and apiFormat properties assume default values for each respective provider.

model

The provider or endpoint may expose multiple models. This property identifies the specific model to use.

endpoint

Use this property to specify a custom endpoint or API URL. This may be necessary for custom, open-source, and/or inhouse models.

apiFormat

Use this property to override the default format of how the data is exchanged with the model. Providers may support different formats. For example, OpenAI offers “completion” and “assistant” API.

apiKey

This property contains the API key or secret key associated with the respective model. These keys are used for authentication when making requests to the API.

stream

Set this Boolean property to true to indicate that you want the model API to stream its output as it is generated rather than sending the output all at once. Beware that some model API may not have this capability.

OpenAI Models

To setup an OpenAI model, you will need an API key. Follow these steps to create the key:

  1. Go to the OpenAI website.

  2. Click Sign Up or Sign In in the top-right corner. You may need to provide payment details for API usage. See OpenAI pricing for details.

  3. Go the API keys section.

  4. Create a new secret key (you can provide an identifiable secret key name, such as “Profound AI Key”).

  5. Copy the secret key (it generally starts with “sk-”), and paste it into your config.js file assigning it to the “apiKey” property.

Google Models

To setup a model from Google, visit https://ai.google.dev/ and select Get API key.

Copy the API key into into your config.js file assigning it to the “apiKey” property.

Prior to using models from Google, you must install the following prerequesites:

  • Node.js v18+

  • GoogleGenerativeAI package - use command below to install:

npm install @google/generative-ai

  • No labels