Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

Code Block
languagejs
models: {
  "GPT-4 Turbo": {
    provider: "openai",
    model: "gpt-4-1106-preview",
    apiKey: "sk-....."
  },
  "GPT-3.5 Turbo": {
    provider: "openai",
    model: "gpt-3.5-turbo-1106",
    apiKey: "sk-....."
  },
  "MistralGemini 7BPro": {
    endpointprovider: "google",
    model: "https://api.endpoints.anyscale.com/v1""gemini-pro",
    apiKey: "AI......"
  },
  "Mistral  apiFormatMedium with Streaming": {
    provider: "completionmistral",
    model: "mistralai/Mistral-7B-Instruct-v0.1mistral-medium",
    stream: true,
    apiKey: "esecret_......"
  },
  "Gemini ProMistral 7B via Anyscale": {
    providerendpoint: "https://api.endpoints.anyscale.com/v1",
    apiFormat: "googlecompletion",
    model: "gemini-promistralai/Mistral-7B-Instruct-v0.1",
    apiKey: "AIesecret_......"
  },
}

Model Properties

provider

When this property is specified (e.g. “openai”, “google”, or “google”“mistral”), the endpoint and apiFormat properties assume default values for each respective provider.

...