Page Comparison

...

models: {
  "My Custom Open Source Model": {
    endpoint: "http://127.0.0.1:11434/v1",
    model: "llama2",
    apiKey: "secret", // requred, even if unused
    stream: true
  }
}

The above configuration is based on the assumption that the model's API follows the format commonly used by the OpenAI Chat Completion API. This applies, for example, if you're hosting an open-source large language model locally with a tool like Ollama.

...