See Model Configuration for a full list of available model properties.

Knowledge Documents and RAG are not supported with Mistral AI models. RAG functionality in Profound AI is only supported with OpenAI models that use the assistants API format (see Agent Knowledge for details).

Overview

Use the procedure outlined below to configure and use Mistral AI models within Profound AI.

Steps

First, log into the Mistral AI console.
1. Before proceeding, you may need to setup the appropriate billing information.
Next, select API Keys, create a new key, and place it into your model configuration.
Finally, install the mistralai npm package using the following command:
npm install @mistralai/mistralai

Example

The example below shows a sample configuration for the mistral-medium and mistralai/Mistral-7B-Instruct-v0.1 models:

models: {
  "Mistral Medium with Streaming": {
    provider: "mistral",
    model: "mistral-medium",
    stream: true,
    apiKey: "......"
  },
  "Mistral 7B via Anyscale": {
    endpoint: "https://api.endpoints.anyscale.com/v1",
    apiFormat: "completion",
    model: "mistralai/Mistral-7B-Instruct-v0.1",
    apiKey: "esecret_......"
  }
}

Mistral Models

Overview

Steps

Example