Profound Logic

Mistral Models

Verified

See Model Configuration for a full list of available model properties.

Overview

Use the procedure outlined below to configure and use Mistral AI models within Profound AI.

Steps

First, log into the Mistral AI console.
1. Before proceeding, you may need to setup the appropriate billing information.
Next, select API Keys, create a new key, and place it into your model configuration.
Finally, install the mistralai npm package using the following command:
npm install @mistralai/mistralai

Example

The example below shows a sample configuration for the mistral-medium and mistralai/Mistral-7B-Instruct-v0.1 models:

models: {
  "Mistral Medium with Streaming": {
    provider: "mistral",
    model: "mistral-medium",
    stream: true,
    apiKey: "......"
  },
  "Mistral 7B via Anyscale": {
    endpoint: "https://api.endpoints.anyscale.com/v1",
    apiFormat: "completion",
    model: "mistralai/Mistral-7B-Instruct-v0.1",
    apiKey: "esecret_......"
  }
}