Profound Logic

Groq Models

Verified

See Model Configuration for a full list of available model properties.

Overview

Use the procedure outlined below to configure and use Groq models within Profound AI.

Steps

Open the Groq Console in your web browser.
Generate a new API key.
In your config.js file, assign the generated key to the apiKey property.
Then install the groq-sdk npm package using the following command:

npm install groq-sdk

Example

The example below shows a sample configuration for the mixtral-8x7b-32768 Groq model:

models: {
  "Groq - Mixtral-8x7b - streaming": {
    provider: "groq",
    model: "mixtral-8x7b-32768",
    apiKey: "gsk_......",
    stream: true
  }
}