Groq Models

Use the Groq Console online to generate an API key and copy it into your config.js file assigning it to the “apiKey” property.

For example:

models: {
  "Groq - Mixtral-8x7b - streaming": {
    provider: "groq",
    model: "mixtral-8x7b-32768",
    apiKey: "gsk_......",
    stream: true
  }
}

Then install the groq-sdk npm package using the following commadn:

npm install groq-sdk