Page Comparison

...

Set this Boolean property to true to indicate that you want the model API to stream its output as it is generated rather than sending the output all at once. Beware that some model API may not have this capability.

additionalParams

To enhance flexibility and allow for customized interactions with various models, use this property to pass extra parameters directly to the model API.

For example:

models: {
  "GPT-4 Turbo": {
    provider: "openai",
    model: "gpt-4-0125-preview",
    apiKey: process.env.OPENAI_API_KEY,
    additionalParams: {
      temperature: 0.7,
      max_tokens: 100,
      top_p: 1.0
    }
  },
  // Include other models as needed...
}

The specific parameters supported within additionalParams depend on the model provider and the API being used. Common parameters include, but are not limited to, temperature, max_tokens, top_p, and frequency_penalty. Please refer to the documentation of the respective model provider's API for a complete list of supported parameters and their effects.

For further flexibility, this configuration can be specified as a JavaScript function that receives the parameters generated by Profound AI and adjusts them dynamically.

Additional documentation for each model type:

...