...
| Code Block | ||
|---|---|---|
| ||
models: {
"GPT-4o": {
provider: "openai",
model: "gpt-4o",
apiKey: "sk-.....",
stream: true
},
"GPT-4o mini": {
provider: "openai",
model: "gpt-4o-mini",
apiKey: "sk-.....",
stream: true
},
"GPT-3.5 Turbo": {
provider: "openai",
model: "gpt-3.5-turbo-0125",
apiKey: "sk-....."
},
"Gemini Pro": {
provider: "google",
model: "gemini-pro",
apiKey: "AI......"
},
"Azure OpenAI GPT-3.5": {
provider: "openai",
cloud: "azure",
model: "azure-gpt-35-0613",
resource: "profound-openai",
apiKey: "......",
apiVersion: "2023-12-01-preview"
},
"Mistral Medium with Streaming": {
provider: "mistral",
model: "mistral-medium",
stream: true,
apiKey: "......"
},
"Mistral 7B via Anyscale": {
endpoint: "https://api.endpoints.anyscale.com/v1",
apiFormat: "completion",
model: "mistralai/Mistral-7B-Instruct-v0.1",
apiKey: "esecret_......"
},
"Llama 2 70B": {
endpoint: "https://myserver",
apiFormat: "completion",
model: "Llama-2-70b-chat-hf-function-calling-v2",
apiKey: "esecret_......"
},
"Claude 2 Streaming": {
provider: "anthropic",
model: "claude-2.1",
apiKey: "sk-ant-......",
stream: true
},
"AWS Bedrock - Claude 2": {
provider: "anthropic",
cloud: "aws",
model: "claude-2.1",
accessKeyId: "......",
secretAccessKey: "......"
}
} |
...
This property contains the API key or secret key associated with the respective model. These keys are used for authentication when making requests to the API.
genApiKey
Alternate way of providing an API key by generating it dynamically.
| Code Block | ||
|---|---|---|
| ||
genApiKey: async () => {
// logic to dynamically retrieve the api key goes here
} |
apiVersion
The API you’re using may require a version. Use this property to set the appropriate API version.
...
Set this Boolean property to true to suppress status messages, such as “Calling Data Access”, when a streaming model is processing information. This ensures the end-user only sees the model’s final response without seeing intermediate action messages.
voice
| Note |
|---|
Due to browser security measures, this feature requires that your Profound AI instance be set up to use HTTPS (SSL). Otherwise, the browser will not give permission to any microphone/voice feature. |
This property allows you to configure voice recognition capabilities for the model. It contains the following sub-properties:
enabled: A Boolean value indicating whether voice recognition is enabled for this model. If not specified, it defaults to
true.lang: A String specifying the language code for voice recognition (e.g.,
"en-US"for English). If not specified, it defaults to"en-US".
...