...
Code Block | ||
---|---|---|
| ||
models: { "GPT-4 Turbo": { provider: "openai", model: "gpt-4-1106-preview", apiKey: "sk-....." }, "GPT-3.5 Turbo": { provider: "openai", model: "gpt-3.5-turbo-1106", apiKey: "sk-....." }, "MistralGemini 7BPro": { endpointprovider: "google", model: "https://api.endpoints.anyscale.com/v1""gemini-pro", apiKey: "AI......" }, "Mistral apiFormatMedium with Streaming": { provider: "completionmistral", model: "mistralai/Mistral-7B-Instruct-v0.1mistral-medium", stream: true, apiKey: "esecret_......" }, "Gemini ProMistral 7B via Anyscale": { providerendpoint: "https://api.endpoints.anyscale.com/v1", apiFormat: "googlecompletion", model: "gemini-promistralai/Mistral-7B-Instruct-v0.1", apiKey: "AIesecret_......" }, } |
Model Properties
provider
When this property is specified (e.g. “openai”, “google”, or “google”“mistral”), the endpoint and apiFormat properties assume default values for each respective provider.
...