Supported LLM Provider & Models

We support 20+ models from different providers:

ProviderModel nameAlias
OpenAIopenai/gpt-4o-2024-08-06openai/gpt-4o
openai/gpt-4o-2024-05-13
openai/gpt-4-turbo-2024-04-09openai/gpt-4-turbo
openai/gpt-4-0125-previewopenai/gpt-4-turbo-2024-04-09
openai/gpt-4-1106-preview
openai/gpt-4-0613openai/gpt-4
openai/gpt-3.5-turbo-0125openai/gpt-3.5-turbo
openai/gpt-4o-mini-2024-07-18openai/gpt-4o-mini
openai/o1-preview-2024-09-12openai/o1-preview
openai/o1-mini-2024-09-12openai/o1-mini
Anthropicanthropic/claude-3-5-sonnet-20240620
anthropic/claude-3-opus-20240229
anthropic/claude-3-sonnet-20240229
anthropic/claude-3-haiku-20240307
anthropic/claude-2.1
Googlegoogle/gemini-1.5-pro-latest
google/gemini-1.5-flash-latest
google/gemini-1.0-pro-latestgoogle/gemini-pro
Mistralmistral/open-mixtral-8x22b
mistral/codestral-latest
mistral/open-mixtral-8x7b
mistral/mistral-large-2407mistral/mistral-large-latest
mistral/mistral-large-2402
mistral/mistral-medium-latest
mistral/mistral-small-latest
mistral/open-mistral-7b
mistral/open-mistral-nemo
Replicatereplicate/meta-llama-3-70b-instruct
replicate/meta-llama-3-8b-instruct
replicate/mixtral-8x7b-instruct-v0.1
replicate/mistral-7b-instruct-v0.2
replicate/meta-llama-3.1-405b-instruct
TogetherAItogetherai/Llama-3-70b-chat-hf
togetherai/Llama-3-8b-chat-hf
togetherai/Meta-Llama-3.1-8B-Instruct-Turbo
togetherai/Meta-Llama-3.1-70B-Instruct-Turbo
togetherai/Meta-Llama-3.1-405B-Instruct-Turbo
togetherai/Qwen2-72B-Instruct
togetherai/Mixtral-8x22B-Instruct-v0.1
togetherai/Mixtral-8x7B-Instruct-v0.1
togetherai/Mistral-7B-Instruct-v0.2
Perplexityperplexity/llama-3.1-sonar-large-128k-online
Coherecohere/command-r-plus
cohere/command-r