2024-04-20 15:06:50 +00:00
|
|
|
namespace AIStudio.Provider;
|
|
|
|
|
|
2024-05-04 08:55:00 +00:00
|
|
|
/// <summary>
|
|
|
|
|
/// Enum for all available providers.
|
|
|
|
|
/// </summary>
|
2024-09-13 19:50:00 +00:00
|
|
|
public enum LLMProviders
|
2024-04-20 15:06:50 +00:00
|
|
|
{
|
2024-07-25 13:29:44 +00:00
|
|
|
NONE = 0,
|
2024-07-03 18:31:04 +00:00
|
|
|
|
2024-07-25 13:29:44 +00:00
|
|
|
OPEN_AI = 1,
|
|
|
|
|
ANTHROPIC = 2,
|
|
|
|
|
MISTRAL = 3,
|
2024-11-09 21:04:00 +00:00
|
|
|
GOOGLE = 7,
|
2025-01-04 14:06:08 +00:00
|
|
|
X = 8,
|
2025-02-27 11:43:19 +00:00
|
|
|
DEEP_SEEK = 11,
|
2025-04-10 10:12:23 +00:00
|
|
|
ALIBABA_CLOUD = 12,
|
2025-08-31 12:27:35 +00:00
|
|
|
PERPLEXITY = 14,
|
2025-12-15 18:31:51 +00:00
|
|
|
OPEN_ROUTER = 15,
|
Add LiteLLM as a new LLM provider
Add LiteLLM as a first-class provider. LiteLLM is a self-hosted AI
gateway that exposes a single OpenAI-compatible endpoint in front of
100+ models across providers (OpenAI, Anthropic, Google, Azure, AWS
Bedrock, and more).
The provider mirrors the existing OpenAI-compatible providers: it uses
the shared StreamOpenAICompatibleChatCompletion helper for streaming
chat and LoadModelsResponse against /v1/models for automatic model
discovery. The user supplies the base URL of their proxy; it is
normalized and the OpenAI-compatible /v1/ path is appended. It uses the
self-hosted trust policy and confidence handling, since the gateway
owner decides which downstream providers requests are routed to.
Wired through the standard plumbing: the LLMProviders enum,
LLMProvidersExtensions (name, confidence, factory, hostname/API-key
requirements), ProviderExtensions (capabilities + reasoning), and
SettingsManager (per-scheme confidence levels). Hostname and API key
are both required. Added a user-facing changelog entry and updated the
configuration-plugin docs to include the new LITE_LLM confidence key.
2026-08-10 12:43:08 +00:00
|
|
|
LITE_LLM = 16,
|
2025-12-15 18:31:51 +00:00
|
|
|
|
2024-07-25 13:29:44 +00:00
|
|
|
FIREWORKS = 5,
|
2024-11-09 19:13:14 +00:00
|
|
|
GROQ = 6,
|
2025-04-11 12:31:10 +00:00
|
|
|
HUGGINGFACE = 13,
|
2024-07-25 13:29:44 +00:00
|
|
|
|
|
|
|
|
SELF_HOSTED = 4,
|
2025-02-26 12:22:01 +00:00
|
|
|
|
|
|
|
|
HELMHOLTZ = 9,
|
2025-02-26 14:34:50 +00:00
|
|
|
GWDG = 10,
|
2024-04-20 15:06:50 +00:00
|
|
|
}
|