Supported Providers

The Kimchi Proxy integrates with various Large Language Model (LLM) providers, acting as a gateway.

Getting current provider information

Cast AI supports a comprehensive range of LLM providers, including both external API services and self-hosted deployment options.

Using the supported providers API

Use the /v1/llm/providers endpoint:

curl --request GET \
     --url https://api.cast.ai/v1/llm/openai/supported-providers \
     --header 'X-API-Key: $CASTAI_API_KEY' \
     --header 'accept: application/json'

This endpoint returns:

Provider identifiers and model catalogs
Detailed model specifications and pricing
Supported modalities
Model types and deployment options

Response structure

{
  "supportedProviders": [
    {
      "provider": "openai",
      "models": [
        {
          "name": "gpt-4o-2024-05-13",
          "maxInputTokens": 128000,
          "promptPricePerMilTokens": "5",
          "completionPricePerMilTokens": "15",
          "modalities": ["text", "image"],
          "type": "chat"
        }
      ],
      "pricingUrl": "https://openai.com/pricing",
      "websiteUrl": "https://openai.com",
      "rateLimitsPerModel": true
    }
  ]
}

📘
Use the API for the most current provider and model information instead of relying on static lists.