> ## Documentation Index
> Fetch the complete documentation index at: https://portkey-docs-chore-model-provisioning-beta-feature-docs.mintlify.site/llms.txt
> Use this file to discover all available pages before exploring further.

# Overview

> Portkey connects with all major LLM providers and orchestration frameworks.

## Supported AI Providers

<CardGroup cols={3}>
  <Card title="OpenAI" href="/integrations/llms/openai">
    <Frame>
      <img src="https://mintcdn.com/portkey-docs-chore-model-provisioning-beta-feature-docs/i1X8_-tVpxTnkL8P/images/supported-llm/open-ai.avif?fit=max&auto=format&n=i1X8_-tVpxTnkL8P&q=85&s=89705a479791fc2ebfb5597406981763" alt="OpenAI" width="245" height="138" data-path="images/supported-llm/open-ai.avif" />
    </Frame>
  </Card>

  <Card title="Anthropic" href="/integrations/llms/anthropic">
    <Frame>
      <img src="https://mintcdn.com/portkey-docs-chore-model-provisioning-beta-feature-docs/i1X8_-tVpxTnkL8P/images/supported-llm/anthroic.avif?fit=max&auto=format&n=i1X8_-tVpxTnkL8P&q=85&s=f2dec85b1bb9a66486eece9c29933c93" alt="Anthropic" width="245" height="138" data-path="images/supported-llm/anthroic.avif" />
    </Frame>
  </Card>

  <Card title="Azure OpenAI" href="/integrations/llms/azure-openai">
    <Frame>
      <img src="https://mintcdn.com/portkey-docs-chore-model-provisioning-beta-feature-docs/i1X8_-tVpxTnkL8P/images/supported-llm/microsoft-assure.avif?fit=max&auto=format&n=i1X8_-tVpxTnkL8P&q=85&s=6693b35e7e8b214cb6227b43dc6b61c7" alt="Azure OpenAI" width="245" height="138" data-path="images/supported-llm/microsoft-assure.avif" />
    </Frame>
  </Card>

  <Card title="AWS Bedrock" href="/integrations/llms/aws-bedrock">
    <Frame>
      <img src="https://mintcdn.com/portkey-docs-chore-model-provisioning-beta-feature-docs/i1X8_-tVpxTnkL8P/images/supported-llm/amazon.avif?fit=max&auto=format&n=i1X8_-tVpxTnkL8P&q=85&s=f99e1f9632b008aaf591f64f02413abf" alt="AWS Bedrock" width="245" height="138" data-path="images/supported-llm/amazon.avif" />
    </Frame>
  </Card>

  <Card title="Cohere" href="/integrations/llms/cohere">
    <Frame>
      <img src="https://mintcdn.com/portkey-docs-chore-model-provisioning-beta-feature-docs/i1X8_-tVpxTnkL8P/images/supported-llm/cohere.avif?fit=max&auto=format&n=i1X8_-tVpxTnkL8P&q=85&s=0d482c63690ba32e358fefde7c0ec8f9" alt="Cohere" width="245" height="138" data-path="images/supported-llm/cohere.avif" />
    </Frame>
  </Card>

  <Card title="Google Gemini" href="/integrations/llms/gemini">
    <Frame>
      <img src="https://mintcdn.com/portkey-docs-chore-model-provisioning-beta-feature-docs/i1X8_-tVpxTnkL8P/images/supported-llm/google-gemini.avif?fit=max&auto=format&n=i1X8_-tVpxTnkL8P&q=85&s=a8469de2479309086beacc921ec7a12b" alt="Google Gemini" width="245" height="138" data-path="images/supported-llm/google-gemini.avif" />
    </Frame>
  </Card>

  <Card title="Vertex AI" href="/integrations/llms/vertex-ai">
    <Frame>
      <img src="https://mintcdn.com/portkey-docs-chore-model-provisioning-beta-feature-docs/KpSrDop00rmILwwz/images/supported-llm/vertex-ai.avif?fit=max&auto=format&n=KpSrDop00rmILwwz&q=85&s=7a47c991ddbb2162bc4bd68375d9745c" alt="Vertex AI" width="245" height="138" data-path="images/supported-llm/vertex-ai.avif" />
    </Frame>
  </Card>

  <Card title="Perplexity AI" href="/integrations/llms/perplexity-ai">
    <Frame>
      <img src="https://mintcdn.com/portkey-docs-chore-model-provisioning-beta-feature-docs/i1X8_-tVpxTnkL8P/images/supported-llm/perplexity-ai.avif?fit=max&auto=format&n=i1X8_-tVpxTnkL8P&q=85&s=f59894453c31f4b489134892f1a69aae" alt="Perplexity AI" width="245" height="138" data-path="images/supported-llm/perplexity-ai.avif" />
    </Frame>
  </Card>

  <Card title="AI21" href="/integrations/llms/ai21">
    <Frame>
      <img src="https://mintcdn.com/portkey-docs-chore-model-provisioning-beta-feature-docs/i1X8_-tVpxTnkL8P/images/supported-llm/ai21.avif?fit=max&auto=format&n=i1X8_-tVpxTnkL8P&q=85&s=be52fc80d5bae2a815b37dbce0f60413" alt="AI21" width="245" height="138" data-path="images/supported-llm/ai21.avif" />
    </Frame>
  </Card>

  <Card title="Anyscale" href="/integrations/llms/anyscale-llama2-mistral-zephyr">
    <Frame>
      <img src="https://mintcdn.com/portkey-docs-chore-model-provisioning-beta-feature-docs/i1X8_-tVpxTnkL8P/images/supported-llm/anyscale.avif?fit=max&auto=format&n=i1X8_-tVpxTnkL8P&q=85&s=bfaf595477aeede3439dc9eedfb8982f" alt="Anyscale" width="245" height="138" data-path="images/supported-llm/anyscale.avif" />
    </Frame>
  </Card>

  <Card title="Byollm" href="/integrations/llms/byollm" />

  <Card title="Dashscope" href="/integrations/llms/dashscope">
    <Frame>
      <img src="https://mintcdn.com/portkey-docs-chore-model-provisioning-beta-feature-docs/i1X8_-tVpxTnkL8P/images/supported-llm/dashscope.jpeg?fit=max&auto=format&n=i1X8_-tVpxTnkL8P&q=85&s=6e2c4024e95c9bfecd5282481df0928a" alt="Dashscope" width="128" height="128" data-path="images/supported-llm/dashscope.jpeg" />
    </Frame>
  </Card>

  <Card title="Deepbricks" href="/integrations/llms/deepbricks">
    <Frame>
      <img src="https://mintcdn.com/portkey-docs-chore-model-provisioning-beta-feature-docs/i1X8_-tVpxTnkL8P/images/supported-llm/deepbricks.jpeg?fit=max&auto=format&n=i1X8_-tVpxTnkL8P&q=85&s=504cb67690fe24226acfa8c3c3db1332" alt="Deepbricks" width="225" height="225" data-path="images/supported-llm/deepbricks.jpeg" />
    </Frame>
  </Card>

  <Card title="DeepInfra" href="/integrations/llms/deepinfra">
    <Frame>
      <img src="https://mintcdn.com/portkey-docs-chore-model-provisioning-beta-feature-docs/i1X8_-tVpxTnkL8P/images/supported-llm/deepinfa.avif?fit=max&auto=format&n=i1X8_-tVpxTnkL8P&q=85&s=69b9943e8b131d98aec94bc2f9040921" alt="DeepInfra" width="245" height="138" data-path="images/supported-llm/deepinfa.avif" />
    </Frame>
  </Card>

  <Card title="DeepSeek" href="/integrations/llms/deepseek">
    <Frame>
      <img src="https://mintcdn.com/portkey-docs-chore-model-provisioning-beta-feature-docs/i1X8_-tVpxTnkL8P/images/supported-llm/deepseek.webp?fit=max&auto=format&n=i1X8_-tVpxTnkL8P&q=85&s=5c40afaa9873d5e8b9a2de862c8ea9a7" alt="DeepSeek" width="780" height="165" data-path="images/supported-llm/deepseek.webp" />
    </Frame>
  </Card>

  <Card title="Fireworks AI" href="/integrations/llms/fireworks">
    <Frame>
      <img src="https://mintcdn.com/portkey-docs-chore-model-provisioning-beta-feature-docs/i1X8_-tVpxTnkL8P/images/supported-llm/fireworks.png?fit=max&auto=format&n=i1X8_-tVpxTnkL8P&q=85&s=c0e6da9df3c0ca6adfefc0b3c8d38701" alt="Fireworks AI" width="240" height="136" data-path="images/supported-llm/fireworks.png" />
    </Frame>
  </Card>

  <Card title="Github Models" href="/integrations/llms/github">
    <Frame>
      <img src="https://mintcdn.com/portkey-docs-chore-model-provisioning-beta-feature-docs/DgyGjK0YwmN1jJ2Y/images/llms/github.png?fit=max&auto=format&n=DgyGjK0YwmN1jJ2Y&q=85&s=f4e48e6df2dabf30557ddb20b61bc2a8" alt="Github" width="954" height="482" data-path="images/llms/github.png" />
    </Frame>
  </Card>

  <Card title="Google Palm" href="/integrations/llms/google-palm">
    <Frame>
      <img src="https://mintcdn.com/portkey-docs-chore-model-provisioning-beta-feature-docs/i1X8_-tVpxTnkL8P/images/supported-llm/google-palm.avif?fit=max&auto=format&n=i1X8_-tVpxTnkL8P&q=85&s=e3990a58e0389cf4354b414e721d3aa9" alt="Google Palm" width="245" height="138" data-path="images/supported-llm/google-palm.avif" />
    </Frame>
  </Card>

  <Card title="Groq" href="/integrations/llms/groq">
    <Frame>
      <img src="https://mintcdn.com/portkey-docs-chore-model-provisioning-beta-feature-docs/i1X8_-tVpxTnkL8P/images/supported-llm/groq.avif?fit=max&auto=format&n=i1X8_-tVpxTnkL8P&q=85&s=fbf3a1f23d704571e0f7d214403dd76f" alt="Groq" width="245" height="138" data-path="images/supported-llm/groq.avif" />
    </Frame>
  </Card>

  <Card title="Jina AI" href="/integrations/llms/jina-ai">
    <Frame>
      <img src="https://mintcdn.com/portkey-docs-chore-model-provisioning-beta-feature-docs/i1X8_-tVpxTnkL8P/images/supported-llm/jina.png?fit=max&auto=format&n=i1X8_-tVpxTnkL8P&q=85&s=99477a76123088e970021050a455ff1d" alt="Jina AI" width="225" height="225" data-path="images/supported-llm/jina.png" />
    </Frame>
  </Card>

  <Card title="Lambda" href="/integrations/llms/lambda">
    <Frame>
      <img src="https://mintcdn.com/portkey-docs-chore-model-provisioning-beta-feature-docs/i1X8_-tVpxTnkL8P/images/supported-llm/lambda.png?fit=max&auto=format&n=i1X8_-tVpxTnkL8P&q=85&s=2e73edc85162c7ea4d31b594dc177228" alt="Lambda" width="225" height="225" data-path="images/supported-llm/lambda.png" />
    </Frame>
  </Card>

  <Card title="Lemonfox AI" href="/integrations/llms/lemon-fox">
    <Frame>
      <img src="https://mintcdn.com/portkey-docs-chore-model-provisioning-beta-feature-docs/i1X8_-tVpxTnkL8P/images/supported-llm/lemonfox-ai.png?fit=max&auto=format&n=i1X8_-tVpxTnkL8P&q=85&s=baf19cc8a20262c9e7409d696007563c" alt="Lemonfox AI" width="225" height="225" data-path="images/supported-llm/lemonfox-ai.png" />
    </Frame>
  </Card>

  <Card title="Lepton AI" href="/integrations/llms/lepton">
    <Frame>
      <img src="https://mintcdn.com/portkey-docs-chore-model-provisioning-beta-feature-docs/i1X8_-tVpxTnkL8P/images/supported-llm/lepton.png?fit=max&auto=format&n=i1X8_-tVpxTnkL8P&q=85&s=fb1119ec4e6046cd78240f8ba9c0dad1" alt="Lepton AI" width="311" height="85" data-path="images/supported-llm/lepton.png" />
    </Frame>
  </Card>

  <Card title="Lingyi (01.ai)" href="/integrations/llms/lingyi-01.ai">
    <Frame>
      <img src="https://mintcdn.com/portkey-docs-chore-model-provisioning-beta-feature-docs/i1X8_-tVpxTnkL8P/images/supported-llm/lingyi.png?fit=max&auto=format&n=i1X8_-tVpxTnkL8P&q=85&s=b25d368d7985a239b61dc4e7904252da" alt="Lingyi (01.ai)" width="200" height="200" data-path="images/supported-llm/lingyi.png" />
    </Frame>
  </Card>

  <Card title="LocalAI" href="/integrations/llms/local-ai">
    <Frame>
      <img src="https://mintcdn.com/portkey-docs-chore-model-provisioning-beta-feature-docs/i1X8_-tVpxTnkL8P/images/supported-llm/local.avif?fit=max&auto=format&n=i1X8_-tVpxTnkL8P&q=85&s=c80ab23ee0ead1d84aa5226c955f18e5" alt="LocalAI" width="245" height="132" data-path="images/supported-llm/local.avif" />
    </Frame>
  </Card>

  <Card title="Mistral AI" href="/integrations/llms/mistral-ai">
    <Frame>
      <img src="https://mintcdn.com/portkey-docs-chore-model-provisioning-beta-feature-docs/i1X8_-tVpxTnkL8P/images/supported-llm/mistral.avif?fit=max&auto=format&n=i1X8_-tVpxTnkL8P&q=85&s=d0f1868eb630a2b67b180a76b5354aed" alt="Mistral AI" width="245" height="138" data-path="images/supported-llm/mistral.avif" />
    </Frame>
  </Card>

  <Card title="MonsterAPI" href="/integrations/llms/monster-api">
    <Frame>
      <img src="https://mintcdn.com/portkey-docs-chore-model-provisioning-beta-feature-docs/i1X8_-tVpxTnkL8P/images/supported-llm/monster.avif?fit=max&auto=format&n=i1X8_-tVpxTnkL8P&q=85&s=5f4a212f80c367969491a027d19b3683" alt="MonsterAPI" width="245" height="138" data-path="images/supported-llm/monster.avif" />
    </Frame>
  </Card>

  <Card title="Moonshot" href="/integrations/llms/moonshot">
    <Frame>
      <img src="https://mintcdn.com/portkey-docs-chore-model-provisioning-beta-feature-docs/i1X8_-tVpxTnkL8P/images/supported-llm/moonshoot.jpg?fit=max&auto=format&n=i1X8_-tVpxTnkL8P&q=85&s=f7b4ea90842bb82cf4825784eb4d6747" alt="Moonshot" width="224" height="224" data-path="images/supported-llm/moonshoot.jpg" />
    </Frame>
  </Card>

  <Card title="nCompass" href="/integrations/llms/ncompass">
    <Frame>
      <img src="https://mintcdn.com/portkey-docs-chore-model-provisioning-beta-feature-docs/DgyGjK0YwmN1jJ2Y/images/llms/ncompass.jpeg?fit=max&auto=format&n=DgyGjK0YwmN1jJ2Y&q=85&s=73dec688f8c6d69c135e8dff4cff04f0" alt="nCompass" width="200" height="200" data-path="images/llms/ncompass.jpeg" />
    </Frame>
  </Card>

  <Card title="Nebius" href="/integrations/llms/nebius">
    <Frame>
      <img src="https://mintcdn.com/portkey-docs-chore-model-provisioning-beta-feature-docs/i1X8_-tVpxTnkL8P/images/supported-llm/nebius.jpeg?fit=max&auto=format&n=i1X8_-tVpxTnkL8P&q=85&s=a7707a4686268dff2955b1de0497514a" alt="Nebius" width="200" height="200" data-path="images/supported-llm/nebius.jpeg" />
    </Frame>
  </Card>

  <Card title="Nomic AI" href="/integrations/llms/nomic">
    <Frame>
      <img src="https://mintcdn.com/portkey-docs-chore-model-provisioning-beta-feature-docs/i1X8_-tVpxTnkL8P/images/supported-llm/nomic.avif?fit=max&auto=format&n=i1X8_-tVpxTnkL8P&q=85&s=6bf1f5ba97eafc0a132ae8b8445b94e4" alt="Nomic AI" width="245" height="138" data-path="images/supported-llm/nomic.avif" />
    </Frame>
  </Card>

  <Card title="Nscale" href="/integrations/llms/nscale">
    <Frame>
      <img src="https://mintcdn.com/portkey-docs-chore-model-provisioning-beta-feature-docs/i1X8_-tVpxTnkL8P/images/supported-llm/nscale.jpeg?fit=max&auto=format&n=i1X8_-tVpxTnkL8P&q=85&s=ba4d93d62692a811fe74a1636b24d966" alt="Nscale" width="259" height="194" data-path="images/supported-llm/nscale.jpeg" />
    </Frame>
  </Card>

  <Card title="Ollama" href="/integrations/llms/ollama">
    <Frame>
      <img src="https://mintcdn.com/portkey-docs-chore-model-provisioning-beta-feature-docs/i1X8_-tVpxTnkL8P/images/supported-llm/ollama.avif?fit=max&auto=format&n=i1X8_-tVpxTnkL8P&q=85&s=33ed9bcb643e857d849b57c00e67a980" alt="Ollama" width="245" height="138" data-path="images/supported-llm/ollama.avif" />
    </Frame>
  </Card>

  <Card title="Openrouter" href="/integrations/llms/openrouter">
    <Frame>
      <img src="https://mintcdn.com/portkey-docs-chore-model-provisioning-beta-feature-docs/i1X8_-tVpxTnkL8P/images/supported-llm/openrouter.png?fit=max&auto=format&n=i1X8_-tVpxTnkL8P&q=85&s=e029e3fb679e2549c4a4304924862ff9" alt="Openrouter" width="224" height="224" data-path="images/supported-llm/openrouter.png" />
    </Frame>
  </Card>

  <Card title="Predibase" href="/integrations/llms/predibase">
    <Frame>
      <img src="https://mintcdn.com/portkey-docs-chore-model-provisioning-beta-feature-docs/i1X8_-tVpxTnkL8P/images/supported-llm/predise.avif?fit=max&auto=format&n=i1X8_-tVpxTnkL8P&q=85&s=aac78b2339a2aa7f3bcf9291b25efaec" alt="Predibase" width="245" height="132" data-path="images/supported-llm/predise.avif" />
    </Frame>
  </Card>

  <Card title="Recraft AI" href="/integrations/llms/recraft-ai">
    <Frame>
      <img src="https://mintcdn.com/portkey-docs-chore-model-provisioning-beta-feature-docs/DgyGjK0YwmN1jJ2Y/images/llms/recraft.jpeg?fit=max&auto=format&n=DgyGjK0YwmN1jJ2Y&q=85&s=d4071e8c3c0eb60971ecc73bddd03da2" alt="Recraft" width="200" height="200" data-path="images/llms/recraft.jpeg" />
    </Frame>
  </Card>

  <Card title="Siliconflow" href="/integrations/llms/siliconflow">
    <Frame>
      <img src="https://mintcdn.com/portkey-docs-chore-model-provisioning-beta-feature-docs/i1X8_-tVpxTnkL8P/images/supported-llm/siliconflow.jpeg?fit=max&auto=format&n=i1X8_-tVpxTnkL8P&q=85&s=80b84688530ae815dea799b3f7882e46" alt="Siliconflow" width="200" height="200" data-path="images/supported-llm/siliconflow.jpeg" />
    </Frame>
  </Card>

  <Card title="Snowflake Cortex" href="/integrations/llms/snowflake-cortex">
    <Frame>
      <img src="https://mintcdn.com/portkey-docs-chore-model-provisioning-beta-feature-docs/fOa8Nq7z2ft-Ew6p/images/llms/Snowflake%20Cortex%20Logo.png?fit=max&auto=format&n=fOa8Nq7z2ft-Ew6p&q=85&s=cc5bda28608d890e9ff605cc8830e09b" alt="Snowflake" width="225" height="225" data-path="images/llms/Snowflake Cortex Logo.png" />
    </Frame>
  </Card>

  <Card title="Stability AI" href="/integrations/llms/stability-ai">
    <Frame>
      <img src="https://mintcdn.com/portkey-docs-chore-model-provisioning-beta-feature-docs/i1X8_-tVpxTnkL8P/images/supported-llm/stability.avif?fit=max&auto=format&n=i1X8_-tVpxTnkL8P&q=85&s=ecbeabe8d3e7997e1617d36c77d307e3" alt="Stability AI" width="245" height="138" data-path="images/supported-llm/stability.avif" />
    </Frame>
  </Card>

  <Card title="Together AI" href="/integrations/llms/together-ai">
    <Frame>
      <img src="https://mintcdn.com/portkey-docs-chore-model-provisioning-beta-feature-docs/i1X8_-tVpxTnkL8P/images/supported-llm/together-ai.avif?fit=max&auto=format&n=i1X8_-tVpxTnkL8P&q=85&s=ca67b3438796aaa622b1e984d61ba080" alt="Together AI" width="245" height="138" data-path="images/supported-llm/together-ai.avif" />
    </Frame>
  </Card>

  <Card title="Triton" href="/integrations/llms/triton">
    <Frame>
      <img src="https://mintcdn.com/portkey-docs-chore-model-provisioning-beta-feature-docs/i1X8_-tVpxTnkL8P/images/supported-llm/triton.png?fit=max&auto=format&n=i1X8_-tVpxTnkL8P&q=85&s=621b1ba65abdbd4d56fc0926cb22523a" alt="Triton" width="254" height="198" data-path="images/supported-llm/triton.png" />
    </Frame>
  </Card>

  <Card title="Upstage" href="/integrations/llms/upstage">
    <Frame>
      <img src="https://mintcdn.com/portkey-docs-chore-model-provisioning-beta-feature-docs/KpSrDop00rmILwwz/images/supported-llm/upstage.jpeg?fit=max&auto=format&n=KpSrDop00rmILwwz&q=85&s=f38ddc12339e81677ba8ed2e83061173" alt="Upstage" width="200" height="200" data-path="images/supported-llm/upstage.jpeg" />
    </Frame>
  </Card>

  <Card title="Voyage-AI" href="/integrations/llms/voyage-ai">
    <Frame>
      <img src="https://mintcdn.com/portkey-docs-chore-model-provisioning-beta-feature-docs/KpSrDop00rmILwwz/images/supported-llm/voyage.png?fit=max&auto=format&n=KpSrDop00rmILwwz&q=85&s=e8443385d04646b7192eab87562a892d" alt="Voyage-AI" width="314" height="160" data-path="images/supported-llm/voyage.png" />
    </Frame>
  </Card>

  <Card title="Workers AI" href="/integrations/llms/workers-ai">
    <Frame>
      <img src="https://mintcdn.com/portkey-docs-chore-model-provisioning-beta-feature-docs/KpSrDop00rmILwwz/images/supported-llm/worksai.jpg?fit=max&auto=format&n=KpSrDop00rmILwwz&q=85&s=4fd7cad2728f2061f874b2f8fdf5e8da" alt="Workers AI" width="225" height="225" data-path="images/supported-llm/worksai.jpg" />
    </Frame>
  </Card>

  <Card title="ZhipuAI" href="/integrations/llms/zhipu">
    <Frame>
      <img src="https://mintcdn.com/portkey-docs-chore-model-provisioning-beta-feature-docs/KpSrDop00rmILwwz/images/supported-llm/zhipu.avif?fit=max&auto=format&n=KpSrDop00rmILwwz&q=85&s=908db5a4669923d6fa62e5dbd8336979" alt="ZhipuAI" width="245" height="132" data-path="images/supported-llm/zhipu.avif" />
    </Frame>
  </Card>
</CardGroup>

## Endpoints Supported

For a detailed breakdown of supported endpoints and features per provider, refer to the table below:

<Card title="Supported Providers" href="/provider-endpoints/supported-providers" />

## Supported Frameworks

Portkey has native integrations with the following frameworks. Click to read their getting started guides.

<CardGroup cols={3}>
  <Card title="Langchain" href="/integrations/libraries/langchain-python">
    <img src="https://mintcdn.com/portkey-docs-chore-model-provisioning-beta-feature-docs/i1X8_-tVpxTnkL8P/images/supported-llm/langchain.avif?fit=max&auto=format&n=i1X8_-tVpxTnkL8P&q=85&s=f0e000f0efefe36baf0e0ae61aae2b37" alt="Langchain" width="245" height="138" data-path="images/supported-llm/langchain.avif" />
  </Card>

  <Card title="LlamaIndex" href="/integrations/libraries/llama-index-python">
    <img src="https://mintcdn.com/portkey-docs-chore-model-provisioning-beta-feature-docs/i1X8_-tVpxTnkL8P/images/supported-llm/llama.avif?fit=max&auto=format&n=i1X8_-tVpxTnkL8P&q=85&s=7bd748445da4b4b4363ed54b93879ac4" alt="LlamaIndex" width="245" height="138" data-path="images/supported-llm/llama.avif" />
  </Card>

  <Card title="Autogen" href="/integrations/libraries/autogen">
    <img src="https://mintcdn.com/portkey-docs-chore-model-provisioning-beta-feature-docs/i1X8_-tVpxTnkL8P/images/supported-llm/autogen.avif?fit=max&auto=format&n=i1X8_-tVpxTnkL8P&q=85&s=2b7d3d00813ff7033edcef5ce650907f" alt="Autogen" width="245" height="138" data-path="images/supported-llm/autogen.avif" />
  </Card>

  <Card title="Vercel" href="/integrations/libraries/vercel">
    <img src="https://mintcdn.com/portkey-docs-chore-model-provisioning-beta-feature-docs/KpSrDop00rmILwwz/images/supported-llm/vercel.avif?fit=max&auto=format&n=KpSrDop00rmILwwz&q=85&s=33bcd8ebd35c4f904f30aa3832789e6a" alt="Vercel" width="245" height="132" data-path="images/supported-llm/vercel.avif" />
  </Card>

  <Card title="Instructor" href="/integrations/libraries/instructor">
    <img src="https://mintcdn.com/portkey-docs-chore-model-provisioning-beta-feature-docs/i1X8_-tVpxTnkL8P/images/supported-llm/instructor.avif?fit=max&auto=format&n=i1X8_-tVpxTnkL8P&q=85&s=4aa601c64992d3bb66fd167039f24055" alt="Instructor" width="245" height="132" data-path="images/supported-llm/instructor.avif" />
  </Card>

  <Card title="DSPy" href="/integrations/libraries/dspy">
    <img src="https://mintcdn.com/portkey-docs-chore-model-provisioning-beta-feature-docs/i1X8_-tVpxTnkL8P/images/supported-llm/dspy.png?fit=max&auto=format&n=i1X8_-tVpxTnkL8P&q=85&s=5d7754f1d521e2ba903c2cc0f5f36619" alt="DSPy" width="300" height="168" data-path="images/supported-llm/dspy.png" />
  </Card>

  <Card title="Promptfoo" href="/integrations/libraries/promptfoo">
    <img src="https://mintcdn.com/portkey-docs-chore-model-provisioning-beta-feature-docs/i1X8_-tVpxTnkL8P/images/supported-llm/prompftoo.avif?fit=max&auto=format&n=i1X8_-tVpxTnkL8P&q=85&s=2aaeee85678e7f8b3f032e03cb46ee66" alt="Promptfoo" width="245" height="132" data-path="images/supported-llm/prompftoo.avif" />
  </Card>
</CardGroup>

Have a suggestion for an integration with Portkey? Drop us a message on [support@portkey.ai](mailto:support@portkey.ai).

While you're here, why not [give us a star](https://git.new/ai-gateway-docs)? It helps us a lot!
