LLM Providers - PraisonAI

PraisonAI TypeScript supports 60+ AI providers through AI SDK v6. Switch between providers by changing the llm parameter - all providers use the same unified API.

Supported Providers (60+)

Core Providers

Provider	Model Examples	Modalities	Env Variable
OpenAI	gpt-4o, gpt-4o-mini, gpt-5	Chat, Embeddings, Image, Audio	`OPENAI_API_KEY`
Anthropic	claude-sonnet-4, claude-3-5-sonnet	Chat, Image	`ANTHROPIC_API_KEY`
Google	gemini-2.0-flash, gemini-1.5-pro	Chat, Embeddings, Image, Audio	`GOOGLE_API_KEY`
Google Vertex	gemini-pro, palm-2	Chat, Embeddings, Image	`GOOGLE_APPLICATION_CREDENTIALS`
Azure OpenAI	gpt-4, gpt-35-turbo	Chat, Embeddings, Image	`AZURE_API_KEY`
Amazon Bedrock	claude-3, titan	Chat, Embeddings	`AWS_ACCESS_KEY_ID`

Inference Providers

Provider	Model Examples	Modalities	Env Variable
xAI	grok-4, grok-3-fast	Chat, Image	`XAI_API_KEY`
Groq	llama-3.3-70b, mixtral-8x7b	Chat	`GROQ_API_KEY`
Fireworks	llama-v3, mixtral	Chat, Embeddings	`FIREWORKS_API_KEY`
Together.ai	llama-3, mistral-7b	Chat, Embeddings	`TOGETHER_API_KEY`
DeepInfra	llama-3, mistral	Chat, Embeddings	`DEEPINFRA_API_KEY`
Replicate	llama, stable-diffusion	Chat, Image	`REPLICATE_API_TOKEN`
Baseten	custom models	Chat	`BASETEN_API_KEY`
Hugging Face	various	Chat, Embeddings	`HUGGINGFACE_API_KEY`

Model Providers

Provider	Model Examples	Modalities	Env Variable
Mistral	mistral-large, mistral-medium	Chat, Embeddings	`MISTRAL_API_KEY`
Cohere	command-r, command-r-plus	Chat, Embeddings	`COHERE_API_KEY`
DeepSeek	deepseek-chat, deepseek-reasoner	Chat	`DEEPSEEK_API_KEY`
Cerebras	llama3.1-8b, llama3.3-70b	Chat	`CEREBRAS_API_KEY`
Perplexity	pplx-7b, pplx-70b	Chat	`PERPLEXITY_API_KEY`

Image Generation

Provider	Model Examples	Modalities	Env Variable
Fal	flux, stable-diffusion	Image	`FAL_KEY`
Black Forest Labs	FLUX.1	Image	`BFL_API_KEY`
Luma	dream-machine	Image, Video	`LUMA_API_KEY`

Audio/Speech Providers

Provider	Model Examples	Modalities	Env Variable
ElevenLabs	eleven_multilingual_v2	Speech	`ELEVENLABS_API_KEY`
AssemblyAI	transcription	Audio	`ASSEMBLYAI_API_KEY`
Deepgram	nova-2	Audio, Speech	`DEEPGRAM_API_KEY`
Gladia	transcription	Audio	`GLADIA_API_KEY`
LMNT	speech	Speech	`LMNT_API_KEY`
Hume	emotion	Audio	`HUME_API_KEY`
Rev.ai	transcription	Audio	`REVAI_API_KEY`

Gateway/Proxy Providers

Provider	Description	Env Variable
AI Gateway	Unified gateway	`AI_GATEWAY_API_KEY`
OpenRouter	Multi-provider routing	`OPENROUTER_API_KEY`
Portkey	AI gateway	`PORTKEY_API_KEY`
Helicone	Observability proxy	`HELICONE_API_KEY`
Cloudflare Workers AI	Edge inference	`CLOUDFLARE_API_TOKEN`

Local/Self-hosted

Provider	Description	Env Variable
Ollama	Local models	`OLLAMA_BASE_URL`
LM Studio	Local inference	`LM_STUDIO_BASE_URL`
NVIDIA NIM	Enterprise local	`NVIDIA_API_KEY`
OpenAI Compatible	Any OpenAI-compatible API	`OPENAI_COMPATIBLE_API_KEY`

Regional/Specialized

Provider	Description	Env Variable
Qwen (Alibaba)	Chinese LLM	`DASHSCOPE_API_KEY`
Zhipu AI	GLM models	`ZHIPU_API_KEY`
MiniMax	Chinese provider	`MINIMAX_API_KEY`
Spark (iFlytek)	Chinese provider	`SPARK_API_KEY`
SambaNova	Enterprise	`SAMBANOVA_API_KEY`

Embedding Specialists

Provider	Description	Env Variable
Voyage AI	High-quality embeddings	`VOYAGE_API_KEY`
Jina AI	Embeddings & search	`JINA_API_KEY`
Mixedbread	Embeddings	`MIXEDBREAD_API_KEY`

Memory/Agent Providers

Provider	Description	Env Variable
Mem0	Memory layer	`MEM0_API_KEY`
Letta	Agent memory	`LETTA_API_KEY`

Enterprise/Cloud

Provider	Description	Env Variable
Azure AI	Azure services	`AZURE_API_KEY`
SAP AI Core	SAP integration	`SAP_AI_CORE_KEY`
Heroku	Heroku AI	`HEROKU_API_KEY`
Anthropic Vertex	Claude via Vertex	`GOOGLE_APPLICATION_CREDENTIALS`

Quick Start

Simple Usage

import { Agent } from 'praisonai';

const agent = new Agent({
  instructions: 'You are helpful.',
  llm: 'gpt-4o-mini'
});

await agent.chat('Hello');

With Configuration

import { Agent } from 'praisonai';

const agent = new Agent({
  instructions: 'You are helpful.',
  llm: 'anthropic/claude-sonnet-4',
  verbose: true
});

Provider Support Matrix

tools, outputSchema, and stream work on every supported provider:

Feature	`openai/...`	`anthropic/...`	`google/...`	`groq/...`	`mistral/...`	`ollama/...`	Other AI SDK providers
`tools`	✅	✅	✅	✅	✅	✅	✅
`outputSchema`	✅ (native)	✅	✅	✅	✅	✅	✅
`stream`	✅	✅	✅	✅	✅	✅	✅
Tools + `outputSchema` together	✅	✅	✅	✅	✅	✅	✅

On OpenAI, outputSchema uses response_format: json_schema; on other providers it routes through the AI SDK backend’s generateObject({ schema }). Both paths return a JSON string that matches the schema.

Agent with Different Models

tools and outputSchema work end-to-end on every supported provider (openai/..., anthropic/..., google/..., groq/..., mistral/..., ollama/..., and more). Tools are formatted once and translated per-provider by the AI SDK backend — the same contract litellm gives the Python SDK. Non-OpenAI providers stream pre-tool text as tokens when stream: true; see Streaming for tool-loop streaming behaviour. Fixed in PraisonAI PR #4412.

Tools & Structured Output on any provider

import { Agent } from 'praisonai';

const getWeather = (city: string) => `Weather in ${city}: 20C, sunny`;

const agent = new Agent({
  instructions: 'Report the weather using the tool.',
  llm: 'anthropic/claude-3-5-sonnet-latest',
  tools: [getWeather],
});

await agent.start('Weather in Paris?');

import { Agent } from 'praisonai';

// OpenAI (default)
const openaiAgent = new Agent({
  instructions: 'You are helpful.',
  llm: 'gpt-4o-mini'
});

// Anthropic Claude
const claudeAgent = new Agent({
  instructions: 'You are helpful.',
  llm: 'anthropic/claude-3-5-sonnet'
});

// Google Gemini
const geminiAgent = new Agent({
  instructions: 'You are helpful.',
  llm: 'google/gemini-2.0-flash'
});

// All work the same way
await openaiAgent.chat('Hello!');
await claudeAgent.chat('Hello!');
await geminiAgent.chat('Hello!');

Multi-Agent with Mixed Providers

Use different models for different Agent roles:

import { Agent, AgentTeam } from 'praisonai';

// Fast model for quick tasks
const triageAgent = new Agent({
  name: 'Triage',
  instructions: 'Quickly categorize incoming requests.',
  llm: 'gpt-4o-mini'  // Fast and cheap
});

// Powerful model for complex reasoning
const analysisAgent = new Agent({
  name: 'Analyst',
  instructions: 'Perform deep analysis of complex problems.',
  llm: 'anthropic/claude-sonnet-4'  // Best reasoning
});

// Creative model for content
const writerAgent = new Agent({
  name: 'Writer',
  instructions: 'Write engaging content.',
  llm: 'gpt-4o'  // Good for creative tasks
});

const agents = new AgentTeam([triageAgent, analysisAgent, writerAgent]);
await agents.start();

Agent Model Selection by Task

import { Agent } from 'praisonai';

function createAgentForTask(taskType: string) {
  const modelMap: Record<string, string> = {
    'quick': 'gpt-4o-mini',
    'reasoning': 'anthropic/claude-sonnet-4',
    'creative': 'gpt-4o',
    'code': 'anthropic/claude-3-5-sonnet',
    'multimodal': 'google/gemini-2.0-flash'
  };

  return new Agent({
    instructions: `You handle ${taskType} tasks.`,
    llm: modelMap[taskType] || 'gpt-4o-mini'
  });
}

const codeAgent = createAgentForTask('code');
await codeAgent.chat('Write a function to sort an array');

Agent with Streaming

import { Agent } from 'praisonai';

const agent = new Agent({
  instructions: 'You tell stories.',
  llm: 'gpt-4o',
  stream: true  // Enable streaming
});

// Response streams to console
await agent.chat('Tell me a short story about a robot');

Environment-Based Model Selection

import { Agent } from 'praisonai';

// Model from environment variable
const agent = new Agent({
  instructions: 'You are helpful.',
  llm: process.env.PRAISONAI_MODEL || 'gpt-4o-mini'
});

// Or use different models per environment
const model = process.env.NODE_ENV === 'production' 
  ? 'gpt-4o'           // Better quality in prod
  : 'gpt-4o-mini';     // Cheaper in dev

const prodAgent = new Agent({
  instructions: 'You are helpful.',
  llm: model
});

Model String Formats

PraisonAI resolves the vendor from your model string — a bare claude-* or gemini-* name routes to Anthropic or Google without a prefix.

You write	Resolves to	Notes
`gpt-4o-mini`	OpenAI	Default for anything not recognised
`claude-3-5-sonnet-latest`	Anthropic	Bare prefix inference — no `anthropic/` required
`gemini-2.0-flash`	Google	Bare prefix inference — no `google/` required
`openai/gpt-4o`	OpenAI	Explicit prefix (wins over `baseURL`)
`anthropic/claude-3-5-sonnet-latest`	Anthropic	Explicit prefix (wins over `baseURL`)
`google/gemini-2.0-flash`	Google	Explicit prefix (wins over `baseURL`)
`groq/llama-3.3-70b-versatile`	Groq	Explicit prefix (required — `llama-*` is not inferred)

See Model Routing for the full routing rules, the complete decision table, and the baseURL exception.

Prefix Inference vs Aliases

Two different mechanisms decide where a model string goes. Prefix inference — the parser reads a bare name and infers the provider:

Bare prefix	Inferred provider
`claude-*`	anthropic
`gemini-*`	google
`gpt-*`	openai

Convenience aliases — short names used only inside the provider-registry lookup:

Alias	Provider
`oai`	openai
`grok`	xai
`vertex`	google-vertex
`aws`, `bedrock`	amazon-bedrock
`together`	togetherai
`flux`, `bfl`	black-forest-labs
`local`, `ollama`	ollama
`nim`, `nvidia`	nvidia-nim

Per-agent API key and baseURL

Pass credentials per agent — as of PraisonAI PR #4483 the constructor-time apiKey is honoured across providers, not only for OpenAI. Env vars remain a fallback.

import { Agent } from 'praisonai';

const agent = new Agent({
  instructions: 'You are helpful.',
  llm: 'claude-3-5-sonnet-latest',
  apiKey: process.env.MY_ANTHROPIC_KEY,          // no ANTHROPIC_API_KEY needed
  baseURL: 'https://gateway.example.com/v1',      // optional, per-agent
});

OpenAI-Compatible Providers

Use any OpenAI-compatible API:

import { Agent } from 'praisonai';

// Local LM Studio
const lmStudioAgent = new Agent({
  instructions: 'You are helpful.',
  llm: 'openai-compatible/local-model',
  llmConfig: {
    baseUrl: 'http://localhost:1234/v1',
    apiKey: 'not-needed'
  }
});

// Custom OpenAI-compatible endpoint
const customAgent = new Agent({
  instructions: 'You are helpful.',
  llm: 'openai-compatible/my-model',
  llmConfig: {
    baseUrl: process.env.CUSTOM_API_BASE,
    apiKey: process.env.CUSTOM_API_KEY
  }
});

Local Providers (Ollama, LM Studio)

import { Agent } from 'praisonai';

// Ollama (local)
const ollamaAgent = new Agent({
  instructions: 'You are helpful.',
  llm: 'ollama/llama3.2',
  llmConfig: {
    baseUrl: 'http://localhost:11434'
  }
});

// LM Studio
const lmStudioAgent = new Agent({
  instructions: 'You are helpful.',
  llm: 'lm-studio/local-model',
  llmConfig: {
    baseUrl: 'http://localhost:1234/v1'
  }
});

// NVIDIA NIM
const nimAgent = new Agent({
  instructions: 'You are helpful.',
  llm: 'nvidia-nim/llama-3.1-8b-instruct'
});

Agent with Custom Provider Config

For advanced use cases:

import { Agent, createProvider } from 'praisonai';

// Create custom provider with options
const customProvider = createProvider('openai/gpt-4o', {
  maxRetries: 3,
  timeout: 60000
});

// Use in Agent (advanced)
const agent = new Agent({
  instructions: 'You are helpful.',
  llm: 'gpt-4o'  // Simple string is usually sufficient
});

await agent.chat('Hello!');

Custom Provider Extension

import { registerProvider, BaseProvider } from 'praisonai';

class MyCustomProvider extends BaseProvider {
  async generateText(options) {
    // Your implementation
    return { text: 'response', usage: { totalTokens: 10 } };
  }
}

// Register globally
registerProvider('my-provider', MyCustomProvider);

// Use in Agent
const agent = new Agent({
  instructions: 'You are helpful.',
  llm: 'my-provider/my-model'
});

ProviderConfig Options

Custom transport and browser support are configurable on ProviderConfig.

Option	Type	Default	Description
`fetch`	`typeof fetch`	`undefined`	Custom fetch — lets a host route egress through native code (e.g. a Tauri command). Implies `dangerouslyAllowBrowser`.
`dangerouslyAllowBrowser`	`boolean`	auto-detected	Force-enable the OpenAI SDK’s browser guard. Auto-`true` in browser-like runtimes.

See Browser & Webview Runtimes for when to use each option.

Environment Variables

# Core providers
export OPENAI_API_KEY=sk-...
export ANTHROPIC_API_KEY=sk-ant-...
export GOOGLE_API_KEY=AIza...

# Inference providers
export XAI_API_KEY=xai-...
export GROQ_API_KEY=gsk_...
export TOGETHER_API_KEY=...
export FIREWORKS_API_KEY=...

# Local providers
export OLLAMA_BASE_URL=http://localhost:11434
export LM_STUDIO_BASE_URL=http://localhost:1234/v1

# Set default model
export PRAISONAI_MODEL=openai/gpt-4o-mini

Providers CLI

CLI commands

Provider Registry

Custom providers

​Supported Providers (60+)

​Core Providers

​Inference Providers

​Model Providers

​Image Generation

​Audio/Speech Providers

​Gateway/Proxy Providers

​Local/Self-hosted

​Regional/Specialized

​Embedding Specialists

​Memory/Agent Providers

​Enterprise/Cloud

​Quick Start

​Provider Support Matrix

​Agent with Different Models

​Tools & Structured Output on any provider

​Multi-Agent with Mixed Providers

​Agent Model Selection by Task

​Agent with Streaming

​Environment-Based Model Selection

​Model String Formats

​Prefix Inference vs Aliases

​Per-agent API key and baseURL

​OpenAI-Compatible Providers

​Local Providers (Ollama, LM Studio)

​Agent with Custom Provider Config

​Custom Provider Extension

​ProviderConfig Options

​Environment Variables

​Related

Providers CLI

Provider Registry

Supported Providers (60+)

Core Providers

Inference Providers

Model Providers

Image Generation

Audio/Speech Providers

Gateway/Proxy Providers

Local/Self-hosted

Regional/Specialized

Embedding Specialists

Memory/Agent Providers

Enterprise/Cloud

Quick Start

Provider Support Matrix

Agent with Different Models

Tools & Structured Output on any provider

Multi-Agent with Mixed Providers

Agent Model Selection by Task

Agent with Streaming

Environment-Based Model Selection

Model String Formats

Prefix Inference vs Aliases

Per-agent API key and baseURL

OpenAI-Compatible Providers

Local Providers (Ollama, LM Studio)

Agent with Custom Provider Config

Custom Provider Extension

ProviderConfig Options

Environment Variables

Related