LLM Provider • Rust AI Agent SDK

LlmProvider: Trait for LLM providers

LlmProvider

Defined in the LLM module.

Rust AI Agent SDK

Trait for LLM providers

Methods

chat

async fn chat(
        &self,
        messages: &[Message],
        tools: Option<&[ToolDefinition]>,
    ) -> Result<LlmResponse>

Send a chat completion request

Parameters:

Name	Type
messages	&[Message]
tools	Option<&[ToolDefinition]>

chat_stream

async fn chat_stream(
        &self,
        messages: &[Message],
        tools: Option<&[ToolDefinition]>,
    ) -> Result<Box<dyn futures::Stream<Item = Result<String>> + Send + Unpin>>

Stream a chat completion (returns chunks)

Parameters:

Name	Type
messages	&[Message]
tools	Option<&[ToolDefinition]>

model

fn model(&self) -> &str

Get the model name

Source

View on GitHub

praisonai/src/llm/mod.rs at line 0

---

Related Documentation

Rust LLM

Rust Providers

Rust Failover