Calculate Quality Metrics • AI Agent SDK

calculate_quality_metrics: Calculate quality metrics using LLM

calculate_quality_metrics

Method

This is a method of the Memory class in the memory module.

Calculate quality metrics using LLM

Signature

def calculate_quality_metrics(output: str, expected_output: str, llm: Optional[str], custom_prompt: Optional[str]) -> Dict[str, float]

Parameters

output · str · required

No description available.

expected_output · str · required

No description available.

llm · Optional

No description available.

custom_prompt · Optional

No description available.

Returns

Returns · Dict[str, float]

The result of the operation.

Uses

• logger.info
• litellm.completion
• OpenAI
• create
• logger.error
• json.loads
• ValueError

Used By

• Task.execute_callback

Source

View on GitHub

praisonaiagents/memory/memory.py at line 1636