The optimizer runs your recipe, evaluates the output, and applies improvements iteratively.
Quick Start
How It Works
1
Run
Executes the recipe and captures output
2
Judge
AI evaluates task achievement, output quality, and instruction following
3
Improve
Proposes specific YAML changes based on feedback
4
Apply
Updates agents.yaml with improvements
5
Repeat
Continues until score threshold or max iterations
Options
Examples
- Basic
- Targeted
- High Quality
- With Input
Optimize with defaults:
What Gets Improved
The AI judge evaluates and improves:Task Achievement
Task Achievement
Did the agent accomplish what it was asked to do?
Output Quality
Output Quality
Does the output match expected format and contain useful information?
Instruction Following
Instruction Following
Did the agent follow specific instructions, format, and constraints?
Error Handling
Error Handling
How well did the agent handle errors and edge cases?
Score Interpretation
Workflow
Next Steps
Recipe Judge
Manually judge recipe traces
Recipe Registry
Share optimized recipes

