Ttft Ms • AI Agents Framework

ttft_ms: Get time to first token in ms.

ttft_ms

Method

This is a method of the StreamingTracker class in the profiler module.

Get time to first token in ms.

Signature

def ttft_ms() -> float

Returns

Returns · float

The result of the operation.

Source

View on GitHub

praisonai/profiler.py at line 197