Skip to main content

​
record_streaming

Method
This is a method of the Profiler class in the profiler module.
Record streaming metrics.

​
Signature

def record_streaming(name: str, ttft_ms: float, total_ms: float, chunk_count: int, total_tokens: int) -> None

​
Parameters

​
name
str
required
No description available.
​
ttft_ms
float
required
No description available.
​
total_ms
float
required
No description available.
​
chunk_count
int
default:"0"
No description available.
​
total_tokens
int
default:"0"
No description available.

​
Source

View on GitHub

praisonai/profiler.py at line 506