Represents the result of an inference process, extending the TempInferStats interface.

InferResult

Hierarchy

Properties

emitTime: number

The time taken for emitting in milliseconds.

emitTimeFormat: string

The formatted string representation of the emit time.

inferenceTime: number

The time taken for the inference process in milliseconds.

text: string

The text associated with the inference result.

thinkingTime: number

The amount of time taken for thinking during the inference.

thinkingTimeFormat: string

The format of the thinking time (e.g., milliseconds, seconds).

tokensPerSecond: number

The number of tokens processed per second.

totalTime: number

The total time taken for the inference process and emitting in milliseconds.

totalTimeFormat: string

The formatted string representation of the total time.

totalTokens: number

The total number of tokens processed.

Generated using TypeDoc