Represents the state of the available models on server.

ModelState

Hierarchy

  • ModelState

Properties

ctx: number

The context value.

isModelLoaded: boolean

Indicates whether a model is loaded or not.

loadedModel: string

The name of the loaded model, empty if no model is loaded.

models: Record<string, ModelTemplate>

The models info object (name, template name, context window size)

Generated using TypeDoc