Represents the configuration of a model.

ModelConf

Hierarchy

  • ModelConf

Properties

Properties

ctx: number

The context value.

gpu_layers?: number

The number of layers to offload to the GPU.

name: string

The name of the model.

Generated using TypeDoc