Interface ModelConf

Represents the configuration of a model.

ModelConf

interface ModelConf {
    ctx: number;
    info?: {
        quant: string;
        size: string;
    };
    name: string;
}

Properties

ctx: number

The context window length, typically used to define how much of the previous data to consider.

info?: {
quant: string;
size: string;
}

Some meta info about the model: parameter size and quantization level

name: string

The unique name of the model.