Interface ModelConf

. Represents the configuration of a model.

ModelConf

const modelConf: ModelConf = {
  name: 'gpt-3',
  ctx: 2048,
  info: { size: '175B', quant: 'q4_0' },
  extra: { url: 'http://example.com/model' }
};

interface ModelConf {
    ctx?: number;
    extra?: Record<string, any>;
    info?: { quant: string; size: string };
    name: string;
}

Properties

ctx?: number

The context window length, typically used to define how much of the previous data to consider.

extra?: Record<string, any>

Extra parameters like urls for browser models

info?: { quant: string; size: string }

Some meta info about the model: parameter size and quantization level

name: string

The unique name of the model.