LocalLm types documentation
    Preparing search index...

    Interface ModelConf<T>

    Represents the configuration of a model.

    ModelConf

    const modelConf: ModelConf = {
      name: 'qwen4b',
      ctx: 2048,
      info: { size: '175B', quant: 'q4_0' },
      extra: { url: 'http://example.com/model' }
    };
    interface ModelConf<T = Record<string, any>> {
        ctx?: number;
        extra?: T;
        info?: { quant: string; size: string };
        name: string;
    }

    Type Parameters

    • T = Record<string, any>
    Index

    Properties

    ctx? extra? info? name

    Properties

    ctx?: number

    The context window length, typically used to define how much of the previous data to consider.

    extra?: T

    Extra parameters like urls for browser models

    info?: { quant: string; size: string }

    Some meta info about the model: parameter size and quantization level

    name: string

    The unique name of the model.

    Settings

    Member Visibility

    On This Page

    Properties