Class Lm

Represents a Language Model (LM) which acts as a high-level interface to various underlying LM providers.

Implements

Implements

  • LmProvider

Constructors

constructor

Properties

abort api apiKey defaults? infer info loadModel model models modelsInfo name onEndEmit? onError? onStartEmit? onToken? provider providerType serverUrl

Constructors

constructor

  • new Lm(params): Lm

  • Constructs a new LM instance with the specified provider and parameters.

    Parameters

    • params: LmParams

      The parameters for initializing the LM.

    Returns Lm

    Throws

    Throws an error if an unknown provider type is specified or if required parameters for a provider are missing.

Properties

abort

abort: (() => Promise<void>)

api

api: {
    addHeader: ((key: string, val: string) => void);
    csrfToken: (() => null | string);
    del: (<T_4>(uri: string, verbose?: boolean) => Promise<ApiResponse<T_4>>);
    get: (<T>(uri: string, verbose?: boolean) => Promise<ApiResponse<T>>);
    hasCsrfCookie: (() => boolean);
    onResponse: ((hook: OnResponseHook) => void);
    patch: (<T_3>(uri: string, payload: any[] | Record<string, any>, verbose?: boolean) => Promise<ApiResponse<T_3>>);
    post: (<T_1>(uri: string, payload: any[] | Record<string, any> | FormData, multipart?: boolean, verbose?: boolean) => Promise<ApiResponse<T_1>>);
    postSse: (<T_5>(uri: string, payload: any[] | Record<string, any> | FormData, onChunk: ((payload: T_5) => void), abortController: AbortController, parseJson?: boolean, multipart?: boolean, verbose?: boolean, debug?: boolean) => Promise<void>);
    put: (<T_2>(uri: string, payload: any[] | Record<string, any>, verbose?: boolean) => Promise<ApiResponse<T_2>>);
    removeHeader: ((key: string) => void);
    setCsrfToken: ((token: string) => void);
    setCsrfTokenFromCookie: ((verbose?: boolean) => boolean);
}

apiKey

apiKey: string

Optionaldefaults

defaults?: LmDefaults

infer

infer: ((prompt: string, params: InferenceParams, parseJson?: boolean, parseJsonFunc?: ((data: string) => Record<string, any>)) => Promise<InferenceResult>)

info

info: (() => Promise<Record<string, any>>)

loadModel

loadModel: ((name: string, ctx?: number, threads?: number, gpu_layers?: number) => Promise<void>)

model

model: ModelConf = ...

models

models: ModelConf[] = ...

modelsInfo

modelsInfo: (() => Promise<void>)

name

name: string

OptionalonEndEmit

onEndEmit?: ((result: InferenceResult) => void)

OptionalonError

onError?: ((err: string) => void)

OptionalonStartEmit

onStartEmit?: ((data: IngestionStats) => void)

OptionalonToken

onToken?: ((t: string) => void)

provider

provider: LmProvider

providerType

providerType: LmProviderType

serverUrl

serverUrl: string

Settings

Member Visibility

On This Page

Constructors
Properties