Default parameters that can be used with an LM provider.

LmDefaults

interface LmDefaults {
    inferenceParams?: InferenceParams;
    model?: ModelConf;
}

Properties

inferenceParams?: InferenceParams

Default inference parameters.

model?: ModelConf

Default model conf to use.