Interface BaseLanguageModelParams

Base interface for language model parameters. A subclass of BaseLanguageModel should have a constructor that takes in a parameter that extends this interface.

interface BaseLanguageModelParams {
    cache?: boolean | BaseCache<Generation[]>;
    callbackManager?: CallbackManager;
    callbacks?: CallbackManager | (BaseCallbackHandlerMethodsClass | BaseCallbackHandler)[];
    maxConcurrency?: number;
    maxRetries?: number;
    metadata?: Record<string, unknown>;
    onFailedAttempt?: FailedAttemptHandler;
    tags?: string[];
    verbose?: boolean;
}

Hierarchy (view full)

Implemented by

Properties

cache? callbackManager? callbacks? maxConcurrency? maxRetries? metadata? onFailedAttempt? tags? verbose?

Properties

Optional cache

cache?: boolean | BaseCache<Generation[]>

Optional callbackManager

callbackManager?: CallbackManager

⚠️ Deprecated ⚠️

Use callbacks instead

This feature is deprecated and will be removed in the future.

It is not recommended for use.

Optional callbacks

callbacks?: CallbackManager | (BaseCallbackHandlerMethodsClass | BaseCallbackHandler)[]

Optional maxConcurrency

maxConcurrency?: number

The maximum number of concurrent calls that can be made. Defaults to Infinity, which means no limit.

Optional maxRetries

maxRetries?: number

The maximum number of retries that can be made for a single call, with an exponential backoff between each attempt. Defaults to 6.

Optional metadata

metadata?: Record<string, unknown>

Optional onFailedAttempt

onFailedAttempt?: FailedAttemptHandler

Custom handler to handle failed attempts. Takes the originally thrown error object as input, and should itself throw an error if the input error is not retryable.

Optional tags

tags?: string[]

Optional verbose

verbose?: boolean

Settings

Member Visibility

Theme

On This Page

Generated using TypeDoc