Interface for TogetherAIEmbeddingsParams parameters. Extends EmbeddingsParams and defines additional parameters specific to the TogetherAIEmbeddings class.

interface TogetherAIEmbeddingsParams {
    apiKey?: string;
    batchSize?: number;
    modelName?: string;
    stripNewLines?: boolean;
    timeout?: number;
}

Hierarchy (view full)

Implemented by

Properties

apiKey?: string

The API key to use for the TogetherAI API.

Default

{process.env.TOGETHER_AI_API_KEY}
batchSize?: number

The maximum number of documents to embed in a single request.

Default

{512}
modelName?: string

Model name to use

Default

{"togethercomputer/m2-bert-80M-8k-retrieval"}
stripNewLines?: boolean

Whether to strip new lines from the input text. May not be suitable for all use cases.

Default

{false}
timeout?: number

Timeout to use when making requests to TogetherAI.

Default

{undefined}

Generated using TypeDoc