Interface ChatGroqInput

interface ChatGroqInput {
    apiKey?: string;
    maxTokens?: number;
    modelName?: string;
    stop?: null | string | string[];
    streaming?: boolean;
    temperature?: number;
}

Hierarchy (view full)

Properties

apiKey? maxTokens? modelName? stop? streaming? temperature?

Properties

Optional apiKey

apiKey?: string

The Groq API key to use for requests.

Default

process.env.GROQ_API_KEY

Optional maxTokens

maxTokens?: number

The maximum number of tokens that the model can process in a single response. This limits ensures computational efficiency and resource management.

Optional modelName

modelName?: string

The name of the model to use.

Default

"llama2-70b-4096"

Optional stop

stop?: null | string | string[]

Up to 4 sequences where the API will stop generating further tokens. The returned text will not contain the stop sequence.

Optional streaming

streaming?: boolean

Whether or not to stream responses.

Optional temperature

temperature?: number

The temperature to use for sampling.

Default

0.7

Settings

Member Visibility

Theme

On This Page

Generated using TypeDoc