Chat Completions Streaming

POST
Generate chat completions based on a conversation history with streaming support.

Request

This endpoint expects an object.
modelstringRequired
The chat model to use for generating completions.
messageslist of objectsRequired
An array of messages used for generating completions.
max_tokensintegerOptional
The maximum number of tokens in the generated completion.
temperaturedoubleOptional
The temperature parameter for controlling randomness in completions.
top_pdoubleOptional
The diversity of the generated text based on nucleus sampling.
top_kintegerOptional
The diversity of the generated text based on top-k sampling.
streambooleanOptional
Turn streaming on.
inputobjectOptional
Options to affect the input of the request.

Response

This endpoint returns a list of objects.
dataobjectOptional

Errors