Chat Completions Vision — Prediction Guard

Generate chat completions based on text and images.

Request

This endpoint expects an object.

modelstringRequired

The chat model to use for generating completions.

messageslist of objectsRequired

An array of messages used for generating completions.

max_tokensintegerOptional

The maximum number of tokens in the generated completion.

temperaturedoubleOptional

The temperature parameter for controlling randomness in completions.

top_pdoubleOptional

The diversity of the generated text based on nucleus sampling.

top_kintegerOptional

The diversity of the generated text based on top-k sampling.

outputobjectOptional

Options to affect the output of the response.

inputobjectOptional

Options to affect the input of the request.

Response

This endpoint returns an object.

idstringOptional

Unique ID for the chat completion.

objectstringOptional

Type of object (chat completion).

createdintegerOptional

Timestamp of when the chat completion was created.

modelstringOptional

The chat model used for generating completions.

choiceslist of objectsOptional

The set of result choices.

Errors

1 curl -X POST https://api.predictionguard.com/chat/completions - Vision Version \ 2 -H "Authorization: Bearer <token>" \ 3 -H "Content-Type: application/json" \ 4 -d '{ 5 "model": "llava-1.5-7b-hf", 6 "messages": [ 7 { 8 "role": "user", 9 "content": [ 10 { 11 "type": "text", 12 "text": "input.question" 13 }, 14 { 15 "type": "image_url", 16 "image_url": { 17 "url": "data:image/jpeg;base64,<DATA>" 18 } 19 } 20 ] 21 } 22 ], 23 "max_tokens": 1000, 24 "temperature": 1, 25 "top_p": 1, 26 "top_k": 50, 27 "output": { 28 "factuality": true, 29 "toxicity": true 30 }, 31 "input": { 32 "pii": "replace", 33 "pii_replace_method": "random" 34 } 35 }'

1 { 2 "id": "chat-8qptYQ1EC1cPhHIKh7ArD5OxKN01N", 3 "object": "chat_completion", 4 "created": 1717681459, 5 "model": "llava-1.5-7b-hf", 6 "choices": [ 7 { 8 "index": 0, 9 "status": "success", 10 "message": { 11 "role": "assistant", 12 "content": "No, there is no deer in this picture. The image features a man wearing a hat and glasses, smiling for the camera.", 13 "output": "null" 14 } 15 } 16 ] 17 }

1	curl -X POST https://api.predictionguard.com/chat/completions - Vision Version \
2	-H "Authorization: Bearer <token>" \
3	-H "Content-Type: application/json" \
4	-d '{
5	"model": "llava-1.5-7b-hf",
6	"messages": [
7	{
8	"role": "user",
9	"content": [
10	{
11	"type": "text",
12	"text": "input.question"
13	},
14	{
15	"type": "image_url",
16	"image_url": {
17	"url": "data:image/jpeg;base64,<DATA>"
18	}
19	}
20	]
21	}
22	],
23	"max_tokens": 1000,
24	"temperature": 1,
25	"top_p": 1,
26	"top_k": 50,
27	"output": {
28	"factuality": true,
29	"toxicity": true
30	},
31	"input": {
32	"pii": "replace",
33	"pii_replace_method": "random"
34	}
35	}'

1	{
2	"id": "chat-8qptYQ1EC1cPhHIKh7ArD5OxKN01N",
3	"object": "chat_completion",
4	"created": 1717681459,
5	"model": "llava-1.5-7b-hf",
6	"choices": [
7	{
8	"index": 0,
9	"status": "success",
10	"message": {
11	"role": "assistant",
12	"content": "No, there is no deer in this picture. The image features a man wearing a hat and glasses, smiling for the camera.",
13	"output": "null"
14	}
15	}
16	]
17	}