Completions — Prediction Guard

Retrieve text completions based on the provided input.

Request

This endpoint expects an object.

modelstringRequired

The chat model to use for generating completions.

promptstringRequired

The prompt to use for generating completions.

max_tokensintegerOptional

The maximum number of tokens in the generated completion.

temperaturedoubleOptional

The temperature parameter for controlling randomness in completions.

top_pdoubleOptional

The diversity of the generated text based on nucleus sampling.

top_kintegerOptional

The diversity of the generated text based on top-k sampling.

outputobjectOptional

Options to affect the output of the response.

inputobjectOptional

Options to affect the input of the request.

Response

Successful response.

idstringOptional

Unique ID for the completion.

objectstringOptional

Type of object (completion).

createdintegerOptional

Timestamp of when the completion was created.

modelstringOptional

The model used for generating the result.

choiceslist of objectsOptional

The set of result choices.

Errors

1 curl -X POST https://api.predictionguard.com/completions \ 2 -H "Authorization: Bearer <token>" \ 3 -H "Content-Type: application/json" \ 4 -d '{ 5 "model": "Hermes-2-Pro-Llama-3-8B", 6 "prompt": "Will I lose my hair?", 7 "max_tokens": 1000, 8 "temperature": 1, 9 "top_p": 1, 10 "top_k": 50, 11 "output": { 12 "factuality": true, 13 "toxicity": true 14 }, 15 "input": { 16 "pii": "replace", 17 "pii_replace_method": "random" 18 } 19 }'

1 { 2 "id": "cmpl-d20e5639-ed8d-48b2-a403-08fe0fdc7add", 3 "object": "text_completion", 4 "created": 1727889988, 5 "model": "Hermes-2-Pro-Llama-3-8B", 6 "choices": [ 7 { 8 "index": 0, 9 "text": "Most people lose some hair every day. It’s a natural process called shedding. On average, you can lose 50-100 strands of hair a day. However, if you notice an increase in hair loss or if you are experiencing hair loss in large clumps, then it could be a sign of an underlying condition. Hair loss can be triggered by a number of factors such as stress, illness, hormone imbalance, medication, and genetics.\nIf you’re concerned about hair loss, you should consult with a trichologist, a hair and scalp specialist. They can help determine the cause of your hair loss and recommend the appropriate treatment." 10 } 11 ] 12 }

1	curl -X POST https://api.predictionguard.com/completions \
2	-H "Authorization: Bearer <token>" \
3	-H "Content-Type: application/json" \
4	-d '{
5	"model": "Hermes-2-Pro-Llama-3-8B",
6	"prompt": "Will I lose my hair?",
7	"max_tokens": 1000,
8	"temperature": 1,
9	"top_p": 1,
10	"top_k": 50,
11	"output": {
12	"factuality": true,
13	"toxicity": true
14	},
15	"input": {
16	"pii": "replace",
17	"pii_replace_method": "random"
18	}
19	}'

1	{
2	"id": "cmpl-d20e5639-ed8d-48b2-a403-08fe0fdc7add",
3	"object": "text_completion",
4	"created": 1727889988,
5	"model": "Hermes-2-Pro-Llama-3-8B",
6	"choices": [
7	{
8	"index": 0,
9	"text": "Most people lose some hair every day. It’s a natural process called shedding. On average, you can lose 50-100 strands of hair a day. However, if you notice an increase in hair loss or if you are experiencing hair loss in large clumps, then it could be a sign of an underlying condition. Hair loss can be triggered by a number of factors such as stress, illness, hormone imbalance, medication, and genetics.\nIf you’re concerned about hair loss, you should consult with a trichologist, a hair and scalp specialist. They can help determine the cause of your hair loss and recommend the appropriate treatment."
10	}
11	]
12	}