Input Requirements

Enumerations

This page provides the list of enumerations used by the Prediction Guard API.

These Roles, ReplaceMethods, and PII Algorithms are required in the /chat/completions endpoint:

Role NameCode-Replace MethodCode-PII AlgCode
Assistantassistant-Randomrandom-Blockblock
Useruser-Fakefake-Replacereplace
Systemsystem-Categorycategory-
-Maskmask-

These Models are required in /completions and /chat/completions endpoints:

Model NameTypeUse CasePrompt FormatContext LengthMore Info
Hermes-2-Pro-Llama-3-8BChatInstruction following or chat-like applicationsChatML4096link
Nous-Hermes-Llama2-13BText GenerationGenerating output in response to arbitrary instructionsAlpaca4096link
Hermes-2-Pro-Mistral-7BChatInstruction following or chat-like applicationsChatML4096link
Neural-Chat-7BChatInstruction following or chat-like applicationsNeural Chat4096link
llama-3-sqlcoder-8bSQL Query GenerationGenerating SQL queriesLlama-3-SQLCoder4096link
deepseek-coder-6.7b-instructCode GenerationGenerating computer code or answering tech questionsDeepseek4096link

This Model is required in the /embeddings endpoint:

Model NameTypeUse CaseContext LengthMore Info
bridgetower-large-itm-mlm-itcEmbedding GenerationUsed for generating text and image embedding100link

This Model is required in the /chat/completions vision endpoint:

Model NameTypeUse CaseContext LengthMore Info
llava-1.5-7b-hfVision Text GenerationUsed for generating text from text and image inputs4096link

These Languages are required in /translate endpoint:

The language code we support is the ISO 639 Set2/T standard.

https://en.wikipedia.org/wiki/List_of_ISO_639_language_codes

Langauge NameCode
Afrikannsafr
Amharicamh
Arabicara
Armenianhye
Azerbaijanaze
Basqueeus
Belarusianbel
Bengaliben
Bosnianbos
Catalancat
Chechenche
Cherokeechr
Chinesezho
Croatianhrv
Czechces
Danishdan
Dutchnld
Englisheng
Estonianest
Fijianfij
Filipinofil
Finnishfin
Frenchfra
Galicianglg
Georgiankat
Germandeu
Greekell
Gujaratiguj
Haitianhat
Hebrewheb
Hindihin
Hungarianhun
Icelandicisl
Indonesianind
Irishgle
Italianita
Japanesejpn
Kannadakan
Kazakhkaz
Koreankor
Latvianlav
Lithuanianlit
Macedonianmkd
Malay1msa
Malay2zlm
Malayalammal
Maltesemlt
Marathimar
Nepalinep
Norwegiannor
Persianfas
Polishpol
Portuguesepor
Romanianron
Russianrus
Samoansmo
Serbiansrp
Slovakslk
Slovenianslv
Slavonicchu
Spanishspa
Swahiliswh
Swedishswe
Tamiltam
Telugutel
Thaitha
Turkishtur
Ukrainianukr
Urduurd
Welshcym
Vietnamesevie