Input Requirements

Enumerations

This page provides the list of enumerations used by the Prediction Guard API.

These Roles, ReplaceMethods, and PII Algorithms are required in the /chat/completions endpoint:

Role NameCode-Replace MethodCode-PII AlgCode
Assistantassistant-Randomrandom-Blockblock
Useruser-Fakefake-Replacereplace
Systemsystem-Categorycategory-
-Maskmask-

These Models are required in /completions and /chat/completions endpoints:

Model NameTypeUse CasePrompt FormatContext LengthMore Info
Hermes-2-Pro-Llama-3-8BChatInstruction following or chat-like applicationsChatML4096link
Nous-Hermes-Llama2-13BText GenerationGenerating output in response to arbitrary instructionsAlpaca4096link
Hermes-2-Pro-Mistral-7BChatInstruction following or chat-like applicationsChatML4096link
Neural-Chat-7BChatInstruction following or chat-like applicationsNeural Chat4096link
llama-3-sqlcoder-8bSQL Query GenerationGenerating SQL queriesLlama-3-SQLCoder4096link
deepseek-coder-6.7b-instructCode GenerationGenerating computer code or answering tech questionsDeepseek4096link

This Model is required in the /embeddings endpoint:

Model NameTypeUse CaseContext LengthMore Info
bridgetower-large-itm-mlm-itcEmbedding GenerationUsed for generating text and image embedding100link

This Model is required in the /chat/completions vision endpoint:

Model NameTypeUse CaseContext LengthMore Info
llava-1.5-7b-hfVision Text GenerationUsed for generating text from text and image inputs4096link

These Languages are required in /translate endpoint:

The language code we support is the ISO 639 Set2/T standard.

https://en.wikipedia.org/wiki/List_of_ISO_639_language_codes

LanguageCode
Afrikaansafr
Albaniansqi
Amharicamh
Arabicara
Armenianhye
Assameseasm
Aymaraaym
Azerbaijaniaze
Bambarabam
Basqueeus
Belarusianbel
Bengaliben
Bhojpuribho
Bosnianbos
Bulgarianbul
Burmesemya
Catalancat
Cebuanoceb
Chinesezho
Corsicancos
Croatianhrv
Czechces
Danishdan
Dhivehidiv
Dogri (individual language)dgo
Dutchnld
Englisheng
Esperantoepo
Estonianest
Eweewe
Filipinofil
Finnishfin
Frenchfra
Frisianfry
Galicianglg
Georgiankat
Germandeu
Guaranigrn
Gujaratiguj
Haitianhat
Hausahau
Hawaiianhaw
Hebrewheb
Hindihin
Hmonghmn
Hungarianhun
Icelandicisl
Igboibo
Indonesianind
Irishgle
Italianita
Japanesejpn
Javanesejav
Kannadakan
Kazakhkaz
Khmerkhm
Kinyarwandakin
Konkani (individual language)knn
Koreankor
Kriokri
Kurdishkur
Laolao
Latinlat
Latvianlav
Lingalalin
Lithuanianlit
Luxembourgishltz
Macedonianmkd
Maithilimai
Malagasymlg
Malay (individual language)zlm
Malayalammal
Maltesemlt
Manipurimni
Maorimri
Marathimar
Modern Greek (1453-)ell
Mongolianmon
Nepali (individual language)npi
Norwegiannor
Nyanjanya
Odiaory
Oromoorm
Persianfas
Polishpol
Portuguesepor
Quechuaque
Romanianron
Russianrus
Samoansmo
Sanskritsan
Scotssco
Scottish Gaelicgla
Serbiansrp
Shonasna
Sindhisnd
Sinhalasin
Slovakslk
Slovenianslv
Somalisom
Spanishspa
Sundanesesun
Swahili (individual language)swh
Swedishswe
Tagalogtgl
Tajiktgk
Tamiltam
Tatartat
Telugutel
Thaitha
Tigrinyatir
Tsongatso
Turkishtur
Turkmentuk
Twitwi
Ukrainianukr
Urduurd
Uzbekuzb
Vietnamesevie
Welshcym
Wolofwol
Xhosaxho
Yiddishyid
Yorubayor
Zuluzul