Tokenize
Generates tokens for a string using a model’s tokenizer.
Headers
Authorization
Bearer authentication of the form Bearer <token>, where token is your auth token.
Request
This endpoint expects an object.
model
The name of the model to use for tokenization.
input
The text to tokenize.
Response
Successful response.
id
Unique ID for the token.
object
Type of object (tokens).
created
Timestamp of when the tokens were generated.
model
The name of the model used.
tokens
An array of token data.