Token calculator (Embedding v2)
    • PDF

    Token calculator (Embedding v2)

    • PDF

    Article summary

    Available in Classic and VPC

    Calculate the number of tokens in a sentence entered in Embedding v2.

    Request

    This section describes the request format. The method and URI are as follows:

    MethodURI
    POST/v1/api-tools/embedding/v2/tokenize

    Request headers

    The following describes the headers.

    HeadersRequiredDescription
    AuthorizationRequiredAPI key for authentication <e.g.,> Bearer nv-************
    X-NCP-CLOVASTUDIO-REQUEST-IDOptionalRequest ID
    Content-TypeRequiredRequest data format
    • application/json

    Request body

    You can include the following data in the body of your request:

    FieldTypeRequiredDescription
    textStringRequiredList of conversation messages to count tokens for
    • 1-10,000 characters (based on Korean)

    Request example

    The request example is as follows:

    curl --location --request POST 'https://clovastudio.stream.ntruss.com/v1/api-tools/embedding/v2/tokenize' \
    --header 'Authorization: Bearer {API Key}' \
    --header 'X-NCP-CLOVASTUDIO-REQUEST-ID: {Request ID}' \
    --header 'Content-Type: application/json' \
    --data '{
        "text": "Tell me the total number of tokens."
    }'
    

    Response

    This section describes the response format.

    Response body

    The response body includes the following data:

    FieldTypeRequiredDescription
    numTokensInteger-Result of calculating the number of tokens

    Response example

    The response example is as follows:

    Succeeded

    The following is a sample response upon a successful call.

    {
        "status": {
            "code": "20000",
            "message": "OK"
        },
        "result": {
            "numTokens": 1000
        }
    }
    

    Failure

    The following is a sample response upon a failed call.


    Was this article helpful?

    Changing your password will log you out immediately. Use the new password to log back in.
    First name must have atleast 2 characters. Numbers and special characters are not allowed.
    Last name must have atleast 1 characters. Numbers and special characters are not allowed.
    Enter a valid email
    Enter a valid password
    Your profile has been successfully updated.