Token calculator (HCX)
    • PDF

    Token calculator (HCX)

    • PDF

    Article summary

    Available in Classic and VPC

    Calculate the number of tokens in a sentence entered in the HCX model.

    Request

    The following describes the request format for the endpoint. The request format is as follows:

    MethodURI
    POST/v1/api-tools/chat-tokenize/{modelName}

    Request headers

    The following describes the request headers.

    HeadersRequiredDescription
    X-NCP-CLOVASTUDIO-API-KEYRequiredAPI key issued when creating the test app or service app
    X-NCP-APIGW-API-KEYRequiredAPI Gateway key issued when creating the test app or service app
    X-NCP-CLOVASTUDIO-REQUEST-IDOptionalRequest ID
    Content-TypeRequiredRequest data format
    • application/json

    Request path parameters

    The following describes the request path parameters.

    FieldTypeRequiredDescription
    modelNameStringRequiredModel name
    • <e.g.> HCX-003

    Request body

    The following describes the request body.

    FieldTypeRequiredDescription
    messagesArrayRequiredList of conversation messages to count tokens for
    messages.roleEnumRequiredRole of conversation messages
    • system | user | assistant
      • system: directives that define roles
      • user: user utterances/questions
      • assistant: answers of the model
    messages.contentStringRequiredContent of conversation messages

    Request example

    The following is a sample request.

    curl --location --request POST 'https://clovastudio.apigw.ntruss.com/v1/api-tools/chat-tokenize/{modelName}' \
    --header 'X-NCP-CLOVASTUDIO-API-KEY: {CLOVA Studio API Key}' \
    --header 'X-NCP-APIGW-API-KEY: {API Gateway API Key}' \
    --header 'X-NCP-CLOVASTUDIO-REQUEST-ID: {Request ID}' \
    --header 'Content-Type: application/json' \
    --data '{
            "messages": [
            {
                "role": "system",
                "content": "- HyperCLOVA X is NAVER's hyperscale AI."
            },
            {
                "role": "user",
                "content": "Hello, what is your name?"
            },
            {
                "role": "assistant",
                "content": "I'm HyperCLOVA X."
            }
        ]
    }'
    

    Response

    The following describes the response format.

    Response body

    The following describes the response body.

    FieldTypeRequiredDescription
    messagesArray-List of request conversation messages with counted tokens
    messages.roleEnum-Role of conversation messages
    • system | user | assistant
      • system: directives that define roles
      • user: user utterances/questions
      • assistant: answers of the model
    messages.contentString-Content of conversation messages
    messages.countInteger-Result of calculating the number of tokens in the conversation message

    Response example

    The following is a sample example.

    Succeeded

    The following is a sample response upon a successful call.

    {
        "status": {
          "code": "20000",
          "message": "OK"
        },
        "result": {
          "messages": [
            {
              "role": "system",
              "content": "- HyperCLOVA X is NAVER's hyperscale AI.",
              "count": 15
            },
            {
              "role": "user",
              "content": "Hello, what is your name?",
              "count": 10
            },
            {
              "role": "assistant",
              "content": "I'm HyperCLOVA X.",
              "count": 9
            }
          ]
        }
      }
    

    Failure

    The following is a sample response upon a failed call.


    Was this article helpful?

    Changing your password will log you out immediately. Use the new password to log back in.
    First name must have atleast 2 characters. Numbers and special characters are not allowed.
    Last name must have atleast 1 characters. Numbers and special characters are not allowed.
    Enter a valid email
    Enter a valid password
    Your profile has been successfully updated.