What is the LLM Token Tracking Tool?

The LLM Token Tracking Tool helps you monitor token usage in large language model (LLM) interactions by calculating total tokens used and the proportion of tokens spent on the prompt versus the completion. This is useful for optimizing token usage, controlling costs, and analyzing model efficiency.

How to Use:

1. Prompt Tokens: Enter the number of tokens used in your prompt (input).
2. Completion Tokens: Enter the number of tokens used in the model’s response (output).
3. Click “Calculate”: The tool will display:
   • Total Tokens: Combined tokens from prompt and completion.
   • Prompt %: Percentage of tokens used for the prompt.
   • Completion %: Percentage of tokens used for the response.
4. Use Results: Helps balance prompt length and expected response size, and monitor overall token consumption.