What is a token?
Large language models don't read words the way we do. They break text into tokens: common short words are usually one token, longer or rarer words are split into pieces, and punctuation, spaces and digits often count separately. Everything about using an AI model is measured in tokens: how long your prompt can be (the context window), how much the model can write back, and how API usage is billed.
Tokens to words: rules of thumb
| Text type | Typical tokens |
|---|---|
| Plain English prose | ~1 token per 4 characters, or ~1.3 tokens per word |
| 1,000 tokens of English | roughly 700–800 words, a page and a half |
| Source code | More tokens per line than prose (symbols, indentation, names) |
| Hindi and other non-Latin scripts | Often several times more tokens than the same message in English |
| Long numbers, IDs, URLs | Split into many small tokens |
Why your token count matters
- Context limits: if your prompt plus the conversation history goes past the model's context window, older text is cut off or the request fails.
- Cost: API pricing is per token, for both input and output, so trimming a long system prompt saves money on every call.
- Quality: shorter, focused prompts often get better answers than long ones full of repetition.
How to reduce tokens without losing meaning
- Remove greetings, repeated instructions and filler like "I was wondering if you could possibly…".
- Paste only the relevant part of a document, not the whole file.
- Use lists instead of long paragraphs for requirements.
- Ask for a specific output length, for example "answer in 5 bullet points".
Writing prompts? Our AI prompt generator guide and free AI tools list are good next steps.
FAQ
Why is this an estimate and not an exact count?
Each AI company uses its own tokenizer, and they change between model versions. An exact count needs the provider's own tokenizer. This tool gives a fast, private estimate that is good for planning.
Does the counter save my text?
No. Nothing leaves your browser, and the text is gone when you close or refresh the page.