Token

For managers, tokens matter in two places: cost and limits. The cost of each query depends directly on the number of input and output tokens, and the context window is also measured in tokens.

A practical point for Persian: Persian text usually tokenizes into more tokens than the equivalent English, so processing Persian costs more. A well-designed system offsets this by caching repeated answers and using deterministic logic instead of the model for simple work.