Tokens
The chunks of text (usually sub-words) that LLMs read and bill on.
Roughly 1 token โ 0.75 English words. Pricing, context windows and rate limits are all measured in tokens, so monitoring token usage is core to AI cost control.
The chunks of text (usually sub-words) that LLMs read and bill on.
Roughly 1 token โ 0.75 English words. Pricing, context windows and rate limits are all measured in tokens, so monitoring token usage is core to AI cost control.