The unit LLMs read and produce — roughly 3/4 of a word in English. Context windows, pricing, and rate limits are all measured in tokens.
"The prompt was 8k tokens and cost 3 cents."
No comments yet — say something.
Add your own interpretation of "token".