Tokens sent to the model: system prompt, context, and user message.
Input tokens include the system prompt, retrieved documents, conversation history, tool definitions, and the user message. Providers usually charge a lower rate per input token than per output token.
RAG and agent workloads are input-heavy, so input pricing and caching dominate their monthly bills.