Hi, I don't understand how the Session context and Daily total token counters work.
For a given day, should the Daily total = sum(Session context)? Because it seems the daily total is always much higher.
Correct me if I'm wrong:
The Context is kind of the input to the model in addition to your prompt. Models are limited in taking context, so this number increases with the complexity of your code base (very simplified) and your prompt. To my knowledge a big context also increases the token number on each request, so whenever possible keep your context small/relevant to your current prompt.
Tokens are the unit of the model workload, units of text, like words.
Hey @YZ and @rmoriz
That was a great question! Let me clarify it for you!
The Session context and Daily total token counters in Rovo Dev CLI measure different things, which is why the daily total is usually much higher than the session context.
Session context shows how many tokens are currently being used in your active session’s working memory. This is like Rovo Dev’s “short-term memory” for your ongoing conversation—once you hit the session context limit (e.g., 200,000 tokens), older messages start getting pruned to make room for new ones. It only counts the tokens that are still “in play” for your current session, not everything you’ve done that day.
Daily total is the sum of all tokens you’ve used across all sessions and actions for the entire day. This includes every prompt, code generation, analysis, and even tokens that have already been pruned from your session context. So, if you start new sessions, clear or prune context, or just do a lot of work, your daily total will keep increasing, while your session context will only show what’s currently loaded in memory for your active session.
I hope this helps!
Kindest regards,
Jovana
It looks like you're new here. Sign in or register to get started.