> We can't really do much with the information that x amount is reserved for MCP, tool calling or the system prompt.
I actually think this is pretty useful information. It helps you evaluate whether an MCP server is worth the context cost. Similar for getting a feel for how much context certain tool uses use up. I feel like there's a way you can change the system prompt, and so that helps you evaluate if what you've got there is worth it also.
grim_io|4 months ago
We can't really do much with the information that x amount is reserved for MCP, tool calling or the system prompt.
simonbw|4 months ago
I actually think this is pretty useful information. It helps you evaluate whether an MCP server is worth the context cost. Similar for getting a feel for how much context certain tool uses use up. I feel like there's a way you can change the system prompt, and so that helps you evaluate if what you've got there is worth it also.