[config_yml]

I have a system prompt of around 100k which includes a couple of internal schema definitions. Having this cached could be super useful to us.

[BonoboIO]

100k … I hear and use all of these high token context LLMs, but often they fail to include all information that should be in their context.

Does your approach work for you?

[social_quotient]

Would love if you could de identify and share a bit more detail on a prompt that big.