You can override it to 24 hours:

https://dev.meta.ai/docs/prompt-caching#cache-retention

Even at 5 minutes, if you're doing 100 agent runs in those 5 minutes, and 1 of them bills at full input price, it still hardly matters.