Love the project! Just read about grimoires with prompts by Ethan Mollick https://open.substack.com/pub/oneusefulthing/p/now-is-the-ti... and this looks like one of the ways to store your prompts!
Having a caching layer also seems useful from cost point of view. I can imagine that with sufficiently large number of users their prompts and responses sometimes will be similar, and this provides space for cost savings, nice idea:)