How do you know it's a cache dir and not configuration or something else? I don't say programs should have access to the cache directories of other programs just to their own inside ~/.cache.
So far that has not failed me yet, maybe some day I will get burned.