I feel your pain points.

> The second problem is it can't just work with the file system structure and organization

I presume you know about storage templates and ruled them out.