I wonder if building something like this on Matrix would be a good fit.

Note "collections" would be rooms, to share collections you can invite people to your encrypted rooms.