> Why do I need to give an app a explicit permission to access common folders in my home directory?

Because you might not be aware that the application wants to harvest all the {meta,}data in your Pictures/Documents/Downloads folders?

The era of trusting applications with wide-open privileges has long since ended.