Black listing is never secure. White listing is. Sadly some really smart person decided it was a good idea to store pictures and SSH keys within the same directory tree.
My Nix Home Manager settings for XDG directories:
xdg.userDirs = {
enable = true;
createDirectories = true;
desktop = "${config.home.homeDirectory}/var/desktop";
documents = "${config.home.homeDirectory}/opt/docs";
download = "${config.home.homeDirectory}/var/download";
music = "${config.home.homeDirectory}/opt/art/music";
pictures = "${config.home.homeDirectory}/opt/art/visual/picture";
publicShare = "${config.home.homeDirectory}/var/public";
videos = "${config.home.homeDirectory}/opt/art/visual/video";
templates = "${config.home.homeDirectory}/opt/templates";
};~/Pictures and ~/.ssh are as far apart as they can be while staying in the user's home directory. I guess you could stick stuff in... /var or something, but that seems worse overall.