Something I realized a while ago is that even if there isn't EXIF data left behind, you can pretty easily track a lot of photos- I've seen pictures of houses with readable licence plates in the parking lot, or a street name visible, house numbers, etc. If you really want to hide yourself, you have to try pretty hard to obscure data.
Consider one thing I saw- the guy said he lived in north Dakota publicly, and had a photo looking out of his garage. Visible was the street name on a signpost, and the house number across from him. Completely innocuous, but it's way more than enough to narrow him down completely. EXIF is easy, but to stay anon properly is hard.