Making a measurement of which path a photon took, is forcing the photon to have taken one path. If you don't make the measurement (read, if you don't interact with the photon somewhere along some path it could take), you can get interference between the paths, despite it being a single photon.