The lack of space before the goal line limits the routes you can run. The defense clogging the middle becomes easier because there is no deep threat to allocate safeties and linebackers to.
I think the more 2 point plays that are run, defenses are going to get better at stopping them. I also wonder what percentage of successful 2 point plays were fake kicks, where special teams defense was out there. Rather than actual defensive starters. I wager that if offenses have to face real defenses in this situation they will perform worse.