Only if you avoid common plugins that need some server-side interaction, for instance Gravity Forms.

(Probably _unless_ you use some custom rewrite rules, but then you're walking on less-trodden paths)