But hey, make it perfect from the get go ;)
I know, temporary stuff has a tendency to become permanent. But if you see this trend, then you and your manager should be grown-up enough to have the discussion of rewriting it for something more longterm. (It all depends on what sort of project it is).
Long term projects should never voluntarily allow technical debt. It's just bad for business.