Why are any of your examples not tech debt? They all mean that there is some development work that must be done to get the software fit to the way you need it.

Also this:

> In all of these cases I feel like clean-up should just be constant and mostly opaque.

This is true for almost all kinds of liability. People only insist on complete transparency for financial ones.