They all differ pointwise by an infinitesmal! This flexibility is a feature, not a bug.
Of course, I agree with you that mathematical progress should proceed on rigorous grounds, and there is a lot to be proven here. But my point is mainly that this is so easy you can just go and see what happens in these cases yourself without much trouble. For applications you really don't have to care.
I've done a course in analysis that covered distributions, but your reply made me chuckle. You've told me that distributions are just as simple and then proceeded to dump paragraphs of jargon at me. L^infinity? Dual space? Support? Penrose defined? Inner product via integrals?
(to be clear, I know what you're talking about, but our hypothetical high school student will have a lot more luck moving infinitesmals around, I guarantee it)
> Do your results depend on ZFC? stronger axioms? At what level of infinity do we stop? You can brush aside the formalities but then what better is this approach than physicists?
For physics, just pick a representative, compute and do some sanity checks. Who is ZFC? =P
Just kidding. Anyway, as you probably know the deeper theory of nonstandard analysis has been worked out in detail already, so if you want to get stuck in the weeds there are answers out there.