As far as we can tell, GR implies, and we have measured, space-time is completely continuous. Draw a square on a piece of paper; or, better yet, outline a cube with some sticks: within that square (or cube) is an infinite set of points of either the integral or real cardinality — whichever you’d like.
The “no physical infinity” thing sounds like a very Greek sort of axiom — like their “nature abhors a vacuum” thing, etc.