Just a word on 2, I think that the axioms have to be finite right? (Given that they exist at all) Nothing in the physical universe can require an infinite description.
For instance the set of even numbers is infinite but computable, just check whether the number is divisible by 2.
The algorithm itself is finite, even if the set it determines is not.