You can view this as a game:
Let's make some assumtions / axioms, and see what we can build with it.
The most popular axiom set is Zermelo-Fraenkel-style Set Theory [1], but there are other choices which have been explored.Note that, there a no claims about absolute truth or reality here. We just play a game in our minds.
The most fundamental question about the game, that we can ask is "Is this game consistent". Goedel found out, somewhat unfortunately, we are not able to answer that question from within the game [2]. However, sofar no intrinsical inconsistencies (paradixies) have been found.
Now, it turns out, that the ZF-Mathematics game is a very useful game, since it allows us to model certain aspects of reality. E.g. Newtons Mechanic, allows us to forecast how planets move in space.
The Natural Sciences (Physics, Chem., Bio) and Engineering are essentially about how to model reality with mathematics. The way to do that is the empirical scientific method [3], where hypothesis are formed, experiments are designed and evidence is collected.
So the question of "truth" does not really arise. It's just:
(A) Mathematics is an interesting mind-game to play.
(B) Mathematics has been used very successfully to model and predict our preceived reality.
That's all you can ask for.
[1] https://en.wikipedia.org/wiki/Zermelo–Fraenkel_set_theory [2] https://en.wikipedia.org/wiki/Gödel%27s_incompleteness_theor... [3] https://en.wikipedia.org/wiki/Empirical_evidence