Your intuition is not all that wrong, but it’s not entirely correct either.
Number Theory is basically the exploration of the deep consequences of a set of (ultimately arbitrary but apparently obvious) axioms. The exploration of those consequences arises from the fact that they are ultimately too plentiful, ramified, and incompletely provable (per Godel’s Incompleteness Theorems & Turing’s Halting Problem).