It's somewhat useful to think of integers this way but it can be dangerous. a lot of operations on integers are 'undefined' on pointers. for example integer subtraction (which is quite common for measuring size) is undefined if the pointers are pointing to different memory objects. same with addition, if you increment a pointer past the end of an array you can create an undefined operation and who knows what the compiler will do.
So pointers are integers but with a big asterix.