No, PHP minor versions are not necessarily compatible with each other. When I worked in web hosting, we had to deal with quite a few issues resulting from changes between 5.2 and 5.3, and later 5.3 and 5.4.
At least Python has a sane versioning scheme, where breaking compatibility increments the major version number or is a bug.