But 3000003 is exact in fp32, as well as it is 3000002.5, 3000002.75 before it or 3000003.25, 3000003.5, 3000003.75 after it?
https://www.h-schmidt.net/FloatConverter/IEEE754.html
And AFAIK the LLMs, lacking the ability to actually calculate, can't check which numbers are such?