IEEE 754 is well defined so that $a+b=b+a$
But it can't give you warranty that $(a+b)+c=a+(b+c)$ (well known error propagation issue)
My point is that floating point numbers are real numbers, but the usual operations on them will not give you the same results as the operations on real numbers.
There's no randomness or fuzziness in floating-point rounding.
Until you deal with overflow.
And to be frank, this is just redefining "correctness". If you want to view FPs as real numbers (which they are), there's nothing wrong with pointing out that real number operations will give you incorrect results (even ignoring overflow).
> There's no randomness or fuzziness in floating-point rounding.
I did not imply there was.