No, not in this case. The assumption of unit cost arithmetic is simply not physically realizable. It's probably easier to understand the integer case: numbers take bits to store and represent. In a typical computer, you would store numbers as either 32 or 64 bits, where 32 bits could store a number up to about 4 billion (or a signed number between -2 and +2 billion). If you want to store and multiply numbers larger than that, they take up more space and they require more work on the part of the processor, and fundamentally, more energy - adding two 128 bit numbers takes twice the work as adding two 64 bit numbers.
The same applies to the precision of floating point numbers. What Ben is arguing is happening in this case is the AI has found a way to hide work by moving it into operations that, in one (unrealistic) model of computation, are assumed to cost the same regardless of how large or precise the numbers are. Other models of computation have a more accurate model of the cost of these things, but that was not the model the AI chose to apply in this case.