If we're talking about the results, is there any reason to think it should make a difference at all?
You can also think about it as compounding errors - at any one weight index the bit values might not be too meaningful, but cascaded over a lot of tensor multiplications they will be.