That is incorrect, you can prove that you are the owner of the private key that spent the bitcoins if you wish. Anyway this seems like a silly argument, with physical cash how can you prove that you paid X with that cash like in the scenario you outline?
My point is that as payments become more and more digital then we must be wary of what that means in terms of data mining and things like that.