Your example is a transaction between people (the doctor and you). You don't have a right to that transaction. The other party can withdraw for whatever reason (including not having time).

The freedom to roam is freedom. I understand the point you're trying to make, but the parent comment is correct in the usage of the world freedom, whether you like it or not.