1000% this.
I have routine procedures that require 2 days just for the procedures. Then a half day for travel. The hospital is 2.5 hours away. One of those days is a prep day so I don't venture to far from the hotel.
And this is a yearly occurrence. Now if I have an acute episode that is a 3 day stay (at a local hospital). Which, luckily this only happens every other year or so.
Basically if I take any time off that is true vacation days I have to make sure I have plenty of days on the books in case I get sick or know I will be having to make doctor appointments in the next few months.