There's also this weird dynamic of not having number on paper. I once took off three weeks for vacation, first in a very long time, several years. When I got back, there was definitely this air of "so and so is finally back, working like the rest of us." Even with my direct management, it felt a lot like I had spent trust for time off.
Since then, I've worked in a large corporate job for a while now as well, and it's different. Here, management and I can look at my PTO sheet and see I've accrued X hours so I can take off Y weeks, and that's earned. It feels more like a contractual obligation at that point, and not just an off-the-cuff spree.