You could argue they also shouldn't spend any money on computer security, investigating internal sexual harassment cases, or patching holes in their parking lot because that is just taking away money that could be used on veterans.
As someone who was the direct caregiver (guardian, POA) of a vet for 25 years, this assertion seems imagined.
It certainly doesn't reflect the factors that determine quality of care in the VA - that is, the factors that differentiate care between Tampa Bay's VA (very good) and Wichita or Atlanta (problematic).
I'm sorry, but freedom isn't free. That includes a cost to have visibility into the government. Making special rules on 'what visibly' also just ends up getting abused like the 'expense'.
This is what freedom looks like.