You're right in that there are multiple ethical systems that could justify the arbitrary nature of taxation. That doesn't mean those ethical systems can survive the scrutiny of philosophical razors.
Being specific, from the perspective of the ethics of private property (derived from the concept of self ownership), you can't justify taking away someone's property by force (eg. taxation). You can't fight the self ownership premise without contradicting yourself: if you can argue, it means you are not me, therefore you "own" yourself.
If your ethical system agrees with the idea of taxation "to serve some social benefit" it necessarily doesn't agree with the the premise of self-ownership, as it would imply that "society" has an existence of its own, therefore it can have property, which would extend to the ability of "owning" individuals and their property. However, the "society" is an abstraction, it doesn't really exist (only individuals exist), so that ethical system would fail under Hume's razor.