In general, I agree with you, but there are degrees of morality. I hope most would agree that someone who's tastes include hunting endangered animals should not be accommodated. Likewise, if you were to go fishing in someone's koi pond or go hunting for a buffalo that someone was raising on their land, you'd also be rightfully punished.
So it stands to reason that all of these "tastes" exist on a spectrum from morally repugnant to the Buddhist practice of refusing to kill anything. And while we all draw our own line on that spectrum between what we consider acceptable and unacceptable, society will also draw that line and consider some of those activities to be illegal.