There are plenty of aftermarket mods and tuning that are perfectly road legal. And if for some reason you need to stray outside those, I figure you can afford to keep a dedicated track car around. "Personal responsibility" doesn't work when your lack of responsibility puts other people at risk.
Also, I'm pretty sure most people don't care one bit what that community wants. When I hear "aftermarket and performance tuning", I think of idiots street racing, overly aggressive drivers, and obnoxiously loud cars. (I don't care if it's a straightpiped Civic or a freaking LFA, it's still obnoxious for everyone not driving the car.) Not exactly what most people want on public roads.