Unscrew the inner valve stem and it's an annoyance that doesn't create permanent damage.
I suppose a more committed vandal could go on to do permanent damage after deflating the tires at reduced personal risk.
One of the more evil variations I've heard of involves pinning a bb or pebble between the cap and valve pin, creating a slow leak that's invisible until you think to take off the cap.