As far as I know the privacy extensions only cycle through the host portion of the address (lower 64 bits) so they should work fine with just a /64. Access to a bigger prefix may help you get around systems that do IP banning in /64 chunks though.