"The rule for carry permit holders is that if they’re stopped by police, they’re to immediately inform the officer that they possess a gun and show their permit."
This varies by state. Whether required by law or not, though, carry permits often show up when the police run the license plate so handing over the carry permit along with driving license is good sense. It also shows the cop that you're not trying to hide anything.