Refusing to talk wouldn't work if you were black or brown though. Either the cop would have looked in the car and found the drugs anyway, or they would have gotten the warrant and found the drugs.
At which point you would be threatened with a trial that might not even be that winnable by the prosecution, but that they'd use as a stick to bully you into taking some kind of plea bargain, maybe even without jail time, but now at least you're on probation and/or have a criminal record.