The double quote quoting, while allowing you to do e.g. rm "file with spaces" still expands $ and `. Compare:
echo none:`date`
echo double: "`date`"
echo single: '`date`'
But it doesn't expand recursively, so "$var" is safe to protect against special characters in var. That said, one should really read one's shell's documentation, because there be dragons.