Never ran into this, as I never thought to put quotes around a tilde in my 20+ years with bash.
I guess it is interesting that ~ behaves differently from a variable, as usually you'll have to use single quotes to get the string literal, but then I wouldn't want the tilde to expand inside quotes, either.