with neovim as the pager for man, it does find ~?

though you have to be aware of the escapes for regex, so \~?