To escape $ you either need to use a single quoted string so the $ is treated literally or in a double quoted string use a backtick before the $ to escape it
Write-Host 'Foo$Bar'
Write-Host "Foo`$Bar"