just export LANG=C... oh, right, microsoft...
New-PSSessionOption -Culture=de-DE
Might be worthwhile looking up the PowerShell reference before making comments like that...
It was probably even in 1.0 but MSDN doesn't contain documentation for old software.