C# and .net core don't have as much cruft, and the simple dev environment in code or visual studio are invaluable - especially the debuggers which are imo one of the most important learning tools.
Argueably MS already provide a complete language pre-installed in PowerShell.
However would be nice if they more of a beginners IDE for simple programming.
Powershell ISE is pre-installed.
The command-line C# compiler csc.exe is also pre-installed as part of the .NET Framework. There's also all the WSH languages (VBScript and JScript).