You can uninstall it with an administrative Powershell using this command:

    Get-AppxPackage Microsoft.WindowsStore | Remove-AppxPackage

Would this not continue to work?