This is a pretty maddening bug that I ran into: https://github.com/godotengine/godot/issues/30215

To summarize, you basically can't use the built-in viewport scaling at all because it breaks mouse input.