That definitely seems like a feature that could/should be added to some (most? all?) linux file managers. In fact, it doesn't even sound like that difficult to implement with standard system calls[0].
It's not really an issue for me (I prefer the command line -- heck, I still use octal when setting permissions instead of 'rwx'), but it sounds like it bugs you a lot.
You don't mention which Desktop Environment (DE) you're using, but I imagine the file manager in your DE is open source. As such, I'm sure you could make yourself and the (I'm sure) many others who'd like to be able to modify file/dir/filesystem permissions/ownership via their GUI file manager much happier.
Try doing that with Windows Explorer or Finder. I think not.
Good luck!
[0] https://www.tutorialpedia.org/blog/how-to-change-show-permis...
Edit: Clarified prose.