For larger distances you wouldn't even see the text in the screen, so you don't even know how much to jump. In this situation I just spam ctrl+d, then tweak with j.
Look where you want to go, there's a number next to it. Type that number and then type j.
Typing 5j, where the number "5ish" was already loaded into your brain by looking at the distance, is 100x better than typing 384g, where 384 is an effectively meaningless number and will change momentarily anyway.
Fwiw, relative line numbers doesn't obscure the "real line numbers" in any meaningful way. First of all, real line numbers aren't used for anything except external references into the file, which you can still navigate to perfectly fine using G or g. Also, relative line numbers show your current line's real line number at all times.
There have been exactly zero times I've regretted having relative line numbers on and it's not default behavior, that's why it's useful to point out here.