I think Google is a bit smarter about that? I.e., I'm pretty sure it detects things like "you click on one link, come back after 10 sec, click on another link and then never come back" and correctly attributes the weight to the link you stayed on.

Possible I'm wrong though. Or could be the heuristics for how long you stay on the page are off. E.g., it can take me a while to realize that some GitHub issue page doesn't help me at all, and I click back, then find another page and get the answer immediately. But maybe Google thinks "well they spent a while on that page, they probably got something useful out of it even if it didn't totally answer their question".