This has a name, it’s called CLS (cumulative layout shift) and Google actually penalizes SERP rankings for pages with bad CLS. More info on it on lighthouse.dev (if I recall the domain correctly).
I did find this though, and I think I will add it to my medium post: https://web.dev/articles/cls