Good observation. I wonder if this is a reason the TV adaptations have been tough. Plot seems best enjoyed in written form whereas world building shines on screen.
The TV series is almost entirely disconnected from the novels. It’s like they picked and used some minor details at random and that’s it. It was bizarre.