I don't completely disagree with you, but the main factor is really speed. Golf carts top out at 15mph and at that speed pedestrians don't die when they are hit by trucks either.
https://mobikefed.org/2020/10/research-risk-death-pedestrian...
https://mobikefed.org/2020/10/research-risk-death-pedestrian...