At the risk of sounding cold hearted: I get that it doesn't seem fair, but logically, it's the right call to drive to the end of the lane.
1) It keeps the rules simple. If we should merge at some arbitrary point before the lane is up, it will always be arbitrary, and different drivers will have different opinions.
2) By getting to the end and slowing down, the driver now has matched the speed of traffic. It's a self correcting problem.
3) Not going to the end of the lane is wasting capacity. If it's 4 lanes reducing to 3, how far back is it fair to expect that ending lane to go unused?
4) For on ramps, it gives more cars the chance to merge at once, which will either help the flow of traffic, or quickly reach equilibrium with the through lane.
5) And finally, if everyone always used the full lane, it wouldn't give "cheaters" the opportunity to pass everyone else and cheat.
>causing the traffic column in the thru-lane to brake dramatically
Theoretically, where the car merges doesn't have any bearing on this occurring or not. It shouldn't be any different at the beginning of the lane or the end. If traffic isn't moving, there's no breaking to be had. If it is, it should only give better opportunity to match speed and merge without disruption. Practically, the problem has as much to do with the aggression of the through lane drivers as it does the merging one.
They certainly have the right of way. I'm just saying that where the merging driver comes over doesn't really change any of that, unless the through traffic is behaving differently in response.