I often drive a section of about 2 miles of highway where I need to average 33 mph to arrive at a traffic light just turning green. Although the speed limit there was recently lowered from 55mph to 45mph, every other car drives well over 50mph, and it takes a lot of will power to maintain my much lower speed. You're right that speed limits often feel more like minima than maxima.
Yes, this is a problem. I would often drive slower, if there wasn't a speed limit.
Personally I think a recommend and speed limit should exist, (on the same road/sign).
That's the German approach actually. There is no speed limit on some of the highways, yet the recommended speed is 130 km/h.