You'll have people passing you on the left and behind you at +30mph. The cars behind you in your lane will form a queue of waiting to pass you, and they'll be getting into the right lane needing to accelerate from 55mph to 80mph (hard for a lot of cars). This is going to cause the cars in the fast lane to brake, which will cascade through the lane and cause a traffic slowdown. If someone isn't paying attention, it's going to result in a rear end collision and an hours-long traffic jam for hundreds of people.
This is one of my worries with self driving cars: They'll follow the letter of the law even when it's not practically safe.