One option is to have charging speed limits based on state-of-charge.
Maybe charging after your daily driving only charges at 3 kW, but charging after a road trip does the full 11.5 kW.
But yeah, I've certainly come home from a road trip with 10% battery, plugged into my 11 kW home charger, and had it say it would take 5 hours to recharge to my 70% limit. If I was only charging at 2 kW, an overnight charge wouldn't get me very far the next day.