300ms is a joke. If 300ms is the best you can do then reduce the amount of information you put up.

Maybe only put up satnav directions. Like “take next turn right”. 3fps is enough for that.

But if you’re gonna draw lines and highlight cars and bicycles at 3 FPS you’re just gonna make everyone vomit in their own car.