Experiment with gstreamer as well.

If you're after very low latency, then try Mjpeg. Most modern compressions are temporal, there will always be a several frames lag.