For me it's UI responsiveness - seems I must be one of few people in the world that care about it since I've never seen any article or benchmark on that (there was a couple about startup times), so I'm not even sure if it isn't only a matter of perception, but for me the problem with Firefox is that the UI feels slow, like there is a lag between clicking on an element and an action being taken by the program. Safari is also very bad at it (in Windows), as well as IE (but to a lesser extent) - Opera and Chrome on the other side are both great.
But again, it's never a topic, so I suppose there's no progress on that in FF4, or is there?