That's the only downside of Firebug -- a memory leak. It's worst on sites with periodic ajax requests, like Gmail.

In general, it's best to leave Firebug disabled by default, and only enable it for specific urls when you need to use it.