It's not really an ideal solution but I do find wiping my profile/firefox config directory periodically helps speed it up. It seems to get heavier over time.