Then it didn't have 80% responsibility and you failed to identify the bottleneck, it just means you identified a local optimisation, which is again "every little bit helps" thinking - what you should do when thinking about queueing systems (or multi-stage) like you describe is to identify the bottleneck. An improvement on the bottleneck should directly translate to an improvement to the end result.