You are of course, correct (as ry0ohki states), but this one FOIA request could lead the way to more competitive favicon quotes from contractors in the future, leaving a net saving for HMG.
Sounds facetious, but it's this transparency that enables public scrutiny (and outrage). The expenses debacle being one such example.