Actually back strengthening and, in general, rear chain exercises are pretty much just the kind of strength training you ought to do to reverse (some of) the effects of prolonged sitting.
[1] Strength training anatomy, Frederic Delavier, pg 76.
That said you are _unable_ to really stretch your lower back while in a seated position, and it's much easier to engage the core and lower back in push up position.
Done properly they are also a core strength workout though which is just as important.