I'm not saying you're wrong, but that graph doesn't show anything with regards to whether or not middle-class folks have been hit with austerity.

Federal outlays are not granular enough and increasing Federal outlays is pretty meaningless.