Greece is a country that can't afford it operations. It has no economic growth and large unemployment. It survives by borrowing money. In a "normal" situation, it would go bankrupt and its money would be devaluated. Then in several troubled years it could experience growth again because with a devaluated money you are in a better economic position to make things and sell them.
In reallity, Greece is part of the Euro zone so its money is the Euro and it has no control over it. Greece's situation is comparable to that of California (although not to the same extent).
While many economist agree that austerity doesn't bring growth, at least it stops the bleeding. Also, we "don't know better" is the general concensus. Not to mention it worked for Iceland.