No. Inequality is the problem. Poverty has nowhere near the same damaging effect.
This book is essential reading on the topic:
http://www.amazon.com/Spirit-Level-Equality-Societies-Strong...
The authors use two test-beds: a comparison of countries around the world and a comparison of states within the US. With these, they show that with overall wealth held constant, it's the larger inequality that causes more social problems.
For example, the UK and Japan have roughly equal GDP and similar average incomes, but Japan is less unequal. On almost any measure you might choose of how well a society is doing, Japan is better. Mental health, drug use, teen pregnancy, violence, divorce, abuse, the whole lot. The same goes across all of the states and countries they looked at.
The sheer scale of the evidence is overwhelming. It's very rare in the social sciences for literally hundreds of studies to point to the same broad trend across so many different parts of the world.
Their work is a revolution as it overturns the common assumption which you expressed that poverty is the problem.