Production needs to be efficient in order to compete. Efficiency needs knowledge. These "groups of poor" lack that knowledge. And the amount of free money is way to low to produce anything with enough surplus value. How many unskilled carpenters, metal workers, and hair stylists do they need? I am currently in Kenya, and the amount of barber shops is amazing.
Production of value is stuff that a country can export, to earn hard currency that can buy knowledge to increase the country's production efficiency. Like Taiwan did, and Korea, and Malaysia, and China, and any country that has ever successfully developed in the past 70 years.
But the aid curse will not allow it, unfortunately.