I think that 'street fruit' is a great resource. There are many fruit trees in neighborhoods that are under harvested, with piles of 'ground fruit.' I've always played by the rule that if I could reach it from the sidewalk, and it was overflowing, I would take some. For sure though, don't harm the fruit-producing plant, or any property surrounding it, because that's not considerate.