Rice and beans are cheap enough. Around here, fresh fruit and veg tend to be pretty expensive though. It's not hard to find pork shoulder or turkey that's cheaper than many varieties of apples, or roughly on par with bell peppers and tomatoes, as an example.
Beef and chicken always tend to be more expensive, of course, but you'll be pretty sad if you like food and stick to only things that are "cheaper than meat".