While a little bug damage is expected here and there, you can still harvest a lot of high quality produce with minimal or zero pest management. Bugs generally go for weak and unhealthy plants, so if you can keep most of your plants healthy, you can just pull the weak ones if they get too many bugs.
Of course there are plenty of other things you can do, but if you have strong, healthy plants, you often don't have to do much. Birds and other larger animals however, can be a much bigger problem depending on your crop.