Exactly this. For instance after sugar beet has been harvested, the land needs 5-10 years to regenerate back to proper nutrient levels and may not yield anything.
Not saying there is a fallow, but that sugar beets take a lot of nutrients from the land, at least in this area.
Sorry for the lack of proper terminology, agriculture is not my primary occupation.