There is almost nothing in fruit worth taking. Especially not a tremendous amount of sugar. One apple can have amounts of sugar similar to Coca-Cola. Furthermore, a lot of it is fructose, which is basically a poison to the body. The sole purpose of human adaptations to fruit seems to be fattening, which makes evolutionary sense for survival in the time of scarcity, but not when you have food in abundance all the time. Note that it's also true that todays fruit is 'weaponized' by long-lasting preference to sugary variants so it contains much more sugar then in historic times and a lot less of other things like vitamins and minerals.
One other important reason is that such amount of sugar will block vitamin C as they are absorbed via the same mechanism (GLUT2). Blocking vitamin C absorption leads to all sorts of bad things, slowly, like lower immunity, higher cholesterol, fragile blood vessels.
The third important aspect is cancer feeding (which mostly relies on sugar, so even though the body makes it, you certainly do not have to ignite it) and effects on insulin which dysfunction is tied to both cancer and diabetes.
You should replace them with vegetables.
As a personal anecdote, my family and I almost never eat fruit (in last 20 years or so) - at most a couple of times per year. We all seem very healthy.