They most certainly will, for at least two reasons. First, jobs aren't just about raw productivity, they're also about responsibility / liability diffusion. A CEO managing an army of agents is possibly on the hook if anything goes wrong - for example, if one of the agents does tax fraud or hacks a competitor. A CEO paying an army of employees, even if the employees are there just there to supervise agents, usually has little to worry about.

The second reason is that we often prefer humans to do it even if a machine can do it faster / cheaper. Sometimes, it's a status thing. For example, some people will buy Ikea furniture, some will have it custom made by a local craftsman. In fact, it's sort of the hallmark of the upper middle class that you can spend more for that human touch. Cupcakes from an artisanal bakery, private banker, etc.

Now, I don't think there's enough people who want to pay extra for human-made software. From the current trends in the industry, my impression is that we don't value our craft, so it would be surprising if others did. For mathematicians, I don't know; it's a bit painful to watch.