A pilot severely limits the kinds of maneuver the craft can perform, where the craft can be deployed from, etc.
The expected direction of drones is as loyal wingmen (i.e., to carry sensors, weapons and/or fuel) and to be low-cost (i.e., disposable). If your drone costs more than an F-35 you'll want to get it home again, whether there's a human inside or not.