Isn’t the argument between transfer learning and neural architecture search the same problem posed by the “no free lunch” theorem, which essentially states specialized algorithms will always beat generalized algorithms in specific tasks and vice versa?