Black box optimization such as CMA-ES or Augmented Random Search (ars) are used by researchers, for example:
CMA-ES: https://blog.otoro.net/2017/10/29/visual-evolution-strategie...
ARS: https://arxiv.org/abs/1803.07055
Those optimizers are efficient up to certain neural network sizes.