Came here to ask about the Powell method. I find Powell is typically what engineers come up with if asked to optimize something "by hand" without a mathematical model of the system they are optimizing.

https://en.wikipedia.org/wiki/Powell%27s_method