If you give me a choice between implementing a solver in an imperative language or a website in Prolog, I'll choose writing the solver. Every time.
Problems in the context of a programming environment where you're already using other languages. Introducing a specialized one does not necessarily make much sense.
if the problem is simple to describe, then sure, write a solver or use a binding. I'm just used to the problems being pretty intense and sophisticated.
I've found having a REPL in a symbolic (term-rewriting) language to be invaluable, and can't imagine going back to for-loops and endless maps of symbol tables chugging out text files for debugging.
Why would I use an external language instead of a library in my existing language? It really isn't as hard as you indicate.
For example, to optimize the grid, you might have a Python app that imports the GUROBI solver module and tells GUROBI to optimize. The advantage is all the file IO, directory, and database stuff gets to be handled with Python (easy easy).