>And the use-case for PINNs is, e.g., modeling a known function that is not solvable analytically?
No. That is the use case for numerical analysis, where you can develop a high performance, accurate algorithm based on the mathematical analysis of the problem.
It is really kind of silly to want to encode the solution in some neural network.