Yes you can do that or there are static site generators backed by MySQL too. So your data and configuration site can still be dynamic but your served site will be completely static.
The only difference between this and adding a cache is that the cache is another piece of software in your production stack.