For someone like me who's never done any hands-on work in ML, the blog is really hard to understand. Whoosh, over my head.
But, I think the underlying problem is that we don't understand how this sh*t works. So, it's just an empirical, iterative mess.
Like physics in the the years shortly before relativity and quantum mechanics.