Similar story for me. Another point I find challenging with Hugo is that they very frequently release breaking changes. I want to upgrade because of features or speed, but there are only a few patches per version before there are also breaking changes. These happen so frequently it's hard to keep up.
Zola is less powerful, but does the job and feels much more stable.