I can attest to how rewarding this can feel. I wrote a static site generator for my site as well[1] and it looks like both of us have a lot of common goals. I agree with you in that a lot of the existing SSGs are bloated out of the box and do not really focus on optimising the end output to site visitors. Gatsby is the only exemption to this but writing my blog in JSX isn't too appealing.