It was tricky in places and fiddly in others, but overall I'm happy that I'm doing a reasonable amount to keep Google out of my life without being inconvenienced now. A piecemeal approach certainly worked for me, so I'd certainly recommend that to minimise impact for anyone thinking of doing the same.
Replacing gmail is possible, but annoying, because I've got way too many site subscriptions tied to it. I really need to start using email addresses on my own domain for everything from now on. That way, in the future it's painless to switch email providers.
Android is one of the hardest, because of all the Android apps that rely on Google services. I'll definitely be checking out Lineage + microG.
OTOH, you're totally right about striking a balance: If I'm sitting at work, looking something up and DuckDuckGo doesn't yield the expected results I'm quick to prepend a "!g" - which gets me the desired information in about 90% of the cases. Or if I plan a trip in advance I use Google Maps so I can get a good estimate of the travel time for a specific time of day.
Also: My SO and I have a shared Google Calendar, which I sync to my device via DAV.
I just stopped indiscriminately streaming all my personal information to Google, instead I gained some more control about what data the company gets.