I agree that you can roll your own store. You'll miss lot of free functionality and the dev tools, but maybe it's not stuff you need.
I also agree that introducing a dependency at every opportunity comes with serious drawbacks.
Every situation is unique of course. In my case: At work, I value code that is more standardised so that I get less bugs, documentation / best patterns and crucially easier on-boarding process. For a personal project, I would definitely consider rolling out my own implementation, even just for the learning it comes with.