I ended up just using redux with react-redux. I just wrote my own bindings (does not cover the entire api surface but the essentials): https://gist.github.com/melbourne2991/b3093187505f2ee9e517bb...
You get a lot of optimizations for free with react-redux. Given reason-react now supports hooks you can also just use `useReducer` but this lacks some optimizations.