RethinkDB is not offline first. It runs queries on the server-side, not on the client.
There is horizonDB which can replicate with RethinkDB but the project is dead with no commits since the rethinkdb company gave up.
This project looks really awesome, and very much has the shape we wished Horizon could have turned into