There isn't an official add-on yet, but as Kudos pointed out, RethinkDB Cloud has an add-on in beta: https://addons.heroku.com/rethinkdb-cloud

This is not something that could evolve into a Heroko add on. What you're thinking of is something like https://www.rethinkdbcloud.com/