I similarly did not get in to using MuJoCo because I want all my work to be reproducible with open source. So I spent time trying to get RL working in Godot video game engine, but ran in to some road blocks. I know MuJoCo already has all the necessary pipelines so this is exciting indeed!