Really like how V-trace reduces to A3C when on-policy. Quite elegant, but it’s unfortunate they don’t give results on continuous tasks.