LORA can be used in RL; it's indifferent to the training scheme. LORA is just a way of lowering the number of trainable parameters.